Sep 09 16:11:45.288535 ip-10-0-131-48 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Sep 09 16:11:45.288545 ip-10-0-131-48 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Sep 09 16:11:45.288551 ip-10-0-131-48 systemd[1]: kubelet.service: Failed with result 'resources'.
Sep 09 16:11:45.288742 ip-10-0-131-48 systemd[1]: Failed to start Kubernetes Kubelet.
Sep 09 16:11:54.839240 ip-10-0-131-48 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Sep 09 16:11:54.839253 ip-10-0-131-48 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 8f83a58b3bf6475b966995147eeb8b8d --
Sep 09 16:13:35.794984 ip-10-0-131-48 systemd[1]: Starting Kubernetes Kubelet...
Sep 09 16:13:36.240002 ip-10-0-131-48 kubenswrapper[2583]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 09 16:13:36.240002 ip-10-0-131-48 kubenswrapper[2583]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 09 16:13:36.240002 ip-10-0-131-48 kubenswrapper[2583]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 09 16:13:36.240002 ip-10-0-131-48 kubenswrapper[2583]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 09 16:13:36.240002 ip-10-0-131-48 kubenswrapper[2583]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 09 16:13:36.242572 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.242514    2583 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 09 16:13:36.249574 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.249552    2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 09 16:13:36.249574 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.249569    2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 09 16:13:36.249574 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.249574    2583 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 09 16:13:36.249574 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.249578    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 09 16:13:36.249802 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.249582    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 09 16:13:36.249802 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.249587    2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 09 16:13:36.249802 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.249594    2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 09 16:13:36.249802 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.249599    2583 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 09 16:13:36.249802 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.249603    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 09 16:13:36.249802 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.249607    2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 09 16:13:36.249802 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.249611    2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 09 16:13:36.249802 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.249615    2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 09 16:13:36.249802 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.249619    2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 09 16:13:36.249802 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.249623    2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 09 16:13:36.249802 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.249627    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 09 16:13:36.249802 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.249631    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 09 16:13:36.249802 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.249634    2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 09 16:13:36.249802 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.249643    2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 09 16:13:36.249802 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.249647    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 09 16:13:36.249802 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.249651    2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 09 16:13:36.249802 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.249654    2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 09 16:13:36.249802 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.249658    2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 09 16:13:36.249802 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.249662    2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 09 16:13:36.250532 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.249666    2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 09 16:13:36.250532 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.249669    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 09 16:13:36.250532 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.249673    2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 09 16:13:36.250532 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.249680    2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 09 16:13:36.250532 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.249685    2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 09 16:13:36.250532 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.249690    2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 09 16:13:36.250532 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.249694    2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 09 16:13:36.250532 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.249698    2583 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 09 16:13:36.250532 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.249702    2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 09 16:13:36.250532 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.249706    2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 09 16:13:36.250532 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.249710    2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 09 16:13:36.250532 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.249713    2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 09 16:13:36.250532 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.249735    2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 09 16:13:36.250532 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.249741    2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 09 16:13:36.250532 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.249746    2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 09 16:13:36.250532 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.249750    2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 09 16:13:36.250532 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.249755    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 09 16:13:36.250532 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.249759    2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 09 16:13:36.250532 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.249763    2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 09 16:13:36.251334 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.249767    2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 09 16:13:36.251334 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.249771    2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 09 16:13:36.251334 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.249775    2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 09 16:13:36.251334 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.249779    2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 09 16:13:36.251334 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.249783    2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 09 16:13:36.251334 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.249787    2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 09 16:13:36.251334 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.249791    2583 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 09 16:13:36.251334 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.249794    2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 09 16:13:36.251334 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.249801    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 09 16:13:36.251334 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.249805    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 09 16:13:36.251334 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.249809    2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 09 16:13:36.251334 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.249813    2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 09 16:13:36.251334 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.249817    2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 09 16:13:36.251334 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.249821    2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 09 16:13:36.251334 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.249824    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 09 16:13:36.251334 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.249829    2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 09 16:13:36.251334 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.249832    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 09 16:13:36.251334 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.249836    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 09 16:13:36.251334 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.249840    2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 09 16:13:36.251334 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.249844    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 09 16:13:36.252145 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.249848    2583 feature_gate.go:328] unrecognized feature gate: Example
Sep 09 16:13:36.252145 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.249852    2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 09 16:13:36.252145 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.249856    2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 09 16:13:36.252145 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.249860    2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 09 16:13:36.252145 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.249864    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 09 16:13:36.252145 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.249868    2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 09 16:13:36.252145 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.249873    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 09 16:13:36.252145 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.249877    2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 09 16:13:36.252145 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.249881    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 09 16:13:36.252145 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.249885    2583 feature_gate.go:328] unrecognized feature gate: Example2
Sep 09 16:13:36.252145 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.249889    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 09 16:13:36.252145 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.249893    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 09 16:13:36.252145 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.249897    2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 09 16:13:36.252145 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.249900    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 09 16:13:36.252145 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.249904    2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 09 16:13:36.252145 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.249908    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 09 16:13:36.252145 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.249912    2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 09 16:13:36.252145 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.249916    2583 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 09 16:13:36.252145 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.249922    2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 09 16:13:36.252145 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.249926    2583 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 09 16:13:36.252145 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.249930    2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 09 16:13:36.252999 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.249935    2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 09 16:13:36.252999 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.249939    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 09 16:13:36.252999 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.249943    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 09 16:13:36.252999 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.249947    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 09 16:13:36.252999 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.249951    2583 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 09 16:13:36.252999 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.249955    2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 09 16:13:36.252999 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.249959    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 09 16:13:36.252999 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.249963    2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 09 16:13:36.252999 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.249967    2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 09 16:13:36.252999 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.249971    2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 09 16:13:36.252999 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.249976    2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 09 16:13:36.252999 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.249980    2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 09 16:13:36.252999 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.249984    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 09 16:13:36.252999 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.249988    2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 09 16:13:36.252999 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.249992    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 09 16:13:36.252999 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.249996    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 09 16:13:36.252999 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.251086    2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 09 16:13:36.252999 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.251096    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 09 16:13:36.252999 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.251102    2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 09 16:13:36.252999 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.251106    2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 09 16:13:36.253823 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.251110    2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 09 16:13:36.253823 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.251114    2583 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 09 16:13:36.253823 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.251118    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 09 16:13:36.253823 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.251122    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 09 16:13:36.253823 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.251126    2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 09 16:13:36.253823 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.251130    2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 09 16:13:36.253823 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.251134    2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 09 16:13:36.253823 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.251138    2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 09 16:13:36.253823 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.251142    2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 09 16:13:36.253823 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.251146    2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 09 16:13:36.253823 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.251152    2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 09 16:13:36.253823 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.251157    2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 09 16:13:36.253823 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.251162    2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 09 16:13:36.253823 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.251166    2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 09 16:13:36.253823 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.251171    2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 09 16:13:36.253823 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.251175    2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 09 16:13:36.253823 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.251179    2583 feature_gate.go:328] unrecognized feature gate: Example2
Sep 09 16:13:36.253823 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.251184    2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 09 16:13:36.253823 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.251188    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 09 16:13:36.253823 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.251192    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 09 16:13:36.254400 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.251195    2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 09 16:13:36.254400 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.251200    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 09 16:13:36.254400 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.251204    2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 09 16:13:36.254400 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.251209    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 09 16:13:36.254400 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.251213    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 09 16:13:36.254400 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.251217    2583 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 09 16:13:36.254400 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.251221    2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 09 16:13:36.254400 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.251225    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 09 16:13:36.254400 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.251252    2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 09 16:13:36.254400 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.251259    2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 09 16:13:36.254400 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.251263    2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 09 16:13:36.254400 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.251267    2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 09 16:13:36.254400 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.251272    2583 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 09 16:13:36.254400 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.251276    2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 09 16:13:36.254400 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.251280    2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 09 16:13:36.254400 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.251284    2583 feature_gate.go:328] unrecognized feature gate: Example
Sep 09 16:13:36.254400 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.251287    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 09 16:13:36.254400 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.251291    2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 09 16:13:36.254400 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.251295    2583 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 09 16:13:36.254400 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.251299    2583 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 09 16:13:36.254972 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.251303    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 09 16:13:36.254972 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.251306    2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 09 16:13:36.254972 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.251310    2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 09 16:13:36.254972 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.251314    2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 09 16:13:36.254972 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.251318    2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 09 16:13:36.254972 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.251322    2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 09 16:13:36.254972 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.251326    2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 09 16:13:36.254972 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.251330    2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 09 16:13:36.254972 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.251333    2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 09 16:13:36.254972 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.251337    2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 09 16:13:36.254972 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.251343    2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 09 16:13:36.254972 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.251346    2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 09 16:13:36.254972 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.251350    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 09 16:13:36.254972 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.251354    2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 09 16:13:36.254972 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.251358    2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 09 16:13:36.254972 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.251362    2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 09 16:13:36.254972 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.251366    2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 09 16:13:36.254972 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.251369    2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 09 16:13:36.254972 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.251374    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 09 16:13:36.255412 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.251378    2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 09 16:13:36.255412 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.251382    2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 09 16:13:36.255412 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.251386    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 09 16:13:36.255412 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.251390    2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 09 16:13:36.255412 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.251394    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 09 16:13:36.255412 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.251397    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 09 16:13:36.255412 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.251401    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 09 16:13:36.255412 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.251405    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 09 16:13:36.255412 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.251409    2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 09 16:13:36.255412 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.251413    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 09 16:13:36.255412 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.251417    2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 09 16:13:36.255412 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.251421    2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 09 16:13:36.255412 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.251425    2583 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 09 16:13:36.255412 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.251429    2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 09 16:13:36.255412 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.251432    2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 09 16:13:36.255412 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.251438    2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 09 16:13:36.255412 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.251442    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 09 16:13:36.255412 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.251446    2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 09 16:13:36.255412 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.251450    2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 09 16:13:36.255412 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.251454    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 09 16:13:36.255925 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.251459    2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 09 16:13:36.255925 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.251463    2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 09 16:13:36.255925 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.251470    2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 09 16:13:36.255925 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.251475    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 09 16:13:36.255925 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.251479    2583 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 09 16:13:36.255925 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.251484    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 09 16:13:36.255925 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.251489    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 09 16:13:36.255925 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.251495    2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 09 16:13:36.255925 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.251499    2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 09 16:13:36.255925 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.251504    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 09 16:13:36.255925 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.251508    2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 09 16:13:36.255925 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.251513    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 09 16:13:36.255925 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.251517    2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 09 16:13:36.255925 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.251520    2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 09 16:13:36.255925 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.251525    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 09 16:13:36.255925 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.251529    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 09 16:13:36.255925 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.252108    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 09 16:13:36.255925 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.252118    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 09 16:13:36.255925 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.252123    2583 feature_gate.go:328] unrecognized feature gate: Example
Sep 09 16:13:36.256528 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.252127    2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 09 16:13:36.256528 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.252131    2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 09 16:13:36.256528 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.252135    2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 09 16:13:36.256528 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.252140    2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 09 16:13:36.256528 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.252144    2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 09 16:13:36.256528 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.252148    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 09 16:13:36.256528 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.252152    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 09 16:13:36.256528 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.252156    2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 09 16:13:36.256528 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.252160    2583 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 09 16:13:36.256528 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.252164    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 09 16:13:36.256528 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.252168    2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 09 16:13:36.256528 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.252171    2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 09 16:13:36.256528 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.252176    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 09 16:13:36.256528 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.252180    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 09 16:13:36.256528 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.252185    2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 09 16:13:36.256528 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.252189    2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 09 16:13:36.256528 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.252193    2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 09 16:13:36.256528 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.252197    2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 09 16:13:36.256528 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.252200    2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 09 16:13:36.257010 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.252205    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 09 16:13:36.257010 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.252209    2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 09 16:13:36.257010 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.252213    2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 09 16:13:36.257010 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.252217    2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 09 16:13:36.257010 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.252221    2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 09 16:13:36.257010 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.252225    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 09 16:13:36.257010 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.252229    2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 09 16:13:36.257010 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.252233    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 09 16:13:36.257010 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.252237    2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 09 16:13:36.257010 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.252241    2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 09 16:13:36.257010 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.252246    2583 feature_gate.go:328] unrecognized feature gate: Example2
Sep 09 16:13:36.257010 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.252250    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 09 16:13:36.257010 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.252253    2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 09 16:13:36.257010 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.252257    2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 09 16:13:36.257010 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.252261    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 09 16:13:36.257010 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.252265    2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 09 16:13:36.257010 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.252269    2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 09 16:13:36.257010 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.252273    2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 09 16:13:36.257010 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.252277    2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 09 16:13:36.257010 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.252280    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 09 16:13:36.257462 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.252285    2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 09 16:13:36.257462 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.252288    2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 09 16:13:36.257462 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.252292    2583 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 09 16:13:36.257462 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.252296    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 09 16:13:36.257462 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.252300    2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 09 16:13:36.257462 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.252304    2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 09 16:13:36.257462 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.252308    2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 09 16:13:36.257462 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.252313    2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 09 16:13:36.257462 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.252317    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 09 16:13:36.257462 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.252322    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 09 16:13:36.257462 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.252326    2583 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 09 16:13:36.257462 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.252334    2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 09 16:13:36.257462 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.252338    2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 09 16:13:36.257462 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.252344    2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 09 16:13:36.257462 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.252347    2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 09 16:13:36.257462 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.252351    2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 09 16:13:36.257462 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.252355    2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 09 16:13:36.257462 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.252359    2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 09 16:13:36.257462 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.252363    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 09 16:13:36.257462 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.252367    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 09 16:13:36.258027 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.252373    2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 09 16:13:36.258027 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.252377    2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 09 16:13:36.258027 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.252381    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 09 16:13:36.258027 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.252385    2583 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 09 16:13:36.258027 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.252389    2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 09 16:13:36.258027 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.252393    2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 09 16:13:36.258027 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.252397    2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 09 16:13:36.258027 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.252401    2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 09 16:13:36.258027 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.252405    2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 09 16:13:36.258027 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.252409    2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 09 16:13:36.258027 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.252413    2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 09 16:13:36.258027 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.252417    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 09 16:13:36.258027 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.252423    2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 09 16:13:36.258027 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.252428    2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 09 16:13:36.258027 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.252433    2583 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 09 16:13:36.258027 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.252437    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 09 16:13:36.258027 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.252442    2583 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 09 16:13:36.258027 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.252446    2583 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 09 16:13:36.258027 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.252450    2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 09 16:13:36.258027 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.252456    2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 09 16:13:36.258478 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.252461    2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 09 16:13:36.258478 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.252467    2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 09 16:13:36.258478 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.252474    2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 09 16:13:36.258478 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.252480    2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 09 16:13:36.258478 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.252486    2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 09 16:13:36.258478 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.252490    2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 09 16:13:36.258478 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.252493    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 09 16:13:36.258478 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.252497    2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 09 16:13:36.258478 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.252501    2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 09 16:13:36.258478 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.252505    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 09 16:13:36.258478 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.252509    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 09 16:13:36.258478 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.252513    2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 09 16:13:36.258478 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.252518    2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 09 16:13:36.258478 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.252522    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 09 16:13:36.258478 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.252526    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 09 16:13:36.258478 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.252530    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 09 16:13:36.258478 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.252535    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 09 16:13:36.258478 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.252623    2583 flags.go:64] FLAG: --address="0.0.0.0"
Sep 09 16:13:36.258478 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.252667    2583 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 09 16:13:36.258478 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.252675    2583 flags.go:64] FLAG: --anonymous-auth="true"
Sep 09 16:13:36.258980 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.252682    2583 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 09 16:13:36.258980 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.252692    2583 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 09 16:13:36.258980 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.252698    2583 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 09 16:13:36.258980 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.252704    2583 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 09 16:13:36.258980 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.252710    2583 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 09 16:13:36.258980 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.252714    2583 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 09 16:13:36.258980 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.252733    2583 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 09 16:13:36.258980 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.252739    2583 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 09 16:13:36.258980 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.252744    2583 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 09 16:13:36.258980 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.252749    2583 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 09 16:13:36.258980 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.252753    2583 flags.go:64] FLAG: --cgroup-root=""
Sep 09 16:13:36.258980 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.252758    2583 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 09 16:13:36.258980 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.252762    2583 flags.go:64] FLAG: --client-ca-file=""
Sep 09 16:13:36.258980 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.252768    2583 flags.go:64] FLAG: --cloud-provider="external"
Sep 09 16:13:36.258980 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.252772    2583 flags.go:64] FLAG: --cluster-dns="[]"
Sep 09 16:13:36.258980 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.252779    2583 flags.go:64] FLAG: --cluster-domain=""
Sep 09 16:13:36.258980 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.252783    2583 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 09 16:13:36.258980 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.252788    2583 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 09 16:13:36.258980 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.252792    2583 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 09 16:13:36.258980 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.252797    2583 flags.go:64] FLAG: --container-log-max-files="5"
Sep 09 16:13:36.258980 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.252803    2583 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 09 16:13:36.258980 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.252808    2583 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 09 16:13:36.258980 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.252812    2583 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 09 16:13:36.259505 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.252817    2583 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 09 16:13:36.259505 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.252826    2583 flags.go:64] FLAG: --contention-profiling="false"
Sep 09 16:13:36.259505 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.252830    2583 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 09 16:13:36.259505 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.252835    2583 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 09 16:13:36.259505 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.252839    2583 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 09 16:13:36.259505 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.252843    2583 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 09 16:13:36.259505 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.252849    2583 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 09 16:13:36.259505 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.252854    2583 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 09 16:13:36.259505 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.252858    2583 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 09 16:13:36.259505 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.252863    2583 flags.go:64] FLAG: --enable-load-reader="false"
Sep 09 16:13:36.259505 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.252867    2583 flags.go:64] FLAG: --enable-server="true"
Sep 09 16:13:36.259505 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.252871    2583 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 09 16:13:36.259505 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.252877    2583 flags.go:64] FLAG: --event-burst="100"
Sep 09 16:13:36.259505 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.252882    2583 flags.go:64] FLAG: --event-qps="50"
Sep 09 16:13:36.259505 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.252886    2583 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 09 16:13:36.259505 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.252891    2583 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 09 16:13:36.259505 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.252895    2583 flags.go:64] FLAG: --eviction-hard=""
Sep 09 16:13:36.259505 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.252903    2583 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 09 16:13:36.259505 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.252907    2583 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 09 16:13:36.259505 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.252911    2583 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 09 16:13:36.259505 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.252916    2583 flags.go:64] FLAG: --eviction-soft=""
Sep 09 16:13:36.259505 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.252920    2583 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 09 16:13:36.259505 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.252924    2583 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 09 16:13:36.259505 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.252930    2583 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 09 16:13:36.259505 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.252934    2583 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 09 16:13:36.260160 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.252938    2583 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 09 16:13:36.260160 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.252943    2583 flags.go:64] FLAG: --fail-swap-on="true"
Sep 09 16:13:36.260160 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.252947    2583 flags.go:64] FLAG: --feature-gates=""
Sep 09 16:13:36.260160 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.252953    2583 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 09 16:13:36.260160 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.252957    2583 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 09 16:13:36.260160 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.252962    2583 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 09 16:13:36.260160 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.252967    2583 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 09 16:13:36.260160 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.252971    2583 flags.go:64] FLAG: --healthz-port="10248"
Sep 09 16:13:36.260160 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.252977    2583 flags.go:64] FLAG: --help="false"
Sep 09 16:13:36.260160 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.252982    2583 flags.go:64] FLAG: --hostname-override="ip-10-0-131-48.ec2.internal"
Sep 09 16:13:36.260160 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.252987    2583 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 09 16:13:36.260160 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.252991    2583 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 09 16:13:36.260160 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.252995    2583 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 09 16:13:36.260160 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.253000    2583 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 09 16:13:36.260160 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.253005    2583 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 09 16:13:36.260160 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.253009    2583 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 09 16:13:36.260160 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.253013    2583 flags.go:64] FLAG: --image-service-endpoint=""
Sep 09 16:13:36.260160 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.253017    2583 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 09 16:13:36.260160 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.253021    2583 flags.go:64] FLAG: --kube-api-burst="100"
Sep 09 16:13:36.260160 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.253026    2583 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 09 16:13:36.260160 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.253031    2583 flags.go:64] FLAG: --kube-api-qps="50"
Sep 09 16:13:36.260160 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.253035    2583 flags.go:64] FLAG: --kube-reserved=""
Sep 09 16:13:36.260160 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.253039    2583 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 09 16:13:36.260160 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.253044    2583 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 09 16:13:36.260740 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.253050    2583 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 09 16:13:36.260740 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.253054    2583 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 09 16:13:36.260740 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.253059    2583 flags.go:64] FLAG: --lock-file=""
Sep 09 16:13:36.260740 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.253063    2583 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 09 16:13:36.260740 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.253067    2583 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 09 16:13:36.260740 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.253072    2583 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 09 16:13:36.260740 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.253080    2583 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 09 16:13:36.260740 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.253085    2583 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 09 16:13:36.260740 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.253089    2583 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 09 16:13:36.260740 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.253094    2583 flags.go:64] FLAG: --logging-format="text"
Sep 09 16:13:36.260740 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.253098    2583 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 09 16:13:36.260740 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.253103    2583 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 09 16:13:36.260740 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.253108    2583 flags.go:64] FLAG: --manifest-url=""
Sep 09 16:13:36.260740 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.253112    2583 flags.go:64] FLAG: --manifest-url-header=""
Sep 09 16:13:36.260740 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.253118    2583 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 09 16:13:36.260740 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.253123    2583 flags.go:64] FLAG: --max-open-files="1000000"
Sep 09 16:13:36.260740 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.253129    2583 flags.go:64] FLAG: --max-pods="110"
Sep 09 16:13:36.260740 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.253133    2583 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 09 16:13:36.260740 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.253137    2583 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 09 16:13:36.260740 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.253142    2583 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 09 16:13:36.260740 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.253146    2583 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 09 16:13:36.260740 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.253151    2583 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 09 16:13:36.260740 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.253155    2583 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 09 16:13:36.260740 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.253159    2583 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 09 16:13:36.260740 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.253169    2583 flags.go:64] FLAG: --node-status-max-images="50"
Sep 09 16:13:36.261327 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.253173    2583 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 09 16:13:36.261327 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.253178    2583 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 09 16:13:36.261327 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.253182    2583 flags.go:64] FLAG: --pod-cidr=""
Sep 09 16:13:36.261327 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.253186    2583 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8ccbacc999dbf9abad8f4009240188312b683f36ced4763eed166c1500c164b1"
Sep 09 16:13:36.261327 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.253194    2583 flags.go:64] FLAG: --pod-manifest-path=""
Sep 09 16:13:36.261327 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.253198    2583 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 09 16:13:36.261327 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.253203    2583 flags.go:64] FLAG: --pods-per-core="0"
Sep 09 16:13:36.261327 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.253208    2583 flags.go:64] FLAG: --port="10250"
Sep 09 16:13:36.261327 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.253213    2583 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 09 16:13:36.261327 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.253217    2583 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-090a6cf8db25e63e9"
Sep 09 16:13:36.261327 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.253222    2583 flags.go:64] FLAG: --qos-reserved=""
Sep 09 16:13:36.261327 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.253227    2583 flags.go:64] FLAG: --read-only-port="10255"
Sep 09 16:13:36.261327 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.253232    2583 flags.go:64] FLAG: --register-node="true"
Sep 09 16:13:36.261327 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.253236    2583 flags.go:64] FLAG: --register-with-taints=""
Sep 09 16:13:36.261327 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.253241    2583 flags.go:64] FLAG: --registry-burst="10"
Sep 09 16:13:36.261327 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.253246    2583 flags.go:64] FLAG: --registry-qps="5"
Sep 09 16:13:36.261327 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.253251    2583 flags.go:64] FLAG: --reserved-cpus=""
Sep 09 16:13:36.261327 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.253255    2583 flags.go:64] FLAG: --reserved-memory=""
Sep 09 16:13:36.261327 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.253261    2583 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 09 16:13:36.261327 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.253266    2583 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 09 16:13:36.261327 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.253270    2583 flags.go:64] FLAG: --rotate-certificates="false"
Sep 09 16:13:36.261327 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.253275    2583 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 09 16:13:36.261327 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.253279    2583 flags.go:64] FLAG: --runonce="false"
Sep 09 16:13:36.261327 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.253283    2583 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 09 16:13:36.261327 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.253288    2583 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 09 16:13:36.261969 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.253293    2583 flags.go:64] FLAG: --seccomp-default="false"
Sep 09 16:13:36.261969 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.253297    2583 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 09 16:13:36.261969 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.253301    2583 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 09 16:13:36.261969 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.253306    2583 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 09 16:13:36.261969 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.253311    2583 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 09 16:13:36.261969 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.253315    2583 flags.go:64] FLAG: --storage-driver-password="root"
Sep 09 16:13:36.261969 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.253319    2583 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 09 16:13:36.261969 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.253324    2583 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 09 16:13:36.261969 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.253328    2583 flags.go:64] FLAG: --storage-driver-user="root"
Sep 09 16:13:36.261969 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.253332    2583 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 09 16:13:36.261969 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.253337    2583 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 09 16:13:36.261969 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.253341    2583 flags.go:64] FLAG: --system-cgroups=""
Sep 09 16:13:36.261969 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.253346    2583 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 09 16:13:36.261969 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.253354    2583 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 09 16:13:36.261969 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.253359    2583 flags.go:64] FLAG: --tls-cert-file=""
Sep 09 16:13:36.261969 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.253364    2583 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 09 16:13:36.261969 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.253370    2583 flags.go:64] FLAG: --tls-min-version=""
Sep 09 16:13:36.261969 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.253374    2583 flags.go:64] FLAG: --tls-private-key-file=""
Sep 09 16:13:36.261969 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.253379    2583 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 09 16:13:36.261969 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.253383    2583 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 09 16:13:36.261969 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.253388    2583 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 09 16:13:36.261969 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.253392    2583 flags.go:64] FLAG: --v="2"
Sep 09 16:13:36.261969 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.253398    2583 flags.go:64] FLAG: --version="false"
Sep 09 16:13:36.261969 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.253404    2583 flags.go:64] FLAG: --vmodule=""
Sep 09 16:13:36.261969 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.253409    2583 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 09 16:13:36.262530 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.253415    2583 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 09 16:13:36.262530 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.253585    2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 09 16:13:36.262530 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.253592    2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 09 16:13:36.262530 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.253596    2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 09 16:13:36.262530 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.253600    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 09 16:13:36.262530 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.253604    2583 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 09 16:13:36.262530 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.253608    2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 09 16:13:36.262530 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.253612    2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 09 16:13:36.262530 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.253616    2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 09 16:13:36.262530 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.253620    2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 09 16:13:36.262530 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.253624    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 09 16:13:36.262530 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.253627    2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 09 16:13:36.262530 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.253633    2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 09 16:13:36.262530 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.253638    2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 09 16:13:36.262530 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.253642    2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 09 16:13:36.262530 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.253666    2583 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 09 16:13:36.262530 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.253671    2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 09 16:13:36.262530 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.253675    2583 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 09 16:13:36.262530 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.253679    2583 feature_gate.go:328] unrecognized feature gate: Example
Sep 09 16:13:36.262530 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.253683    2583 feature_gate.go:328] unrecognized feature gate: Example2
Sep 09 16:13:36.263000 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.253686    2583 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 09 16:13:36.263000 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.253692    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 09 16:13:36.263000 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.253696    2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 09 16:13:36.263000 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.253700    2583 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 09 16:13:36.263000 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.253704    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 09 16:13:36.263000 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.253708    2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 09 16:13:36.263000 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.253711    2583 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 09 16:13:36.263000 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.253716    2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 09 16:13:36.263000 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.253733    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 09 16:13:36.263000 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.253737    2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 09 16:13:36.263000 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.253741    2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 09 16:13:36.263000 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.253746    2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 09 16:13:36.263000 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.253750    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 09 16:13:36.263000 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.253753    2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 09 16:13:36.263000 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.253758    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 09 16:13:36.263000 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.253762    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 09 16:13:36.263000 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.253765    2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 09 16:13:36.263000 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.253770    2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 09 16:13:36.263000 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.253776    2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 09 16:13:36.263000 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.253782    2583 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 09 16:13:36.263446 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.253787    2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 09 16:13:36.263446 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.253792    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 09 16:13:36.263446 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.253797    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 09 16:13:36.263446 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.253801    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 09 16:13:36.263446 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.253806    2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 09 16:13:36.263446 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.253810    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 09 16:13:36.263446 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.253814    2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 09 16:13:36.263446 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.253819    2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 09 16:13:36.263446 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.253822    2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 09 16:13:36.263446 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.253827    2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 09 16:13:36.263446 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.253830    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 09 16:13:36.263446 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.253834    2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 09 16:13:36.263446 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.253837    2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 09 16:13:36.263446 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.253843    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 09 16:13:36.263446 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.253847    2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 09 16:13:36.263446 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.253851    2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 09 16:13:36.263446 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.253855    2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 09 16:13:36.263446 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.253859    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 09 16:13:36.263446 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.253863    2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 09 16:13:36.263446 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.253867    2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 09 16:13:36.263956 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.253871    2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 09 16:13:36.263956 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.253875    2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 09 16:13:36.263956 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.253879    2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 09 16:13:36.263956 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.253883    2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 09 16:13:36.263956 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.253896    2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 09 16:13:36.263956 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.253901    2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 09 16:13:36.263956 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.253905    2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 09 16:13:36.263956 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.253909    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 09 16:13:36.263956 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.253913    2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 09 16:13:36.263956 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.253918    2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 09 16:13:36.263956 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.253922    2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 09 16:13:36.263956 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.253926    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 09 16:13:36.263956 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.253930    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 09 16:13:36.263956 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.253934    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 09 16:13:36.263956 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.253938    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 09 16:13:36.263956 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.253942    2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 09 16:13:36.263956 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.253945    2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 09 16:13:36.263956 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.253949    2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 09 16:13:36.263956 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.253953    2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 09 16:13:36.263956 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.253957    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 09 16:13:36.264417 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.253961    2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 09 16:13:36.264417 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.253965    2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 09 16:13:36.264417 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.253968    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 09 16:13:36.264417 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.253972    2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 09 16:13:36.264417 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.253977    2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 09 16:13:36.264417 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.253985    2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 09 16:13:36.264417 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.253990    2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 09 16:13:36.264417 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.253995    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 09 16:13:36.264417 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.253999    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 09 16:13:36.264417 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.254003    2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 09 16:13:36.264417 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.254008    2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 09 16:13:36.264417 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.254012    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 09 16:13:36.264417 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.254015    2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 09 16:13:36.264417 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.254020    2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 09 16:13:36.264417 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.254024    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 09 16:13:36.264417 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.254030    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 09 16:13:36.264417 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.254034    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 09 16:13:36.264417 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.254046    2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 09 16:13:36.264417 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.254050    2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 09 16:13:36.264899 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.254054    2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 09 16:13:36.264899 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.254783    2583 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 09 16:13:36.264899 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.262106    2583 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 09 16:13:36.264899 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.262120    2583 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 09 16:13:36.264899 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.262138    2583 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 09 16:13:36.264899 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.262146    2583 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 09 16:13:36.264899 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.262202    2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 09 16:13:36.264899 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.262206    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 09 16:13:36.264899 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.262209    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 09 16:13:36.264899 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.262212    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 09 16:13:36.264899 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.262215    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 09 16:13:36.264899 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.262218    2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 09 16:13:36.264899 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.262221    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 09 16:13:36.264899 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.262223    2583 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 09 16:13:36.264899 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.262226    2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 09 16:13:36.265279 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.262228    2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 09 16:13:36.265279 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.262231    2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 09 16:13:36.265279 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.262233    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 09 16:13:36.265279 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.262236    2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 09 16:13:36.265279 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.262238    2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 09 16:13:36.265279 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.262241    2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 09 16:13:36.265279 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.262244    2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 09 16:13:36.265279 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.262246    2583 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 09 16:13:36.265279 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.262249    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 09 16:13:36.265279 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.262251    2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 09 16:13:36.265279 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.262254    2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 09 16:13:36.265279 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.262256    2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 09 16:13:36.265279 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.262259    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 09 16:13:36.265279 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.262261    2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 09 16:13:36.265279 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.262263    2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 09 16:13:36.265279 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.262266    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 09 16:13:36.265279 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.262269    2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 09 16:13:36.265279 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.262271    2583 feature_gate.go:328] unrecognized feature gate: Example
Sep 09 16:13:36.265279 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.262275    2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 09 16:13:36.265732 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.262279    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 09 16:13:36.265732 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.262283    2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 09 16:13:36.265732 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.262286    2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 09 16:13:36.265732 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.262288    2583 feature_gate.go:328] unrecognized feature gate: Example2
Sep 09 16:13:36.265732 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.262291    2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 09 16:13:36.265732 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.262293    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 09 16:13:36.265732 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.262296    2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 09 16:13:36.265732 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.262298    2583 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 09 16:13:36.265732 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.262301    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 09 16:13:36.265732 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.262303    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 09 16:13:36.265732 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.262306    2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 09 16:13:36.265732 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.262308    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 09 16:13:36.265732 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.262310    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 09 16:13:36.265732 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.262313    2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 09 16:13:36.265732 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.262315    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 09 16:13:36.265732 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.262318    2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 09 16:13:36.265732 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.262320    2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 09 16:13:36.265732 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.262322    2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 09 16:13:36.265732 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.262325    2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 09 16:13:36.265732 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.262327    2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 09 16:13:36.266200 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.262329    2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 09 16:13:36.266200 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.262332    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 09 16:13:36.266200 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.262334    2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 09 16:13:36.266200 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.262337    2583 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 09 16:13:36.266200 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.262339    2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 09 16:13:36.266200 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.262341    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 09 16:13:36.266200 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.262344    2583 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 09 16:13:36.266200 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.262346    2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 09 16:13:36.266200 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.262349    2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 09 16:13:36.266200 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.262352    2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 09 16:13:36.266200 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.262354    2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 09 16:13:36.266200 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.262357    2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 09 16:13:36.266200 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.262359    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 09 16:13:36.266200 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.262362    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 09 16:13:36.266200 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.262365    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 09 16:13:36.266200 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.262367    2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 09 16:13:36.266200 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.262370    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 09 16:13:36.266200 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.262372    2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 09 16:13:36.266200 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.262375    2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 09 16:13:36.266200 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.262377    2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 09 16:13:36.266200 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.262380    2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 09 16:13:36.266678 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.262382    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 09 16:13:36.266678 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.262386    2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 09 16:13:36.266678 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.262389    2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 09 16:13:36.266678 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.262392    2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 09 16:13:36.266678 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.262395    2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 09 16:13:36.266678 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.262398    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 09 16:13:36.266678 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.262400    2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 09 16:13:36.266678 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.262403    2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 09 16:13:36.266678 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.262406    2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 09 16:13:36.266678 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.262409    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 09 16:13:36.266678 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.262412    2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 09 16:13:36.266678 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.262415    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 09 16:13:36.266678 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.262417    2583 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 09 16:13:36.266678 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.262420    2583 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 09 16:13:36.266678 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.262422    2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 09 16:13:36.266678 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.262425    2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 09 16:13:36.266678 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.262427    2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 09 16:13:36.266678 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.262429    2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 09 16:13:36.266678 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.262432    2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 09 16:13:36.267152 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.262435    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 09 16:13:36.267152 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.262437    2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 09 16:13:36.267152 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.262440    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 09 16:13:36.267152 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.262443    2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 09 16:13:36.267152 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.262446    2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 09 16:13:36.267152 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.262449    2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 09 16:13:36.267152 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.262451    2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 09 16:13:36.267152 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.262454    2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 09 16:13:36.267152 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.262457    2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 09 16:13:36.267152 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.262459    2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 09 16:13:36.267152 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.262461    2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 09 16:13:36.267152 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.262466    2583 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 09 16:13:36.267152 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.262569    2583 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 09 16:13:36.267152 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.262573    2583 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 09 16:13:36.267152 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.262577    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 09 16:13:36.267501 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.262579    2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 09 16:13:36.267501 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.262582    2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 09 16:13:36.267501 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.262585    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 09 16:13:36.267501 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.262588    2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 09 16:13:36.267501 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.262590    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 09 16:13:36.267501 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.262593    2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 09 16:13:36.267501 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.262596    2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 09 16:13:36.267501 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.262599    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 09 16:13:36.267501 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.262602    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 09 16:13:36.267501 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.262604    2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 09 16:13:36.267501 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.262607    2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 09 16:13:36.267501 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.262610    2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 09 16:13:36.267501 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.262612    2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 09 16:13:36.267501 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.262615    2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 09 16:13:36.267501 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.262617    2583 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 09 16:13:36.267501 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.262620    2583 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 09 16:13:36.267501 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.262622    2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 09 16:13:36.267501 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.262624    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 09 16:13:36.267501 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.262627    2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 09 16:13:36.267501 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.262630    2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 09 16:13:36.267975 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.262632    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 09 16:13:36.267975 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.262635    2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 09 16:13:36.267975 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.262637    2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 09 16:13:36.267975 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.262639    2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 09 16:13:36.267975 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.262642    2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 09 16:13:36.267975 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.262644    2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 09 16:13:36.267975 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.262647    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 09 16:13:36.267975 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.262650    2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 09 16:13:36.267975 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.262653    2583 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 09 16:13:36.267975 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.262656    2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 09 16:13:36.267975 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.262658    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 09 16:13:36.267975 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.262661    2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 09 16:13:36.267975 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.262664    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 09 16:13:36.267975 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.262668    2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 09 16:13:36.267975 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.262671    2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 09 16:13:36.267975 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.262673    2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 09 16:13:36.267975 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.262676    2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 09 16:13:36.267975 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.262678    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 09 16:13:36.267975 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.262681    2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 09 16:13:36.268408 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.262683    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 09 16:13:36.268408 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.262685    2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 09 16:13:36.268408 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.262688    2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 09 16:13:36.268408 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.262690    2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 09 16:13:36.268408 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.262693    2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 09 16:13:36.268408 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.262695    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 09 16:13:36.268408 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.262697    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 09 16:13:36.268408 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.262700    2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 09 16:13:36.268408 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.262702    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 09 16:13:36.268408 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.262704    2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 09 16:13:36.268408 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.262707    2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 09 16:13:36.268408 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.262709    2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 09 16:13:36.268408 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.262711    2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 09 16:13:36.268408 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.262714    2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 09 16:13:36.268408 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.262716    2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 09 16:13:36.268408 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.262732    2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 09 16:13:36.268408 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.262737    2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 09 16:13:36.268408 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.262741    2583 feature_gate.go:328] unrecognized feature gate: Example
Sep 09 16:13:36.268408 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.262743    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 09 16:13:36.268408 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.262747    2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 09 16:13:36.268895 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.262750    2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 09 16:13:36.268895 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.262752    2583 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 09 16:13:36.268895 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.262754    2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 09 16:13:36.268895 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.262756    2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 09 16:13:36.268895 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.262759    2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 09 16:13:36.268895 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.262761    2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 09 16:13:36.268895 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.262763    2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 09 16:13:36.268895 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.262766    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 09 16:13:36.268895 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.262769    2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 09 16:13:36.268895 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.262772    2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 09 16:13:36.268895 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.262774    2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 09 16:13:36.268895 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.262777    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 09 16:13:36.268895 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.262779    2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 09 16:13:36.268895 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.262781    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 09 16:13:36.268895 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.262783    2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 09 16:13:36.268895 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.262786    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 09 16:13:36.268895 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.262788    2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 09 16:13:36.268895 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.262790    2583 feature_gate.go:328] unrecognized feature gate: Example2
Sep 09 16:13:36.268895 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.262793    2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 09 16:13:36.268895 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.262795    2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 09 16:13:36.269345 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.262797    2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 09 16:13:36.269345 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.262800    2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 09 16:13:36.269345 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.262802    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 09 16:13:36.269345 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.262804    2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 09 16:13:36.269345 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.262807    2583 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 09 16:13:36.269345 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.262809    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 09 16:13:36.269345 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.262811    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 09 16:13:36.269345 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.262814    2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 09 16:13:36.269345 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.262816    2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 09 16:13:36.269345 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.262818    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 09 16:13:36.269345 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.262821    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 09 16:13:36.269345 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.262823    2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 09 16:13:36.269345 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.262826    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 09 16:13:36.269345 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.262828    2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 09 16:13:36.269345 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.262830    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 09 16:13:36.269345 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.262833    2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 09 16:13:36.269345 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:36.262835    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 09 16:13:36.269970 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.262840    2583 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 09 16:13:36.269970 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.262922    2583 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 09 16:13:36.269970 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.265037    2583 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 09 16:13:36.269970 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.266030    2583 server.go:1019] "Starting client certificate rotation"
Sep 09 16:13:36.269970 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.266133    2583 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 09 16:13:36.269970 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.266867    2583 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 09 16:13:36.269970 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.268805    2583 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 09 16:13:36.273894 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.273872    2583 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 09 16:13:36.281617 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.281602    2583 log.go:25] "Validated CRI v1 runtime API"
Sep 09 16:13:36.286090 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.286074    2583 log.go:25] "Validated CRI v1 image API"
Sep 09 16:13:36.287613 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.287601    2583 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 09 16:13:36.290898 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.290878    2583 fs.go:135] Filesystem UUIDs: map[6c0fce29-c360-451b-8e1b-187f267ca7bb:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 cd49629a-aa44-40fa-95d1-294497716a21:/dev/nvme0n1p3]
Sep 09 16:13:36.290975 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.290896    2583 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 09 16:13:36.294675 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.294581    2583 manager.go:216] Machine: {Timestamp:2026-09-09 16:13:36.294172685 +0000 UTC m=+0.373164642 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3299422 MemoryCapacity:33164472320 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec292c53253d1c5a5edc88886be087df SystemUUID:ec292c53-253d-1c5a-5edc-88886be087df BootID:8f83a58b-3bf6-475b-9669-95147eeb8b8d Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582238208 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582234112 Type:vfs Inodes:4048397 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632894464 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:94:c0:b3:f5:bf Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:94:c0:b3:f5:bf Speed:0 Mtu:9001} {Name:ovs-system MacAddress:92:13:33:02:b0:28 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164472320 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 09 16:13:36.294675 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.294662    2583 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 09 16:13:36.294831 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.294748    2583 manager.go:232] Version: {KernelVersion:5.14.0-570.138.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260901-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 09 16:13:36.297774 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.297757    2583 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 09 16:13:36.299217 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.299194    2583 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 09 16:13:36.299367 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.299222    2583 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-131-48.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 09 16:13:36.300672 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.300661    2583 topology_manager.go:138] "Creating topology manager with none policy"
Sep 09 16:13:36.300704 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.300674    2583 container_manager_linux.go:309] "Creating device plugin manager"
Sep 09 16:13:36.300704 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.300681    2583 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 09 16:13:36.301618 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.301607    2583 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 09 16:13:36.303245 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.303236    2583 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 09 16:13:36.307094 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.307082    2583 state_mem.go:36] "Initialized new in-memory state store"
Sep 09 16:13:36.307216 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.307207    2583 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 09 16:13:36.307250 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.307234    2583 kubelet.go:486] "Attempting to sync node with API server"
Sep 09 16:13:36.307250 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.307243    2583 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 09 16:13:36.307303 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.307256    2583 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 09 16:13:36.307303 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.307265    2583 kubelet.go:398] "Adding apiserver pod source"
Sep 09 16:13:36.307303 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.307273    2583 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 09 16:13:36.307535 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.307524    2583 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 09 16:13:36.307572 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.307541    2583 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 09 16:13:36.310001 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.309986    2583 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 09 16:13:36.312709 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.312696    2583 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 09 16:13:36.312772 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.312739    2583 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 09 16:13:36.312949 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.312939    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 09 16:13:36.312976 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.312954    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 09 16:13:36.312976 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.312960    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 09 16:13:36.312976 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.312965    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 09 16:13:36.312976 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.312972    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 09 16:13:36.312976 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.312977    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 09 16:13:36.313554 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.313543    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 09 16:13:36.313554 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.313551    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 09 16:13:36.313636 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.313561    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 09 16:13:36.313636 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.313577    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 09 16:13:36.313636 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.313588    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 09 16:13:36.313636 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.313595    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 09 16:13:36.313636 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.313615    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 09 16:13:36.313829 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.313640    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 09 16:13:36.316986 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.316970    2583 server.go:1268] "Started kubelet"
Sep 09 16:13:36.317077 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.317031    2583 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 09 16:13:36.317128 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.317081    2583 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 09 16:13:36.317193 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.317177    2583 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 09 16:13:36.317593 ip-10-0-131-48 systemd[1]: Started Kubernetes Kubelet.
Sep 09 16:13:36.321481 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.321234    2583 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-131-48.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 09 16:13:36.321779 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.321762    2583 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 09 16:13:36.321884 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:13:36.321860    2583 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 09 16:13:36.321942 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:13:36.321906    2583 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-131-48.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 09 16:13:36.323383 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.323369    2583 server.go:310] "Adding debug handlers to kubelet server"
Sep 09 16:13:36.325447 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:13:36.325421    2583 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 09 16:13:36.328449 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:13:36.327303    2583 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-48.ec2.internal.18d3b31d824118b8  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-48.ec2.internal,UID:ip-10-0-131-48.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-131-48.ec2.internal,},FirstTimestamp:2026-09-09 16:13:36.316946616 +0000 UTC m=+0.395938554,LastTimestamp:2026-09-09 16:13:36.316946616 +0000 UTC m=+0.395938554,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-48.ec2.internal,}"
Sep 09 16:13:36.329524 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.329511    2583 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 09 16:13:36.329524 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.329517    2583 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 09 16:13:36.329872 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:13:36.329665    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-48.ec2.internal\" not found"
Sep 09 16:13:36.330147 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.330130    2583 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 09 16:13:36.330222 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.330130    2583 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 09 16:13:36.330222 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.330174    2583 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 09 16:13:36.330326 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.330236    2583 reconstruct.go:97] "Volume reconstruction finished"
Sep 09 16:13:36.330326 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.330244    2583 reconciler.go:29] "Reconciler: start to sync state"
Sep 09 16:13:36.330326 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.330310    2583 factory.go:55] Registering systemd factory
Sep 09 16:13:36.330326 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.330325    2583 factory.go:223] Registration of the systemd container factory successfully
Sep 09 16:13:36.330574 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.330550    2583 factory.go:153] Registering CRI-O factory
Sep 09 16:13:36.330574 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.330571    2583 factory.go:223] Registration of the crio container factory successfully
Sep 09 16:13:36.330668 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.330617    2583 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 09 16:13:36.330668 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.330634    2583 factory.go:103] Registering Raw factory
Sep 09 16:13:36.330668 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.330647    2583 manager.go:1196] Started watching for new ooms in manager
Sep 09 16:13:36.330987 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.330972    2583 manager.go:349] Starting recovery of all containers
Sep 09 16:13:36.336109 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:13:36.336086    2583 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 09 16:13:36.336221 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:13:36.336202    2583 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-131-48.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 09 16:13:36.339511 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.339491    2583 manager.go:354] Recovery completed
Sep 09 16:13:36.341294 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.341275    2583 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-th8s7"
Sep 09 16:13:36.345450 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.345434    2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 09 16:13:36.346975 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.346957    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-48.ec2.internal" event="NodeHasSufficientMemory"
Sep 09 16:13:36.347047 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.346985    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-48.ec2.internal" event="NodeHasNoDiskPressure"
Sep 09 16:13:36.347047 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.346995    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-48.ec2.internal" event="NodeHasSufficientPID"
Sep 09 16:13:36.347550 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.347490    2583 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 09 16:13:36.347550 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.347503    2583 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 09 16:13:36.347550 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.347505    2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 09 16:13:36.347550 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.347549    2583 state_mem.go:36] "Initialized new in-memory state store"
Sep 09 16:13:36.348145 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.348132    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-48.ec2.internal" event="NodeHasSufficientMemory"
Sep 09 16:13:36.348214 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.348155    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-48.ec2.internal" event="NodeHasNoDiskPressure"
Sep 09 16:13:36.348214 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.348168    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-48.ec2.internal" event="NodeHasSufficientPID"
Sep 09 16:13:36.348562 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.348550    2583 policy_none.go:49] "None policy: Start"
Sep 09 16:13:36.348605 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.348566    2583 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 09 16:13:36.348605 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.348575    2583 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 09 16:13:36.348839 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.348826    2583 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-th8s7"
Sep 09 16:13:36.349613 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.349598    2583 policy_none.go:47] "Start"
Sep 09 16:13:36.349689 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:13:36.349618    2583 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-48.ec2.internal.18d3b31d840b49f7  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-48.ec2.internal,UID:ip-10-0-131-48.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-131-48.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-131-48.ec2.internal,},FirstTimestamp:2026-09-09 16:13:36.346974711 +0000 UTC m=+0.425966648,LastTimestamp:2026-09-09 16:13:36.346974711 +0000 UTC m=+0.425966648,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-48.ec2.internal,}"
Sep 09 16:13:36.360063 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:13:36.359580    2583 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-48.ec2.internal.18d3b31d840b84cd  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-48.ec2.internal,UID:ip-10-0-131-48.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-131-48.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-131-48.ec2.internal,},FirstTimestamp:2026-09-09 16:13:36.346989773 +0000 UTC m=+0.425981711,LastTimestamp:2026-09-09 16:13:36.346989773 +0000 UTC m=+0.425981711,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-48.ec2.internal,}"
Sep 09 16:13:36.368326 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:13:36.368273    2583 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-48.ec2.internal.18d3b31d840bae3a  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-48.ec2.internal,UID:ip-10-0-131-48.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-131-48.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-131-48.ec2.internal,},FirstTimestamp:2026-09-09 16:13:36.347000378 +0000 UTC m=+0.425992317,LastTimestamp:2026-09-09 16:13:36.347000378 +0000 UTC m=+0.425992317,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-48.ec2.internal,}"
Sep 09 16:13:36.374247 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.374235    2583 manager.go:337] "Starting Device Plugin manager"
Sep 09 16:13:36.374316 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:13:36.374268    2583 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 09 16:13:36.374316 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.374276    2583 server.go:87] "Starting device plugin registration server"
Sep 09 16:13:36.374534 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.374520    2583 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 09 16:13:36.374607 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.374534    2583 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 09 16:13:36.374662 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.374653    2583 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 09 16:13:36.374796 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.374736    2583 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 09 16:13:36.374796 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.374747    2583 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 09 16:13:36.375198 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:13:36.375178    2583 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 09 16:13:36.375270 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:13:36.375221    2583 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-131-48.ec2.internal\" not found"
Sep 09 16:13:36.377081 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:13:36.377017    2583 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-131-48.ec2.internal.18d3b31d840b49f7\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-48.ec2.internal.18d3b31d840b49f7  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-48.ec2.internal,UID:ip-10-0-131-48.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-131-48.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-131-48.ec2.internal,},FirstTimestamp:2026-09-09 16:13:36.346974711 +0000 UTC m=+0.425966648,LastTimestamp:2026-09-09 16:13:36.348143533 +0000 UTC m=+0.427135471,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-48.ec2.internal,}"
Sep 09 16:13:36.384607 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:13:36.384555    2583 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-131-48.ec2.internal.18d3b31d840b84cd\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-48.ec2.internal.18d3b31d840b84cd  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-48.ec2.internal,UID:ip-10-0-131-48.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-131-48.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-131-48.ec2.internal,},FirstTimestamp:2026-09-09 16:13:36.346989773 +0000 UTC m=+0.425981711,LastTimestamp:2026-09-09 16:13:36.348161532 +0000 UTC m=+0.427153473,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-48.ec2.internal,}"
Sep 09 16:13:36.386708 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.386692    2583 container_manager_linux.go:676] "Failed to ensure state" containerName="/system.slice" err="failed to move PID 2617 into the system container \"/system.slice\": <nil>"
Sep 09 16:13:36.392369 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:13:36.392319    2583 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-131-48.ec2.internal.18d3b31d840bae3a\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-48.ec2.internal.18d3b31d840bae3a  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-48.ec2.internal,UID:ip-10-0-131-48.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-131-48.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-131-48.ec2.internal,},FirstTimestamp:2026-09-09 16:13:36.347000378 +0000 UTC m=+0.425992317,LastTimestamp:2026-09-09 16:13:36.348171564 +0000 UTC m=+0.427163502,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-48.ec2.internal,}"
Sep 09 16:13:36.405436 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:13:36.405376    2583 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-48.ec2.internal.18d3b31d862302b9  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-48.ec2.internal,UID:ip-10-0-131-48.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeAllocatableEnforced,Message:Updated Node Allocatable limit across pods,Source:EventSource{Component:kubelet,Host:ip-10-0-131-48.ec2.internal,},FirstTimestamp:2026-09-09 16:13:36.382083769 +0000 UTC m=+0.461075697,LastTimestamp:2026-09-09 16:13:36.382083769 +0000 UTC m=+0.461075697,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-48.ec2.internal,}"
Sep 09 16:13:36.474628 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.474602    2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 09 16:13:36.475287 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.475272    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-48.ec2.internal" event="NodeHasSufficientMemory"
Sep 09 16:13:36.475347 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.475299    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-48.ec2.internal" event="NodeHasNoDiskPressure"
Sep 09 16:13:36.475347 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.475312    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-48.ec2.internal" event="NodeHasSufficientPID"
Sep 09 16:13:36.475347 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.475330    2583 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-131-48.ec2.internal"
Sep 09 16:13:36.484676 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:13:36.484608    2583 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-131-48.ec2.internal.18d3b31d840b49f7\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-48.ec2.internal.18d3b31d840b49f7  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-48.ec2.internal,UID:ip-10-0-131-48.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-131-48.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-131-48.ec2.internal,},FirstTimestamp:2026-09-09 16:13:36.346974711 +0000 UTC m=+0.425966648,LastTimestamp:2026-09-09 16:13:36.475286189 +0000 UTC m=+0.554278132,Count:3,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-48.ec2.internal,}"
Sep 09 16:13:36.494802 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:13:36.494778    2583 kubelet_node_status.go:116] "Unable to register node with API server, error getting existing node" err="nodes \"ip-10-0-131-48.ec2.internal\" not found" node="ip-10-0-131-48.ec2.internal"
Sep 09 16:13:36.509967 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.505528    2583 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 09 16:13:36.509967 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.506554    2583 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 09 16:13:36.509967 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.506587    2583 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 09 16:13:36.509967 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.506603    2583 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 09 16:13:36.509967 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:13:36.506632    2583 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 09 16:13:36.509967 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.508344    2583 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 09 16:13:36.542048 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:13:36.542031    2583 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-131-48.ec2.internal\" not found" node="ip-10-0-131-48.ec2.internal"
Sep 09 16:13:36.607151 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.607131    2583 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-48.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-131-48.ec2.internal"]
Sep 09 16:13:36.607205 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.607200    2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 09 16:13:36.608644 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.608630    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-48.ec2.internal" event="NodeHasSufficientMemory"
Sep 09 16:13:36.608743 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.608658    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-48.ec2.internal" event="NodeHasNoDiskPressure"
Sep 09 16:13:36.608743 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.608671    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-48.ec2.internal" event="NodeHasSufficientPID"
Sep 09 16:13:36.610869 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.610854    2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 09 16:13:36.610988 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.610962    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-48.ec2.internal"
Sep 09 16:13:36.611034 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.610998    2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 09 16:13:36.611530 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.611516    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-48.ec2.internal" event="NodeHasSufficientMemory"
Sep 09 16:13:36.611530 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.611527    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-48.ec2.internal" event="NodeHasSufficientMemory"
Sep 09 16:13:36.611657 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.611544    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-48.ec2.internal" event="NodeHasNoDiskPressure"
Sep 09 16:13:36.611657 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.611558    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-48.ec2.internal" event="NodeHasSufficientPID"
Sep 09 16:13:36.611657 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.611545    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-48.ec2.internal" event="NodeHasNoDiskPressure"
Sep 09 16:13:36.611657 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.611624    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-48.ec2.internal" event="NodeHasSufficientPID"
Sep 09 16:13:36.613797 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.613782    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-48.ec2.internal"
Sep 09 16:13:36.613873 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.613813    2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 09 16:13:36.614462 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.614443    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-48.ec2.internal" event="NodeHasSufficientMemory"
Sep 09 16:13:36.614512 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.614478    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-48.ec2.internal" event="NodeHasNoDiskPressure"
Sep 09 16:13:36.614512 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.614495    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-48.ec2.internal" event="NodeHasSufficientPID"
Sep 09 16:13:36.632594 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.632572    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/da4295cbced7cf805209af4a484bf441-config\") pod \"kube-apiserver-proxy-ip-10-0-131-48.ec2.internal\" (UID: \"da4295cbced7cf805209af4a484bf441\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-48.ec2.internal"
Sep 09 16:13:36.632679 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.632601    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7e11b2d54eb39bede7ac13e502e3398d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-48.ec2.internal\" (UID: \"7e11b2d54eb39bede7ac13e502e3398d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-48.ec2.internal"
Sep 09 16:13:36.632679 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.632622    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7e11b2d54eb39bede7ac13e502e3398d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-48.ec2.internal\" (UID: \"7e11b2d54eb39bede7ac13e502e3398d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-48.ec2.internal"
Sep 09 16:13:36.640295 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:13:36.640273    2583 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-48.ec2.internal\" not found" node="ip-10-0-131-48.ec2.internal"
Sep 09 16:13:36.644497 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:13:36.644481    2583 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-48.ec2.internal\" not found" node="ip-10-0-131-48.ec2.internal"
Sep 09 16:13:36.695532 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.695517    2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 09 16:13:36.696194 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.696179    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-48.ec2.internal" event="NodeHasSufficientMemory"
Sep 09 16:13:36.696273 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.696204    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-48.ec2.internal" event="NodeHasNoDiskPressure"
Sep 09 16:13:36.696273 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.696214    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-48.ec2.internal" event="NodeHasSufficientPID"
Sep 09 16:13:36.696273 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.696232    2583 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-131-48.ec2.internal"
Sep 09 16:13:36.704887 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.704868    2583 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-131-48.ec2.internal"
Sep 09 16:13:36.704958 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:13:36.704888    2583 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-131-48.ec2.internal\": node \"ip-10-0-131-48.ec2.internal\" not found"
Sep 09 16:13:36.730629 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:13:36.730610    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-48.ec2.internal\" not found"
Sep 09 16:13:36.733710 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.733695    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7e11b2d54eb39bede7ac13e502e3398d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-48.ec2.internal\" (UID: \"7e11b2d54eb39bede7ac13e502e3398d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-48.ec2.internal"
Sep 09 16:13:36.733778 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.733718    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7e11b2d54eb39bede7ac13e502e3398d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-48.ec2.internal\" (UID: \"7e11b2d54eb39bede7ac13e502e3398d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-48.ec2.internal"
Sep 09 16:13:36.733778 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.733745    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/da4295cbced7cf805209af4a484bf441-config\") pod \"kube-apiserver-proxy-ip-10-0-131-48.ec2.internal\" (UID: \"da4295cbced7cf805209af4a484bf441\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-48.ec2.internal"
Sep 09 16:13:36.733850 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.733784    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7e11b2d54eb39bede7ac13e502e3398d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-48.ec2.internal\" (UID: \"7e11b2d54eb39bede7ac13e502e3398d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-48.ec2.internal"
Sep 09 16:13:36.733850 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.733792    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7e11b2d54eb39bede7ac13e502e3398d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-48.ec2.internal\" (UID: \"7e11b2d54eb39bede7ac13e502e3398d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-48.ec2.internal"
Sep 09 16:13:36.733850 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.733826    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/da4295cbced7cf805209af4a484bf441-config\") pod \"kube-apiserver-proxy-ip-10-0-131-48.ec2.internal\" (UID: \"da4295cbced7cf805209af4a484bf441\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-48.ec2.internal"
Sep 09 16:13:36.831267 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:13:36.831212    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-48.ec2.internal\" not found"
Sep 09 16:13:36.931696 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:13:36.931663    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-48.ec2.internal\" not found"
Sep 09 16:13:36.943956 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.943937    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-48.ec2.internal"
Sep 09 16:13:36.947996 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:36.947978    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-48.ec2.internal"
Sep 09 16:13:37.032625 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:13:37.032600    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-48.ec2.internal\" not found"
Sep 09 16:13:37.133203 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:13:37.133158    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-48.ec2.internal\" not found"
Sep 09 16:13:37.155116 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.155097    2583 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 09 16:13:37.229971 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.229948    2583 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-48.ec2.internal"
Sep 09 16:13:37.242432 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.242410    2583 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 09 16:13:37.244685 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.244667    2583 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-48.ec2.internal"
Sep 09 16:13:37.250740 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.250712    2583 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 09 16:13:37.265874 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.265841    2583 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 09 16:13:37.266001 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.265982    2583 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 09 16:13:37.266055 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.266010    2583 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 09 16:13:37.308168 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.308151    2583 apiserver.go:52] "Watching apiserver"
Sep 09 16:13:37.328084 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.328064    2583 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 09 16:13:37.328428 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.328405    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-131-48.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-44ltr","openshift-cluster-node-tuning-operator/tuned-9x9xn","openshift-dns/node-resolver-6df6z","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-48.ec2.internal","openshift-multus/multus-additional-cni-plugins-djp68","openshift-image-registry/node-ca-xfwg5","openshift-multus/multus-grl6q","openshift-multus/network-metrics-daemon-qmp4p","openshift-network-diagnostics/network-check-target-vgwn2","openshift-network-operator/iptables-alerter-8nq9w","openshift-ovn-kubernetes/ovnkube-node-8xkw6","kube-system/global-pull-secret-syncer-stpmj","kube-system/konnectivity-agent-867mp"]
Sep 09 16:13:37.330146 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.330130    2583 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 09 16:13:37.330835 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.330821    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-44ltr"
Sep 09 16:13:37.333043 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.333022    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-9x9xn"
Sep 09 16:13:37.333165 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.333147    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-j29t9\""
Sep 09 16:13:37.333439 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.333416    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 09 16:13:37.333439 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.333432    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 09 16:13:37.333699 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.333684    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 09 16:13:37.335186 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.335144    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-6df6z"
Sep 09 16:13:37.335613 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.335594    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 09 16:13:37.335672 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.335635    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 09 16:13:37.335672 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.335657    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-b62br\""
Sep 09 16:13:37.337255 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.337234    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1b4c0b53-fcf7-4082-924b-99445132777e-socket-dir\") pod \"aws-ebs-csi-driver-node-44ltr\" (UID: \"1b4c0b53-fcf7-4082-924b-99445132777e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-44ltr"
Sep 09 16:13:37.337361 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.337259    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1b4c0b53-fcf7-4082-924b-99445132777e-etc-selinux\") pod \"aws-ebs-csi-driver-node-44ltr\" (UID: \"1b4c0b53-fcf7-4082-924b-99445132777e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-44ltr"
Sep 09 16:13:37.337361 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.337275    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1b4c0b53-fcf7-4082-924b-99445132777e-sys-fs\") pod \"aws-ebs-csi-driver-node-44ltr\" (UID: \"1b4c0b53-fcf7-4082-924b-99445132777e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-44ltr"
Sep 09 16:13:37.337361 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.337290    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1b4c0b53-fcf7-4082-924b-99445132777e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-44ltr\" (UID: \"1b4c0b53-fcf7-4082-924b-99445132777e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-44ltr"
Sep 09 16:13:37.337361 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.337326    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1b4c0b53-fcf7-4082-924b-99445132777e-registration-dir\") pod \"aws-ebs-csi-driver-node-44ltr\" (UID: \"1b4c0b53-fcf7-4082-924b-99445132777e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-44ltr"
Sep 09 16:13:37.337565 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.337366    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1b4c0b53-fcf7-4082-924b-99445132777e-device-dir\") pod \"aws-ebs-csi-driver-node-44ltr\" (UID: \"1b4c0b53-fcf7-4082-924b-99445132777e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-44ltr"
Sep 09 16:13:37.337565 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.337391    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-djp68"
Sep 09 16:13:37.337565 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.337447    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hk5v4\" (UniqueName: \"kubernetes.io/projected/1b4c0b53-fcf7-4082-924b-99445132777e-kube-api-access-hk5v4\") pod \"aws-ebs-csi-driver-node-44ltr\" (UID: \"1b4c0b53-fcf7-4082-924b-99445132777e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-44ltr"
Sep 09 16:13:37.337692 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.337625    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 09 16:13:37.337927 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.337910    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 09 16:13:37.338028 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.338011    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-f9fcc\""
Sep 09 16:13:37.339534 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.339519    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-xfwg5"
Sep 09 16:13:37.339659 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.339635    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 09 16:13:37.339969 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.339952    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 09 16:13:37.340082 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.340068    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 09 16:13:37.340393 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.340374    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-2v25j\""
Sep 09 16:13:37.340470 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.340379    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 09 16:13:37.340470 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.340382    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 09 16:13:37.341655 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.341634    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 09 16:13:37.341777 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.341707    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-grl6q"
Sep 09 16:13:37.342192 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.342173    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 09 16:13:37.342335 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.342175    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 09 16:13:37.342462 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.342447    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-v855q\""
Sep 09 16:13:37.342615 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.342602    2583 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 09 16:13:37.343884 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.343867    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-4kfhd\""
Sep 09 16:13:37.343977 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.343873    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmp4p"
Sep 09 16:13:37.344026 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:13:37.344000    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qmp4p" podUID="f8a2ea6e-22df-4b6d-b1b1-e554e877f94c"
Sep 09 16:13:37.344129 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.344112    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 09 16:13:37.346204 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.346187    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vgwn2"
Sep 09 16:13:37.346283 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:13:37.346244    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vgwn2" podUID="f7554c3b-d296-4424-8822-a3e75a994efa"
Sep 09 16:13:37.348415 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.348398    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-8nq9w"
Sep 09 16:13:37.350942 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.350922    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-8xkw6"
Sep 09 16:13:37.351999 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.351980    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 09 16:13:37.352091 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.352056    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 09 16:13:37.352091 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.352072    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 09 16:13:37.354694 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.352605    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-hxb6n\""
Sep 09 16:13:37.354694 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.353977    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-stpmj"
Sep 09 16:13:37.354694 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:13:37.354122    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-stpmj" podUID="2e619341-a4d2-42fc-b5d9-e33ffeebd306"
Sep 09 16:13:37.355309 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.355293    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 09 16:13:37.355527 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.355512    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 09 16:13:37.355816 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.355800    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-867mp"
Sep 09 16:13:37.356413 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.356195    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 09 16:13:37.356413 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.356284    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 09 16:13:37.356413 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.356312    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-bvgrk\""
Sep 09 16:13:37.356413 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.356332    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 09 16:13:37.356413 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.356390    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 09 16:13:37.358198 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.358179    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 09 16:13:37.358625 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.358594    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-7wbz9\""
Sep 09 16:13:37.358713 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.358641    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 09 16:13:37.431685 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.431670    2583 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 09 16:13:37.437806 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.437793    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/83e1ba8e-4b2d-475a-9494-f4bbece9ee78-etc-sysctl-d\") pod \"tuned-9x9xn\" (UID: \"83e1ba8e-4b2d-475a-9494-f4bbece9ee78\") " pod="openshift-cluster-node-tuning-operator/tuned-9x9xn"
Sep 09 16:13:37.437883 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.437812    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/be6bb207-ddbb-459e-af6c-bc2500a92955-cni-binary-copy\") pod \"multus-additional-cni-plugins-djp68\" (UID: \"be6bb207-ddbb-459e-af6c-bc2500a92955\") " pod="openshift-multus/multus-additional-cni-plugins-djp68"
Sep 09 16:13:37.437883 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.437827    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ab137fdc-62f3-4f47-ab97-f1c896ce3d56-host-var-lib-cni-multus\") pod \"multus-grl6q\" (UID: \"ab137fdc-62f3-4f47-ab97-f1c896ce3d56\") " pod="openshift-multus/multus-grl6q"
Sep 09 16:13:37.437883 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.437840    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/83e1ba8e-4b2d-475a-9494-f4bbece9ee78-lib-modules\") pod \"tuned-9x9xn\" (UID: \"83e1ba8e-4b2d-475a-9494-f4bbece9ee78\") " pod="openshift-cluster-node-tuning-operator/tuned-9x9xn"
Sep 09 16:13:37.437883 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.437853    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/83e1ba8e-4b2d-475a-9494-f4bbece9ee78-var-lib-kubelet\") pod \"tuned-9x9xn\" (UID: \"83e1ba8e-4b2d-475a-9494-f4bbece9ee78\") " pod="openshift-cluster-node-tuning-operator/tuned-9x9xn"
Sep 09 16:13:37.438000 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.437887    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b8492dc1-21be-43db-bd0c-8860f4b76f97-tmp-dir\") pod \"node-resolver-6df6z\" (UID: \"b8492dc1-21be-43db-bd0c-8860f4b76f97\") " pod="openshift-dns/node-resolver-6df6z"
Sep 09 16:13:37.438000 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.437901    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j4cfb\" (UniqueName: \"kubernetes.io/projected/b8492dc1-21be-43db-bd0c-8860f4b76f97-kube-api-access-j4cfb\") pod \"node-resolver-6df6z\" (UID: \"b8492dc1-21be-43db-bd0c-8860f4b76f97\") " pod="openshift-dns/node-resolver-6df6z"
Sep 09 16:13:37.438000 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.437919    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ab137fdc-62f3-4f47-ab97-f1c896ce3d56-multus-daemon-config\") pod \"multus-grl6q\" (UID: \"ab137fdc-62f3-4f47-ab97-f1c896ce3d56\") " pod="openshift-multus/multus-grl6q"
Sep 09 16:13:37.438000 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.437932    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/45de5b46-a121-43e3-b141-4de97a0ad121-host-kubelet\") pod \"ovnkube-node-8xkw6\" (UID: \"45de5b46-a121-43e3-b141-4de97a0ad121\") " pod="openshift-ovn-kubernetes/ovnkube-node-8xkw6"
Sep 09 16:13:37.438000 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.437945    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/83e1ba8e-4b2d-475a-9494-f4bbece9ee78-run\") pod \"tuned-9x9xn\" (UID: \"83e1ba8e-4b2d-475a-9494-f4bbece9ee78\") " pod="openshift-cluster-node-tuning-operator/tuned-9x9xn"
Sep 09 16:13:37.438000 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.437975    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/83e1ba8e-4b2d-475a-9494-f4bbece9ee78-sys\") pod \"tuned-9x9xn\" (UID: \"83e1ba8e-4b2d-475a-9494-f4bbece9ee78\") " pod="openshift-cluster-node-tuning-operator/tuned-9x9xn"
Sep 09 16:13:37.438000 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.437997    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/23975f85-e5cd-4329-9152-0d52fbdefcde-host\") pod \"node-ca-xfwg5\" (UID: \"23975f85-e5cd-4329-9152-0d52fbdefcde\") " pod="openshift-image-registry/node-ca-xfwg5"
Sep 09 16:13:37.438233 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.438022    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jmjzk\" (UniqueName: \"kubernetes.io/projected/23975f85-e5cd-4329-9152-0d52fbdefcde-kube-api-access-jmjzk\") pod \"node-ca-xfwg5\" (UID: \"23975f85-e5cd-4329-9152-0d52fbdefcde\") " pod="openshift-image-registry/node-ca-xfwg5"
Sep 09 16:13:37.438233 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.438047    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f8a2ea6e-22df-4b6d-b1b1-e554e877f94c-metrics-certs\") pod \"network-metrics-daemon-qmp4p\" (UID: \"f8a2ea6e-22df-4b6d-b1b1-e554e877f94c\") " pod="openshift-multus/network-metrics-daemon-qmp4p"
Sep 09 16:13:37.438233 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.438062    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2e619341-a4d2-42fc-b5d9-e33ffeebd306-kubelet-config\") pod \"global-pull-secret-syncer-stpmj\" (UID: \"2e619341-a4d2-42fc-b5d9-e33ffeebd306\") " pod="kube-system/global-pull-secret-syncer-stpmj"
Sep 09 16:13:37.438233 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.438073    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2e619341-a4d2-42fc-b5d9-e33ffeebd306-dbus\") pod \"global-pull-secret-syncer-stpmj\" (UID: \"2e619341-a4d2-42fc-b5d9-e33ffeebd306\") " pod="kube-system/global-pull-secret-syncer-stpmj"
Sep 09 16:13:37.438233 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.438087    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d01fa91c-300b-4d4b-8a2f-3646eb02566c-konnectivity-ca\") pod \"konnectivity-agent-867mp\" (UID: \"d01fa91c-300b-4d4b-8a2f-3646eb02566c\") " pod="kube-system/konnectivity-agent-867mp"
Sep 09 16:13:37.438233 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.438108    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ab137fdc-62f3-4f47-ab97-f1c896ce3d56-cni-binary-copy\") pod \"multus-grl6q\" (UID: \"ab137fdc-62f3-4f47-ab97-f1c896ce3d56\") " pod="openshift-multus/multus-grl6q"
Sep 09 16:13:37.438233 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.438131    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/45de5b46-a121-43e3-b141-4de97a0ad121-run-openvswitch\") pod \"ovnkube-node-8xkw6\" (UID: \"45de5b46-a121-43e3-b141-4de97a0ad121\") " pod="openshift-ovn-kubernetes/ovnkube-node-8xkw6"
Sep 09 16:13:37.438233 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.438149    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/45de5b46-a121-43e3-b141-4de97a0ad121-host-cni-netd\") pod \"ovnkube-node-8xkw6\" (UID: \"45de5b46-a121-43e3-b141-4de97a0ad121\") " pod="openshift-ovn-kubernetes/ovnkube-node-8xkw6"
Sep 09 16:13:37.438233 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.438162    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ab137fdc-62f3-4f47-ab97-f1c896ce3d56-host-run-k8s-cni-cncf-io\") pod \"multus-grl6q\" (UID: \"ab137fdc-62f3-4f47-ab97-f1c896ce3d56\") " pod="openshift-multus/multus-grl6q"
Sep 09 16:13:37.438233 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.438188    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/45de5b46-a121-43e3-b141-4de97a0ad121-run-systemd\") pod \"ovnkube-node-8xkw6\" (UID: \"45de5b46-a121-43e3-b141-4de97a0ad121\") " pod="openshift-ovn-kubernetes/ovnkube-node-8xkw6"
Sep 09 16:13:37.438233 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.438209    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d01fa91c-300b-4d4b-8a2f-3646eb02566c-agent-certs\") pod \"konnectivity-agent-867mp\" (UID: \"d01fa91c-300b-4d4b-8a2f-3646eb02566c\") " pod="kube-system/konnectivity-agent-867mp"
Sep 09 16:13:37.438233 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.438232    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/be6bb207-ddbb-459e-af6c-bc2500a92955-system-cni-dir\") pod \"multus-additional-cni-plugins-djp68\" (UID: \"be6bb207-ddbb-459e-af6c-bc2500a92955\") " pod="openshift-multus/multus-additional-cni-plugins-djp68"
Sep 09 16:13:37.438562 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.438252    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ab137fdc-62f3-4f47-ab97-f1c896ce3d56-etc-kubernetes\") pod \"multus-grl6q\" (UID: \"ab137fdc-62f3-4f47-ab97-f1c896ce3d56\") " pod="openshift-multus/multus-grl6q"
Sep 09 16:13:37.438562 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.438267    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/45de5b46-a121-43e3-b141-4de97a0ad121-var-lib-openvswitch\") pod \"ovnkube-node-8xkw6\" (UID: \"45de5b46-a121-43e3-b141-4de97a0ad121\") " pod="openshift-ovn-kubernetes/ovnkube-node-8xkw6"
Sep 09 16:13:37.438562 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.438279    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/45de5b46-a121-43e3-b141-4de97a0ad121-log-socket\") pod \"ovnkube-node-8xkw6\" (UID: \"45de5b46-a121-43e3-b141-4de97a0ad121\") " pod="openshift-ovn-kubernetes/ovnkube-node-8xkw6"
Sep 09 16:13:37.438562 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.438294    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/45de5b46-a121-43e3-b141-4de97a0ad121-ovn-node-metrics-cert\") pod \"ovnkube-node-8xkw6\" (UID: \"45de5b46-a121-43e3-b141-4de97a0ad121\") " pod="openshift-ovn-kubernetes/ovnkube-node-8xkw6"
Sep 09 16:13:37.438562 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.438316    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/be6bb207-ddbb-459e-af6c-bc2500a92955-cnibin\") pod \"multus-additional-cni-plugins-djp68\" (UID: \"be6bb207-ddbb-459e-af6c-bc2500a92955\") " pod="openshift-multus/multus-additional-cni-plugins-djp68"
Sep 09 16:13:37.438562 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.438343    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ab137fdc-62f3-4f47-ab97-f1c896ce3d56-host-var-lib-kubelet\") pod \"multus-grl6q\" (UID: \"ab137fdc-62f3-4f47-ab97-f1c896ce3d56\") " pod="openshift-multus/multus-grl6q"
Sep 09 16:13:37.438562 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.438359    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/00f043bd-266f-4a52-8b28-43c6704636d4-iptables-alerter-script\") pod \"iptables-alerter-8nq9w\" (UID: \"00f043bd-266f-4a52-8b28-43c6704636d4\") " pod="openshift-network-operator/iptables-alerter-8nq9w"
Sep 09 16:13:37.438562 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.438376    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1b4c0b53-fcf7-4082-924b-99445132777e-etc-selinux\") pod \"aws-ebs-csi-driver-node-44ltr\" (UID: \"1b4c0b53-fcf7-4082-924b-99445132777e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-44ltr"
Sep 09 16:13:37.438562 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.438397    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/83e1ba8e-4b2d-475a-9494-f4bbece9ee78-etc-kubernetes\") pod \"tuned-9x9xn\" (UID: \"83e1ba8e-4b2d-475a-9494-f4bbece9ee78\") " pod="openshift-cluster-node-tuning-operator/tuned-9x9xn"
Sep 09 16:13:37.438562 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.438412    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/83e1ba8e-4b2d-475a-9494-f4bbece9ee78-host\") pod \"tuned-9x9xn\" (UID: \"83e1ba8e-4b2d-475a-9494-f4bbece9ee78\") " pod="openshift-cluster-node-tuning-operator/tuned-9x9xn"
Sep 09 16:13:37.438562 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.438431    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p9phz\" (UniqueName: \"kubernetes.io/projected/be6bb207-ddbb-459e-af6c-bc2500a92955-kube-api-access-p9phz\") pod \"multus-additional-cni-plugins-djp68\" (UID: \"be6bb207-ddbb-459e-af6c-bc2500a92955\") " pod="openshift-multus/multus-additional-cni-plugins-djp68"
Sep 09 16:13:37.438562 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.438448    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4hr95\" (UniqueName: \"kubernetes.io/projected/f8a2ea6e-22df-4b6d-b1b1-e554e877f94c-kube-api-access-4hr95\") pod \"network-metrics-daemon-qmp4p\" (UID: \"f8a2ea6e-22df-4b6d-b1b1-e554e877f94c\") " pod="openshift-multus/network-metrics-daemon-qmp4p"
Sep 09 16:13:37.438562 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.438467    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g7jh9\" (UniqueName: \"kubernetes.io/projected/f7554c3b-d296-4424-8822-a3e75a994efa-kube-api-access-g7jh9\") pod \"network-check-target-vgwn2\" (UID: \"f7554c3b-d296-4424-8822-a3e75a994efa\") " pod="openshift-network-diagnostics/network-check-target-vgwn2"
Sep 09 16:13:37.438562 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.438494    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ab137fdc-62f3-4f47-ab97-f1c896ce3d56-multus-cni-dir\") pod \"multus-grl6q\" (UID: \"ab137fdc-62f3-4f47-ab97-f1c896ce3d56\") " pod="openshift-multus/multus-grl6q"
Sep 09 16:13:37.438562 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.438506    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/45de5b46-a121-43e3-b141-4de97a0ad121-systemd-units\") pod \"ovnkube-node-8xkw6\" (UID: \"45de5b46-a121-43e3-b141-4de97a0ad121\") " pod="openshift-ovn-kubernetes/ovnkube-node-8xkw6"
Sep 09 16:13:37.438562 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.438518    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gdx76\" (UniqueName: \"kubernetes.io/projected/83e1ba8e-4b2d-475a-9494-f4bbece9ee78-kube-api-access-gdx76\") pod \"tuned-9x9xn\" (UID: \"83e1ba8e-4b2d-475a-9494-f4bbece9ee78\") " pod="openshift-cluster-node-tuning-operator/tuned-9x9xn"
Sep 09 16:13:37.439021 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.438551    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ab137fdc-62f3-4f47-ab97-f1c896ce3d56-cnibin\") pod \"multus-grl6q\" (UID: \"ab137fdc-62f3-4f47-ab97-f1c896ce3d56\") " pod="openshift-multus/multus-grl6q"
Sep 09 16:13:37.439021 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.438563    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ab137fdc-62f3-4f47-ab97-f1c896ce3d56-hostroot\") pod \"multus-grl6q\" (UID: \"ab137fdc-62f3-4f47-ab97-f1c896ce3d56\") " pod="openshift-multus/multus-grl6q"
Sep 09 16:13:37.439021 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.438577    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ts8jp\" (UniqueName: \"kubernetes.io/projected/ab137fdc-62f3-4f47-ab97-f1c896ce3d56-kube-api-access-ts8jp\") pod \"multus-grl6q\" (UID: \"ab137fdc-62f3-4f47-ab97-f1c896ce3d56\") " pod="openshift-multus/multus-grl6q"
Sep 09 16:13:37.439021 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.438589    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/45de5b46-a121-43e3-b141-4de97a0ad121-host-run-netns\") pod \"ovnkube-node-8xkw6\" (UID: \"45de5b46-a121-43e3-b141-4de97a0ad121\") " pod="openshift-ovn-kubernetes/ovnkube-node-8xkw6"
Sep 09 16:13:37.439021 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.438602    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/45de5b46-a121-43e3-b141-4de97a0ad121-etc-openvswitch\") pod \"ovnkube-node-8xkw6\" (UID: \"45de5b46-a121-43e3-b141-4de97a0ad121\") " pod="openshift-ovn-kubernetes/ovnkube-node-8xkw6"
Sep 09 16:13:37.439021 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.438615    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/45de5b46-a121-43e3-b141-4de97a0ad121-node-log\") pod \"ovnkube-node-8xkw6\" (UID: \"45de5b46-a121-43e3-b141-4de97a0ad121\") " pod="openshift-ovn-kubernetes/ovnkube-node-8xkw6"
Sep 09 16:13:37.439021 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.438632    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/45de5b46-a121-43e3-b141-4de97a0ad121-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-8xkw6\" (UID: \"45de5b46-a121-43e3-b141-4de97a0ad121\") " pod="openshift-ovn-kubernetes/ovnkube-node-8xkw6"
Sep 09 16:13:37.439021 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.438644    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/83e1ba8e-4b2d-475a-9494-f4bbece9ee78-etc-modprobe-d\") pod \"tuned-9x9xn\" (UID: \"83e1ba8e-4b2d-475a-9494-f4bbece9ee78\") " pod="openshift-cluster-node-tuning-operator/tuned-9x9xn"
Sep 09 16:13:37.439021 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.438666    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/be6bb207-ddbb-459e-af6c-bc2500a92955-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-djp68\" (UID: \"be6bb207-ddbb-459e-af6c-bc2500a92955\") " pod="openshift-multus/multus-additional-cni-plugins-djp68"
Sep 09 16:13:37.439021 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.438692    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/be6bb207-ddbb-459e-af6c-bc2500a92955-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-djp68\" (UID: \"be6bb207-ddbb-459e-af6c-bc2500a92955\") " pod="openshift-multus/multus-additional-cni-plugins-djp68"
Sep 09 16:13:37.439021 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.438708    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ab137fdc-62f3-4f47-ab97-f1c896ce3d56-host-var-lib-cni-bin\") pod \"multus-grl6q\" (UID: \"ab137fdc-62f3-4f47-ab97-f1c896ce3d56\") " pod="openshift-multus/multus-grl6q"
Sep 09 16:13:37.439021 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.438743    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1b4c0b53-fcf7-4082-924b-99445132777e-registration-dir\") pod \"aws-ebs-csi-driver-node-44ltr\" (UID: \"1b4c0b53-fcf7-4082-924b-99445132777e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-44ltr"
Sep 09 16:13:37.439021 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.438759    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ab137fdc-62f3-4f47-ab97-f1c896ce3d56-system-cni-dir\") pod \"multus-grl6q\" (UID: \"ab137fdc-62f3-4f47-ab97-f1c896ce3d56\") " pod="openshift-multus/multus-grl6q"
Sep 09 16:13:37.439021 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.438772    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ab137fdc-62f3-4f47-ab97-f1c896ce3d56-host-run-multus-certs\") pod \"multus-grl6q\" (UID: \"ab137fdc-62f3-4f47-ab97-f1c896ce3d56\") " pod="openshift-multus/multus-grl6q"
Sep 09 16:13:37.439021 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.438800    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l8qq4\" (UniqueName: \"kubernetes.io/projected/00f043bd-266f-4a52-8b28-43c6704636d4-kube-api-access-l8qq4\") pod \"iptables-alerter-8nq9w\" (UID: \"00f043bd-266f-4a52-8b28-43c6704636d4\") " pod="openshift-network-operator/iptables-alerter-8nq9w"
Sep 09 16:13:37.439021 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.438825    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1b4c0b53-fcf7-4082-924b-99445132777e-socket-dir\") pod \"aws-ebs-csi-driver-node-44ltr\" (UID: \"1b4c0b53-fcf7-4082-924b-99445132777e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-44ltr"
Sep 09 16:13:37.439467 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.438850    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1b4c0b53-fcf7-4082-924b-99445132777e-registration-dir\") pod \"aws-ebs-csi-driver-node-44ltr\" (UID: \"1b4c0b53-fcf7-4082-924b-99445132777e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-44ltr"
Sep 09 16:13:37.439467 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.438946    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1b4c0b53-fcf7-4082-924b-99445132777e-etc-selinux\") pod \"aws-ebs-csi-driver-node-44ltr\" (UID: \"1b4c0b53-fcf7-4082-924b-99445132777e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-44ltr"
Sep 09 16:13:37.439467 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.439325    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/45de5b46-a121-43e3-b141-4de97a0ad121-host-slash\") pod \"ovnkube-node-8xkw6\" (UID: \"45de5b46-a121-43e3-b141-4de97a0ad121\") " pod="openshift-ovn-kubernetes/ovnkube-node-8xkw6"
Sep 09 16:13:37.439467 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.439343    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/45de5b46-a121-43e3-b141-4de97a0ad121-run-ovn\") pod \"ovnkube-node-8xkw6\" (UID: \"45de5b46-a121-43e3-b141-4de97a0ad121\") " pod="openshift-ovn-kubernetes/ovnkube-node-8xkw6"
Sep 09 16:13:37.439467 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.439356    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/45de5b46-a121-43e3-b141-4de97a0ad121-host-cni-bin\") pod \"ovnkube-node-8xkw6\" (UID: \"45de5b46-a121-43e3-b141-4de97a0ad121\") " pod="openshift-ovn-kubernetes/ovnkube-node-8xkw6"
Sep 09 16:13:37.439467 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.439370    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/45de5b46-a121-43e3-b141-4de97a0ad121-env-overrides\") pod \"ovnkube-node-8xkw6\" (UID: \"45de5b46-a121-43e3-b141-4de97a0ad121\") " pod="openshift-ovn-kubernetes/ovnkube-node-8xkw6"
Sep 09 16:13:37.439467 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.439382    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zdvxf\" (UniqueName: \"kubernetes.io/projected/45de5b46-a121-43e3-b141-4de97a0ad121-kube-api-access-zdvxf\") pod \"ovnkube-node-8xkw6\" (UID: \"45de5b46-a121-43e3-b141-4de97a0ad121\") " pod="openshift-ovn-kubernetes/ovnkube-node-8xkw6"
Sep 09 16:13:37.439467 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.439396    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ab137fdc-62f3-4f47-ab97-f1c896ce3d56-host-run-netns\") pod \"multus-grl6q\" (UID: \"ab137fdc-62f3-4f47-ab97-f1c896ce3d56\") " pod="openshift-multus/multus-grl6q"
Sep 09 16:13:37.439467 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.439412    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hk5v4\" (UniqueName: \"kubernetes.io/projected/1b4c0b53-fcf7-4082-924b-99445132777e-kube-api-access-hk5v4\") pod \"aws-ebs-csi-driver-node-44ltr\" (UID: \"1b4c0b53-fcf7-4082-924b-99445132777e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-44ltr"
Sep 09 16:13:37.439467 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.439427    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/83e1ba8e-4b2d-475a-9494-f4bbece9ee78-etc-sysctl-conf\") pod \"tuned-9x9xn\" (UID: \"83e1ba8e-4b2d-475a-9494-f4bbece9ee78\") " pod="openshift-cluster-node-tuning-operator/tuned-9x9xn"
Sep 09 16:13:37.439467 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.439440    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/83e1ba8e-4b2d-475a-9494-f4bbece9ee78-etc-systemd\") pod \"tuned-9x9xn\" (UID: \"83e1ba8e-4b2d-475a-9494-f4bbece9ee78\") " pod="openshift-cluster-node-tuning-operator/tuned-9x9xn"
Sep 09 16:13:37.439467 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.439452    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/83e1ba8e-4b2d-475a-9494-f4bbece9ee78-etc-tuned\") pod \"tuned-9x9xn\" (UID: \"83e1ba8e-4b2d-475a-9494-f4bbece9ee78\") " pod="openshift-cluster-node-tuning-operator/tuned-9x9xn"
Sep 09 16:13:37.439467 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.439466    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/be6bb207-ddbb-459e-af6c-bc2500a92955-tuning-conf-dir\") pod \"multus-additional-cni-plugins-djp68\" (UID: \"be6bb207-ddbb-459e-af6c-bc2500a92955\") " pod="openshift-multus/multus-additional-cni-plugins-djp68"
Sep 09 16:13:37.439822 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.439481    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/00f043bd-266f-4a52-8b28-43c6704636d4-host-slash\") pod \"iptables-alerter-8nq9w\" (UID: \"00f043bd-266f-4a52-8b28-43c6704636d4\") " pod="openshift-network-operator/iptables-alerter-8nq9w"
Sep 09 16:13:37.439822 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.439537    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1b4c0b53-fcf7-4082-924b-99445132777e-socket-dir\") pod \"aws-ebs-csi-driver-node-44ltr\" (UID: \"1b4c0b53-fcf7-4082-924b-99445132777e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-44ltr"
Sep 09 16:13:37.439822 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.439563    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/45de5b46-a121-43e3-b141-4de97a0ad121-ovnkube-config\") pod \"ovnkube-node-8xkw6\" (UID: \"45de5b46-a121-43e3-b141-4de97a0ad121\") " pod="openshift-ovn-kubernetes/ovnkube-node-8xkw6"
Sep 09 16:13:37.439822 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.439579    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b8492dc1-21be-43db-bd0c-8860f4b76f97-hosts-file\") pod \"node-resolver-6df6z\" (UID: \"b8492dc1-21be-43db-bd0c-8860f4b76f97\") " pod="openshift-dns/node-resolver-6df6z"
Sep 09 16:13:37.439822 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.439594    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ab137fdc-62f3-4f47-ab97-f1c896ce3d56-multus-socket-dir-parent\") pod \"multus-grl6q\" (UID: \"ab137fdc-62f3-4f47-ab97-f1c896ce3d56\") " pod="openshift-multus/multus-grl6q"
Sep 09 16:13:37.439822 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.439630    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1b4c0b53-fcf7-4082-924b-99445132777e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-44ltr\" (UID: \"1b4c0b53-fcf7-4082-924b-99445132777e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-44ltr"
Sep 09 16:13:37.439822 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.439644    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1b4c0b53-fcf7-4082-924b-99445132777e-device-dir\") pod \"aws-ebs-csi-driver-node-44ltr\" (UID: \"1b4c0b53-fcf7-4082-924b-99445132777e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-44ltr"
Sep 09 16:13:37.439822 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.439658    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/45de5b46-a121-43e3-b141-4de97a0ad121-ovnkube-script-lib\") pod \"ovnkube-node-8xkw6\" (UID: \"45de5b46-a121-43e3-b141-4de97a0ad121\") " pod="openshift-ovn-kubernetes/ovnkube-node-8xkw6"
Sep 09 16:13:37.439822 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.439667    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1b4c0b53-fcf7-4082-924b-99445132777e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-44ltr\" (UID: \"1b4c0b53-fcf7-4082-924b-99445132777e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-44ltr"
Sep 09 16:13:37.439822 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.439672    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2e619341-a4d2-42fc-b5d9-e33ffeebd306-original-pull-secret\") pod \"global-pull-secret-syncer-stpmj\" (UID: \"2e619341-a4d2-42fc-b5d9-e33ffeebd306\") " pod="kube-system/global-pull-secret-syncer-stpmj"
Sep 09 16:13:37.439822 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.439694    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ab137fdc-62f3-4f47-ab97-f1c896ce3d56-multus-conf-dir\") pod \"multus-grl6q\" (UID: \"ab137fdc-62f3-4f47-ab97-f1c896ce3d56\") " pod="openshift-multus/multus-grl6q"
Sep 09 16:13:37.439822 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.439697    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1b4c0b53-fcf7-4082-924b-99445132777e-device-dir\") pod \"aws-ebs-csi-driver-node-44ltr\" (UID: \"1b4c0b53-fcf7-4082-924b-99445132777e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-44ltr"
Sep 09 16:13:37.439822 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.439730    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1b4c0b53-fcf7-4082-924b-99445132777e-sys-fs\") pod \"aws-ebs-csi-driver-node-44ltr\" (UID: \"1b4c0b53-fcf7-4082-924b-99445132777e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-44ltr"
Sep 09 16:13:37.439822 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.439757    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/45de5b46-a121-43e3-b141-4de97a0ad121-host-run-ovn-kubernetes\") pod \"ovnkube-node-8xkw6\" (UID: \"45de5b46-a121-43e3-b141-4de97a0ad121\") " pod="openshift-ovn-kubernetes/ovnkube-node-8xkw6"
Sep 09 16:13:37.439822 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.439765    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1b4c0b53-fcf7-4082-924b-99445132777e-sys-fs\") pod \"aws-ebs-csi-driver-node-44ltr\" (UID: \"1b4c0b53-fcf7-4082-924b-99445132777e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-44ltr"
Sep 09 16:13:37.439822 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.439773    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/83e1ba8e-4b2d-475a-9494-f4bbece9ee78-tmp\") pod \"tuned-9x9xn\" (UID: \"83e1ba8e-4b2d-475a-9494-f4bbece9ee78\") " pod="openshift-cluster-node-tuning-operator/tuned-9x9xn"
Sep 09 16:13:37.439822 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.439795    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/23975f85-e5cd-4329-9152-0d52fbdefcde-serviceca\") pod \"node-ca-xfwg5\" (UID: \"23975f85-e5cd-4329-9152-0d52fbdefcde\") " pod="openshift-image-registry/node-ca-xfwg5"
Sep 09 16:13:37.440264 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.439815    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/83e1ba8e-4b2d-475a-9494-f4bbece9ee78-etc-sysconfig\") pod \"tuned-9x9xn\" (UID: \"83e1ba8e-4b2d-475a-9494-f4bbece9ee78\") " pod="openshift-cluster-node-tuning-operator/tuned-9x9xn"
Sep 09 16:13:37.446385 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.446370    2583 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 09 16:13:37.449064 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.449044    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hk5v4\" (UniqueName: \"kubernetes.io/projected/1b4c0b53-fcf7-4082-924b-99445132777e-kube-api-access-hk5v4\") pod \"aws-ebs-csi-driver-node-44ltr\" (UID: \"1b4c0b53-fcf7-4082-924b-99445132777e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-44ltr"
Sep 09 16:13:37.452603 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.452583    2583 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-v48xx"
Sep 09 16:13:37.462416 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.462392    2583 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-v48xx"
Sep 09 16:13:37.486785 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.486748    2583 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-08 16:08:38 +0000 UTC" deadline="2028-03-04 10:05:24.414206749 +0000 UTC"
Sep 09 16:13:37.486785 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.486781    2583 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13001h51m46.927429107s"
Sep 09 16:13:37.535798 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.535783    2583 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 09 16:13:37.540397 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.540381    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/45de5b46-a121-43e3-b141-4de97a0ad121-node-log\") pod \"ovnkube-node-8xkw6\" (UID: \"45de5b46-a121-43e3-b141-4de97a0ad121\") " pod="openshift-ovn-kubernetes/ovnkube-node-8xkw6"
Sep 09 16:13:37.540466 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.540404    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/45de5b46-a121-43e3-b141-4de97a0ad121-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-8xkw6\" (UID: \"45de5b46-a121-43e3-b141-4de97a0ad121\") " pod="openshift-ovn-kubernetes/ovnkube-node-8xkw6"
Sep 09 16:13:37.540466 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.540420    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/83e1ba8e-4b2d-475a-9494-f4bbece9ee78-etc-modprobe-d\") pod \"tuned-9x9xn\" (UID: \"83e1ba8e-4b2d-475a-9494-f4bbece9ee78\") " pod="openshift-cluster-node-tuning-operator/tuned-9x9xn"
Sep 09 16:13:37.540466 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.540438    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/be6bb207-ddbb-459e-af6c-bc2500a92955-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-djp68\" (UID: \"be6bb207-ddbb-459e-af6c-bc2500a92955\") " pod="openshift-multus/multus-additional-cni-plugins-djp68"
Sep 09 16:13:37.540466 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.540461    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/be6bb207-ddbb-459e-af6c-bc2500a92955-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-djp68\" (UID: \"be6bb207-ddbb-459e-af6c-bc2500a92955\") " pod="openshift-multus/multus-additional-cni-plugins-djp68"
Sep 09 16:13:37.540615 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.540473    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/45de5b46-a121-43e3-b141-4de97a0ad121-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-8xkw6\" (UID: \"45de5b46-a121-43e3-b141-4de97a0ad121\") " pod="openshift-ovn-kubernetes/ovnkube-node-8xkw6"
Sep 09 16:13:37.540615 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.540483    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ab137fdc-62f3-4f47-ab97-f1c896ce3d56-host-var-lib-cni-bin\") pod \"multus-grl6q\" (UID: \"ab137fdc-62f3-4f47-ab97-f1c896ce3d56\") " pod="openshift-multus/multus-grl6q"
Sep 09 16:13:37.540615 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.540491    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/45de5b46-a121-43e3-b141-4de97a0ad121-node-log\") pod \"ovnkube-node-8xkw6\" (UID: \"45de5b46-a121-43e3-b141-4de97a0ad121\") " pod="openshift-ovn-kubernetes/ovnkube-node-8xkw6"
Sep 09 16:13:37.540615 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.540517    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ab137fdc-62f3-4f47-ab97-f1c896ce3d56-system-cni-dir\") pod \"multus-grl6q\" (UID: \"ab137fdc-62f3-4f47-ab97-f1c896ce3d56\") " pod="openshift-multus/multus-grl6q"
Sep 09 16:13:37.540615 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.540522    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ab137fdc-62f3-4f47-ab97-f1c896ce3d56-host-var-lib-cni-bin\") pod \"multus-grl6q\" (UID: \"ab137fdc-62f3-4f47-ab97-f1c896ce3d56\") " pod="openshift-multus/multus-grl6q"
Sep 09 16:13:37.540615 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.540529    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/83e1ba8e-4b2d-475a-9494-f4bbece9ee78-etc-modprobe-d\") pod \"tuned-9x9xn\" (UID: \"83e1ba8e-4b2d-475a-9494-f4bbece9ee78\") " pod="openshift-cluster-node-tuning-operator/tuned-9x9xn"
Sep 09 16:13:37.540615 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.540542    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ab137fdc-62f3-4f47-ab97-f1c896ce3d56-host-run-multus-certs\") pod \"multus-grl6q\" (UID: \"ab137fdc-62f3-4f47-ab97-f1c896ce3d56\") " pod="openshift-multus/multus-grl6q"
Sep 09 16:13:37.540615 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.540568    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l8qq4\" (UniqueName: \"kubernetes.io/projected/00f043bd-266f-4a52-8b28-43c6704636d4-kube-api-access-l8qq4\") pod \"iptables-alerter-8nq9w\" (UID: \"00f043bd-266f-4a52-8b28-43c6704636d4\") " pod="openshift-network-operator/iptables-alerter-8nq9w"
Sep 09 16:13:37.540615 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.540590    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ab137fdc-62f3-4f47-ab97-f1c896ce3d56-system-cni-dir\") pod \"multus-grl6q\" (UID: \"ab137fdc-62f3-4f47-ab97-f1c896ce3d56\") " pod="openshift-multus/multus-grl6q"
Sep 09 16:13:37.540615 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.540595    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/45de5b46-a121-43e3-b141-4de97a0ad121-host-slash\") pod \"ovnkube-node-8xkw6\" (UID: \"45de5b46-a121-43e3-b141-4de97a0ad121\") " pod="openshift-ovn-kubernetes/ovnkube-node-8xkw6"
Sep 09 16:13:37.540615 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.540616    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/45de5b46-a121-43e3-b141-4de97a0ad121-run-ovn\") pod \"ovnkube-node-8xkw6\" (UID: \"45de5b46-a121-43e3-b141-4de97a0ad121\") " pod="openshift-ovn-kubernetes/ovnkube-node-8xkw6"
Sep 09 16:13:37.541084 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.540629    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/45de5b46-a121-43e3-b141-4de97a0ad121-host-cni-bin\") pod \"ovnkube-node-8xkw6\" (UID: \"45de5b46-a121-43e3-b141-4de97a0ad121\") " pod="openshift-ovn-kubernetes/ovnkube-node-8xkw6"
Sep 09 16:13:37.541084 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.540571    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ab137fdc-62f3-4f47-ab97-f1c896ce3d56-host-run-multus-certs\") pod \"multus-grl6q\" (UID: \"ab137fdc-62f3-4f47-ab97-f1c896ce3d56\") " pod="openshift-multus/multus-grl6q"
Sep 09 16:13:37.541084 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.540617    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/45de5b46-a121-43e3-b141-4de97a0ad121-host-slash\") pod \"ovnkube-node-8xkw6\" (UID: \"45de5b46-a121-43e3-b141-4de97a0ad121\") " pod="openshift-ovn-kubernetes/ovnkube-node-8xkw6"
Sep 09 16:13:37.541084 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.540647    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/45de5b46-a121-43e3-b141-4de97a0ad121-env-overrides\") pod \"ovnkube-node-8xkw6\" (UID: \"45de5b46-a121-43e3-b141-4de97a0ad121\") " pod="openshift-ovn-kubernetes/ovnkube-node-8xkw6"
Sep 09 16:13:37.541084 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.540669    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/45de5b46-a121-43e3-b141-4de97a0ad121-host-cni-bin\") pod \"ovnkube-node-8xkw6\" (UID: \"45de5b46-a121-43e3-b141-4de97a0ad121\") " pod="openshift-ovn-kubernetes/ovnkube-node-8xkw6"
Sep 09 16:13:37.541084 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.540678    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zdvxf\" (UniqueName: \"kubernetes.io/projected/45de5b46-a121-43e3-b141-4de97a0ad121-kube-api-access-zdvxf\") pod \"ovnkube-node-8xkw6\" (UID: \"45de5b46-a121-43e3-b141-4de97a0ad121\") " pod="openshift-ovn-kubernetes/ovnkube-node-8xkw6"
Sep 09 16:13:37.541084 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.540703    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/45de5b46-a121-43e3-b141-4de97a0ad121-run-ovn\") pod \"ovnkube-node-8xkw6\" (UID: \"45de5b46-a121-43e3-b141-4de97a0ad121\") " pod="openshift-ovn-kubernetes/ovnkube-node-8xkw6"
Sep 09 16:13:37.541084 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.540704    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ab137fdc-62f3-4f47-ab97-f1c896ce3d56-host-run-netns\") pod \"multus-grl6q\" (UID: \"ab137fdc-62f3-4f47-ab97-f1c896ce3d56\") " pod="openshift-multus/multus-grl6q"
Sep 09 16:13:37.541084 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.540742    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/83e1ba8e-4b2d-475a-9494-f4bbece9ee78-etc-sysctl-conf\") pod \"tuned-9x9xn\" (UID: \"83e1ba8e-4b2d-475a-9494-f4bbece9ee78\") " pod="openshift-cluster-node-tuning-operator/tuned-9x9xn"
Sep 09 16:13:37.541084 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.540764    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/83e1ba8e-4b2d-475a-9494-f4bbece9ee78-etc-systemd\") pod \"tuned-9x9xn\" (UID: \"83e1ba8e-4b2d-475a-9494-f4bbece9ee78\") " pod="openshift-cluster-node-tuning-operator/tuned-9x9xn"
Sep 09 16:13:37.541084 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.540787    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/83e1ba8e-4b2d-475a-9494-f4bbece9ee78-etc-tuned\") pod \"tuned-9x9xn\" (UID: \"83e1ba8e-4b2d-475a-9494-f4bbece9ee78\") " pod="openshift-cluster-node-tuning-operator/tuned-9x9xn"
Sep 09 16:13:37.541084 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.540812    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/be6bb207-ddbb-459e-af6c-bc2500a92955-tuning-conf-dir\") pod \"multus-additional-cni-plugins-djp68\" (UID: \"be6bb207-ddbb-459e-af6c-bc2500a92955\") " pod="openshift-multus/multus-additional-cni-plugins-djp68"
Sep 09 16:13:37.541084 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.540835    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/00f043bd-266f-4a52-8b28-43c6704636d4-host-slash\") pod \"iptables-alerter-8nq9w\" (UID: \"00f043bd-266f-4a52-8b28-43c6704636d4\") " pod="openshift-network-operator/iptables-alerter-8nq9w"
Sep 09 16:13:37.541084 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.540856    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/45de5b46-a121-43e3-b141-4de97a0ad121-ovnkube-config\") pod \"ovnkube-node-8xkw6\" (UID: \"45de5b46-a121-43e3-b141-4de97a0ad121\") " pod="openshift-ovn-kubernetes/ovnkube-node-8xkw6"
Sep 09 16:13:37.541084 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.540875    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/83e1ba8e-4b2d-475a-9494-f4bbece9ee78-etc-sysctl-conf\") pod \"tuned-9x9xn\" (UID: \"83e1ba8e-4b2d-475a-9494-f4bbece9ee78\") " pod="openshift-cluster-node-tuning-operator/tuned-9x9xn"
Sep 09 16:13:37.541084 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.540878    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b8492dc1-21be-43db-bd0c-8860f4b76f97-hosts-file\") pod \"node-resolver-6df6z\" (UID: \"b8492dc1-21be-43db-bd0c-8860f4b76f97\") " pod="openshift-dns/node-resolver-6df6z"
Sep 09 16:13:37.541084 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.540910    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ab137fdc-62f3-4f47-ab97-f1c896ce3d56-multus-socket-dir-parent\") pod \"multus-grl6q\" (UID: \"ab137fdc-62f3-4f47-ab97-f1c896ce3d56\") " pod="openshift-multus/multus-grl6q"
Sep 09 16:13:37.541084 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.540948    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/45de5b46-a121-43e3-b141-4de97a0ad121-ovnkube-script-lib\") pod \"ovnkube-node-8xkw6\" (UID: \"45de5b46-a121-43e3-b141-4de97a0ad121\") " pod="openshift-ovn-kubernetes/ovnkube-node-8xkw6"
Sep 09 16:13:37.541937 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.540970    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2e619341-a4d2-42fc-b5d9-e33ffeebd306-original-pull-secret\") pod \"global-pull-secret-syncer-stpmj\" (UID: \"2e619341-a4d2-42fc-b5d9-e33ffeebd306\") " pod="kube-system/global-pull-secret-syncer-stpmj"
Sep 09 16:13:37.541937 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.540991    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ab137fdc-62f3-4f47-ab97-f1c896ce3d56-multus-conf-dir\") pod \"multus-grl6q\" (UID: \"ab137fdc-62f3-4f47-ab97-f1c896ce3d56\") " pod="openshift-multus/multus-grl6q"
Sep 09 16:13:37.541937 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.541023    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/be6bb207-ddbb-459e-af6c-bc2500a92955-tuning-conf-dir\") pod \"multus-additional-cni-plugins-djp68\" (UID: \"be6bb207-ddbb-459e-af6c-bc2500a92955\") " pod="openshift-multus/multus-additional-cni-plugins-djp68"
Sep 09 16:13:37.541937 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.541023    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/be6bb207-ddbb-459e-af6c-bc2500a92955-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-djp68\" (UID: \"be6bb207-ddbb-459e-af6c-bc2500a92955\") " pod="openshift-multus/multus-additional-cni-plugins-djp68"
Sep 09 16:13:37.541937 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.541030    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/be6bb207-ddbb-459e-af6c-bc2500a92955-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-djp68\" (UID: \"be6bb207-ddbb-459e-af6c-bc2500a92955\") " pod="openshift-multus/multus-additional-cni-plugins-djp68"
Sep 09 16:13:37.541937 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.540787    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ab137fdc-62f3-4f47-ab97-f1c896ce3d56-host-run-netns\") pod \"multus-grl6q\" (UID: \"ab137fdc-62f3-4f47-ab97-f1c896ce3d56\") " pod="openshift-multus/multus-grl6q"
Sep 09 16:13:37.541937 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.540913    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/00f043bd-266f-4a52-8b28-43c6704636d4-host-slash\") pod \"iptables-alerter-8nq9w\" (UID: \"00f043bd-266f-4a52-8b28-43c6704636d4\") " pod="openshift-network-operator/iptables-alerter-8nq9w"
Sep 09 16:13:37.541937 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.541029    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/45de5b46-a121-43e3-b141-4de97a0ad121-host-run-ovn-kubernetes\") pod \"ovnkube-node-8xkw6\" (UID: \"45de5b46-a121-43e3-b141-4de97a0ad121\") " pod="openshift-ovn-kubernetes/ovnkube-node-8xkw6"
Sep 09 16:13:37.541937 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.541062    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/45de5b46-a121-43e3-b141-4de97a0ad121-env-overrides\") pod \"ovnkube-node-8xkw6\" (UID: \"45de5b46-a121-43e3-b141-4de97a0ad121\") " pod="openshift-ovn-kubernetes/ovnkube-node-8xkw6"
Sep 09 16:13:37.541937 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.541084    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ab137fdc-62f3-4f47-ab97-f1c896ce3d56-multus-conf-dir\") pod \"multus-grl6q\" (UID: \"ab137fdc-62f3-4f47-ab97-f1c896ce3d56\") " pod="openshift-multus/multus-grl6q"
Sep 09 16:13:37.541937 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.541114    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/83e1ba8e-4b2d-475a-9494-f4bbece9ee78-etc-systemd\") pod \"tuned-9x9xn\" (UID: \"83e1ba8e-4b2d-475a-9494-f4bbece9ee78\") " pod="openshift-cluster-node-tuning-operator/tuned-9x9xn"
Sep 09 16:13:37.541937 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.541095    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/83e1ba8e-4b2d-475a-9494-f4bbece9ee78-tmp\") pod \"tuned-9x9xn\" (UID: \"83e1ba8e-4b2d-475a-9494-f4bbece9ee78\") " pod="openshift-cluster-node-tuning-operator/tuned-9x9xn"
Sep 09 16:13:37.541937 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.541137    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/45de5b46-a121-43e3-b141-4de97a0ad121-host-run-ovn-kubernetes\") pod \"ovnkube-node-8xkw6\" (UID: \"45de5b46-a121-43e3-b141-4de97a0ad121\") " pod="openshift-ovn-kubernetes/ovnkube-node-8xkw6"
Sep 09 16:13:37.541937 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:13:37.541151    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 09 16:13:37.541937 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.541157    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/23975f85-e5cd-4329-9152-0d52fbdefcde-serviceca\") pod \"node-ca-xfwg5\" (UID: \"23975f85-e5cd-4329-9152-0d52fbdefcde\") " pod="openshift-image-registry/node-ca-xfwg5"
Sep 09 16:13:37.541937 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.541178    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/83e1ba8e-4b2d-475a-9494-f4bbece9ee78-etc-sysconfig\") pod \"tuned-9x9xn\" (UID: \"83e1ba8e-4b2d-475a-9494-f4bbece9ee78\") " pod="openshift-cluster-node-tuning-operator/tuned-9x9xn"
Sep 09 16:13:37.541937 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.541189    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ab137fdc-62f3-4f47-ab97-f1c896ce3d56-multus-socket-dir-parent\") pod \"multus-grl6q\" (UID: \"ab137fdc-62f3-4f47-ab97-f1c896ce3d56\") " pod="openshift-multus/multus-grl6q"
Sep 09 16:13:37.542687 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:13:37.541210    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e619341-a4d2-42fc-b5d9-e33ffeebd306-original-pull-secret podName:2e619341-a4d2-42fc-b5d9-e33ffeebd306 nodeName:}" failed. No retries permitted until 2026-09-09 16:13:38.041194029 +0000 UTC m=+2.120185971 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2e619341-a4d2-42fc-b5d9-e33ffeebd306-original-pull-secret") pod "global-pull-secret-syncer-stpmj" (UID: "2e619341-a4d2-42fc-b5d9-e33ffeebd306") : object "kube-system"/"original-pull-secret" not registered
Sep 09 16:13:37.542687 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.541220    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/83e1ba8e-4b2d-475a-9494-f4bbece9ee78-etc-sysconfig\") pod \"tuned-9x9xn\" (UID: \"83e1ba8e-4b2d-475a-9494-f4bbece9ee78\") " pod="openshift-cluster-node-tuning-operator/tuned-9x9xn"
Sep 09 16:13:37.542687 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.541228    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/83e1ba8e-4b2d-475a-9494-f4bbece9ee78-etc-sysctl-d\") pod \"tuned-9x9xn\" (UID: \"83e1ba8e-4b2d-475a-9494-f4bbece9ee78\") " pod="openshift-cluster-node-tuning-operator/tuned-9x9xn"
Sep 09 16:13:37.542687 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.541254    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/be6bb207-ddbb-459e-af6c-bc2500a92955-cni-binary-copy\") pod \"multus-additional-cni-plugins-djp68\" (UID: \"be6bb207-ddbb-459e-af6c-bc2500a92955\") " pod="openshift-multus/multus-additional-cni-plugins-djp68"
Sep 09 16:13:37.542687 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.541278    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ab137fdc-62f3-4f47-ab97-f1c896ce3d56-host-var-lib-cni-multus\") pod \"multus-grl6q\" (UID: \"ab137fdc-62f3-4f47-ab97-f1c896ce3d56\") " pod="openshift-multus/multus-grl6q"
Sep 09 16:13:37.542687 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.541300    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/83e1ba8e-4b2d-475a-9494-f4bbece9ee78-lib-modules\") pod \"tuned-9x9xn\" (UID: \"83e1ba8e-4b2d-475a-9494-f4bbece9ee78\") " pod="openshift-cluster-node-tuning-operator/tuned-9x9xn"
Sep 09 16:13:37.542687 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.541322    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/83e1ba8e-4b2d-475a-9494-f4bbece9ee78-var-lib-kubelet\") pod \"tuned-9x9xn\" (UID: \"83e1ba8e-4b2d-475a-9494-f4bbece9ee78\") " pod="openshift-cluster-node-tuning-operator/tuned-9x9xn"
Sep 09 16:13:37.542687 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.541345    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b8492dc1-21be-43db-bd0c-8860f4b76f97-tmp-dir\") pod \"node-resolver-6df6z\" (UID: \"b8492dc1-21be-43db-bd0c-8860f4b76f97\") " pod="openshift-dns/node-resolver-6df6z"
Sep 09 16:13:37.542687 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.541349    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/45de5b46-a121-43e3-b141-4de97a0ad121-ovnkube-config\") pod \"ovnkube-node-8xkw6\" (UID: \"45de5b46-a121-43e3-b141-4de97a0ad121\") " pod="openshift-ovn-kubernetes/ovnkube-node-8xkw6"
Sep 09 16:13:37.542687 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.541366    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j4cfb\" (UniqueName: \"kubernetes.io/projected/b8492dc1-21be-43db-bd0c-8860f4b76f97-kube-api-access-j4cfb\") pod \"node-resolver-6df6z\" (UID: \"b8492dc1-21be-43db-bd0c-8860f4b76f97\") " pod="openshift-dns/node-resolver-6df6z"
Sep 09 16:13:37.542687 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.541392    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ab137fdc-62f3-4f47-ab97-f1c896ce3d56-multus-daemon-config\") pod \"multus-grl6q\" (UID: \"ab137fdc-62f3-4f47-ab97-f1c896ce3d56\") " pod="openshift-multus/multus-grl6q"
Sep 09 16:13:37.542687 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.541422    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/45de5b46-a121-43e3-b141-4de97a0ad121-host-kubelet\") pod \"ovnkube-node-8xkw6\" (UID: \"45de5b46-a121-43e3-b141-4de97a0ad121\") " pod="openshift-ovn-kubernetes/ovnkube-node-8xkw6"
Sep 09 16:13:37.542687 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.541445    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/83e1ba8e-4b2d-475a-9494-f4bbece9ee78-run\") pod \"tuned-9x9xn\" (UID: \"83e1ba8e-4b2d-475a-9494-f4bbece9ee78\") " pod="openshift-cluster-node-tuning-operator/tuned-9x9xn"
Sep 09 16:13:37.542687 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.541486    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/83e1ba8e-4b2d-475a-9494-f4bbece9ee78-sys\") pod \"tuned-9x9xn\" (UID: \"83e1ba8e-4b2d-475a-9494-f4bbece9ee78\") " pod="openshift-cluster-node-tuning-operator/tuned-9x9xn"
Sep 09 16:13:37.542687 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.541491    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/83e1ba8e-4b2d-475a-9494-f4bbece9ee78-lib-modules\") pod \"tuned-9x9xn\" (UID: \"83e1ba8e-4b2d-475a-9494-f4bbece9ee78\") " pod="openshift-cluster-node-tuning-operator/tuned-9x9xn"
Sep 09 16:13:37.542687 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.541506    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/23975f85-e5cd-4329-9152-0d52fbdefcde-host\") pod \"node-ca-xfwg5\" (UID: \"23975f85-e5cd-4329-9152-0d52fbdefcde\") " pod="openshift-image-registry/node-ca-xfwg5"
Sep 09 16:13:37.542687 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.541531    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jmjzk\" (UniqueName: \"kubernetes.io/projected/23975f85-e5cd-4329-9152-0d52fbdefcde-kube-api-access-jmjzk\") pod \"node-ca-xfwg5\" (UID: \"23975f85-e5cd-4329-9152-0d52fbdefcde\") " pod="openshift-image-registry/node-ca-xfwg5"
Sep 09 16:13:37.543487 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.541539    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/45de5b46-a121-43e3-b141-4de97a0ad121-host-kubelet\") pod \"ovnkube-node-8xkw6\" (UID: \"45de5b46-a121-43e3-b141-4de97a0ad121\") " pod="openshift-ovn-kubernetes/ovnkube-node-8xkw6"
Sep 09 16:13:37.543487 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.541490    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/45de5b46-a121-43e3-b141-4de97a0ad121-ovnkube-script-lib\") pod \"ovnkube-node-8xkw6\" (UID: \"45de5b46-a121-43e3-b141-4de97a0ad121\") " pod="openshift-ovn-kubernetes/ovnkube-node-8xkw6"
Sep 09 16:13:37.543487 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.541560    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/23975f85-e5cd-4329-9152-0d52fbdefcde-serviceca\") pod \"node-ca-xfwg5\" (UID: \"23975f85-e5cd-4329-9152-0d52fbdefcde\") " pod="openshift-image-registry/node-ca-xfwg5"
Sep 09 16:13:37.543487 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.541554    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f8a2ea6e-22df-4b6d-b1b1-e554e877f94c-metrics-certs\") pod \"network-metrics-daemon-qmp4p\" (UID: \"f8a2ea6e-22df-4b6d-b1b1-e554e877f94c\") " pod="openshift-multus/network-metrics-daemon-qmp4p"
Sep 09 16:13:37.543487 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.541599    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/23975f85-e5cd-4329-9152-0d52fbdefcde-host\") pod \"node-ca-xfwg5\" (UID: \"23975f85-e5cd-4329-9152-0d52fbdefcde\") " pod="openshift-image-registry/node-ca-xfwg5"
Sep 09 16:13:37.543487 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.541613    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2e619341-a4d2-42fc-b5d9-e33ffeebd306-kubelet-config\") pod \"global-pull-secret-syncer-stpmj\" (UID: \"2e619341-a4d2-42fc-b5d9-e33ffeebd306\") " pod="kube-system/global-pull-secret-syncer-stpmj"
Sep 09 16:13:37.543487 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:13:37.541621    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 16:13:37.543487 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.541637    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2e619341-a4d2-42fc-b5d9-e33ffeebd306-dbus\") pod \"global-pull-secret-syncer-stpmj\" (UID: \"2e619341-a4d2-42fc-b5d9-e33ffeebd306\") " pod="kube-system/global-pull-secret-syncer-stpmj"
Sep 09 16:13:37.543487 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.541638    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/83e1ba8e-4b2d-475a-9494-f4bbece9ee78-sys\") pod \"tuned-9x9xn\" (UID: \"83e1ba8e-4b2d-475a-9494-f4bbece9ee78\") " pod="openshift-cluster-node-tuning-operator/tuned-9x9xn"
Sep 09 16:13:37.543487 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:13:37.541664    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8a2ea6e-22df-4b6d-b1b1-e554e877f94c-metrics-certs podName:f8a2ea6e-22df-4b6d-b1b1-e554e877f94c nodeName:}" failed. No retries permitted until 2026-09-09 16:13:38.041649256 +0000 UTC m=+2.120641195 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f8a2ea6e-22df-4b6d-b1b1-e554e877f94c-metrics-certs") pod "network-metrics-daemon-qmp4p" (UID: "f8a2ea6e-22df-4b6d-b1b1-e554e877f94c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 16:13:37.543487 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.541669    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/83e1ba8e-4b2d-475a-9494-f4bbece9ee78-run\") pod \"tuned-9x9xn\" (UID: \"83e1ba8e-4b2d-475a-9494-f4bbece9ee78\") " pod="openshift-cluster-node-tuning-operator/tuned-9x9xn"
Sep 09 16:13:37.543487 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.541683    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d01fa91c-300b-4d4b-8a2f-3646eb02566c-konnectivity-ca\") pod \"konnectivity-agent-867mp\" (UID: \"d01fa91c-300b-4d4b-8a2f-3646eb02566c\") " pod="kube-system/konnectivity-agent-867mp"
Sep 09 16:13:37.543487 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.541704    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2e619341-a4d2-42fc-b5d9-e33ffeebd306-kubelet-config\") pod \"global-pull-secret-syncer-stpmj\" (UID: \"2e619341-a4d2-42fc-b5d9-e33ffeebd306\") " pod="kube-system/global-pull-secret-syncer-stpmj"
Sep 09 16:13:37.543487 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.541707    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ab137fdc-62f3-4f47-ab97-f1c896ce3d56-cni-binary-copy\") pod \"multus-grl6q\" (UID: \"ab137fdc-62f3-4f47-ab97-f1c896ce3d56\") " pod="openshift-multus/multus-grl6q"
Sep 09 16:13:37.543487 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.541761    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/45de5b46-a121-43e3-b141-4de97a0ad121-run-openvswitch\") pod \"ovnkube-node-8xkw6\" (UID: \"45de5b46-a121-43e3-b141-4de97a0ad121\") " pod="openshift-ovn-kubernetes/ovnkube-node-8xkw6"
Sep 09 16:13:37.543487 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.541789    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/45de5b46-a121-43e3-b141-4de97a0ad121-host-cni-netd\") pod \"ovnkube-node-8xkw6\" (UID: \"45de5b46-a121-43e3-b141-4de97a0ad121\") " pod="openshift-ovn-kubernetes/ovnkube-node-8xkw6"
Sep 09 16:13:37.543487 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.541814    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ab137fdc-62f3-4f47-ab97-f1c896ce3d56-host-run-k8s-cni-cncf-io\") pod \"multus-grl6q\" (UID: \"ab137fdc-62f3-4f47-ab97-f1c896ce3d56\") " pod="openshift-multus/multus-grl6q"
Sep 09 16:13:37.544055 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.541820    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/83e1ba8e-4b2d-475a-9494-f4bbece9ee78-var-lib-kubelet\") pod \"tuned-9x9xn\" (UID: \"83e1ba8e-4b2d-475a-9494-f4bbece9ee78\") " pod="openshift-cluster-node-tuning-operator/tuned-9x9xn"
Sep 09 16:13:37.544055 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.541828    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b8492dc1-21be-43db-bd0c-8860f4b76f97-tmp-dir\") pod \"node-resolver-6df6z\" (UID: \"b8492dc1-21be-43db-bd0c-8860f4b76f97\") " pod="openshift-dns/node-resolver-6df6z"
Sep 09 16:13:37.544055 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.541837    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/be6bb207-ddbb-459e-af6c-bc2500a92955-cni-binary-copy\") pod \"multus-additional-cni-plugins-djp68\" (UID: \"be6bb207-ddbb-459e-af6c-bc2500a92955\") " pod="openshift-multus/multus-additional-cni-plugins-djp68"
Sep 09 16:13:37.544055 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.541718    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2e619341-a4d2-42fc-b5d9-e33ffeebd306-dbus\") pod \"global-pull-secret-syncer-stpmj\" (UID: \"2e619341-a4d2-42fc-b5d9-e33ffeebd306\") " pod="kube-system/global-pull-secret-syncer-stpmj"
Sep 09 16:13:37.544055 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.541761    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/83e1ba8e-4b2d-475a-9494-f4bbece9ee78-etc-sysctl-d\") pod \"tuned-9x9xn\" (UID: \"83e1ba8e-4b2d-475a-9494-f4bbece9ee78\") " pod="openshift-cluster-node-tuning-operator/tuned-9x9xn"
Sep 09 16:13:37.544055 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.541840    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/45de5b46-a121-43e3-b141-4de97a0ad121-run-systemd\") pod \"ovnkube-node-8xkw6\" (UID: \"45de5b46-a121-43e3-b141-4de97a0ad121\") " pod="openshift-ovn-kubernetes/ovnkube-node-8xkw6"
Sep 09 16:13:37.544055 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.541789    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ab137fdc-62f3-4f47-ab97-f1c896ce3d56-host-var-lib-cni-multus\") pod \"multus-grl6q\" (UID: \"ab137fdc-62f3-4f47-ab97-f1c896ce3d56\") " pod="openshift-multus/multus-grl6q"
Sep 09 16:13:37.544055 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.541877    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d01fa91c-300b-4d4b-8a2f-3646eb02566c-agent-certs\") pod \"konnectivity-agent-867mp\" (UID: \"d01fa91c-300b-4d4b-8a2f-3646eb02566c\") " pod="kube-system/konnectivity-agent-867mp"
Sep 09 16:13:37.544055 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.541905    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/45de5b46-a121-43e3-b141-4de97a0ad121-run-systemd\") pod \"ovnkube-node-8xkw6\" (UID: \"45de5b46-a121-43e3-b141-4de97a0ad121\") " pod="openshift-ovn-kubernetes/ovnkube-node-8xkw6"
Sep 09 16:13:37.544055 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.541904    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b8492dc1-21be-43db-bd0c-8860f4b76f97-hosts-file\") pod \"node-resolver-6df6z\" (UID: \"b8492dc1-21be-43db-bd0c-8860f4b76f97\") " pod="openshift-dns/node-resolver-6df6z"
Sep 09 16:13:37.544055 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.541917    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/45de5b46-a121-43e3-b141-4de97a0ad121-run-openvswitch\") pod \"ovnkube-node-8xkw6\" (UID: \"45de5b46-a121-43e3-b141-4de97a0ad121\") " pod="openshift-ovn-kubernetes/ovnkube-node-8xkw6"
Sep 09 16:13:37.544055 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.541959    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/be6bb207-ddbb-459e-af6c-bc2500a92955-system-cni-dir\") pod \"multus-additional-cni-plugins-djp68\" (UID: \"be6bb207-ddbb-459e-af6c-bc2500a92955\") " pod="openshift-multus/multus-additional-cni-plugins-djp68"
Sep 09 16:13:37.544055 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.541984    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ab137fdc-62f3-4f47-ab97-f1c896ce3d56-etc-kubernetes\") pod \"multus-grl6q\" (UID: \"ab137fdc-62f3-4f47-ab97-f1c896ce3d56\") " pod="openshift-multus/multus-grl6q"
Sep 09 16:13:37.544055 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.542006    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/45de5b46-a121-43e3-b141-4de97a0ad121-var-lib-openvswitch\") pod \"ovnkube-node-8xkw6\" (UID: \"45de5b46-a121-43e3-b141-4de97a0ad121\") " pod="openshift-ovn-kubernetes/ovnkube-node-8xkw6"
Sep 09 16:13:37.544055 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.542014    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/45de5b46-a121-43e3-b141-4de97a0ad121-host-cni-netd\") pod \"ovnkube-node-8xkw6\" (UID: \"45de5b46-a121-43e3-b141-4de97a0ad121\") " pod="openshift-ovn-kubernetes/ovnkube-node-8xkw6"
Sep 09 16:13:37.544055 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.542041    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/45de5b46-a121-43e3-b141-4de97a0ad121-log-socket\") pod \"ovnkube-node-8xkw6\" (UID: \"45de5b46-a121-43e3-b141-4de97a0ad121\") " pod="openshift-ovn-kubernetes/ovnkube-node-8xkw6"
Sep 09 16:13:37.544055 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.542066    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/45de5b46-a121-43e3-b141-4de97a0ad121-ovn-node-metrics-cert\") pod \"ovnkube-node-8xkw6\" (UID: \"45de5b46-a121-43e3-b141-4de97a0ad121\") " pod="openshift-ovn-kubernetes/ovnkube-node-8xkw6"
Sep 09 16:13:37.544055 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.542074    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/be6bb207-ddbb-459e-af6c-bc2500a92955-system-cni-dir\") pod \"multus-additional-cni-plugins-djp68\" (UID: \"be6bb207-ddbb-459e-af6c-bc2500a92955\") " pod="openshift-multus/multus-additional-cni-plugins-djp68"
Sep 09 16:13:37.544542 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.542081    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/be6bb207-ddbb-459e-af6c-bc2500a92955-cnibin\") pod \"multus-additional-cni-plugins-djp68\" (UID: \"be6bb207-ddbb-459e-af6c-bc2500a92955\") " pod="openshift-multus/multus-additional-cni-plugins-djp68"
Sep 09 16:13:37.544542 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.542117    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ab137fdc-62f3-4f47-ab97-f1c896ce3d56-etc-kubernetes\") pod \"multus-grl6q\" (UID: \"ab137fdc-62f3-4f47-ab97-f1c896ce3d56\") " pod="openshift-multus/multus-grl6q"
Sep 09 16:13:37.544542 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.542112    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/45de5b46-a121-43e3-b141-4de97a0ad121-var-lib-openvswitch\") pod \"ovnkube-node-8xkw6\" (UID: \"45de5b46-a121-43e3-b141-4de97a0ad121\") " pod="openshift-ovn-kubernetes/ovnkube-node-8xkw6"
Sep 09 16:13:37.544542 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.542140    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/45de5b46-a121-43e3-b141-4de97a0ad121-log-socket\") pod \"ovnkube-node-8xkw6\" (UID: \"45de5b46-a121-43e3-b141-4de97a0ad121\") " pod="openshift-ovn-kubernetes/ovnkube-node-8xkw6"
Sep 09 16:13:37.544542 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.542169    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/be6bb207-ddbb-459e-af6c-bc2500a92955-cnibin\") pod \"multus-additional-cni-plugins-djp68\" (UID: \"be6bb207-ddbb-459e-af6c-bc2500a92955\") " pod="openshift-multus/multus-additional-cni-plugins-djp68"
Sep 09 16:13:37.544542 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.542195    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ab137fdc-62f3-4f47-ab97-f1c896ce3d56-host-var-lib-kubelet\") pod \"multus-grl6q\" (UID: \"ab137fdc-62f3-4f47-ab97-f1c896ce3d56\") " pod="openshift-multus/multus-grl6q"
Sep 09 16:13:37.544542 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.542222    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/00f043bd-266f-4a52-8b28-43c6704636d4-iptables-alerter-script\") pod \"iptables-alerter-8nq9w\" (UID: \"00f043bd-266f-4a52-8b28-43c6704636d4\") " pod="openshift-network-operator/iptables-alerter-8nq9w"
Sep 09 16:13:37.544542 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.542227    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ab137fdc-62f3-4f47-ab97-f1c896ce3d56-cni-binary-copy\") pod \"multus-grl6q\" (UID: \"ab137fdc-62f3-4f47-ab97-f1c896ce3d56\") " pod="openshift-multus/multus-grl6q"
Sep 09 16:13:37.544542 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.542268    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/83e1ba8e-4b2d-475a-9494-f4bbece9ee78-etc-kubernetes\") pod \"tuned-9x9xn\" (UID: \"83e1ba8e-4b2d-475a-9494-f4bbece9ee78\") " pod="openshift-cluster-node-tuning-operator/tuned-9x9xn"
Sep 09 16:13:37.544542 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.542295    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/83e1ba8e-4b2d-475a-9494-f4bbece9ee78-host\") pod \"tuned-9x9xn\" (UID: \"83e1ba8e-4b2d-475a-9494-f4bbece9ee78\") " pod="openshift-cluster-node-tuning-operator/tuned-9x9xn"
Sep 09 16:13:37.544542 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.542321    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p9phz\" (UniqueName: \"kubernetes.io/projected/be6bb207-ddbb-459e-af6c-bc2500a92955-kube-api-access-p9phz\") pod \"multus-additional-cni-plugins-djp68\" (UID: \"be6bb207-ddbb-459e-af6c-bc2500a92955\") " pod="openshift-multus/multus-additional-cni-plugins-djp68"
Sep 09 16:13:37.544542 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.542377    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ab137fdc-62f3-4f47-ab97-f1c896ce3d56-host-var-lib-kubelet\") pod \"multus-grl6q\" (UID: \"ab137fdc-62f3-4f47-ab97-f1c896ce3d56\") " pod="openshift-multus/multus-grl6q"
Sep 09 16:13:37.544542 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.542428    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d01fa91c-300b-4d4b-8a2f-3646eb02566c-konnectivity-ca\") pod \"konnectivity-agent-867mp\" (UID: \"d01fa91c-300b-4d4b-8a2f-3646eb02566c\") " pod="kube-system/konnectivity-agent-867mp"
Sep 09 16:13:37.544542 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.542478    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/83e1ba8e-4b2d-475a-9494-f4bbece9ee78-host\") pod \"tuned-9x9xn\" (UID: \"83e1ba8e-4b2d-475a-9494-f4bbece9ee78\") " pod="openshift-cluster-node-tuning-operator/tuned-9x9xn"
Sep 09 16:13:37.544542 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.542514    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4hr95\" (UniqueName: \"kubernetes.io/projected/f8a2ea6e-22df-4b6d-b1b1-e554e877f94c-kube-api-access-4hr95\") pod \"network-metrics-daemon-qmp4p\" (UID: \"f8a2ea6e-22df-4b6d-b1b1-e554e877f94c\") " pod="openshift-multus/network-metrics-daemon-qmp4p"
Sep 09 16:13:37.544542 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.542540    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g7jh9\" (UniqueName: \"kubernetes.io/projected/f7554c3b-d296-4424-8822-a3e75a994efa-kube-api-access-g7jh9\") pod \"network-check-target-vgwn2\" (UID: \"f7554c3b-d296-4424-8822-a3e75a994efa\") " pod="openshift-network-diagnostics/network-check-target-vgwn2"
Sep 09 16:13:37.544542 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.542552    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/83e1ba8e-4b2d-475a-9494-f4bbece9ee78-etc-kubernetes\") pod \"tuned-9x9xn\" (UID: \"83e1ba8e-4b2d-475a-9494-f4bbece9ee78\") " pod="openshift-cluster-node-tuning-operator/tuned-9x9xn"
Sep 09 16:13:37.544994 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.542579    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ab137fdc-62f3-4f47-ab97-f1c896ce3d56-multus-cni-dir\") pod \"multus-grl6q\" (UID: \"ab137fdc-62f3-4f47-ab97-f1c896ce3d56\") " pod="openshift-multus/multus-grl6q"
Sep 09 16:13:37.544994 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.542582    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ab137fdc-62f3-4f47-ab97-f1c896ce3d56-host-run-k8s-cni-cncf-io\") pod \"multus-grl6q\" (UID: \"ab137fdc-62f3-4f47-ab97-f1c896ce3d56\") " pod="openshift-multus/multus-grl6q"
Sep 09 16:13:37.544994 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.542702    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/45de5b46-a121-43e3-b141-4de97a0ad121-systemd-units\") pod \"ovnkube-node-8xkw6\" (UID: \"45de5b46-a121-43e3-b141-4de97a0ad121\") " pod="openshift-ovn-kubernetes/ovnkube-node-8xkw6"
Sep 09 16:13:37.544994 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.542743    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ab137fdc-62f3-4f47-ab97-f1c896ce3d56-multus-cni-dir\") pod \"multus-grl6q\" (UID: \"ab137fdc-62f3-4f47-ab97-f1c896ce3d56\") " pod="openshift-multus/multus-grl6q"
Sep 09 16:13:37.544994 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.542783    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gdx76\" (UniqueName: \"kubernetes.io/projected/83e1ba8e-4b2d-475a-9494-f4bbece9ee78-kube-api-access-gdx76\") pod \"tuned-9x9xn\" (UID: \"83e1ba8e-4b2d-475a-9494-f4bbece9ee78\") " pod="openshift-cluster-node-tuning-operator/tuned-9x9xn"
Sep 09 16:13:37.544994 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.542825    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ab137fdc-62f3-4f47-ab97-f1c896ce3d56-cnibin\") pod \"multus-grl6q\" (UID: \"ab137fdc-62f3-4f47-ab97-f1c896ce3d56\") " pod="openshift-multus/multus-grl6q"
Sep 09 16:13:37.544994 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.542834    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/45de5b46-a121-43e3-b141-4de97a0ad121-systemd-units\") pod \"ovnkube-node-8xkw6\" (UID: \"45de5b46-a121-43e3-b141-4de97a0ad121\") " pod="openshift-ovn-kubernetes/ovnkube-node-8xkw6"
Sep 09 16:13:37.544994 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.542878    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ab137fdc-62f3-4f47-ab97-f1c896ce3d56-hostroot\") pod \"multus-grl6q\" (UID: \"ab137fdc-62f3-4f47-ab97-f1c896ce3d56\") " pod="openshift-multus/multus-grl6q"
Sep 09 16:13:37.544994 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.542909    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ts8jp\" (UniqueName: \"kubernetes.io/projected/ab137fdc-62f3-4f47-ab97-f1c896ce3d56-kube-api-access-ts8jp\") pod \"multus-grl6q\" (UID: \"ab137fdc-62f3-4f47-ab97-f1c896ce3d56\") " pod="openshift-multus/multus-grl6q"
Sep 09 16:13:37.544994 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.542914    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ab137fdc-62f3-4f47-ab97-f1c896ce3d56-hostroot\") pod \"multus-grl6q\" (UID: \"ab137fdc-62f3-4f47-ab97-f1c896ce3d56\") " pod="openshift-multus/multus-grl6q"
Sep 09 16:13:37.544994 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.542945    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/45de5b46-a121-43e3-b141-4de97a0ad121-host-run-netns\") pod \"ovnkube-node-8xkw6\" (UID: \"45de5b46-a121-43e3-b141-4de97a0ad121\") " pod="openshift-ovn-kubernetes/ovnkube-node-8xkw6"
Sep 09 16:13:37.544994 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.542955    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ab137fdc-62f3-4f47-ab97-f1c896ce3d56-cnibin\") pod \"multus-grl6q\" (UID: \"ab137fdc-62f3-4f47-ab97-f1c896ce3d56\") " pod="openshift-multus/multus-grl6q"
Sep 09 16:13:37.544994 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.542968    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/45de5b46-a121-43e3-b141-4de97a0ad121-etc-openvswitch\") pod \"ovnkube-node-8xkw6\" (UID: \"45de5b46-a121-43e3-b141-4de97a0ad121\") " pod="openshift-ovn-kubernetes/ovnkube-node-8xkw6"
Sep 09 16:13:37.544994 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.542995    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/00f043bd-266f-4a52-8b28-43c6704636d4-iptables-alerter-script\") pod \"iptables-alerter-8nq9w\" (UID: \"00f043bd-266f-4a52-8b28-43c6704636d4\") " pod="openshift-network-operator/iptables-alerter-8nq9w"
Sep 09 16:13:37.544994 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.543028    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/45de5b46-a121-43e3-b141-4de97a0ad121-etc-openvswitch\") pod \"ovnkube-node-8xkw6\" (UID: \"45de5b46-a121-43e3-b141-4de97a0ad121\") " pod="openshift-ovn-kubernetes/ovnkube-node-8xkw6"
Sep 09 16:13:37.544994 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.543000    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/45de5b46-a121-43e3-b141-4de97a0ad121-host-run-netns\") pod \"ovnkube-node-8xkw6\" (UID: \"45de5b46-a121-43e3-b141-4de97a0ad121\") " pod="openshift-ovn-kubernetes/ovnkube-node-8xkw6"
Sep 09 16:13:37.544994 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.543233    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ab137fdc-62f3-4f47-ab97-f1c896ce3d56-multus-daemon-config\") pod \"multus-grl6q\" (UID: \"ab137fdc-62f3-4f47-ab97-f1c896ce3d56\") " pod="openshift-multus/multus-grl6q"
Sep 09 16:13:37.544994 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.543701    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/83e1ba8e-4b2d-475a-9494-f4bbece9ee78-etc-tuned\") pod \"tuned-9x9xn\" (UID: \"83e1ba8e-4b2d-475a-9494-f4bbece9ee78\") " pod="openshift-cluster-node-tuning-operator/tuned-9x9xn"
Sep 09 16:13:37.545440 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.543787    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/83e1ba8e-4b2d-475a-9494-f4bbece9ee78-tmp\") pod \"tuned-9x9xn\" (UID: \"83e1ba8e-4b2d-475a-9494-f4bbece9ee78\") " pod="openshift-cluster-node-tuning-operator/tuned-9x9xn"
Sep 09 16:13:37.545440 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.544221    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/45de5b46-a121-43e3-b141-4de97a0ad121-ovn-node-metrics-cert\") pod \"ovnkube-node-8xkw6\" (UID: \"45de5b46-a121-43e3-b141-4de97a0ad121\") " pod="openshift-ovn-kubernetes/ovnkube-node-8xkw6"
Sep 09 16:13:37.545440 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.544849    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d01fa91c-300b-4d4b-8a2f-3646eb02566c-agent-certs\") pod \"konnectivity-agent-867mp\" (UID: \"d01fa91c-300b-4d4b-8a2f-3646eb02566c\") " pod="kube-system/konnectivity-agent-867mp"
Sep 09 16:13:37.552590 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.552570    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l8qq4\" (UniqueName: \"kubernetes.io/projected/00f043bd-266f-4a52-8b28-43c6704636d4-kube-api-access-l8qq4\") pod \"iptables-alerter-8nq9w\" (UID: \"00f043bd-266f-4a52-8b28-43c6704636d4\") " pod="openshift-network-operator/iptables-alerter-8nq9w"
Sep 09 16:13:37.553134 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.553114    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zdvxf\" (UniqueName: \"kubernetes.io/projected/45de5b46-a121-43e3-b141-4de97a0ad121-kube-api-access-zdvxf\") pod \"ovnkube-node-8xkw6\" (UID: \"45de5b46-a121-43e3-b141-4de97a0ad121\") " pod="openshift-ovn-kubernetes/ovnkube-node-8xkw6"
Sep 09 16:13:37.554943 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:13:37.554925    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 09 16:13:37.555072 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:13:37.554949    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 09 16:13:37.555072 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:13:37.554962    2583 projected.go:196] Error preparing data for projected volume kube-api-access-g7jh9 for pod openshift-network-diagnostics/network-check-target-vgwn2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 16:13:37.555072 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:13:37.555007    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f7554c3b-d296-4424-8822-a3e75a994efa-kube-api-access-g7jh9 podName:f7554c3b-d296-4424-8822-a3e75a994efa nodeName:}" failed. No retries permitted until 2026-09-09 16:13:38.054993118 +0000 UTC m=+2.133985060 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-g7jh9" (UniqueName: "kubernetes.io/projected/f7554c3b-d296-4424-8822-a3e75a994efa-kube-api-access-g7jh9") pod "network-check-target-vgwn2" (UID: "f7554c3b-d296-4424-8822-a3e75a994efa") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 16:13:37.555605 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.555583    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jmjzk\" (UniqueName: \"kubernetes.io/projected/23975f85-e5cd-4329-9152-0d52fbdefcde-kube-api-access-jmjzk\") pod \"node-ca-xfwg5\" (UID: \"23975f85-e5cd-4329-9152-0d52fbdefcde\") " pod="openshift-image-registry/node-ca-xfwg5"
Sep 09 16:13:37.556074 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.556055    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j4cfb\" (UniqueName: \"kubernetes.io/projected/b8492dc1-21be-43db-bd0c-8860f4b76f97-kube-api-access-j4cfb\") pod \"node-resolver-6df6z\" (UID: \"b8492dc1-21be-43db-bd0c-8860f4b76f97\") " pod="openshift-dns/node-resolver-6df6z"
Sep 09 16:13:37.556752 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.556716    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gdx76\" (UniqueName: \"kubernetes.io/projected/83e1ba8e-4b2d-475a-9494-f4bbece9ee78-kube-api-access-gdx76\") pod \"tuned-9x9xn\" (UID: \"83e1ba8e-4b2d-475a-9494-f4bbece9ee78\") " pod="openshift-cluster-node-tuning-operator/tuned-9x9xn"
Sep 09 16:13:37.557055 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.557039    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p9phz\" (UniqueName: \"kubernetes.io/projected/be6bb207-ddbb-459e-af6c-bc2500a92955-kube-api-access-p9phz\") pod \"multus-additional-cni-plugins-djp68\" (UID: \"be6bb207-ddbb-459e-af6c-bc2500a92955\") " pod="openshift-multus/multus-additional-cni-plugins-djp68"
Sep 09 16:13:37.557373 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.557355    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ts8jp\" (UniqueName: \"kubernetes.io/projected/ab137fdc-62f3-4f47-ab97-f1c896ce3d56-kube-api-access-ts8jp\") pod \"multus-grl6q\" (UID: \"ab137fdc-62f3-4f47-ab97-f1c896ce3d56\") " pod="openshift-multus/multus-grl6q"
Sep 09 16:13:37.557818 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:37.557804    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4hr95\" (UniqueName: \"kubernetes.io/projected/f8a2ea6e-22df-4b6d-b1b1-e554e877f94c-kube-api-access-4hr95\") pod \"network-metrics-daemon-qmp4p\" (UID: \"f8a2ea6e-22df-4b6d-b1b1-e554e877f94c\") " pod="openshift-multus/network-metrics-daemon-qmp4p"
Sep 09 16:13:39.387464 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:39.387422    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-44ltr"
Sep 09 16:13:39.409446 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:39.409427    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-9x9xn"
Sep 09 16:13:39.427110 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:39.427094    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-6df6z"
Sep 09 16:13:39.440510 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:39.440494    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-djp68"
Sep 09 16:13:39.445954 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:39.445940    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-xfwg5"
Sep 09 16:13:39.459751 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:39.459734    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-grl6q"
Sep 09 16:13:39.479950 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:39.479934    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-8nq9w"
Sep 09 16:13:39.495555 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:39.495539    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-8xkw6"
Sep 09 16:13:39.498865 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:39.498852    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-867mp"
Sep 09 16:13:39.555608 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:39.555586    2583 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 09 16:13:39.665264 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:39.665141    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e11b2d54eb39bede7ac13e502e3398d.slice/crio-b80bc46c41ee8dd74d453fc6b76a13709aadf7bc3213d43aa2049bb98ed52eed WatchSource:0}: Error finding container b80bc46c41ee8dd74d453fc6b76a13709aadf7bc3213d43aa2049bb98ed52eed: Status 404 returned error can't find the container with id b80bc46c41ee8dd74d453fc6b76a13709aadf7bc3213d43aa2049bb98ed52eed
Sep 09 16:13:39.665600 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:39.665567    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda4295cbced7cf805209af4a484bf441.slice/crio-6257f065d1ec082ae36030f7f0004426fab26aeccd50c231800460da93198b02 WatchSource:0}: Error finding container 6257f065d1ec082ae36030f7f0004426fab26aeccd50c231800460da93198b02: Status 404 returned error can't find the container with id 6257f065d1ec082ae36030f7f0004426fab26aeccd50c231800460da93198b02
Sep 09 16:13:39.673464 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:39.673448    2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 09 16:13:39.729005 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:39.728974    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b4c0b53_fcf7_4082_924b_99445132777e.slice/crio-0caac244db4aa4af773c9ff275e50e2aede9729416c57c7514f3b3aebcbf697e WatchSource:0}: Error finding container 0caac244db4aa4af773c9ff275e50e2aede9729416c57c7514f3b3aebcbf697e: Status 404 returned error can't find the container with id 0caac244db4aa4af773c9ff275e50e2aede9729416c57c7514f3b3aebcbf697e
Sep 09 16:13:39.772128 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:39.772109    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f8a2ea6e-22df-4b6d-b1b1-e554e877f94c-metrics-certs\") pod \"network-metrics-daemon-qmp4p\" (UID: \"f8a2ea6e-22df-4b6d-b1b1-e554e877f94c\") " pod="openshift-multus/network-metrics-daemon-qmp4p"
Sep 09 16:13:39.772224 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:39.772173    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2e619341-a4d2-42fc-b5d9-e33ffeebd306-original-pull-secret\") pod \"global-pull-secret-syncer-stpmj\" (UID: \"2e619341-a4d2-42fc-b5d9-e33ffeebd306\") " pod="kube-system/global-pull-secret-syncer-stpmj"
Sep 09 16:13:39.772281 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:13:39.772233    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 16:13:39.772281 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:13:39.772265    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 09 16:13:39.772352 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:13:39.772307    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8a2ea6e-22df-4b6d-b1b1-e554e877f94c-metrics-certs podName:f8a2ea6e-22df-4b6d-b1b1-e554e877f94c nodeName:}" failed. No retries permitted until 2026-09-09 16:13:40.772268036 +0000 UTC m=+3.125997846 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f8a2ea6e-22df-4b6d-b1b1-e554e877f94c-metrics-certs") pod "network-metrics-daemon-qmp4p" (UID: "f8a2ea6e-22df-4b6d-b1b1-e554e877f94c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 16:13:39.772352 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:13:39.772321    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e619341-a4d2-42fc-b5d9-e33ffeebd306-original-pull-secret podName:2e619341-a4d2-42fc-b5d9-e33ffeebd306 nodeName:}" failed. No retries permitted until 2026-09-09 16:13:40.772315052 +0000 UTC m=+3.126044862 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2e619341-a4d2-42fc-b5d9-e33ffeebd306-original-pull-secret") pod "global-pull-secret-syncer-stpmj" (UID: "2e619341-a4d2-42fc-b5d9-e33ffeebd306") : object "kube-system"/"original-pull-secret" not registered
Sep 09 16:13:39.812527 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:39.812509    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe6bb207_ddbb_459e_af6c_bc2500a92955.slice/crio-a23d53868ed4af82d8b68997699db0d6e76c0f706e10ae1e84e022a809b011f8 WatchSource:0}: Error finding container a23d53868ed4af82d8b68997699db0d6e76c0f706e10ae1e84e022a809b011f8: Status 404 returned error can't find the container with id a23d53868ed4af82d8b68997699db0d6e76c0f706e10ae1e84e022a809b011f8
Sep 09 16:13:39.872782 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:39.872761    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g7jh9\" (UniqueName: \"kubernetes.io/projected/f7554c3b-d296-4424-8822-a3e75a994efa-kube-api-access-g7jh9\") pod \"network-check-target-vgwn2\" (UID: \"f7554c3b-d296-4424-8822-a3e75a994efa\") " pod="openshift-network-diagnostics/network-check-target-vgwn2"
Sep 09 16:13:39.872861 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:13:39.872851    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 09 16:13:39.872897 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:13:39.872864    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 09 16:13:39.872897 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:13:39.872872    2583 projected.go:196] Error preparing data for projected volume kube-api-access-g7jh9 for pod openshift-network-diagnostics/network-check-target-vgwn2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 16:13:39.872957 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:13:39.872907    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f7554c3b-d296-4424-8822-a3e75a994efa-kube-api-access-g7jh9 podName:f7554c3b-d296-4424-8822-a3e75a994efa nodeName:}" failed. No retries permitted until 2026-09-09 16:13:40.872896241 +0000 UTC m=+3.226626052 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-g7jh9" (UniqueName: "kubernetes.io/projected/f7554c3b-d296-4424-8822-a3e75a994efa-kube-api-access-g7jh9") pod "network-check-target-vgwn2" (UID: "f7554c3b-d296-4424-8822-a3e75a994efa") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 16:13:39.983053 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:39.983035    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab137fdc_62f3_4f47_ab97_f1c896ce3d56.slice/crio-bf98a2c9623feb2de8c27dde3348364f304b3032ccfabf3d0612f3f58c43e6ea WatchSource:0}: Error finding container bf98a2c9623feb2de8c27dde3348364f304b3032ccfabf3d0612f3f58c43e6ea: Status 404 returned error can't find the container with id bf98a2c9623feb2de8c27dde3348364f304b3032ccfabf3d0612f3f58c43e6ea
Sep 09 16:13:40.017243 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:40.017224    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00f043bd_266f_4a52_8b28_43c6704636d4.slice/crio-d7f66c4add15dc0de8f2ea8ef06827be8ef1562a31291665cd9144f2c04ac7ab WatchSource:0}: Error finding container d7f66c4add15dc0de8f2ea8ef06827be8ef1562a31291665cd9144f2c04ac7ab: Status 404 returned error can't find the container with id d7f66c4add15dc0de8f2ea8ef06827be8ef1562a31291665cd9144f2c04ac7ab
Sep 09 16:13:40.026671 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:40.026653    2583 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 09 16:13:40.036609 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:40.036595    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd01fa91c_300b_4d4b_8a2f_3646eb02566c.slice/crio-af7200a071424e8402a1f4a0e163a515e556e42c900a50b6d35331d71a11982c WatchSource:0}: Error finding container af7200a071424e8402a1f4a0e163a515e556e42c900a50b6d35331d71a11982c: Status 404 returned error can't find the container with id af7200a071424e8402a1f4a0e163a515e556e42c900a50b6d35331d71a11982c
Sep 09 16:13:40.148365 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:40.148348    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83e1ba8e_4b2d_475a_9494_f4bbece9ee78.slice/crio-ffa2aa20b41f55c5372dbb72dfb8d8b8f638ee076180abb9cfa344ffe86f0598 WatchSource:0}: Error finding container ffa2aa20b41f55c5372dbb72dfb8d8b8f638ee076180abb9cfa344ffe86f0598: Status 404 returned error can't find the container with id ffa2aa20b41f55c5372dbb72dfb8d8b8f638ee076180abb9cfa344ffe86f0598
Sep 09 16:13:40.191978 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:40.191951    2583 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-08 16:08:39 +0000 UTC" deadline="2028-04-30 01:33:04.90252723 +0000 UTC"
Sep 09 16:13:40.191978 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:40.191977    2583 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14361h19m24.710554101s"
Sep 09 16:13:40.232213 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:40.232166    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vgwn2"
Sep 09 16:13:40.232292 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:13:40.232271    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vgwn2" podUID="f7554c3b-d296-4424-8822-a3e75a994efa"
Sep 09 16:13:40.238013 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:40.237951    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-48.ec2.internal" event={"ID":"7e11b2d54eb39bede7ac13e502e3398d","Type":"ContainerStarted","Data":"b80bc46c41ee8dd74d453fc6b76a13709aadf7bc3213d43aa2049bb98ed52eed"}
Sep 09 16:13:40.239341 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:40.239318    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-48.ec2.internal" event={"ID":"da4295cbced7cf805209af4a484bf441","Type":"ContainerStarted","Data":"6257f065d1ec082ae36030f7f0004426fab26aeccd50c231800460da93198b02"}
Sep 09 16:13:40.240459 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:40.240435    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-867mp" event={"ID":"d01fa91c-300b-4d4b-8a2f-3646eb02566c","Type":"ContainerStarted","Data":"af7200a071424e8402a1f4a0e163a515e556e42c900a50b6d35331d71a11982c"}
Sep 09 16:13:40.241633 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:40.241608    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-9x9xn" event={"ID":"83e1ba8e-4b2d-475a-9494-f4bbece9ee78","Type":"ContainerStarted","Data":"ffa2aa20b41f55c5372dbb72dfb8d8b8f638ee076180abb9cfa344ffe86f0598"}
Sep 09 16:13:40.242838 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:40.242811    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-xfwg5" event={"ID":"23975f85-e5cd-4329-9152-0d52fbdefcde","Type":"ContainerStarted","Data":"b710a4ffd6da143c60a711518483308cf87c42e63911cf38a104f4e94b63ffcd"}
Sep 09 16:13:40.243973 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:40.243942    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-8nq9w" event={"ID":"00f043bd-266f-4a52-8b28-43c6704636d4","Type":"ContainerStarted","Data":"d7f66c4add15dc0de8f2ea8ef06827be8ef1562a31291665cd9144f2c04ac7ab"}
Sep 09 16:13:40.245092 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:40.245070    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-grl6q" event={"ID":"ab137fdc-62f3-4f47-ab97-f1c896ce3d56","Type":"ContainerStarted","Data":"bf98a2c9623feb2de8c27dde3348364f304b3032ccfabf3d0612f3f58c43e6ea"}
Sep 09 16:13:40.246235 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:40.246209    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-djp68" event={"ID":"be6bb207-ddbb-459e-af6c-bc2500a92955","Type":"ContainerStarted","Data":"a23d53868ed4af82d8b68997699db0d6e76c0f706e10ae1e84e022a809b011f8"}
Sep 09 16:13:40.247303 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:40.247283    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-44ltr" event={"ID":"1b4c0b53-fcf7-4082-924b-99445132777e","Type":"ContainerStarted","Data":"0caac244db4aa4af773c9ff275e50e2aede9729416c57c7514f3b3aebcbf697e"}
Sep 09 16:13:40.408204 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:40.408178    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45de5b46_a121_43e3_b141_4de97a0ad121.slice/crio-fb2d940497620eeb8bbaa3d18566dc143d4bdc1a109f95c4219d4ecaa6d6c748 WatchSource:0}: Error finding container fb2d940497620eeb8bbaa3d18566dc143d4bdc1a109f95c4219d4ecaa6d6c748: Status 404 returned error can't find the container with id fb2d940497620eeb8bbaa3d18566dc143d4bdc1a109f95c4219d4ecaa6d6c748
Sep 09 16:13:40.778547 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:40.778511    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2e619341-a4d2-42fc-b5d9-e33ffeebd306-original-pull-secret\") pod \"global-pull-secret-syncer-stpmj\" (UID: \"2e619341-a4d2-42fc-b5d9-e33ffeebd306\") " pod="kube-system/global-pull-secret-syncer-stpmj"
Sep 09 16:13:40.778721 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:40.778571    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f8a2ea6e-22df-4b6d-b1b1-e554e877f94c-metrics-certs\") pod \"network-metrics-daemon-qmp4p\" (UID: \"f8a2ea6e-22df-4b6d-b1b1-e554e877f94c\") " pod="openshift-multus/network-metrics-daemon-qmp4p"
Sep 09 16:13:40.778803 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:13:40.778729    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 16:13:40.778803 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:13:40.778798    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8a2ea6e-22df-4b6d-b1b1-e554e877f94c-metrics-certs podName:f8a2ea6e-22df-4b6d-b1b1-e554e877f94c nodeName:}" failed. No retries permitted until 2026-09-09 16:13:42.778779869 +0000 UTC m=+5.132509725 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f8a2ea6e-22df-4b6d-b1b1-e554e877f94c-metrics-certs") pod "network-metrics-daemon-qmp4p" (UID: "f8a2ea6e-22df-4b6d-b1b1-e554e877f94c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 16:13:40.778913 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:13:40.778864    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 09 16:13:40.778913 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:13:40.778896    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e619341-a4d2-42fc-b5d9-e33ffeebd306-original-pull-secret podName:2e619341-a4d2-42fc-b5d9-e33ffeebd306 nodeName:}" failed. No retries permitted until 2026-09-09 16:13:42.778885243 +0000 UTC m=+5.132615056 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2e619341-a4d2-42fc-b5d9-e33ffeebd306-original-pull-secret") pod "global-pull-secret-syncer-stpmj" (UID: "2e619341-a4d2-42fc-b5d9-e33ffeebd306") : object "kube-system"/"original-pull-secret" not registered
Sep 09 16:13:40.879078 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:40.879048    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g7jh9\" (UniqueName: \"kubernetes.io/projected/f7554c3b-d296-4424-8822-a3e75a994efa-kube-api-access-g7jh9\") pod \"network-check-target-vgwn2\" (UID: \"f7554c3b-d296-4424-8822-a3e75a994efa\") " pod="openshift-network-diagnostics/network-check-target-vgwn2"
Sep 09 16:13:40.879239 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:13:40.879197    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 09 16:13:40.879239 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:13:40.879214    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 09 16:13:40.879239 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:13:40.879225    2583 projected.go:196] Error preparing data for projected volume kube-api-access-g7jh9 for pod openshift-network-diagnostics/network-check-target-vgwn2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 16:13:40.879394 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:13:40.879277    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f7554c3b-d296-4424-8822-a3e75a994efa-kube-api-access-g7jh9 podName:f7554c3b-d296-4424-8822-a3e75a994efa nodeName:}" failed. No retries permitted until 2026-09-09 16:13:42.879260286 +0000 UTC m=+5.232990100 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-g7jh9" (UniqueName: "kubernetes.io/projected/f7554c3b-d296-4424-8822-a3e75a994efa-kube-api-access-g7jh9") pod "network-check-target-vgwn2" (UID: "f7554c3b-d296-4424-8822-a3e75a994efa") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 16:13:41.008929 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:41.008903    2583 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 09 16:13:41.192605 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:41.192524    2583 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-08 16:08:39 +0000 UTC" deadline="2028-06-06 10:52:14.077609272 +0000 UTC"
Sep 09 16:13:41.192605 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:41.192560    2583 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15258h38m32.885053097s"
Sep 09 16:13:41.232606 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:41.232578    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmp4p"
Sep 09 16:13:41.232744 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:13:41.232709    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qmp4p" podUID="f8a2ea6e-22df-4b6d-b1b1-e554e877f94c"
Sep 09 16:13:41.232816 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:41.232794    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-stpmj"
Sep 09 16:13:41.232928 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:13:41.232909    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-stpmj" podUID="2e619341-a4d2-42fc-b5d9-e33ffeebd306"
Sep 09 16:13:41.251543 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:41.251516    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8xkw6" event={"ID":"45de5b46-a121-43e3-b141-4de97a0ad121","Type":"ContainerStarted","Data":"fb2d940497620eeb8bbaa3d18566dc143d4bdc1a109f95c4219d4ecaa6d6c748"}
Sep 09 16:13:42.233449 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:42.233381    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vgwn2"
Sep 09 16:13:42.234142 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:13:42.233516    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vgwn2" podUID="f7554c3b-d296-4424-8822-a3e75a994efa"
Sep 09 16:13:42.254913 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:42.254878    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-48.ec2.internal" event={"ID":"7e11b2d54eb39bede7ac13e502e3398d","Type":"ContainerStarted","Data":"5025b0eec0919da21efa1a3c8e5912a2663146c4e9ece430079ab62495855361"}
Sep 09 16:13:42.795347 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:42.795314    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2e619341-a4d2-42fc-b5d9-e33ffeebd306-original-pull-secret\") pod \"global-pull-secret-syncer-stpmj\" (UID: \"2e619341-a4d2-42fc-b5d9-e33ffeebd306\") " pod="kube-system/global-pull-secret-syncer-stpmj"
Sep 09 16:13:42.795522 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:42.795370    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f8a2ea6e-22df-4b6d-b1b1-e554e877f94c-metrics-certs\") pod \"network-metrics-daemon-qmp4p\" (UID: \"f8a2ea6e-22df-4b6d-b1b1-e554e877f94c\") " pod="openshift-multus/network-metrics-daemon-qmp4p"
Sep 09 16:13:42.795522 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:13:42.795461    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 09 16:13:42.795522 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:13:42.795498    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 16:13:42.795670 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:13:42.795529    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e619341-a4d2-42fc-b5d9-e33ffeebd306-original-pull-secret podName:2e619341-a4d2-42fc-b5d9-e33ffeebd306 nodeName:}" failed. No retries permitted until 2026-09-09 16:13:46.795510649 +0000 UTC m=+9.149240467 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2e619341-a4d2-42fc-b5d9-e33ffeebd306-original-pull-secret") pod "global-pull-secret-syncer-stpmj" (UID: "2e619341-a4d2-42fc-b5d9-e33ffeebd306") : object "kube-system"/"original-pull-secret" not registered
Sep 09 16:13:42.795670 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:13:42.795555    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8a2ea6e-22df-4b6d-b1b1-e554e877f94c-metrics-certs podName:f8a2ea6e-22df-4b6d-b1b1-e554e877f94c nodeName:}" failed. No retries permitted until 2026-09-09 16:13:46.795540017 +0000 UTC m=+9.149269828 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f8a2ea6e-22df-4b6d-b1b1-e554e877f94c-metrics-certs") pod "network-metrics-daemon-qmp4p" (UID: "f8a2ea6e-22df-4b6d-b1b1-e554e877f94c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 16:13:42.896338 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:42.896300    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g7jh9\" (UniqueName: \"kubernetes.io/projected/f7554c3b-d296-4424-8822-a3e75a994efa-kube-api-access-g7jh9\") pod \"network-check-target-vgwn2\" (UID: \"f7554c3b-d296-4424-8822-a3e75a994efa\") " pod="openshift-network-diagnostics/network-check-target-vgwn2"
Sep 09 16:13:42.896489 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:13:42.896465    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 09 16:13:42.896489 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:13:42.896486    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 09 16:13:42.896559 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:13:42.896497    2583 projected.go:196] Error preparing data for projected volume kube-api-access-g7jh9 for pod openshift-network-diagnostics/network-check-target-vgwn2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 16:13:42.896559 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:13:42.896548    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f7554c3b-d296-4424-8822-a3e75a994efa-kube-api-access-g7jh9 podName:f7554c3b-d296-4424-8822-a3e75a994efa nodeName:}" failed. No retries permitted until 2026-09-09 16:13:46.896532022 +0000 UTC m=+9.250261851 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-g7jh9" (UniqueName: "kubernetes.io/projected/f7554c3b-d296-4424-8822-a3e75a994efa-kube-api-access-g7jh9") pod "network-check-target-vgwn2" (UID: "f7554c3b-d296-4424-8822-a3e75a994efa") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 16:13:43.232403 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:43.232327    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-stpmj"
Sep 09 16:13:43.232403 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:43.232360    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmp4p"
Sep 09 16:13:43.232614 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:13:43.232450    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-stpmj" podUID="2e619341-a4d2-42fc-b5d9-e33ffeebd306"
Sep 09 16:13:43.232614 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:13:43.232504    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qmp4p" podUID="f8a2ea6e-22df-4b6d-b1b1-e554e877f94c"
Sep 09 16:13:43.258854 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:43.258823    2583 generic.go:356] "Generic (PLEG): container finished" podID="7e11b2d54eb39bede7ac13e502e3398d" containerID="5025b0eec0919da21efa1a3c8e5912a2663146c4e9ece430079ab62495855361" exitCode=0
Sep 09 16:13:43.259264 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:43.258869    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-48.ec2.internal" event={"ID":"7e11b2d54eb39bede7ac13e502e3398d","Type":"ContainerDied","Data":"5025b0eec0919da21efa1a3c8e5912a2663146c4e9ece430079ab62495855361"}
Sep 09 16:13:44.233416 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:44.233381    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vgwn2"
Sep 09 16:13:44.233591 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:13:44.233502    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vgwn2" podUID="f7554c3b-d296-4424-8822-a3e75a994efa"
Sep 09 16:13:45.232595 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:45.232525    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-stpmj"
Sep 09 16:13:45.233104 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:45.232527    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmp4p"
Sep 09 16:13:45.233104 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:13:45.232653    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-stpmj" podUID="2e619341-a4d2-42fc-b5d9-e33ffeebd306"
Sep 09 16:13:45.233104 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:13:45.232736    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qmp4p" podUID="f8a2ea6e-22df-4b6d-b1b1-e554e877f94c"
Sep 09 16:13:46.232896 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:46.232870    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vgwn2"
Sep 09 16:13:46.233306 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:13:46.233003    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vgwn2" podUID="f7554c3b-d296-4424-8822-a3e75a994efa"
Sep 09 16:13:46.823755 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:46.823715    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f8a2ea6e-22df-4b6d-b1b1-e554e877f94c-metrics-certs\") pod \"network-metrics-daemon-qmp4p\" (UID: \"f8a2ea6e-22df-4b6d-b1b1-e554e877f94c\") " pod="openshift-multus/network-metrics-daemon-qmp4p"
Sep 09 16:13:46.823926 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:46.823797    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2e619341-a4d2-42fc-b5d9-e33ffeebd306-original-pull-secret\") pod \"global-pull-secret-syncer-stpmj\" (UID: \"2e619341-a4d2-42fc-b5d9-e33ffeebd306\") " pod="kube-system/global-pull-secret-syncer-stpmj"
Sep 09 16:13:46.823926 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:13:46.823902    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 09 16:13:46.824051 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:13:46.823956    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e619341-a4d2-42fc-b5d9-e33ffeebd306-original-pull-secret podName:2e619341-a4d2-42fc-b5d9-e33ffeebd306 nodeName:}" failed. No retries permitted until 2026-09-09 16:13:54.823938163 +0000 UTC m=+17.177667986 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2e619341-a4d2-42fc-b5d9-e33ffeebd306-original-pull-secret") pod "global-pull-secret-syncer-stpmj" (UID: "2e619341-a4d2-42fc-b5d9-e33ffeebd306") : object "kube-system"/"original-pull-secret" not registered
Sep 09 16:13:46.824283 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:13:46.824192    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 16:13:46.824283 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:13:46.824244    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8a2ea6e-22df-4b6d-b1b1-e554e877f94c-metrics-certs podName:f8a2ea6e-22df-4b6d-b1b1-e554e877f94c nodeName:}" failed. No retries permitted until 2026-09-09 16:13:54.824228524 +0000 UTC m=+17.177958350 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f8a2ea6e-22df-4b6d-b1b1-e554e877f94c-metrics-certs") pod "network-metrics-daemon-qmp4p" (UID: "f8a2ea6e-22df-4b6d-b1b1-e554e877f94c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 16:13:46.924631 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:46.924552    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g7jh9\" (UniqueName: \"kubernetes.io/projected/f7554c3b-d296-4424-8822-a3e75a994efa-kube-api-access-g7jh9\") pod \"network-check-target-vgwn2\" (UID: \"f7554c3b-d296-4424-8822-a3e75a994efa\") " pod="openshift-network-diagnostics/network-check-target-vgwn2"
Sep 09 16:13:46.924741 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:13:46.924690    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 09 16:13:46.924741 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:13:46.924710    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 09 16:13:46.924741 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:13:46.924722    2583 projected.go:196] Error preparing data for projected volume kube-api-access-g7jh9 for pod openshift-network-diagnostics/network-check-target-vgwn2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 16:13:46.924877 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:13:46.924775    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f7554c3b-d296-4424-8822-a3e75a994efa-kube-api-access-g7jh9 podName:f7554c3b-d296-4424-8822-a3e75a994efa nodeName:}" failed. No retries permitted until 2026-09-09 16:13:54.924757299 +0000 UTC m=+17.278487150 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-g7jh9" (UniqueName: "kubernetes.io/projected/f7554c3b-d296-4424-8822-a3e75a994efa-kube-api-access-g7jh9") pod "network-check-target-vgwn2" (UID: "f7554c3b-d296-4424-8822-a3e75a994efa") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 16:13:47.233037 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:47.232957    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmp4p"
Sep 09 16:13:47.233493 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:13:47.233098    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qmp4p" podUID="f8a2ea6e-22df-4b6d-b1b1-e554e877f94c"
Sep 09 16:13:47.233493 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:47.233160    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-stpmj"
Sep 09 16:13:47.233493 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:13:47.233234    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-stpmj" podUID="2e619341-a4d2-42fc-b5d9-e33ffeebd306"
Sep 09 16:13:48.234057 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:48.233965    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vgwn2"
Sep 09 16:13:48.234460 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:13:48.234103    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vgwn2" podUID="f7554c3b-d296-4424-8822-a3e75a994efa"
Sep 09 16:13:49.232332 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:49.232299    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-stpmj"
Sep 09 16:13:49.232491 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:49.232305    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmp4p"
Sep 09 16:13:49.232491 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:13:49.232428    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-stpmj" podUID="2e619341-a4d2-42fc-b5d9-e33ffeebd306"
Sep 09 16:13:49.232614 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:13:49.232498    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qmp4p" podUID="f8a2ea6e-22df-4b6d-b1b1-e554e877f94c"
Sep 09 16:13:50.232330 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:50.232300    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vgwn2"
Sep 09 16:13:50.232776 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:13:50.232421    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vgwn2" podUID="f7554c3b-d296-4424-8822-a3e75a994efa"
Sep 09 16:13:51.232393 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:51.232362    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmp4p"
Sep 09 16:13:51.232861 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:13:51.232499    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qmp4p" podUID="f8a2ea6e-22df-4b6d-b1b1-e554e877f94c"
Sep 09 16:13:51.232861 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:51.232511    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-stpmj"
Sep 09 16:13:51.232861 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:13:51.232602    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-stpmj" podUID="2e619341-a4d2-42fc-b5d9-e33ffeebd306"
Sep 09 16:13:52.232416 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:52.232388    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vgwn2"
Sep 09 16:13:52.232857 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:13:52.232510    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vgwn2" podUID="f7554c3b-d296-4424-8822-a3e75a994efa"
Sep 09 16:13:53.232312 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:53.232279    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-stpmj"
Sep 09 16:13:53.232477 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:53.232286    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmp4p"
Sep 09 16:13:53.232477 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:13:53.232383    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-stpmj" podUID="2e619341-a4d2-42fc-b5d9-e33ffeebd306"
Sep 09 16:13:53.232795 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:13:53.232477    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qmp4p" podUID="f8a2ea6e-22df-4b6d-b1b1-e554e877f94c"
Sep 09 16:13:54.232760 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:54.232729    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vgwn2"
Sep 09 16:13:54.233202 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:13:54.232828    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vgwn2" podUID="f7554c3b-d296-4424-8822-a3e75a994efa"
Sep 09 16:13:54.882446 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:54.882415    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2e619341-a4d2-42fc-b5d9-e33ffeebd306-original-pull-secret\") pod \"global-pull-secret-syncer-stpmj\" (UID: \"2e619341-a4d2-42fc-b5d9-e33ffeebd306\") " pod="kube-system/global-pull-secret-syncer-stpmj"
Sep 09 16:13:54.882600 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:54.882465    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f8a2ea6e-22df-4b6d-b1b1-e554e877f94c-metrics-certs\") pod \"network-metrics-daemon-qmp4p\" (UID: \"f8a2ea6e-22df-4b6d-b1b1-e554e877f94c\") " pod="openshift-multus/network-metrics-daemon-qmp4p"
Sep 09 16:13:54.882600 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:13:54.882573    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 16:13:54.882700 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:13:54.882629    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8a2ea6e-22df-4b6d-b1b1-e554e877f94c-metrics-certs podName:f8a2ea6e-22df-4b6d-b1b1-e554e877f94c nodeName:}" failed. No retries permitted until 2026-09-09 16:14:10.882615965 +0000 UTC m=+33.236345776 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f8a2ea6e-22df-4b6d-b1b1-e554e877f94c-metrics-certs") pod "network-metrics-daemon-qmp4p" (UID: "f8a2ea6e-22df-4b6d-b1b1-e554e877f94c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 16:13:54.882700 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:13:54.882573    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 09 16:13:54.882791 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:13:54.882712    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e619341-a4d2-42fc-b5d9-e33ffeebd306-original-pull-secret podName:2e619341-a4d2-42fc-b5d9-e33ffeebd306 nodeName:}" failed. No retries permitted until 2026-09-09 16:14:10.88269652 +0000 UTC m=+33.236426346 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2e619341-a4d2-42fc-b5d9-e33ffeebd306-original-pull-secret") pod "global-pull-secret-syncer-stpmj" (UID: "2e619341-a4d2-42fc-b5d9-e33ffeebd306") : object "kube-system"/"original-pull-secret" not registered
Sep 09 16:13:54.983640 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:54.983608    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g7jh9\" (UniqueName: \"kubernetes.io/projected/f7554c3b-d296-4424-8822-a3e75a994efa-kube-api-access-g7jh9\") pod \"network-check-target-vgwn2\" (UID: \"f7554c3b-d296-4424-8822-a3e75a994efa\") " pod="openshift-network-diagnostics/network-check-target-vgwn2"
Sep 09 16:13:54.983806 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:13:54.983791    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 09 16:13:54.983885 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:13:54.983815    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 09 16:13:54.983885 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:13:54.983824    2583 projected.go:196] Error preparing data for projected volume kube-api-access-g7jh9 for pod openshift-network-diagnostics/network-check-target-vgwn2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 16:13:54.983885 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:13:54.983884    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f7554c3b-d296-4424-8822-a3e75a994efa-kube-api-access-g7jh9 podName:f7554c3b-d296-4424-8822-a3e75a994efa nodeName:}" failed. No retries permitted until 2026-09-09 16:14:10.983868471 +0000 UTC m=+33.337598288 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-g7jh9" (UniqueName: "kubernetes.io/projected/f7554c3b-d296-4424-8822-a3e75a994efa-kube-api-access-g7jh9") pod "network-check-target-vgwn2" (UID: "f7554c3b-d296-4424-8822-a3e75a994efa") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 16:13:55.232275 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:55.232219    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-stpmj"
Sep 09 16:13:55.232377 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:13:55.232309    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-stpmj" podUID="2e619341-a4d2-42fc-b5d9-e33ffeebd306"
Sep 09 16:13:55.232377 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:55.232364    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmp4p"
Sep 09 16:13:55.232461 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:13:55.232443    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qmp4p" podUID="f8a2ea6e-22df-4b6d-b1b1-e554e877f94c"
Sep 09 16:13:56.232869 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:56.232783    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vgwn2"
Sep 09 16:13:56.233297 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:13:56.232912    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vgwn2" podUID="f7554c3b-d296-4424-8822-a3e75a994efa"
Sep 09 16:13:56.520127 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:13:56.520100    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8492dc1_21be_43db_bd0c_8860f4b76f97.slice/crio-501501bdcc624e4b14996aff10463ac0a321951ddf10afcbb8a2949cef4d528f WatchSource:0}: Error finding container 501501bdcc624e4b14996aff10463ac0a321951ddf10afcbb8a2949cef4d528f: Status 404 returned error can't find the container with id 501501bdcc624e4b14996aff10463ac0a321951ddf10afcbb8a2949cef4d528f
Sep 09 16:13:57.232626 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:57.232347    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmp4p"
Sep 09 16:13:57.232741 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:57.232412    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-stpmj"
Sep 09 16:13:57.232741 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:13:57.232701    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qmp4p" podUID="f8a2ea6e-22df-4b6d-b1b1-e554e877f94c"
Sep 09 16:13:57.232819 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:13:57.232775    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-stpmj" podUID="2e619341-a4d2-42fc-b5d9-e33ffeebd306"
Sep 09 16:13:57.284633 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:57.284609    2583 generic.go:356] "Generic (PLEG): container finished" podID="be6bb207-ddbb-459e-af6c-bc2500a92955" containerID="f6aa1a61a270bf98c236c91730f2d6a388878341cb8e4f3c729ad1c885e36341" exitCode=0
Sep 09 16:13:57.285224 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:57.284637    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-djp68" event={"ID":"be6bb207-ddbb-459e-af6c-bc2500a92955","Type":"ContainerDied","Data":"f6aa1a61a270bf98c236c91730f2d6a388878341cb8e4f3c729ad1c885e36341"}
Sep 09 16:13:57.286550 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:57.286528    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-44ltr" event={"ID":"1b4c0b53-fcf7-4082-924b-99445132777e","Type":"ContainerStarted","Data":"be331f26f1dbfc36d2b1575bdb4f00e8cf8996a7a624df5c2d63c109f4c744c3"}
Sep 09 16:13:57.288864 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:57.288841    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-48.ec2.internal" event={"ID":"7e11b2d54eb39bede7ac13e502e3398d","Type":"ContainerStarted","Data":"fe783131a5c2d196df848ae9c2a287217283cebceef8588e380892a669b18cc3"}
Sep 09 16:13:57.290574 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:57.290553    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-48.ec2.internal" event={"ID":"da4295cbced7cf805209af4a484bf441","Type":"ContainerStarted","Data":"ab0c318e02e51db716f3bfd96e41025f9ec74f78403298693b09aab55efe7dbc"}
Sep 09 16:13:57.292551 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:57.292511    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-867mp" event={"ID":"d01fa91c-300b-4d4b-8a2f-3646eb02566c","Type":"ContainerStarted","Data":"1fc2e83dc0e1843ffe6d3be5885fa211e4cd0f668436951e70fc35a2f7624cef"}
Sep 09 16:13:57.296133 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:57.296110    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8xkw6" event={"ID":"45de5b46-a121-43e3-b141-4de97a0ad121","Type":"ContainerStarted","Data":"bc92b829243fede1689380453c39c96370620a1a5f0ef8cfa652aa8793350f36"}
Sep 09 16:13:57.296233 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:57.296173    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8xkw6" event={"ID":"45de5b46-a121-43e3-b141-4de97a0ad121","Type":"ContainerStarted","Data":"4aeb26265ec07f80637394bb47ac56f32e850cc4148f62f1e1dd937f99793fa9"}
Sep 09 16:13:57.296233 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:57.296204    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8xkw6" event={"ID":"45de5b46-a121-43e3-b141-4de97a0ad121","Type":"ContainerStarted","Data":"fd6c09321044b40009ec7585a56fbd2df6faf64fcb0b01abc3c686196e5957e1"}
Sep 09 16:13:57.296350 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:57.296244    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8xkw6" event={"ID":"45de5b46-a121-43e3-b141-4de97a0ad121","Type":"ContainerStarted","Data":"61e4d6de941c8e4dbec5fe46789411d4787fd30d2f766b76867a01fd92819f70"}
Sep 09 16:13:57.296350 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:57.296286    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8xkw6" event={"ID":"45de5b46-a121-43e3-b141-4de97a0ad121","Type":"ContainerStarted","Data":"8d8dcf84b9b80fdd2de62a1fafb41b22e028d45c731bde48603fe203e2a3c2df"}
Sep 09 16:13:57.296350 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:57.296319    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8xkw6" event={"ID":"45de5b46-a121-43e3-b141-4de97a0ad121","Type":"ContainerStarted","Data":"aed7e6c971d55d09c2b30fa7bd851d429b7084f9e757cf38981d22e21e0fa73e"}
Sep 09 16:13:57.299893 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:57.299790    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-6df6z" event={"ID":"b8492dc1-21be-43db-bd0c-8860f4b76f97","Type":"ContainerStarted","Data":"515b3f7f5af03f5f196695510e1afe430b198b93733ab38da23062f206ccf442"}
Sep 09 16:13:57.300007 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:57.299955    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-6df6z" event={"ID":"b8492dc1-21be-43db-bd0c-8860f4b76f97","Type":"ContainerStarted","Data":"501501bdcc624e4b14996aff10463ac0a321951ddf10afcbb8a2949cef4d528f"}
Sep 09 16:13:57.301813 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:57.301787    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-9x9xn" event={"ID":"83e1ba8e-4b2d-475a-9494-f4bbece9ee78","Type":"ContainerStarted","Data":"18fcd068170a8a88b2d846283baef9cfc9828415875092a136f37f62b6e405d5"}
Sep 09 16:13:57.303435 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:57.303406    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-xfwg5" event={"ID":"23975f85-e5cd-4329-9152-0d52fbdefcde","Type":"ContainerStarted","Data":"f54267b12c0a4aacc2a732f67af8da0eea7703fdfae035bd3425cbedd06eae42"}
Sep 09 16:13:57.304862 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:57.304839    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-grl6q" event={"ID":"ab137fdc-62f3-4f47-ab97-f1c896ce3d56","Type":"ContainerStarted","Data":"835a3bcfc5a1a2e8e1508d1ef74091e0cf386c6224073dd01224f43ec962050c"}
Sep 09 16:13:57.317264 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:57.317230    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-867mp" podStartSLOduration=3.405206122 podStartE2EDuration="19.317218469s" totalImagesPullingTime="15.912012347s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 16:13:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:13:57.317170906 +0000 UTC m=+19.670900738" watchObservedRunningTime="2026-09-09 16:13:57.317218469 +0000 UTC m=+19.670948300"
Sep 09 16:13:57.331572 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:57.331530    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-48.ec2.internal" podStartSLOduration=19.331520194 podStartE2EDuration="19.331520194s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 16:13:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:13:57.331230562 +0000 UTC m=+19.684960397" watchObservedRunningTime="2026-09-09 16:13:57.331520194 +0000 UTC m=+19.685250025"
Sep 09 16:13:57.357579 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:57.357517    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-48.ec2.internal" podStartSLOduration=19.357496566000002 podStartE2EDuration="19.357496566s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 16:13:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:13:57.34284038 +0000 UTC m=+19.696570211" watchObservedRunningTime="2026-09-09 16:13:57.357496566 +0000 UTC m=+19.711226397"
Sep 09 16:13:57.371095 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:57.371067    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-9x9xn" podStartSLOduration=3.007800673 podStartE2EDuration="19.371057457s" totalImagesPullingTime="16.363256784s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 16:13:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:13:57.35765606 +0000 UTC m=+19.711385919" watchObservedRunningTime="2026-09-09 16:13:57.371057457 +0000 UTC m=+19.724787332"
Sep 09 16:13:57.371184 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:57.371148    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-6df6z" podStartSLOduration=19.371143647 podStartE2EDuration="19.371143647s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 16:13:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:13:57.370865739 +0000 UTC m=+19.724595575" watchObservedRunningTime="2026-09-09 16:13:57.371143647 +0000 UTC m=+19.724873480"
Sep 09 16:13:57.415136 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:57.415105    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-xfwg5" podStartSLOduration=2.947306842 podStartE2EDuration="19.415095119s" totalImagesPullingTime="16.467788277s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 16:13:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:13:57.392849382 +0000 UTC m=+19.746579223" watchObservedRunningTime="2026-09-09 16:13:57.415095119 +0000 UTC m=+19.768824950"
Sep 09 16:13:57.415209 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:57.415160    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-grl6q" podStartSLOduration=2.887065962 podStartE2EDuration="19.41515469s" totalImagesPullingTime="16.528088728s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 16:13:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:13:57.41462678 +0000 UTC m=+19.768356634" watchObservedRunningTime="2026-09-09 16:13:57.41515469 +0000 UTC m=+19.768884551"
Sep 09 16:13:57.803016 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:57.802979    2583 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 09 16:13:58.109426 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:58.109335    2583 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-09T16:13:57.80301235Z","UUID":"d9d8bea8-978d-474d-858e-a8c362959e19","Handler":null,"Name":"","Endpoint":""}
Sep 09 16:13:58.110733 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:58.110710    2583 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 09 16:13:58.110839 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:58.110744    2583 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 09 16:13:58.233460 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:58.233308    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vgwn2"
Sep 09 16:13:58.233571 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:13:58.233535    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vgwn2" podUID="f7554c3b-d296-4424-8822-a3e75a994efa"
Sep 09 16:13:58.308258 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:58.308235    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-44ltr" event={"ID":"1b4c0b53-fcf7-4082-924b-99445132777e","Type":"ContainerStarted","Data":"5a2c94fba82e3fc37ea9a88fe262b204e00cb72793f676641d3cfa9c5bdf5028"}
Sep 09 16:13:58.309571 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:58.309527    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-8nq9w" event={"ID":"00f043bd-266f-4a52-8b28-43c6704636d4","Type":"ContainerStarted","Data":"aaaf2b2e6618b289dd382ba74be26340e7bcb3a7e806bbbc51c1078982b50ed7"}
Sep 09 16:13:58.326669 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:58.326633    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-8nq9w" podStartSLOduration=4.395641302 podStartE2EDuration="20.326621319s" totalImagesPullingTime="15.930980017s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 16:13:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:13:58.326385322 +0000 UTC m=+20.680115153" watchObservedRunningTime="2026-09-09 16:13:58.326621319 +0000 UTC m=+20.680351150"
Sep 09 16:13:59.232620 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:59.232591    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmp4p"
Sep 09 16:13:59.232620 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:59.232610    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-stpmj"
Sep 09 16:13:59.232762 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:13:59.232684    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qmp4p" podUID="f8a2ea6e-22df-4b6d-b1b1-e554e877f94c"
Sep 09 16:13:59.232762 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:13:59.232738    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-stpmj" podUID="2e619341-a4d2-42fc-b5d9-e33ffeebd306"
Sep 09 16:13:59.314024 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:59.313946    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-44ltr" event={"ID":"1b4c0b53-fcf7-4082-924b-99445132777e","Type":"ContainerStarted","Data":"827637263a4974abcf4304ebe4c600626c6f1f8b18ab30201892c15d3b63a2ec"}
Sep 09 16:13:59.317716 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:59.317692    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8xkw6" event={"ID":"45de5b46-a121-43e3-b141-4de97a0ad121","Type":"ContainerStarted","Data":"7de19a96a6d93c1103ea7d18c711e4659e17bb4a6a5146abcfa6b3160c7d5507"}
Sep 09 16:13:59.333942 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:13:59.333901    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-44ltr" podStartSLOduration=3.193893087 podStartE2EDuration="21.333888761s" totalImagesPullingTime="18.139995674s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 16:13:38 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:13:59.331996434 +0000 UTC m=+21.685726283" watchObservedRunningTime="2026-09-09 16:13:59.333888761 +0000 UTC m=+21.687618592"
Sep 09 16:14:00.232813 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:00.232783    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vgwn2"
Sep 09 16:14:00.232971 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:14:00.232886    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vgwn2" podUID="f7554c3b-d296-4424-8822-a3e75a994efa"
Sep 09 16:14:00.298951 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:00.298924    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-867mp"
Sep 09 16:14:00.299504 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:00.299485    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-867mp"
Sep 09 16:14:00.320503 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:00.320479    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-867mp"
Sep 09 16:14:00.320854 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:00.320835    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-867mp"
Sep 09 16:14:01.232729 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:01.232700    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-stpmj"
Sep 09 16:14:01.232895 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:14:01.232800    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-stpmj" podUID="2e619341-a4d2-42fc-b5d9-e33ffeebd306"
Sep 09 16:14:01.232895 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:01.232853    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmp4p"
Sep 09 16:14:01.233001 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:14:01.232962    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qmp4p" podUID="f8a2ea6e-22df-4b6d-b1b1-e554e877f94c"
Sep 09 16:14:02.233055 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:02.232908    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vgwn2"
Sep 09 16:14:02.233407 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:14:02.233130    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vgwn2" podUID="f7554c3b-d296-4424-8822-a3e75a994efa"
Sep 09 16:14:02.325594 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:02.325566    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-djp68" event={"ID":"be6bb207-ddbb-459e-af6c-bc2500a92955","Type":"ContainerStarted","Data":"955ecfcfedb66691e9bfd38a5bb2cd62a0cd60b469877b4d6c8e35e944011f3a"}
Sep 09 16:14:02.331324 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:02.331300    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8xkw6" event={"ID":"45de5b46-a121-43e3-b141-4de97a0ad121","Type":"ContainerStarted","Data":"b9c19acdffa116ecb0c2986237ce3f2f5a7536a22a9cb49f91e6978fa77f5039"}
Sep 09 16:14:02.356305 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:02.356258    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-8xkw6" podStartSLOduration=8.253711799 podStartE2EDuration="24.356243817s" totalImagesPullingTime="16.102532018s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 16:13:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:14:02.355590382 +0000 UTC m=+24.709320214" watchObservedRunningTime="2026-09-09 16:14:02.356243817 +0000 UTC m=+24.709973648"
Sep 09 16:14:03.232978 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:03.232942    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmp4p"
Sep 09 16:14:03.233211 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:14:03.233084    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qmp4p" podUID="f8a2ea6e-22df-4b6d-b1b1-e554e877f94c"
Sep 09 16:14:03.233211 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:03.233141    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-stpmj"
Sep 09 16:14:03.233211 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:14:03.233196    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-stpmj" podUID="2e619341-a4d2-42fc-b5d9-e33ffeebd306"
Sep 09 16:14:03.334695 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:03.334664    2583 generic.go:356] "Generic (PLEG): container finished" podID="be6bb207-ddbb-459e-af6c-bc2500a92955" containerID="955ecfcfedb66691e9bfd38a5bb2cd62a0cd60b469877b4d6c8e35e944011f3a" exitCode=0
Sep 09 16:14:03.334847 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:03.334746    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-djp68" event={"ID":"be6bb207-ddbb-459e-af6c-bc2500a92955","Type":"ContainerDied","Data":"955ecfcfedb66691e9bfd38a5bb2cd62a0cd60b469877b4d6c8e35e944011f3a"}
Sep 09 16:14:03.335153 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:03.335119    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-8xkw6"
Sep 09 16:14:03.335278 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:03.335192    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-8xkw6"
Sep 09 16:14:03.335278 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:03.335225    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-8xkw6"
Sep 09 16:14:03.349660 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:03.349611    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-8xkw6"
Sep 09 16:14:03.353744 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:03.353726    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-8xkw6"
Sep 09 16:14:03.992024 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:03.991979    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-stpmj"]
Sep 09 16:14:03.992246 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:03.992144    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-stpmj"
Sep 09 16:14:03.992316 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:14:03.992264    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-stpmj" podUID="2e619341-a4d2-42fc-b5d9-e33ffeebd306"
Sep 09 16:14:03.995051 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:03.995024    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-vgwn2"]
Sep 09 16:14:03.995192 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:03.995122    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vgwn2"
Sep 09 16:14:03.995257 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:14:03.995201    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vgwn2" podUID="f7554c3b-d296-4424-8822-a3e75a994efa"
Sep 09 16:14:03.996198 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:03.996064    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-qmp4p"]
Sep 09 16:14:03.996358 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:03.996161    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmp4p"
Sep 09 16:14:03.996464 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:14:03.996438    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qmp4p" podUID="f8a2ea6e-22df-4b6d-b1b1-e554e877f94c"
Sep 09 16:14:04.338793 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:04.338764    2583 generic.go:356] "Generic (PLEG): container finished" podID="be6bb207-ddbb-459e-af6c-bc2500a92955" containerID="43f48cdd2f0f790ac83ac5fcc7f47ff1af6c927a2bdd4ae9365db675fa5b2510" exitCode=0
Sep 09 16:14:04.339256 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:04.338849    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-djp68" event={"ID":"be6bb207-ddbb-459e-af6c-bc2500a92955","Type":"ContainerDied","Data":"43f48cdd2f0f790ac83ac5fcc7f47ff1af6c927a2bdd4ae9365db675fa5b2510"}
Sep 09 16:14:06.232705 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:06.232548    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vgwn2"
Sep 09 16:14:06.233117 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:06.232548    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmp4p"
Sep 09 16:14:06.233117 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:14:06.232790    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vgwn2" podUID="f7554c3b-d296-4424-8822-a3e75a994efa"
Sep 09 16:14:06.233117 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:14:06.232891    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qmp4p" podUID="f8a2ea6e-22df-4b6d-b1b1-e554e877f94c"
Sep 09 16:14:06.233117 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:06.232603    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-stpmj"
Sep 09 16:14:06.233117 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:14:06.233024    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-stpmj" podUID="2e619341-a4d2-42fc-b5d9-e33ffeebd306"
Sep 09 16:14:06.346249 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:06.346187    2583 generic.go:356] "Generic (PLEG): container finished" podID="be6bb207-ddbb-459e-af6c-bc2500a92955" containerID="5dabd580088dc8902b67deddae83086c7de89ded2cabbb1a68f19e707798c677" exitCode=0
Sep 09 16:14:06.346364 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:06.346249    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-djp68" event={"ID":"be6bb207-ddbb-459e-af6c-bc2500a92955","Type":"ContainerDied","Data":"5dabd580088dc8902b67deddae83086c7de89ded2cabbb1a68f19e707798c677"}
Sep 09 16:14:08.233574 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:08.233543    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vgwn2"
Sep 09 16:14:08.233906 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:14:08.233634    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vgwn2" podUID="f7554c3b-d296-4424-8822-a3e75a994efa"
Sep 09 16:14:08.233906 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:08.233710    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmp4p"
Sep 09 16:14:08.233906 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:14:08.233794    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qmp4p" podUID="f8a2ea6e-22df-4b6d-b1b1-e554e877f94c"
Sep 09 16:14:08.233906 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:08.233826    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-stpmj"
Sep 09 16:14:08.233906 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:14:08.233884    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-stpmj" podUID="2e619341-a4d2-42fc-b5d9-e33ffeebd306"
Sep 09 16:14:09.404173 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:09.404144    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-48.ec2.internal" event="NodeReady"
Sep 09 16:14:09.404501 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:09.404269    2583 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 09 16:14:09.437813 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:09.437770    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-79977f9844-779cg"]
Sep 09 16:14:09.465413 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:09.465390    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-59fcb64bf-tzq28"]
Sep 09 16:14:09.465522 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:09.465489    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-79977f9844-779cg"
Sep 09 16:14:09.468331 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:09.468251    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Sep 09 16:14:09.468331 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:09.468308    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-mwg2z\""
Sep 09 16:14:09.468526 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:09.468508    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Sep 09 16:14:09.483175 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:09.483153    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-685456655f-lk5jk"]
Sep 09 16:14:09.483397 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:09.483374    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-59fcb64bf-tzq28"
Sep 09 16:14:09.485936 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:09.485918    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 09 16:14:09.486071 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:09.486052    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 09 16:14:09.486170 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:09.486151    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 09 16:14:09.486252 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:09.486177    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-8q4lv\""
Sep 09 16:14:09.491704 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:09.491684    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 09 16:14:09.498828 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:09.498809    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-79977f9844-779cg"]
Sep 09 16:14:09.498922 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:09.498846    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-685456655f-lk5jk"]
Sep 09 16:14:09.498922 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:09.498865    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-xzslz"]
Sep 09 16:14:09.498922 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:09.498916    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-685456655f-lk5jk"
Sep 09 16:14:09.501902 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:09.501886    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-9r4fk\""
Sep 09 16:14:09.502561 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:09.502540    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 09 16:14:09.502655 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:09.502542    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 09 16:14:09.516845 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:09.516777    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-n7vc2"]
Sep 09 16:14:09.516936 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:09.516837    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xzslz"
Sep 09 16:14:09.520078 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:09.519860    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-zjfwh\""
Sep 09 16:14:09.520078 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:09.519947    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 09 16:14:09.520078 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:09.520076    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 09 16:14:09.538802 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:09.538785    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-59fcb64bf-tzq28"]
Sep 09 16:14:09.538893 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:09.538819    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-xzslz"]
Sep 09 16:14:09.539127 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:09.539107    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-n7vc2"]
Sep 09 16:14:09.539258 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:09.539242    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-n7vc2"
Sep 09 16:14:09.542500 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:09.542479    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 09 16:14:09.542640 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:09.542479    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-vg786\""
Sep 09 16:14:09.542640 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:09.542558    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 09 16:14:09.542761 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:09.542562    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 09 16:14:09.595541 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:09.595516    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3b749ab0-b112-4083-8efc-6d45e9c5e6c2-config-volume\") pod \"dns-default-xzslz\" (UID: \"3b749ab0-b112-4083-8efc-6d45e9c5e6c2\") " pod="openshift-dns/dns-default-xzslz"
Sep 09 16:14:09.595665 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:09.595552    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3b749ab0-b112-4083-8efc-6d45e9c5e6c2-tmp-dir\") pod \"dns-default-xzslz\" (UID: \"3b749ab0-b112-4083-8efc-6d45e9c5e6c2\") " pod="openshift-dns/dns-default-xzslz"
Sep 09 16:14:09.595665 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:09.595579    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/c4338f01-9c80-4c3d-b2e1-187d647cb696-nginx-conf\") pod \"networking-console-plugin-79977f9844-779cg\" (UID: \"c4338f01-9c80-4c3d-b2e1-187d647cb696\") " pod="openshift-network-console/networking-console-plugin-79977f9844-779cg"
Sep 09 16:14:09.595665 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:09.595603    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f82110b1-4cd3-40e9-b412-ede8228aed4b-registry-tls\") pod \"image-registry-59fcb64bf-tzq28\" (UID: \"f82110b1-4cd3-40e9-b412-ede8228aed4b\") " pod="openshift-image-registry/image-registry-59fcb64bf-tzq28"
Sep 09 16:14:09.595665 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:09.595636    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f82110b1-4cd3-40e9-b412-ede8228aed4b-registry-certificates\") pod \"image-registry-59fcb64bf-tzq28\" (UID: \"f82110b1-4cd3-40e9-b412-ede8228aed4b\") " pod="openshift-image-registry/image-registry-59fcb64bf-tzq28"
Sep 09 16:14:09.595665 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:09.595662    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f82110b1-4cd3-40e9-b412-ede8228aed4b-bound-sa-token\") pod \"image-registry-59fcb64bf-tzq28\" (UID: \"f82110b1-4cd3-40e9-b412-ede8228aed4b\") " pod="openshift-image-registry/image-registry-59fcb64bf-tzq28"
Sep 09 16:14:09.595839 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:09.595690    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8nl69\" (UniqueName: \"kubernetes.io/projected/c72a79fa-90df-448d-9b09-23262729fa2e-kube-api-access-8nl69\") pod \"network-check-source-685456655f-lk5jk\" (UID: \"c72a79fa-90df-448d-9b09-23262729fa2e\") " pod="openshift-network-diagnostics/network-check-source-685456655f-lk5jk"
Sep 09 16:14:09.595839 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:09.595716    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f82110b1-4cd3-40e9-b412-ede8228aed4b-ca-trust-extracted\") pod \"image-registry-59fcb64bf-tzq28\" (UID: \"f82110b1-4cd3-40e9-b412-ede8228aed4b\") " pod="openshift-image-registry/image-registry-59fcb64bf-tzq28"
Sep 09 16:14:09.595839 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:09.595757    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f82110b1-4cd3-40e9-b412-ede8228aed4b-image-registry-private-configuration\") pod \"image-registry-59fcb64bf-tzq28\" (UID: \"f82110b1-4cd3-40e9-b412-ede8228aed4b\") " pod="openshift-image-registry/image-registry-59fcb64bf-tzq28"
Sep 09 16:14:09.595839 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:09.595776    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g8sjz\" (UniqueName: \"kubernetes.io/projected/f82110b1-4cd3-40e9-b412-ede8228aed4b-kube-api-access-g8sjz\") pod \"image-registry-59fcb64bf-tzq28\" (UID: \"f82110b1-4cd3-40e9-b412-ede8228aed4b\") " pod="openshift-image-registry/image-registry-59fcb64bf-tzq28"
Sep 09 16:14:09.595839 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:09.595794    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c4338f01-9c80-4c3d-b2e1-187d647cb696-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-779cg\" (UID: \"c4338f01-9c80-4c3d-b2e1-187d647cb696\") " pod="openshift-network-console/networking-console-plugin-79977f9844-779cg"
Sep 09 16:14:09.595839 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:09.595811    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3b749ab0-b112-4083-8efc-6d45e9c5e6c2-metrics-tls\") pod \"dns-default-xzslz\" (UID: \"3b749ab0-b112-4083-8efc-6d45e9c5e6c2\") " pod="openshift-dns/dns-default-xzslz"
Sep 09 16:14:09.595839 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:09.595824    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f82110b1-4cd3-40e9-b412-ede8228aed4b-trusted-ca\") pod \"image-registry-59fcb64bf-tzq28\" (UID: \"f82110b1-4cd3-40e9-b412-ede8228aed4b\") " pod="openshift-image-registry/image-registry-59fcb64bf-tzq28"
Sep 09 16:14:09.596055 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:09.595852    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vd76z\" (UniqueName: \"kubernetes.io/projected/3b749ab0-b112-4083-8efc-6d45e9c5e6c2-kube-api-access-vd76z\") pod \"dns-default-xzslz\" (UID: \"3b749ab0-b112-4083-8efc-6d45e9c5e6c2\") " pod="openshift-dns/dns-default-xzslz"
Sep 09 16:14:09.596055 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:09.595869    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f82110b1-4cd3-40e9-b412-ede8228aed4b-installation-pull-secrets\") pod \"image-registry-59fcb64bf-tzq28\" (UID: \"f82110b1-4cd3-40e9-b412-ede8228aed4b\") " pod="openshift-image-registry/image-registry-59fcb64bf-tzq28"
Sep 09 16:14:09.612023 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:09.611994    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:14:09.696736 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:09.696681    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f82110b1-4cd3-40e9-b412-ede8228aed4b-installation-pull-secrets\") pod \"image-registry-59fcb64bf-tzq28\" (UID: \"f82110b1-4cd3-40e9-b412-ede8228aed4b\") " pod="openshift-image-registry/image-registry-59fcb64bf-tzq28"
Sep 09 16:14:09.696836 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:09.696795    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3b749ab0-b112-4083-8efc-6d45e9c5e6c2-config-volume\") pod \"dns-default-xzslz\" (UID: \"3b749ab0-b112-4083-8efc-6d45e9c5e6c2\") " pod="openshift-dns/dns-default-xzslz"
Sep 09 16:14:09.696836 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:09.696815    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3b749ab0-b112-4083-8efc-6d45e9c5e6c2-tmp-dir\") pod \"dns-default-xzslz\" (UID: \"3b749ab0-b112-4083-8efc-6d45e9c5e6c2\") " pod="openshift-dns/dns-default-xzslz"
Sep 09 16:14:09.696932 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:09.696841    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/c4338f01-9c80-4c3d-b2e1-187d647cb696-nginx-conf\") pod \"networking-console-plugin-79977f9844-779cg\" (UID: \"c4338f01-9c80-4c3d-b2e1-187d647cb696\") " pod="openshift-network-console/networking-console-plugin-79977f9844-779cg"
Sep 09 16:14:09.696932 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:09.696887    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f82110b1-4cd3-40e9-b412-ede8228aed4b-registry-tls\") pod \"image-registry-59fcb64bf-tzq28\" (UID: \"f82110b1-4cd3-40e9-b412-ede8228aed4b\") " pod="openshift-image-registry/image-registry-59fcb64bf-tzq28"
Sep 09 16:14:09.697052 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:09.696932    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f82110b1-4cd3-40e9-b412-ede8228aed4b-registry-certificates\") pod \"image-registry-59fcb64bf-tzq28\" (UID: \"f82110b1-4cd3-40e9-b412-ede8228aed4b\") " pod="openshift-image-registry/image-registry-59fcb64bf-tzq28"
Sep 09 16:14:09.697052 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:09.696957    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f82110b1-4cd3-40e9-b412-ede8228aed4b-bound-sa-token\") pod \"image-registry-59fcb64bf-tzq28\" (UID: \"f82110b1-4cd3-40e9-b412-ede8228aed4b\") " pod="openshift-image-registry/image-registry-59fcb64bf-tzq28"
Sep 09 16:14:09.697052 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:09.696995    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8nl69\" (UniqueName: \"kubernetes.io/projected/c72a79fa-90df-448d-9b09-23262729fa2e-kube-api-access-8nl69\") pod \"network-check-source-685456655f-lk5jk\" (UID: \"c72a79fa-90df-448d-9b09-23262729fa2e\") " pod="openshift-network-diagnostics/network-check-source-685456655f-lk5jk"
Sep 09 16:14:09.697052 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:09.697017    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f82110b1-4cd3-40e9-b412-ede8228aed4b-ca-trust-extracted\") pod \"image-registry-59fcb64bf-tzq28\" (UID: \"f82110b1-4cd3-40e9-b412-ede8228aed4b\") " pod="openshift-image-registry/image-registry-59fcb64bf-tzq28"
Sep 09 16:14:09.697215 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:14:09.697075    2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 09 16:14:09.697215 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:14:09.697093    2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-59fcb64bf-tzq28: secret "image-registry-tls" not found
Sep 09 16:14:09.697215 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:14:09.697153    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f82110b1-4cd3-40e9-b412-ede8228aed4b-registry-tls podName:f82110b1-4cd3-40e9-b412-ede8228aed4b nodeName:}" failed. No retries permitted until 2026-09-09 16:14:10.197133784 +0000 UTC m=+32.550863608 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f82110b1-4cd3-40e9-b412-ede8228aed4b-registry-tls") pod "image-registry-59fcb64bf-tzq28" (UID: "f82110b1-4cd3-40e9-b412-ede8228aed4b") : secret "image-registry-tls" not found
Sep 09 16:14:09.697441 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:09.697410    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f82110b1-4cd3-40e9-b412-ede8228aed4b-ca-trust-extracted\") pod \"image-registry-59fcb64bf-tzq28\" (UID: \"f82110b1-4cd3-40e9-b412-ede8228aed4b\") " pod="openshift-image-registry/image-registry-59fcb64bf-tzq28"
Sep 09 16:14:09.697531 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:09.697482    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dg9br\" (UniqueName: \"kubernetes.io/projected/b16dca46-9632-4408-9ae4-320cc254b225-kube-api-access-dg9br\") pod \"ingress-canary-n7vc2\" (UID: \"b16dca46-9632-4408-9ae4-320cc254b225\") " pod="openshift-ingress-canary/ingress-canary-n7vc2"
Sep 09 16:14:09.697594 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:09.697534    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f82110b1-4cd3-40e9-b412-ede8228aed4b-image-registry-private-configuration\") pod \"image-registry-59fcb64bf-tzq28\" (UID: \"f82110b1-4cd3-40e9-b412-ede8228aed4b\") " pod="openshift-image-registry/image-registry-59fcb64bf-tzq28"
Sep 09 16:14:09.697594 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:09.697562    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g8sjz\" (UniqueName: \"kubernetes.io/projected/f82110b1-4cd3-40e9-b412-ede8228aed4b-kube-api-access-g8sjz\") pod \"image-registry-59fcb64bf-tzq28\" (UID: \"f82110b1-4cd3-40e9-b412-ede8228aed4b\") " pod="openshift-image-registry/image-registry-59fcb64bf-tzq28"
Sep 09 16:14:09.697690 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:09.697594    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c4338f01-9c80-4c3d-b2e1-187d647cb696-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-779cg\" (UID: \"c4338f01-9c80-4c3d-b2e1-187d647cb696\") " pod="openshift-network-console/networking-console-plugin-79977f9844-779cg"
Sep 09 16:14:09.697690 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:09.697597    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/c4338f01-9c80-4c3d-b2e1-187d647cb696-nginx-conf\") pod \"networking-console-plugin-79977f9844-779cg\" (UID: \"c4338f01-9c80-4c3d-b2e1-187d647cb696\") " pod="openshift-network-console/networking-console-plugin-79977f9844-779cg"
Sep 09 16:14:09.697690 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:09.697622    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3b749ab0-b112-4083-8efc-6d45e9c5e6c2-metrics-tls\") pod \"dns-default-xzslz\" (UID: \"3b749ab0-b112-4083-8efc-6d45e9c5e6c2\") " pod="openshift-dns/dns-default-xzslz"
Sep 09 16:14:09.697690 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:09.697649    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f82110b1-4cd3-40e9-b412-ede8228aed4b-trusted-ca\") pod \"image-registry-59fcb64bf-tzq28\" (UID: \"f82110b1-4cd3-40e9-b412-ede8228aed4b\") " pod="openshift-image-registry/image-registry-59fcb64bf-tzq28"
Sep 09 16:14:09.697690 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:09.697675    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b16dca46-9632-4408-9ae4-320cc254b225-cert\") pod \"ingress-canary-n7vc2\" (UID: \"b16dca46-9632-4408-9ae4-320cc254b225\") " pod="openshift-ingress-canary/ingress-canary-n7vc2"
Sep 09 16:14:09.697905 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:09.697724    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vd76z\" (UniqueName: \"kubernetes.io/projected/3b749ab0-b112-4083-8efc-6d45e9c5e6c2-kube-api-access-vd76z\") pod \"dns-default-xzslz\" (UID: \"3b749ab0-b112-4083-8efc-6d45e9c5e6c2\") " pod="openshift-dns/dns-default-xzslz"
Sep 09 16:14:09.697905 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:09.697777    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f82110b1-4cd3-40e9-b412-ede8228aed4b-registry-certificates\") pod \"image-registry-59fcb64bf-tzq28\" (UID: \"f82110b1-4cd3-40e9-b412-ede8228aed4b\") " pod="openshift-image-registry/image-registry-59fcb64bf-tzq28"
Sep 09 16:14:09.697905 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:14:09.697873    2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 09 16:14:09.698061 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:09.697900    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:14:09.698061 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:14:09.697926    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b749ab0-b112-4083-8efc-6d45e9c5e6c2-metrics-tls podName:3b749ab0-b112-4083-8efc-6d45e9c5e6c2 nodeName:}" failed. No retries permitted until 2026-09-09 16:14:10.197901492 +0000 UTC m=+32.551631319 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3b749ab0-b112-4083-8efc-6d45e9c5e6c2-metrics-tls") pod "dns-default-xzslz" (UID: "3b749ab0-b112-4083-8efc-6d45e9c5e6c2") : secret "dns-default-metrics-tls" not found
Sep 09 16:14:09.698061 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:14:09.697970    2583 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 09 16:14:09.698061 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:14:09.698054    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c4338f01-9c80-4c3d-b2e1-187d647cb696-networking-console-plugin-cert podName:c4338f01-9c80-4c3d-b2e1-187d647cb696 nodeName:}" failed. No retries permitted until 2026-09-09 16:14:10.198035906 +0000 UTC m=+32.551765727 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c4338f01-9c80-4c3d-b2e1-187d647cb696-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-779cg" (UID: "c4338f01-9c80-4c3d-b2e1-187d647cb696") : secret "networking-console-plugin-cert" not found
Sep 09 16:14:09.698777 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:09.698756    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f82110b1-4cd3-40e9-b412-ede8228aed4b-trusted-ca\") pod \"image-registry-59fcb64bf-tzq28\" (UID: \"f82110b1-4cd3-40e9-b412-ede8228aed4b\") " pod="openshift-image-registry/image-registry-59fcb64bf-tzq28"
Sep 09 16:14:09.701816 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:09.701796    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f82110b1-4cd3-40e9-b412-ede8228aed4b-installation-pull-secrets\") pod \"image-registry-59fcb64bf-tzq28\" (UID: \"f82110b1-4cd3-40e9-b412-ede8228aed4b\") " pod="openshift-image-registry/image-registry-59fcb64bf-tzq28"
Sep 09 16:14:09.701894 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:09.701796    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f82110b1-4cd3-40e9-b412-ede8228aed4b-image-registry-private-configuration\") pod \"image-registry-59fcb64bf-tzq28\" (UID: \"f82110b1-4cd3-40e9-b412-ede8228aed4b\") " pod="openshift-image-registry/image-registry-59fcb64bf-tzq28"
Sep 09 16:14:09.705286 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:09.705265    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3b749ab0-b112-4083-8efc-6d45e9c5e6c2-tmp-dir\") pod \"dns-default-xzslz\" (UID: \"3b749ab0-b112-4083-8efc-6d45e9c5e6c2\") " pod="openshift-dns/dns-default-xzslz"
Sep 09 16:14:09.705651 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:09.705628    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3b749ab0-b112-4083-8efc-6d45e9c5e6c2-config-volume\") pod \"dns-default-xzslz\" (UID: \"3b749ab0-b112-4083-8efc-6d45e9c5e6c2\") " pod="openshift-dns/dns-default-xzslz"
Sep 09 16:14:09.707870 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:09.707835    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f82110b1-4cd3-40e9-b412-ede8228aed4b-bound-sa-token\") pod \"image-registry-59fcb64bf-tzq28\" (UID: \"f82110b1-4cd3-40e9-b412-ede8228aed4b\") " pod="openshift-image-registry/image-registry-59fcb64bf-tzq28"
Sep 09 16:14:09.708263 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:09.708237    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g8sjz\" (UniqueName: \"kubernetes.io/projected/f82110b1-4cd3-40e9-b412-ede8228aed4b-kube-api-access-g8sjz\") pod \"image-registry-59fcb64bf-tzq28\" (UID: \"f82110b1-4cd3-40e9-b412-ede8228aed4b\") " pod="openshift-image-registry/image-registry-59fcb64bf-tzq28"
Sep 09 16:14:09.708391 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:09.708371    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8nl69\" (UniqueName: \"kubernetes.io/projected/c72a79fa-90df-448d-9b09-23262729fa2e-kube-api-access-8nl69\") pod \"network-check-source-685456655f-lk5jk\" (UID: \"c72a79fa-90df-448d-9b09-23262729fa2e\") " pod="openshift-network-diagnostics/network-check-source-685456655f-lk5jk"
Sep 09 16:14:09.709029 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:09.708976    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vd76z\" (UniqueName: \"kubernetes.io/projected/3b749ab0-b112-4083-8efc-6d45e9c5e6c2-kube-api-access-vd76z\") pod \"dns-default-xzslz\" (UID: \"3b749ab0-b112-4083-8efc-6d45e9c5e6c2\") " pod="openshift-dns/dns-default-xzslz"
Sep 09 16:14:09.798572 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:09.798548    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dg9br\" (UniqueName: \"kubernetes.io/projected/b16dca46-9632-4408-9ae4-320cc254b225-kube-api-access-dg9br\") pod \"ingress-canary-n7vc2\" (UID: \"b16dca46-9632-4408-9ae4-320cc254b225\") " pod="openshift-ingress-canary/ingress-canary-n7vc2"
Sep 09 16:14:09.798685 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:09.798600    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b16dca46-9632-4408-9ae4-320cc254b225-cert\") pod \"ingress-canary-n7vc2\" (UID: \"b16dca46-9632-4408-9ae4-320cc254b225\") " pod="openshift-ingress-canary/ingress-canary-n7vc2"
Sep 09 16:14:09.800812 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:09.800793    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b16dca46-9632-4408-9ae4-320cc254b225-cert\") pod \"ingress-canary-n7vc2\" (UID: \"b16dca46-9632-4408-9ae4-320cc254b225\") " pod="openshift-ingress-canary/ingress-canary-n7vc2"
Sep 09 16:14:09.806814 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:09.806790    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dg9br\" (UniqueName: \"kubernetes.io/projected/b16dca46-9632-4408-9ae4-320cc254b225-kube-api-access-dg9br\") pod \"ingress-canary-n7vc2\" (UID: \"b16dca46-9632-4408-9ae4-320cc254b225\") " pod="openshift-ingress-canary/ingress-canary-n7vc2"
Sep 09 16:14:09.807513 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:09.807492    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-685456655f-lk5jk"
Sep 09 16:14:09.850593 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:09.850572    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-n7vc2"
Sep 09 16:14:10.201806 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:10.201770    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f82110b1-4cd3-40e9-b412-ede8228aed4b-registry-tls\") pod \"image-registry-59fcb64bf-tzq28\" (UID: \"f82110b1-4cd3-40e9-b412-ede8228aed4b\") " pod="openshift-image-registry/image-registry-59fcb64bf-tzq28"
Sep 09 16:14:10.202096 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:10.201841    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c4338f01-9c80-4c3d-b2e1-187d647cb696-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-779cg\" (UID: \"c4338f01-9c80-4c3d-b2e1-187d647cb696\") " pod="openshift-network-console/networking-console-plugin-79977f9844-779cg"
Sep 09 16:14:10.202096 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:10.201868    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3b749ab0-b112-4083-8efc-6d45e9c5e6c2-metrics-tls\") pod \"dns-default-xzslz\" (UID: \"3b749ab0-b112-4083-8efc-6d45e9c5e6c2\") " pod="openshift-dns/dns-default-xzslz"
Sep 09 16:14:10.202096 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:14:10.201939    2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 09 16:14:10.202096 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:14:10.201961    2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-59fcb64bf-tzq28: secret "image-registry-tls" not found
Sep 09 16:14:10.202096 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:14:10.202000    2583 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 09 16:14:10.202096 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:14:10.202014    2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 09 16:14:10.202096 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:14:10.202040    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f82110b1-4cd3-40e9-b412-ede8228aed4b-registry-tls podName:f82110b1-4cd3-40e9-b412-ede8228aed4b nodeName:}" failed. No retries permitted until 2026-09-09 16:14:11.202021442 +0000 UTC m=+33.555751268 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f82110b1-4cd3-40e9-b412-ede8228aed4b-registry-tls") pod "image-registry-59fcb64bf-tzq28" (UID: "f82110b1-4cd3-40e9-b412-ede8228aed4b") : secret "image-registry-tls" not found
Sep 09 16:14:10.202096 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:14:10.202063    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b749ab0-b112-4083-8efc-6d45e9c5e6c2-metrics-tls podName:3b749ab0-b112-4083-8efc-6d45e9c5e6c2 nodeName:}" failed. No retries permitted until 2026-09-09 16:14:11.202047449 +0000 UTC m=+33.555777314 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3b749ab0-b112-4083-8efc-6d45e9c5e6c2-metrics-tls") pod "dns-default-xzslz" (UID: "3b749ab0-b112-4083-8efc-6d45e9c5e6c2") : secret "dns-default-metrics-tls" not found
Sep 09 16:14:10.202096 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:14:10.202078    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c4338f01-9c80-4c3d-b2e1-187d647cb696-networking-console-plugin-cert podName:c4338f01-9c80-4c3d-b2e1-187d647cb696 nodeName:}" failed. No retries permitted until 2026-09-09 16:14:11.202071991 +0000 UTC m=+33.555801801 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c4338f01-9c80-4c3d-b2e1-187d647cb696-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-779cg" (UID: "c4338f01-9c80-4c3d-b2e1-187d647cb696") : secret "networking-console-plugin-cert" not found
Sep 09 16:14:10.232513 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:10.232491    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmp4p"
Sep 09 16:14:10.232634 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:10.232491    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-stpmj"
Sep 09 16:14:10.232634 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:10.232619    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vgwn2"
Sep 09 16:14:10.235030 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:10.235009    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 09 16:14:10.235133 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:10.235121    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 09 16:14:10.235222 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:10.235191    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-7wfvc\""
Sep 09 16:14:10.235459 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:10.235441    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-cjzmn\""
Sep 09 16:14:10.906223 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:10.906196    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2e619341-a4d2-42fc-b5d9-e33ffeebd306-original-pull-secret\") pod \"global-pull-secret-syncer-stpmj\" (UID: \"2e619341-a4d2-42fc-b5d9-e33ffeebd306\") " pod="kube-system/global-pull-secret-syncer-stpmj"
Sep 09 16:14:10.906590 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:10.906263    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f8a2ea6e-22df-4b6d-b1b1-e554e877f94c-metrics-certs\") pod \"network-metrics-daemon-qmp4p\" (UID: \"f8a2ea6e-22df-4b6d-b1b1-e554e877f94c\") " pod="openshift-multus/network-metrics-daemon-qmp4p"
Sep 09 16:14:10.906590 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:14:10.906409    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 09 16:14:10.906590 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:14:10.906482    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8a2ea6e-22df-4b6d-b1b1-e554e877f94c-metrics-certs podName:f8a2ea6e-22df-4b6d-b1b1-e554e877f94c nodeName:}" failed. No retries permitted until 2026-09-09 16:14:42.9064607 +0000 UTC m=+65.260190529 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f8a2ea6e-22df-4b6d-b1b1-e554e877f94c-metrics-certs") pod "network-metrics-daemon-qmp4p" (UID: "f8a2ea6e-22df-4b6d-b1b1-e554e877f94c") : secret "metrics-daemon-secret" not found
Sep 09 16:14:10.908570 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:10.908543    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2e619341-a4d2-42fc-b5d9-e33ffeebd306-original-pull-secret\") pod \"global-pull-secret-syncer-stpmj\" (UID: \"2e619341-a4d2-42fc-b5d9-e33ffeebd306\") " pod="kube-system/global-pull-secret-syncer-stpmj"
Sep 09 16:14:11.006704 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:11.006667    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g7jh9\" (UniqueName: \"kubernetes.io/projected/f7554c3b-d296-4424-8822-a3e75a994efa-kube-api-access-g7jh9\") pod \"network-check-target-vgwn2\" (UID: \"f7554c3b-d296-4424-8822-a3e75a994efa\") " pod="openshift-network-diagnostics/network-check-target-vgwn2"
Sep 09 16:14:11.009431 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:11.009303    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g7jh9\" (UniqueName: \"kubernetes.io/projected/f7554c3b-d296-4424-8822-a3e75a994efa-kube-api-access-g7jh9\") pod \"network-check-target-vgwn2\" (UID: \"f7554c3b-d296-4424-8822-a3e75a994efa\") " pod="openshift-network-diagnostics/network-check-target-vgwn2"
Sep 09 16:14:11.149028 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:11.148970    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-stpmj"
Sep 09 16:14:11.154126 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:11.154109    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vgwn2"
Sep 09 16:14:11.180545 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:11.180519    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-n7vc2"]
Sep 09 16:14:11.181136 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:11.181118    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-685456655f-lk5jk"]
Sep 09 16:14:11.196124 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:14:11.196106    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc72a79fa_90df_448d_9b09_23262729fa2e.slice/crio-8d910952ed6a19016b75d5e9e499593456b800fc9612f190a6aae19bc4f2aa70 WatchSource:0}: Error finding container 8d910952ed6a19016b75d5e9e499593456b800fc9612f190a6aae19bc4f2aa70: Status 404 returned error can't find the container with id 8d910952ed6a19016b75d5e9e499593456b800fc9612f190a6aae19bc4f2aa70
Sep 09 16:14:11.196502 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:14:11.196478    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb16dca46_9632_4408_9ae4_320cc254b225.slice/crio-f08d6dd747983f776dce6ba86c04cfe5fccfa6335dfb42668630778da1101cf4 WatchSource:0}: Error finding container f08d6dd747983f776dce6ba86c04cfe5fccfa6335dfb42668630778da1101cf4: Status 404 returned error can't find the container with id f08d6dd747983f776dce6ba86c04cfe5fccfa6335dfb42668630778da1101cf4
Sep 09 16:14:11.208856 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:11.208834    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f82110b1-4cd3-40e9-b412-ede8228aed4b-registry-tls\") pod \"image-registry-59fcb64bf-tzq28\" (UID: \"f82110b1-4cd3-40e9-b412-ede8228aed4b\") " pod="openshift-image-registry/image-registry-59fcb64bf-tzq28"
Sep 09 16:14:11.208935 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:11.208885    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c4338f01-9c80-4c3d-b2e1-187d647cb696-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-779cg\" (UID: \"c4338f01-9c80-4c3d-b2e1-187d647cb696\") " pod="openshift-network-console/networking-console-plugin-79977f9844-779cg"
Sep 09 16:14:11.208935 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:11.208915    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3b749ab0-b112-4083-8efc-6d45e9c5e6c2-metrics-tls\") pod \"dns-default-xzslz\" (UID: \"3b749ab0-b112-4083-8efc-6d45e9c5e6c2\") " pod="openshift-dns/dns-default-xzslz"
Sep 09 16:14:11.209068 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:14:11.208968    2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 09 16:14:11.209068 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:14:11.208997    2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-59fcb64bf-tzq28: secret "image-registry-tls" not found
Sep 09 16:14:11.209068 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:14:11.209036    2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 09 16:14:11.209068 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:14:11.209043    2583 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 09 16:14:11.209068 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:14:11.209055    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f82110b1-4cd3-40e9-b412-ede8228aed4b-registry-tls podName:f82110b1-4cd3-40e9-b412-ede8228aed4b nodeName:}" failed. No retries permitted until 2026-09-09 16:14:13.209036235 +0000 UTC m=+35.562766064 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f82110b1-4cd3-40e9-b412-ede8228aed4b-registry-tls") pod "image-registry-59fcb64bf-tzq28" (UID: "f82110b1-4cd3-40e9-b412-ede8228aed4b") : secret "image-registry-tls" not found
Sep 09 16:14:11.209240 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:14:11.209080    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c4338f01-9c80-4c3d-b2e1-187d647cb696-networking-console-plugin-cert podName:c4338f01-9c80-4c3d-b2e1-187d647cb696 nodeName:}" failed. No retries permitted until 2026-09-09 16:14:13.209070122 +0000 UTC m=+35.562799946 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c4338f01-9c80-4c3d-b2e1-187d647cb696-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-779cg" (UID: "c4338f01-9c80-4c3d-b2e1-187d647cb696") : secret "networking-console-plugin-cert" not found
Sep 09 16:14:11.209240 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:14:11.209093    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b749ab0-b112-4083-8efc-6d45e9c5e6c2-metrics-tls podName:3b749ab0-b112-4083-8efc-6d45e9c5e6c2 nodeName:}" failed. No retries permitted until 2026-09-09 16:14:13.20908659 +0000 UTC m=+35.562816402 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3b749ab0-b112-4083-8efc-6d45e9c5e6c2-metrics-tls") pod "dns-default-xzslz" (UID: "3b749ab0-b112-4083-8efc-6d45e9c5e6c2") : secret "dns-default-metrics-tls" not found
Sep 09 16:14:11.358031 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:11.358009    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-685456655f-lk5jk" event={"ID":"c72a79fa-90df-448d-9b09-23262729fa2e","Type":"ContainerStarted","Data":"8d910952ed6a19016b75d5e9e499593456b800fc9612f190a6aae19bc4f2aa70"}
Sep 09 16:14:11.359003 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:11.358971    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-n7vc2" event={"ID":"b16dca46-9632-4408-9ae4-320cc254b225","Type":"ContainerStarted","Data":"f08d6dd747983f776dce6ba86c04cfe5fccfa6335dfb42668630778da1101cf4"}
Sep 09 16:14:11.488627 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:11.488603    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-vgwn2"]
Sep 09 16:14:11.491401 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:11.491376    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-stpmj"]
Sep 09 16:14:11.527843 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:14:11.527784    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7554c3b_d296_4424_8822_a3e75a994efa.slice/crio-2137722f2ccd5866774e70920cc3da87482bfd034064fce91dcdb6c865d549ce WatchSource:0}: Error finding container 2137722f2ccd5866774e70920cc3da87482bfd034064fce91dcdb6c865d549ce: Status 404 returned error can't find the container with id 2137722f2ccd5866774e70920cc3da87482bfd034064fce91dcdb6c865d549ce
Sep 09 16:14:11.528031 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:14:11.528017    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e619341_a4d2_42fc_b5d9_e33ffeebd306.slice/crio-4dc6b5ff00eb776a4c666358c29946fb033eb01edd113c22e2be3902949fa845 WatchSource:0}: Error finding container 4dc6b5ff00eb776a4c666358c29946fb033eb01edd113c22e2be3902949fa845: Status 404 returned error can't find the container with id 4dc6b5ff00eb776a4c666358c29946fb033eb01edd113c22e2be3902949fa845
Sep 09 16:14:12.112051 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:12.112023    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:14:12.217178 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:12.217133    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:14:12.366703 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:12.366558    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-vgwn2" event={"ID":"f7554c3b-d296-4424-8822-a3e75a994efa","Type":"ContainerStarted","Data":"2137722f2ccd5866774e70920cc3da87482bfd034064fce91dcdb6c865d549ce"}
Sep 09 16:14:12.368279 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:12.368248    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-stpmj" event={"ID":"2e619341-a4d2-42fc-b5d9-e33ffeebd306","Type":"ContainerStarted","Data":"4dc6b5ff00eb776a4c666358c29946fb033eb01edd113c22e2be3902949fa845"}
Sep 09 16:14:12.371937 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:12.371861    2583 generic.go:356] "Generic (PLEG): container finished" podID="be6bb207-ddbb-459e-af6c-bc2500a92955" containerID="339b727bb985dbbc5b60e9fa4f51d6fab142dd97a124149c662ee12b47a0c297" exitCode=0
Sep 09 16:14:12.371937 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:12.371897    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-djp68" event={"ID":"be6bb207-ddbb-459e-af6c-bc2500a92955","Type":"ContainerDied","Data":"339b727bb985dbbc5b60e9fa4f51d6fab142dd97a124149c662ee12b47a0c297"}
Sep 09 16:14:13.223553 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:13.223270    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f82110b1-4cd3-40e9-b412-ede8228aed4b-registry-tls\") pod \"image-registry-59fcb64bf-tzq28\" (UID: \"f82110b1-4cd3-40e9-b412-ede8228aed4b\") " pod="openshift-image-registry/image-registry-59fcb64bf-tzq28"
Sep 09 16:14:13.223553 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:13.223331    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c4338f01-9c80-4c3d-b2e1-187d647cb696-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-779cg\" (UID: \"c4338f01-9c80-4c3d-b2e1-187d647cb696\") " pod="openshift-network-console/networking-console-plugin-79977f9844-779cg"
Sep 09 16:14:13.223553 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:13.223361    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3b749ab0-b112-4083-8efc-6d45e9c5e6c2-metrics-tls\") pod \"dns-default-xzslz\" (UID: \"3b749ab0-b112-4083-8efc-6d45e9c5e6c2\") " pod="openshift-dns/dns-default-xzslz"
Sep 09 16:14:13.223553 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:14:13.223422    2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 09 16:14:13.223553 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:14:13.223438    2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-59fcb64bf-tzq28: secret "image-registry-tls" not found
Sep 09 16:14:13.223553 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:14:13.223474    2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 09 16:14:13.223553 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:14:13.223498    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f82110b1-4cd3-40e9-b412-ede8228aed4b-registry-tls podName:f82110b1-4cd3-40e9-b412-ede8228aed4b nodeName:}" failed. No retries permitted until 2026-09-09 16:14:17.223478684 +0000 UTC m=+39.577208508 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f82110b1-4cd3-40e9-b412-ede8228aed4b-registry-tls") pod "image-registry-59fcb64bf-tzq28" (UID: "f82110b1-4cd3-40e9-b412-ede8228aed4b") : secret "image-registry-tls" not found
Sep 09 16:14:13.223553 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:14:13.223505    2583 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 09 16:14:13.223553 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:14:13.223514    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b749ab0-b112-4083-8efc-6d45e9c5e6c2-metrics-tls podName:3b749ab0-b112-4083-8efc-6d45e9c5e6c2 nodeName:}" failed. No retries permitted until 2026-09-09 16:14:17.223506261 +0000 UTC m=+39.577236071 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3b749ab0-b112-4083-8efc-6d45e9c5e6c2-metrics-tls") pod "dns-default-xzslz" (UID: "3b749ab0-b112-4083-8efc-6d45e9c5e6c2") : secret "dns-default-metrics-tls" not found
Sep 09 16:14:13.224449 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:14:13.223590    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c4338f01-9c80-4c3d-b2e1-187d647cb696-networking-console-plugin-cert podName:c4338f01-9c80-4c3d-b2e1-187d647cb696 nodeName:}" failed. No retries permitted until 2026-09-09 16:14:17.223570885 +0000 UTC m=+39.577300700 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c4338f01-9c80-4c3d-b2e1-187d647cb696-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-779cg" (UID: "c4338f01-9c80-4c3d-b2e1-187d647cb696") : secret "networking-console-plugin-cert" not found
Sep 09 16:14:13.379876 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:13.379841    2583 generic.go:356] "Generic (PLEG): container finished" podID="be6bb207-ddbb-459e-af6c-bc2500a92955" containerID="8b457871774f976f2486dbb3e69e75569f15a29a4599fe0241591b0f72d3f54c" exitCode=0
Sep 09 16:14:13.380034 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:13.379919    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-djp68" event={"ID":"be6bb207-ddbb-459e-af6c-bc2500a92955","Type":"ContainerDied","Data":"8b457871774f976f2486dbb3e69e75569f15a29a4599fe0241591b0f72d3f54c"}
Sep 09 16:14:15.041434 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:15.041389    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:14:15.141097 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:15.141059    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:14:15.919215 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:15.919180    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:14:16.021275 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:16.021232    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:14:16.122740 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:16.122706    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:14:16.958659 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:16.958594    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:14:17.060830 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:17.060680    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:14:17.257511 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:17.257490    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f82110b1-4cd3-40e9-b412-ede8228aed4b-registry-tls\") pod \"image-registry-59fcb64bf-tzq28\" (UID: \"f82110b1-4cd3-40e9-b412-ede8228aed4b\") " pod="openshift-image-registry/image-registry-59fcb64bf-tzq28"
Sep 09 16:14:17.257814 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:17.257543    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c4338f01-9c80-4c3d-b2e1-187d647cb696-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-779cg\" (UID: \"c4338f01-9c80-4c3d-b2e1-187d647cb696\") " pod="openshift-network-console/networking-console-plugin-79977f9844-779cg"
Sep 09 16:14:17.257814 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:17.257574    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3b749ab0-b112-4083-8efc-6d45e9c5e6c2-metrics-tls\") pod \"dns-default-xzslz\" (UID: \"3b749ab0-b112-4083-8efc-6d45e9c5e6c2\") " pod="openshift-dns/dns-default-xzslz"
Sep 09 16:14:17.257814 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:14:17.257680    2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 09 16:14:17.257814 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:14:17.257704    2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-59fcb64bf-tzq28: secret "image-registry-tls" not found
Sep 09 16:14:17.257814 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:14:17.257733    2583 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 09 16:14:17.257814 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:14:17.257792    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c4338f01-9c80-4c3d-b2e1-187d647cb696-networking-console-plugin-cert podName:c4338f01-9c80-4c3d-b2e1-187d647cb696 nodeName:}" failed. No retries permitted until 2026-09-09 16:14:25.257771753 +0000 UTC m=+47.611501566 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c4338f01-9c80-4c3d-b2e1-187d647cb696-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-779cg" (UID: "c4338f01-9c80-4c3d-b2e1-187d647cb696") : secret "networking-console-plugin-cert" not found
Sep 09 16:14:17.257814 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:14:17.257812    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f82110b1-4cd3-40e9-b412-ede8228aed4b-registry-tls podName:f82110b1-4cd3-40e9-b412-ede8228aed4b nodeName:}" failed. No retries permitted until 2026-09-09 16:14:25.257801299 +0000 UTC m=+47.611531114 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f82110b1-4cd3-40e9-b412-ede8228aed4b-registry-tls") pod "image-registry-59fcb64bf-tzq28" (UID: "f82110b1-4cd3-40e9-b412-ede8228aed4b") : secret "image-registry-tls" not found
Sep 09 16:14:17.258050 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:14:17.257817    2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 09 16:14:17.258050 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:14:17.257891    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b749ab0-b112-4083-8efc-6d45e9c5e6c2-metrics-tls podName:3b749ab0-b112-4083-8efc-6d45e9c5e6c2 nodeName:}" failed. No retries permitted until 2026-09-09 16:14:25.2578714 +0000 UTC m=+47.611601224 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3b749ab0-b112-4083-8efc-6d45e9c5e6c2-metrics-tls") pod "dns-default-xzslz" (UID: "3b749ab0-b112-4083-8efc-6d45e9c5e6c2") : secret "dns-default-metrics-tls" not found
Sep 09 16:14:17.391307 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:17.391278    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-stpmj" event={"ID":"2e619341-a4d2-42fc-b5d9-e33ffeebd306","Type":"ContainerStarted","Data":"12f4eadb8c6c29e86eba66fba52bede441626c2d348631a538c84211d5c0ddb6"}
Sep 09 16:14:17.394939 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:17.394913    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-djp68" event={"ID":"be6bb207-ddbb-459e-af6c-bc2500a92955","Type":"ContainerStarted","Data":"f411246898e228384130b4149cf776fbe79985d60bbfa60be0c9a855dadd2fa6"}
Sep 09 16:14:17.396585 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:17.396562    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-vgwn2" event={"ID":"f7554c3b-d296-4424-8822-a3e75a994efa","Type":"ContainerStarted","Data":"0a62072f5ea834fba8ea71668982b75ca8b512b36fe6fd667a6b6fd1e098548e"}
Sep 09 16:14:17.396686 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:17.396662    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-vgwn2"
Sep 09 16:14:17.398001 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:17.397967    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-n7vc2" event={"ID":"b16dca46-9632-4408-9ae4-320cc254b225","Type":"ContainerStarted","Data":"dd64fdc9eb18b30149bcbded4796a407ac3d23ee20840a03ead7bec1a6cb75fe"}
Sep 09 16:14:17.412516 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:17.412477    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-stpmj" podStartSLOduration=33.845946666 podStartE2EDuration="39.412465148s" totalImagesPullingTime="5.566518482s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 16:13:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:14:17.411874478 +0000 UTC m=+39.765604327" watchObservedRunningTime="2026-09-09 16:14:17.412465148 +0000 UTC m=+39.766194979"
Sep 09 16:14:17.429593 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:17.429548    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-n7vc2" podStartSLOduration=2.56483463 podStartE2EDuration="8.429538244s" totalImagesPullingTime="5.864703614s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 16:14:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:14:17.42884798 +0000 UTC m=+39.782577809" watchObservedRunningTime="2026-09-09 16:14:17.429538244 +0000 UTC m=+39.783268067"
Sep 09 16:14:17.456913 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:17.456861    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-djp68" podStartSLOduration=11.169331078 podStartE2EDuration="39.456848235s" totalImagesPullingTime="28.287517157s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 16:13:38 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:14:17.455147034 +0000 UTC m=+39.808876889" watchObservedRunningTime="2026-09-09 16:14:17.456848235 +0000 UTC m=+39.810578069"
Sep 09 16:14:17.474043 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:17.473959    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-vgwn2" podStartSLOduration=33.917839276 podStartE2EDuration="39.473940895s" totalImagesPullingTime="5.556101619s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 16:13:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:14:17.473006655 +0000 UTC m=+39.826736506" watchObservedRunningTime="2026-09-09 16:14:17.473940895 +0000 UTC m=+39.827670727"
Sep 09 16:14:17.564759 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:17.564737    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:14:17.668823 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:17.668798    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:14:18.402078 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:18.402038    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-685456655f-lk5jk" event={"ID":"c72a79fa-90df-448d-9b09-23262729fa2e","Type":"ContainerStarted","Data":"440dedff5e207b2645f4891dd70ef06d2b4da7f5679c6fb44c35369f7207eab3"}
Sep 09 16:14:18.417399 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:18.417358    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-685456655f-lk5jk" podStartSLOduration=32.31503912 podStartE2EDuration="38.417344487s" totalImagesPullingTime="6.102305367s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 16:13:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:14:18.417297882 +0000 UTC m=+40.771027740" watchObservedRunningTime="2026-09-09 16:14:18.417344487 +0000 UTC m=+40.771074319"
Sep 09 16:14:19.912591 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:19.912552    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:14:23.860385 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:23.860333    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:14:23.912003 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:23.911964    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:14:25.307762 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:25.307733    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c4338f01-9c80-4c3d-b2e1-187d647cb696-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-779cg\" (UID: \"c4338f01-9c80-4c3d-b2e1-187d647cb696\") " pod="openshift-network-console/networking-console-plugin-79977f9844-779cg"
Sep 09 16:14:25.308141 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:25.307768    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3b749ab0-b112-4083-8efc-6d45e9c5e6c2-metrics-tls\") pod \"dns-default-xzslz\" (UID: \"3b749ab0-b112-4083-8efc-6d45e9c5e6c2\") " pod="openshift-dns/dns-default-xzslz"
Sep 09 16:14:25.308141 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:14:25.307897    2583 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 09 16:14:25.308141 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:25.307912    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f82110b1-4cd3-40e9-b412-ede8228aed4b-registry-tls\") pod \"image-registry-59fcb64bf-tzq28\" (UID: \"f82110b1-4cd3-40e9-b412-ede8228aed4b\") " pod="openshift-image-registry/image-registry-59fcb64bf-tzq28"
Sep 09 16:14:25.308141 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:14:25.307910    2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 09 16:14:25.308141 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:14:25.308018    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c4338f01-9c80-4c3d-b2e1-187d647cb696-networking-console-plugin-cert podName:c4338f01-9c80-4c3d-b2e1-187d647cb696 nodeName:}" failed. No retries permitted until 2026-09-09 16:14:41.307957609 +0000 UTC m=+63.661687491 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c4338f01-9c80-4c3d-b2e1-187d647cb696-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-779cg" (UID: "c4338f01-9c80-4c3d-b2e1-187d647cb696") : secret "networking-console-plugin-cert" not found
Sep 09 16:14:25.308141 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:14:25.308126    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b749ab0-b112-4083-8efc-6d45e9c5e6c2-metrics-tls podName:3b749ab0-b112-4083-8efc-6d45e9c5e6c2 nodeName:}" failed. No retries permitted until 2026-09-09 16:14:41.308107433 +0000 UTC m=+63.661837265 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3b749ab0-b112-4083-8efc-6d45e9c5e6c2-metrics-tls") pod "dns-default-xzslz" (UID: "3b749ab0-b112-4083-8efc-6d45e9c5e6c2") : secret "dns-default-metrics-tls" not found
Sep 09 16:14:25.308389 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:14:25.308155    2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 09 16:14:25.308389 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:14:25.308181    2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-59fcb64bf-tzq28: secret "image-registry-tls" not found
Sep 09 16:14:25.308389 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:14:25.308242    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f82110b1-4cd3-40e9-b412-ede8228aed4b-registry-tls podName:f82110b1-4cd3-40e9-b412-ede8228aed4b nodeName:}" failed. No retries permitted until 2026-09-09 16:14:41.308221369 +0000 UTC m=+63.661951229 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f82110b1-4cd3-40e9-b412-ede8228aed4b-registry-tls") pod "image-registry-59fcb64bf-tzq28" (UID: "f82110b1-4cd3-40e9-b412-ede8228aed4b") : secret "image-registry-tls" not found
Sep 09 16:14:26.552638 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:26.552601    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:14:26.606873 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:26.606841    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:14:29.146398 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:29.146369    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:14:29.195913 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:29.195887    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:14:33.776428 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:33.776395    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:14:33.872220 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:33.872189    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:14:34.073735 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:34.073700    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:14:34.172772 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:34.172748    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:14:35.352111 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:35.352088    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-8xkw6"
Sep 09 16:14:35.499100 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:35.499046    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:14:35.554608 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:35.554580    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:14:37.817665 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:37.817635    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:14:37.864801 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:37.864760    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:14:41.318679 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:41.318647    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c4338f01-9c80-4c3d-b2e1-187d647cb696-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-779cg\" (UID: \"c4338f01-9c80-4c3d-b2e1-187d647cb696\") " pod="openshift-network-console/networking-console-plugin-79977f9844-779cg"
Sep 09 16:14:41.319049 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:41.318683    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3b749ab0-b112-4083-8efc-6d45e9c5e6c2-metrics-tls\") pod \"dns-default-xzslz\" (UID: \"3b749ab0-b112-4083-8efc-6d45e9c5e6c2\") " pod="openshift-dns/dns-default-xzslz"
Sep 09 16:14:41.319049 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:41.318738    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f82110b1-4cd3-40e9-b412-ede8228aed4b-registry-tls\") pod \"image-registry-59fcb64bf-tzq28\" (UID: \"f82110b1-4cd3-40e9-b412-ede8228aed4b\") " pod="openshift-image-registry/image-registry-59fcb64bf-tzq28"
Sep 09 16:14:41.319049 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:14:41.318803    2583 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 09 16:14:41.319049 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:14:41.318858    2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 09 16:14:41.319049 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:14:41.318875    2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-59fcb64bf-tzq28: secret "image-registry-tls" not found
Sep 09 16:14:41.319049 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:14:41.318882    2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 09 16:14:41.319049 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:14:41.318865    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c4338f01-9c80-4c3d-b2e1-187d647cb696-networking-console-plugin-cert podName:c4338f01-9c80-4c3d-b2e1-187d647cb696 nodeName:}" failed. No retries permitted until 2026-09-09 16:15:13.3188495 +0000 UTC m=+95.672579315 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c4338f01-9c80-4c3d-b2e1-187d647cb696-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-779cg" (UID: "c4338f01-9c80-4c3d-b2e1-187d647cb696") : secret "networking-console-plugin-cert" not found
Sep 09 16:14:41.319049 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:14:41.318937    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f82110b1-4cd3-40e9-b412-ede8228aed4b-registry-tls podName:f82110b1-4cd3-40e9-b412-ede8228aed4b nodeName:}" failed. No retries permitted until 2026-09-09 16:15:13.318919404 +0000 UTC m=+95.672649223 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f82110b1-4cd3-40e9-b412-ede8228aed4b-registry-tls") pod "image-registry-59fcb64bf-tzq28" (UID: "f82110b1-4cd3-40e9-b412-ede8228aed4b") : secret "image-registry-tls" not found
Sep 09 16:14:41.319049 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:14:41.318957    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b749ab0-b112-4083-8efc-6d45e9c5e6c2-metrics-tls podName:3b749ab0-b112-4083-8efc-6d45e9c5e6c2 nodeName:}" failed. No retries permitted until 2026-09-09 16:15:13.318950663 +0000 UTC m=+95.672680473 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3b749ab0-b112-4083-8efc-6d45e9c5e6c2-metrics-tls") pod "dns-default-xzslz" (UID: "3b749ab0-b112-4083-8efc-6d45e9c5e6c2") : secret "dns-default-metrics-tls" not found
Sep 09 16:14:42.929297 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:42.929264    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f8a2ea6e-22df-4b6d-b1b1-e554e877f94c-metrics-certs\") pod \"network-metrics-daemon-qmp4p\" (UID: \"f8a2ea6e-22df-4b6d-b1b1-e554e877f94c\") " pod="openshift-multus/network-metrics-daemon-qmp4p"
Sep 09 16:14:42.929620 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:14:42.929358    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 09 16:14:42.929620 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:14:42.929401    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8a2ea6e-22df-4b6d-b1b1-e554e877f94c-metrics-certs podName:f8a2ea6e-22df-4b6d-b1b1-e554e877f94c nodeName:}" failed. No retries permitted until 2026-09-09 16:15:46.929389828 +0000 UTC m=+129.283119639 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f8a2ea6e-22df-4b6d-b1b1-e554e877f94c-metrics-certs") pod "network-metrics-daemon-qmp4p" (UID: "f8a2ea6e-22df-4b6d-b1b1-e554e877f94c") : secret "metrics-daemon-secret" not found
Sep 09 16:14:48.404921 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:48.404892    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-vgwn2"
Sep 09 16:14:54.010128 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:54.010088    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:14:54.063810 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:14:54.063766    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:15:13.333432 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:15:13.333301    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c4338f01-9c80-4c3d-b2e1-187d647cb696-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-779cg\" (UID: \"c4338f01-9c80-4c3d-b2e1-187d647cb696\") " pod="openshift-network-console/networking-console-plugin-79977f9844-779cg"
Sep 09 16:15:13.333432 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:15:13.333350    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3b749ab0-b112-4083-8efc-6d45e9c5e6c2-metrics-tls\") pod \"dns-default-xzslz\" (UID: \"3b749ab0-b112-4083-8efc-6d45e9c5e6c2\") " pod="openshift-dns/dns-default-xzslz"
Sep 09 16:15:13.333432 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:15:13.333410    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f82110b1-4cd3-40e9-b412-ede8228aed4b-registry-tls\") pod \"image-registry-59fcb64bf-tzq28\" (UID: \"f82110b1-4cd3-40e9-b412-ede8228aed4b\") " pod="openshift-image-registry/image-registry-59fcb64bf-tzq28"
Sep 09 16:15:13.333432 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:15:13.333435    2583 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 09 16:15:13.334009 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:15:13.333508    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c4338f01-9c80-4c3d-b2e1-187d647cb696-networking-console-plugin-cert podName:c4338f01-9c80-4c3d-b2e1-187d647cb696 nodeName:}" failed. No retries permitted until 2026-09-09 16:16:17.333490381 +0000 UTC m=+159.687220197 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c4338f01-9c80-4c3d-b2e1-187d647cb696-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-779cg" (UID: "c4338f01-9c80-4c3d-b2e1-187d647cb696") : secret "networking-console-plugin-cert" not found
Sep 09 16:15:13.334009 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:15:13.333518    2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 09 16:15:13.334009 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:15:13.333522    2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 09 16:15:13.334009 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:15:13.333573    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b749ab0-b112-4083-8efc-6d45e9c5e6c2-metrics-tls podName:3b749ab0-b112-4083-8efc-6d45e9c5e6c2 nodeName:}" failed. No retries permitted until 2026-09-09 16:16:17.333559676 +0000 UTC m=+159.687289490 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3b749ab0-b112-4083-8efc-6d45e9c5e6c2-metrics-tls") pod "dns-default-xzslz" (UID: "3b749ab0-b112-4083-8efc-6d45e9c5e6c2") : secret "dns-default-metrics-tls" not found
Sep 09 16:15:13.334009 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:15:13.333589    2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-59fcb64bf-tzq28: secret "image-registry-tls" not found
Sep 09 16:15:13.334009 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:15:13.333665    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f82110b1-4cd3-40e9-b412-ede8228aed4b-registry-tls podName:f82110b1-4cd3-40e9-b412-ede8228aed4b nodeName:}" failed. No retries permitted until 2026-09-09 16:16:17.333648469 +0000 UTC m=+159.687378320 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f82110b1-4cd3-40e9-b412-ede8228aed4b-registry-tls") pod "image-registry-59fcb64bf-tzq28" (UID: "f82110b1-4cd3-40e9-b412-ede8228aed4b") : secret "image-registry-tls" not found
Sep 09 16:15:22.822834 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:15:22.822746    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:15:23.674606 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:15:23.674576    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:15:23.779518 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:15:23.779484    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:15:46.958241 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:15:46.958203    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f8a2ea6e-22df-4b6d-b1b1-e554e877f94c-metrics-certs\") pod \"network-metrics-daemon-qmp4p\" (UID: \"f8a2ea6e-22df-4b6d-b1b1-e554e877f94c\") " pod="openshift-multus/network-metrics-daemon-qmp4p"
Sep 09 16:15:46.958693 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:15:46.958304    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 09 16:15:46.958693 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:15:46.958353    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8a2ea6e-22df-4b6d-b1b1-e554e877f94c-metrics-certs podName:f8a2ea6e-22df-4b6d-b1b1-e554e877f94c nodeName:}" failed. No retries permitted until 2026-09-09 16:17:48.958339063 +0000 UTC m=+251.312068874 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f8a2ea6e-22df-4b6d-b1b1-e554e877f94c-metrics-certs") pod "network-metrics-daemon-qmp4p" (UID: "f8a2ea6e-22df-4b6d-b1b1-e554e877f94c") : secret "metrics-daemon-secret" not found
Sep 09 16:16:12.478159 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:16:12.478115    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-79977f9844-779cg" podUID="c4338f01-9c80-4c3d-b2e1-187d647cb696"
Sep 09 16:16:12.493290 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:16:12.493255    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-59fcb64bf-tzq28" podUID="f82110b1-4cd3-40e9-b412-ede8228aed4b"
Sep 09 16:16:12.526498 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:16:12.526471    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-xzslz" podUID="3b749ab0-b112-4083-8efc-6d45e9c5e6c2"
Sep 09 16:16:12.656233 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:16:12.656202    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xzslz"
Sep 09 16:16:12.656364 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:16:12.656210    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-79977f9844-779cg"
Sep 09 16:16:12.656405 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:16:12.656211    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-59fcb64bf-tzq28"
Sep 09 16:16:13.243294 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:16:13.243258    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-qmp4p" podUID="f8a2ea6e-22df-4b6d-b1b1-e554e877f94c"
Sep 09 16:16:17.360252 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:16:17.360218    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c4338f01-9c80-4c3d-b2e1-187d647cb696-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-779cg\" (UID: \"c4338f01-9c80-4c3d-b2e1-187d647cb696\") " pod="openshift-network-console/networking-console-plugin-79977f9844-779cg"
Sep 09 16:16:17.360660 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:16:17.360256    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3b749ab0-b112-4083-8efc-6d45e9c5e6c2-metrics-tls\") pod \"dns-default-xzslz\" (UID: \"3b749ab0-b112-4083-8efc-6d45e9c5e6c2\") " pod="openshift-dns/dns-default-xzslz"
Sep 09 16:16:17.360660 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:16:17.360343    2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 09 16:16:17.360660 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:16:17.360360    2583 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 09 16:16:17.360660 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:16:17.360417    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f82110b1-4cd3-40e9-b412-ede8228aed4b-registry-tls\") pod \"image-registry-59fcb64bf-tzq28\" (UID: \"f82110b1-4cd3-40e9-b412-ede8228aed4b\") " pod="openshift-image-registry/image-registry-59fcb64bf-tzq28"
Sep 09 16:16:17.360660 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:16:17.360432    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c4338f01-9c80-4c3d-b2e1-187d647cb696-networking-console-plugin-cert podName:c4338f01-9c80-4c3d-b2e1-187d647cb696 nodeName:}" failed. No retries permitted until 2026-09-09 16:18:19.360416887 +0000 UTC m=+281.714146702 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c4338f01-9c80-4c3d-b2e1-187d647cb696-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-779cg" (UID: "c4338f01-9c80-4c3d-b2e1-187d647cb696") : secret "networking-console-plugin-cert" not found
Sep 09 16:16:17.360660 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:16:17.360481    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b749ab0-b112-4083-8efc-6d45e9c5e6c2-metrics-tls podName:3b749ab0-b112-4083-8efc-6d45e9c5e6c2 nodeName:}" failed. No retries permitted until 2026-09-09 16:18:19.360466705 +0000 UTC m=+281.714196516 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3b749ab0-b112-4083-8efc-6d45e9c5e6c2-metrics-tls") pod "dns-default-xzslz" (UID: "3b749ab0-b112-4083-8efc-6d45e9c5e6c2") : secret "dns-default-metrics-tls" not found
Sep 09 16:16:17.360660 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:16:17.360483    2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 09 16:16:17.360660 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:16:17.360493    2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-59fcb64bf-tzq28: secret "image-registry-tls" not found
Sep 09 16:16:17.360660 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:16:17.360525    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f82110b1-4cd3-40e9-b412-ede8228aed4b-registry-tls podName:f82110b1-4cd3-40e9-b412-ede8228aed4b nodeName:}" failed. No retries permitted until 2026-09-09 16:18:19.360516656 +0000 UTC m=+281.714246467 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f82110b1-4cd3-40e9-b412-ede8228aed4b-registry-tls") pod "image-registry-59fcb64bf-tzq28" (UID: "f82110b1-4cd3-40e9-b412-ede8228aed4b") : secret "image-registry-tls" not found
Sep 09 16:16:24.233020 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:16:24.232957    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmp4p"
Sep 09 16:17:19.220854 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:17:19.220820    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:17:49.056085 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:17:49.056042    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f8a2ea6e-22df-4b6d-b1b1-e554e877f94c-metrics-certs\") pod \"network-metrics-daemon-qmp4p\" (UID: \"f8a2ea6e-22df-4b6d-b1b1-e554e877f94c\") " pod="openshift-multus/network-metrics-daemon-qmp4p"
Sep 09 16:17:49.056559 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:17:49.056149    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 09 16:17:49.056559 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:17:49.056209    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8a2ea6e-22df-4b6d-b1b1-e554e877f94c-metrics-certs podName:f8a2ea6e-22df-4b6d-b1b1-e554e877f94c nodeName:}" failed. No retries permitted until 2026-09-09 16:19:51.056194208 +0000 UTC m=+373.409924028 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f8a2ea6e-22df-4b6d-b1b1-e554e877f94c-metrics-certs") pod "network-metrics-daemon-qmp4p" (UID: "f8a2ea6e-22df-4b6d-b1b1-e554e877f94c") : secret "metrics-daemon-secret" not found
Sep 09 16:18:06.777205 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:06.777119    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-j7hwj"]
Sep 09 16:18:06.778960 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:06.778939    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-j7hwj"
Sep 09 16:18:06.781481 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:06.781454    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-lrv6n\""
Sep 09 16:18:06.781661 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:06.781640    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Sep 09 16:18:06.782660 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:06.782639    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Sep 09 16:18:06.788757 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:06.788735    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-j7hwj"]
Sep 09 16:18:06.793499 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:06.793475    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cdcc96965-cx95g"]
Sep 09 16:18:06.795413 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:06.795393    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-dl57k"]
Sep 09 16:18:06.795528 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:06.795514    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-cx95g"
Sep 09 16:18:06.797040 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:06.797022    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-dl57k"
Sep 09 16:18:06.797934 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:06.797914    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Sep 09 16:18:06.798174 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:06.798140    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 09 16:18:06.798284 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:06.798232    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-k5429\""
Sep 09 16:18:06.798468 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:06.798450    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 09 16:18:06.800738 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:06.800718    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Sep 09 16:18:06.800923 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:06.800894    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Sep 09 16:18:06.801058 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:06.800963    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Sep 09 16:18:06.801058 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:06.800994    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-qfqw4\""
Sep 09 16:18:06.801058 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:06.801048    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Sep 09 16:18:06.801210 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:06.801048    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Sep 09 16:18:06.804343 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:06.804318    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cdcc96965-cx95g"]
Sep 09 16:18:06.815947 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:06.815923    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-dl57k"]
Sep 09 16:18:06.874033 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:06.874009    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-859f94c4b-nk2n7"]
Sep 09 16:18:06.874192 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:06.874174    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/83ef6f08-6c9b-4e4a-8d3f-2ac0e855bd2c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-cx95g\" (UID: \"83ef6f08-6c9b-4e4a-8d3f-2ac0e855bd2c\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-cx95g"
Sep 09 16:18:06.874264 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:06.874208    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2e7595e7-f00a-4fa7-be8e-f8e4adb4e628-serving-cert\") pod \"kube-storage-version-migrator-operator-8d7dd4675-dl57k\" (UID: \"2e7595e7-f00a-4fa7-be8e-f8e4adb4e628\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-dl57k"
Sep 09 16:18:06.874264 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:06.874239    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/83ef6f08-6c9b-4e4a-8d3f-2ac0e855bd2c-telemetry-config\") pod \"cluster-monitoring-operator-6cdcc96965-cx95g\" (UID: \"83ef6f08-6c9b-4e4a-8d3f-2ac0e855bd2c\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-cx95g"
Sep 09 16:18:06.874359 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:06.874276    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2e7595e7-f00a-4fa7-be8e-f8e4adb4e628-config\") pod \"kube-storage-version-migrator-operator-8d7dd4675-dl57k\" (UID: \"2e7595e7-f00a-4fa7-be8e-f8e4adb4e628\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-dl57k"
Sep 09 16:18:06.874396 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:06.874382    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q27qx\" (UniqueName: \"kubernetes.io/projected/2e7595e7-f00a-4fa7-be8e-f8e4adb4e628-kube-api-access-q27qx\") pod \"kube-storage-version-migrator-operator-8d7dd4675-dl57k\" (UID: \"2e7595e7-f00a-4fa7-be8e-f8e4adb4e628\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-dl57k"
Sep 09 16:18:06.874437 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:06.874415    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6flf7\" (UniqueName: \"kubernetes.io/projected/f45ba4c9-fc40-4998-a7f4-df0799d03123-kube-api-access-6flf7\") pod \"volume-data-source-validator-695c895bd6-j7hwj\" (UID: \"f45ba4c9-fc40-4998-a7f4-df0799d03123\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-j7hwj"
Sep 09 16:18:06.874494 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:06.874453    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hhhxc\" (UniqueName: \"kubernetes.io/projected/83ef6f08-6c9b-4e4a-8d3f-2ac0e855bd2c-kube-api-access-hhhxc\") pod \"cluster-monitoring-operator-6cdcc96965-cx95g\" (UID: \"83ef6f08-6c9b-4e4a-8d3f-2ac0e855bd2c\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-cx95g"
Sep 09 16:18:06.875810 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:06.875796    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-nk2n7"
Sep 09 16:18:06.878339 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:06.878314    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-kdnh9\""
Sep 09 16:18:06.878450 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:06.878385    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Sep 09 16:18:06.878450 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:06.878423    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Sep 09 16:18:06.878545 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:06.878453    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Sep 09 16:18:06.878545 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:06.878458    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Sep 09 16:18:06.881703 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:06.881680    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-brfr9"]
Sep 09 16:18:06.883779 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:06.883761    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-55d847bddd-kr8vk"]
Sep 09 16:18:06.883873 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:06.883857    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-brfr9"
Sep 09 16:18:06.885630 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:06.885613    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-55d847bddd-kr8vk"
Sep 09 16:18:06.887170 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:06.887149    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Sep 09 16:18:06.888274 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:06.888250    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Sep 09 16:18:06.888379 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:06.888237    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Sep 09 16:18:06.888379 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:06.888346    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-859f94c4b-nk2n7"]
Sep 09 16:18:06.888786 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:06.888645    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Sep 09 16:18:06.888786 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:06.888666    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Sep 09 16:18:06.888786 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:06.888652    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Sep 09 16:18:06.890706 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:06.890595    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-rxwnl\""
Sep 09 16:18:06.891041 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:06.891022    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 09 16:18:06.891131 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:06.891091    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Sep 09 16:18:06.891203 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:06.891182    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-7mqwh\""
Sep 09 16:18:06.891374 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:06.891349    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 09 16:18:06.907838 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:06.907814    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-brfr9"]
Sep 09 16:18:06.908658 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:06.908640    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-55d847bddd-kr8vk"]
Sep 09 16:18:06.974721 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:06.974697    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v9xvd\" (UniqueName: \"kubernetes.io/projected/42d53258-31de-41f2-8ef9-887e6e89cac2-kube-api-access-v9xvd\") pod \"router-default-55d847bddd-kr8vk\" (UID: \"42d53258-31de-41f2-8ef9-887e6e89cac2\") " pod="openshift-ingress/router-default-55d847bddd-kr8vk"
Sep 09 16:18:06.974810 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:06.974724    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2e7595e7-f00a-4fa7-be8e-f8e4adb4e628-config\") pod \"kube-storage-version-migrator-operator-8d7dd4675-dl57k\" (UID: \"2e7595e7-f00a-4fa7-be8e-f8e4adb4e628\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-dl57k"
Sep 09 16:18:06.974810 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:06.974740    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qd8ff\" (UniqueName: \"kubernetes.io/projected/3126605a-6654-402a-8185-4795e376d566-kube-api-access-qd8ff\") pod \"service-ca-operator-859f94c4b-nk2n7\" (UID: \"3126605a-6654-402a-8185-4795e376d566\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-nk2n7"
Sep 09 16:18:06.974810 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:06.974799    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/42d53258-31de-41f2-8ef9-887e6e89cac2-metrics-certs\") pod \"router-default-55d847bddd-kr8vk\" (UID: \"42d53258-31de-41f2-8ef9-887e6e89cac2\") " pod="openshift-ingress/router-default-55d847bddd-kr8vk"
Sep 09 16:18:06.974923 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:06.974817    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/42d53258-31de-41f2-8ef9-887e6e89cac2-stats-auth\") pod \"router-default-55d847bddd-kr8vk\" (UID: \"42d53258-31de-41f2-8ef9-887e6e89cac2\") " pod="openshift-ingress/router-default-55d847bddd-kr8vk"
Sep 09 16:18:06.974923 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:06.974851    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hhhxc\" (UniqueName: \"kubernetes.io/projected/83ef6f08-6c9b-4e4a-8d3f-2ac0e855bd2c-kube-api-access-hhhxc\") pod \"cluster-monitoring-operator-6cdcc96965-cx95g\" (UID: \"83ef6f08-6c9b-4e4a-8d3f-2ac0e855bd2c\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-cx95g"
Sep 09 16:18:06.974923 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:06.974889    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3126605a-6654-402a-8185-4795e376d566-config\") pod \"service-ca-operator-859f94c4b-nk2n7\" (UID: \"3126605a-6654-402a-8185-4795e376d566\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-nk2n7"
Sep 09 16:18:06.974923 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:06.974903    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3126605a-6654-402a-8185-4795e376d566-serving-cert\") pod \"service-ca-operator-859f94c4b-nk2n7\" (UID: \"3126605a-6654-402a-8185-4795e376d566\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-nk2n7"
Sep 09 16:18:06.975129 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:06.974924    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/42d53258-31de-41f2-8ef9-887e6e89cac2-service-ca-bundle\") pod \"router-default-55d847bddd-kr8vk\" (UID: \"42d53258-31de-41f2-8ef9-887e6e89cac2\") " pod="openshift-ingress/router-default-55d847bddd-kr8vk"
Sep 09 16:18:06.975129 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:06.974964    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/83ef6f08-6c9b-4e4a-8d3f-2ac0e855bd2c-telemetry-config\") pod \"cluster-monitoring-operator-6cdcc96965-cx95g\" (UID: \"83ef6f08-6c9b-4e4a-8d3f-2ac0e855bd2c\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-cx95g"
Sep 09 16:18:06.975129 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:06.975025    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bv7kg\" (UniqueName: \"kubernetes.io/projected/c39100a1-7825-46ce-9573-de82e10a7772-kube-api-access-bv7kg\") pod \"cluster-samples-operator-7cdcfcf76c-brfr9\" (UID: \"c39100a1-7825-46ce-9573-de82e10a7772\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-brfr9"
Sep 09 16:18:06.975129 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:06.975043    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q27qx\" (UniqueName: \"kubernetes.io/projected/2e7595e7-f00a-4fa7-be8e-f8e4adb4e628-kube-api-access-q27qx\") pod \"kube-storage-version-migrator-operator-8d7dd4675-dl57k\" (UID: \"2e7595e7-f00a-4fa7-be8e-f8e4adb4e628\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-dl57k"
Sep 09 16:18:06.975129 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:06.975060    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6flf7\" (UniqueName: \"kubernetes.io/projected/f45ba4c9-fc40-4998-a7f4-df0799d03123-kube-api-access-6flf7\") pod \"volume-data-source-validator-695c895bd6-j7hwj\" (UID: \"f45ba4c9-fc40-4998-a7f4-df0799d03123\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-j7hwj"
Sep 09 16:18:06.975129 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:06.975077    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c39100a1-7825-46ce-9573-de82e10a7772-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-brfr9\" (UID: \"c39100a1-7825-46ce-9573-de82e10a7772\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-brfr9"
Sep 09 16:18:06.975129 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:06.975100    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/83ef6f08-6c9b-4e4a-8d3f-2ac0e855bd2c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-cx95g\" (UID: \"83ef6f08-6c9b-4e4a-8d3f-2ac0e855bd2c\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-cx95g"
Sep 09 16:18:06.975521 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:06.975137    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2e7595e7-f00a-4fa7-be8e-f8e4adb4e628-serving-cert\") pod \"kube-storage-version-migrator-operator-8d7dd4675-dl57k\" (UID: \"2e7595e7-f00a-4fa7-be8e-f8e4adb4e628\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-dl57k"
Sep 09 16:18:06.975521 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:18:06.975171    2583 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 09 16:18:06.975521 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:06.975190    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/42d53258-31de-41f2-8ef9-887e6e89cac2-default-certificate\") pod \"router-default-55d847bddd-kr8vk\" (UID: \"42d53258-31de-41f2-8ef9-887e6e89cac2\") " pod="openshift-ingress/router-default-55d847bddd-kr8vk"
Sep 09 16:18:06.975521 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:18:06.975233    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/83ef6f08-6c9b-4e4a-8d3f-2ac0e855bd2c-cluster-monitoring-operator-tls podName:83ef6f08-6c9b-4e4a-8d3f-2ac0e855bd2c nodeName:}" failed. No retries permitted until 2026-09-09 16:18:07.475216716 +0000 UTC m=+269.828946538 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/83ef6f08-6c9b-4e4a-8d3f-2ac0e855bd2c-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-cx95g" (UID: "83ef6f08-6c9b-4e4a-8d3f-2ac0e855bd2c") : secret "cluster-monitoring-operator-tls" not found
Sep 09 16:18:06.975521 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:06.975243    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2e7595e7-f00a-4fa7-be8e-f8e4adb4e628-config\") pod \"kube-storage-version-migrator-operator-8d7dd4675-dl57k\" (UID: \"2e7595e7-f00a-4fa7-be8e-f8e4adb4e628\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-dl57k"
Sep 09 16:18:06.975760 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:06.975693    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/83ef6f08-6c9b-4e4a-8d3f-2ac0e855bd2c-telemetry-config\") pod \"cluster-monitoring-operator-6cdcc96965-cx95g\" (UID: \"83ef6f08-6c9b-4e4a-8d3f-2ac0e855bd2c\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-cx95g"
Sep 09 16:18:06.977522 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:06.977506    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2e7595e7-f00a-4fa7-be8e-f8e4adb4e628-serving-cert\") pod \"kube-storage-version-migrator-operator-8d7dd4675-dl57k\" (UID: \"2e7595e7-f00a-4fa7-be8e-f8e4adb4e628\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-dl57k"
Sep 09 16:18:06.983057 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:06.983039    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q27qx\" (UniqueName: \"kubernetes.io/projected/2e7595e7-f00a-4fa7-be8e-f8e4adb4e628-kube-api-access-q27qx\") pod \"kube-storage-version-migrator-operator-8d7dd4675-dl57k\" (UID: \"2e7595e7-f00a-4fa7-be8e-f8e4adb4e628\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-dl57k"
Sep 09 16:18:06.983284 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:06.983264    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hhhxc\" (UniqueName: \"kubernetes.io/projected/83ef6f08-6c9b-4e4a-8d3f-2ac0e855bd2c-kube-api-access-hhhxc\") pod \"cluster-monitoring-operator-6cdcc96965-cx95g\" (UID: \"83ef6f08-6c9b-4e4a-8d3f-2ac0e855bd2c\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-cx95g"
Sep 09 16:18:06.983334 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:06.983320    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6flf7\" (UniqueName: \"kubernetes.io/projected/f45ba4c9-fc40-4998-a7f4-df0799d03123-kube-api-access-6flf7\") pod \"volume-data-source-validator-695c895bd6-j7hwj\" (UID: \"f45ba4c9-fc40-4998-a7f4-df0799d03123\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-j7hwj"
Sep 09 16:18:07.052712 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:07.052663    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:18:07.075710 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:07.075685    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bv7kg\" (UniqueName: \"kubernetes.io/projected/c39100a1-7825-46ce-9573-de82e10a7772-kube-api-access-bv7kg\") pod \"cluster-samples-operator-7cdcfcf76c-brfr9\" (UID: \"c39100a1-7825-46ce-9573-de82e10a7772\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-brfr9"
Sep 09 16:18:07.075788 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:07.075716    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c39100a1-7825-46ce-9573-de82e10a7772-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-brfr9\" (UID: \"c39100a1-7825-46ce-9573-de82e10a7772\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-brfr9"
Sep 09 16:18:07.075788 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:07.075748    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/42d53258-31de-41f2-8ef9-887e6e89cac2-default-certificate\") pod \"router-default-55d847bddd-kr8vk\" (UID: \"42d53258-31de-41f2-8ef9-887e6e89cac2\") " pod="openshift-ingress/router-default-55d847bddd-kr8vk"
Sep 09 16:18:07.075788 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:07.075776    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v9xvd\" (UniqueName: \"kubernetes.io/projected/42d53258-31de-41f2-8ef9-887e6e89cac2-kube-api-access-v9xvd\") pod \"router-default-55d847bddd-kr8vk\" (UID: \"42d53258-31de-41f2-8ef9-887e6e89cac2\") " pod="openshift-ingress/router-default-55d847bddd-kr8vk"
Sep 09 16:18:07.075909 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:07.075793    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qd8ff\" (UniqueName: \"kubernetes.io/projected/3126605a-6654-402a-8185-4795e376d566-kube-api-access-qd8ff\") pod \"service-ca-operator-859f94c4b-nk2n7\" (UID: \"3126605a-6654-402a-8185-4795e376d566\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-nk2n7"
Sep 09 16:18:07.075909 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:18:07.075816    2583 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 09 16:18:07.075909 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:07.075827    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/42d53258-31de-41f2-8ef9-887e6e89cac2-metrics-certs\") pod \"router-default-55d847bddd-kr8vk\" (UID: \"42d53258-31de-41f2-8ef9-887e6e89cac2\") " pod="openshift-ingress/router-default-55d847bddd-kr8vk"
Sep 09 16:18:07.075909 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:07.075852    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/42d53258-31de-41f2-8ef9-887e6e89cac2-stats-auth\") pod \"router-default-55d847bddd-kr8vk\" (UID: \"42d53258-31de-41f2-8ef9-887e6e89cac2\") " pod="openshift-ingress/router-default-55d847bddd-kr8vk"
Sep 09 16:18:07.075909 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:18:07.075870    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c39100a1-7825-46ce-9573-de82e10a7772-samples-operator-tls podName:c39100a1-7825-46ce-9573-de82e10a7772 nodeName:}" failed. No retries permitted until 2026-09-09 16:18:07.575853384 +0000 UTC m=+269.929583208 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/c39100a1-7825-46ce-9573-de82e10a7772-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-brfr9" (UID: "c39100a1-7825-46ce-9573-de82e10a7772") : secret "samples-operator-tls" not found
Sep 09 16:18:07.076165 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:18:07.075924    2583 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 09 16:18:07.076165 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:07.075942    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3126605a-6654-402a-8185-4795e376d566-config\") pod \"service-ca-operator-859f94c4b-nk2n7\" (UID: \"3126605a-6654-402a-8185-4795e376d566\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-nk2n7"
Sep 09 16:18:07.076165 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:07.075969    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3126605a-6654-402a-8185-4795e376d566-serving-cert\") pod \"service-ca-operator-859f94c4b-nk2n7\" (UID: \"3126605a-6654-402a-8185-4795e376d566\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-nk2n7"
Sep 09 16:18:07.076165 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:18:07.075974    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/42d53258-31de-41f2-8ef9-887e6e89cac2-metrics-certs podName:42d53258-31de-41f2-8ef9-887e6e89cac2 nodeName:}" failed. No retries permitted until 2026-09-09 16:18:07.575962746 +0000 UTC m=+269.929692557 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/42d53258-31de-41f2-8ef9-887e6e89cac2-metrics-certs") pod "router-default-55d847bddd-kr8vk" (UID: "42d53258-31de-41f2-8ef9-887e6e89cac2") : secret "router-metrics-certs-default" not found
Sep 09 16:18:07.076165 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:07.076025    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/42d53258-31de-41f2-8ef9-887e6e89cac2-service-ca-bundle\") pod \"router-default-55d847bddd-kr8vk\" (UID: \"42d53258-31de-41f2-8ef9-887e6e89cac2\") " pod="openshift-ingress/router-default-55d847bddd-kr8vk"
Sep 09 16:18:07.076165 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:18:07.076130    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/42d53258-31de-41f2-8ef9-887e6e89cac2-service-ca-bundle podName:42d53258-31de-41f2-8ef9-887e6e89cac2 nodeName:}" failed. No retries permitted until 2026-09-09 16:18:07.576117072 +0000 UTC m=+269.929846888 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/42d53258-31de-41f2-8ef9-887e6e89cac2-service-ca-bundle") pod "router-default-55d847bddd-kr8vk" (UID: "42d53258-31de-41f2-8ef9-887e6e89cac2") : configmap references non-existent config key: service-ca.crt
Sep 09 16:18:07.076450 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:07.076413    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3126605a-6654-402a-8185-4795e376d566-config\") pod \"service-ca-operator-859f94c4b-nk2n7\" (UID: \"3126605a-6654-402a-8185-4795e376d566\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-nk2n7"
Sep 09 16:18:07.077897 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:07.077876    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3126605a-6654-402a-8185-4795e376d566-serving-cert\") pod \"service-ca-operator-859f94c4b-nk2n7\" (UID: \"3126605a-6654-402a-8185-4795e376d566\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-nk2n7"
Sep 09 16:18:07.077979 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:07.077960    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/42d53258-31de-41f2-8ef9-887e6e89cac2-stats-auth\") pod \"router-default-55d847bddd-kr8vk\" (UID: \"42d53258-31de-41f2-8ef9-887e6e89cac2\") " pod="openshift-ingress/router-default-55d847bddd-kr8vk"
Sep 09 16:18:07.078041 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:07.078010    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/42d53258-31de-41f2-8ef9-887e6e89cac2-default-certificate\") pod \"router-default-55d847bddd-kr8vk\" (UID: \"42d53258-31de-41f2-8ef9-887e6e89cac2\") " pod="openshift-ingress/router-default-55d847bddd-kr8vk"
Sep 09 16:18:07.086851 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:07.086827    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v9xvd\" (UniqueName: \"kubernetes.io/projected/42d53258-31de-41f2-8ef9-887e6e89cac2-kube-api-access-v9xvd\") pod \"router-default-55d847bddd-kr8vk\" (UID: \"42d53258-31de-41f2-8ef9-887e6e89cac2\") " pod="openshift-ingress/router-default-55d847bddd-kr8vk"
Sep 09 16:18:07.088263 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:07.087881    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-j7hwj"
Sep 09 16:18:07.088952 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:07.088930    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qd8ff\" (UniqueName: \"kubernetes.io/projected/3126605a-6654-402a-8185-4795e376d566-kube-api-access-qd8ff\") pod \"service-ca-operator-859f94c4b-nk2n7\" (UID: \"3126605a-6654-402a-8185-4795e376d566\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-nk2n7"
Sep 09 16:18:07.089020 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:07.088978    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bv7kg\" (UniqueName: \"kubernetes.io/projected/c39100a1-7825-46ce-9573-de82e10a7772-kube-api-access-bv7kg\") pod \"cluster-samples-operator-7cdcfcf76c-brfr9\" (UID: \"c39100a1-7825-46ce-9573-de82e10a7772\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-brfr9"
Sep 09 16:18:07.110222 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:07.110204    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-dl57k"
Sep 09 16:18:07.154127 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:07.154091    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:18:07.184659 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:07.184639    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-nk2n7"
Sep 09 16:18:07.349668 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:07.349546    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-j7hwj"]
Sep 09 16:18:07.351902 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:18:07.351882    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf45ba4c9_fc40_4998_a7f4_df0799d03123.slice/crio-40c336b63de4e187ed1c3c02340973ecc97a5efc0d6fffc09235f5a2999c6b5a WatchSource:0}: Error finding container 40c336b63de4e187ed1c3c02340973ecc97a5efc0d6fffc09235f5a2999c6b5a: Status 404 returned error can't find the container with id 40c336b63de4e187ed1c3c02340973ecc97a5efc0d6fffc09235f5a2999c6b5a
Sep 09 16:18:07.376283 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:07.376265    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-dl57k"]
Sep 09 16:18:07.377890 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:18:07.377868    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e7595e7_f00a_4fa7_be8e_f8e4adb4e628.slice/crio-f41b0fea3737872bc05f43102b2fc9c3791a936fed27a80c6541c6479fe6ace2 WatchSource:0}: Error finding container f41b0fea3737872bc05f43102b2fc9c3791a936fed27a80c6541c6479fe6ace2: Status 404 returned error can't find the container with id f41b0fea3737872bc05f43102b2fc9c3791a936fed27a80c6541c6479fe6ace2
Sep 09 16:18:07.446910 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:07.446889    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-859f94c4b-nk2n7"]
Sep 09 16:18:07.448651 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:18:07.448632    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3126605a_6654_402a_8185_4795e376d566.slice/crio-96a503cb2234fef5204823e3516abc05cdcad0dca734ebf9a6fbedd29534ae49 WatchSource:0}: Error finding container 96a503cb2234fef5204823e3516abc05cdcad0dca734ebf9a6fbedd29534ae49: Status 404 returned error can't find the container with id 96a503cb2234fef5204823e3516abc05cdcad0dca734ebf9a6fbedd29534ae49
Sep 09 16:18:07.478365 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:07.478343    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/83ef6f08-6c9b-4e4a-8d3f-2ac0e855bd2c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-cx95g\" (UID: \"83ef6f08-6c9b-4e4a-8d3f-2ac0e855bd2c\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-cx95g"
Sep 09 16:18:07.478502 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:18:07.478487    2583 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 09 16:18:07.478552 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:18:07.478542    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/83ef6f08-6c9b-4e4a-8d3f-2ac0e855bd2c-cluster-monitoring-operator-tls podName:83ef6f08-6c9b-4e4a-8d3f-2ac0e855bd2c nodeName:}" failed. No retries permitted until 2026-09-09 16:18:08.478524861 +0000 UTC m=+270.832254685 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/83ef6f08-6c9b-4e4a-8d3f-2ac0e855bd2c-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-cx95g" (UID: "83ef6f08-6c9b-4e4a-8d3f-2ac0e855bd2c") : secret "cluster-monitoring-operator-tls" not found
Sep 09 16:18:07.579387 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:07.579360    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/42d53258-31de-41f2-8ef9-887e6e89cac2-metrics-certs\") pod \"router-default-55d847bddd-kr8vk\" (UID: \"42d53258-31de-41f2-8ef9-887e6e89cac2\") " pod="openshift-ingress/router-default-55d847bddd-kr8vk"
Sep 09 16:18:07.579467 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:07.579420    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/42d53258-31de-41f2-8ef9-887e6e89cac2-service-ca-bundle\") pod \"router-default-55d847bddd-kr8vk\" (UID: \"42d53258-31de-41f2-8ef9-887e6e89cac2\") " pod="openshift-ingress/router-default-55d847bddd-kr8vk"
Sep 09 16:18:07.579467 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:07.579448    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c39100a1-7825-46ce-9573-de82e10a7772-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-brfr9\" (UID: \"c39100a1-7825-46ce-9573-de82e10a7772\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-brfr9"
Sep 09 16:18:07.579541 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:18:07.579502    2583 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 09 16:18:07.579582 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:18:07.579554    2583 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 09 16:18:07.579582 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:18:07.579568    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/42d53258-31de-41f2-8ef9-887e6e89cac2-metrics-certs podName:42d53258-31de-41f2-8ef9-887e6e89cac2 nodeName:}" failed. No retries permitted until 2026-09-09 16:18:08.579549892 +0000 UTC m=+270.933279712 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/42d53258-31de-41f2-8ef9-887e6e89cac2-metrics-certs") pod "router-default-55d847bddd-kr8vk" (UID: "42d53258-31de-41f2-8ef9-887e6e89cac2") : secret "router-metrics-certs-default" not found
Sep 09 16:18:07.579656 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:18:07.579584    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/42d53258-31de-41f2-8ef9-887e6e89cac2-service-ca-bundle podName:42d53258-31de-41f2-8ef9-887e6e89cac2 nodeName:}" failed. No retries permitted until 2026-09-09 16:18:08.579578831 +0000 UTC m=+270.933308645 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/42d53258-31de-41f2-8ef9-887e6e89cac2-service-ca-bundle") pod "router-default-55d847bddd-kr8vk" (UID: "42d53258-31de-41f2-8ef9-887e6e89cac2") : configmap references non-existent config key: service-ca.crt
Sep 09 16:18:07.579656 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:18:07.579598    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c39100a1-7825-46ce-9573-de82e10a7772-samples-operator-tls podName:c39100a1-7825-46ce-9573-de82e10a7772 nodeName:}" failed. No retries permitted until 2026-09-09 16:18:08.579591989 +0000 UTC m=+270.933321800 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/c39100a1-7825-46ce-9573-de82e10a7772-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-brfr9" (UID: "c39100a1-7825-46ce-9573-de82e10a7772") : secret "samples-operator-tls" not found
Sep 09 16:18:07.907289 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:07.907257    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-dl57k" event={"ID":"2e7595e7-f00a-4fa7-be8e-f8e4adb4e628","Type":"ContainerStarted","Data":"f41b0fea3737872bc05f43102b2fc9c3791a936fed27a80c6541c6479fe6ace2"}
Sep 09 16:18:07.908755 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:07.908722    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-nk2n7" event={"ID":"3126605a-6654-402a-8185-4795e376d566","Type":"ContainerStarted","Data":"96a503cb2234fef5204823e3516abc05cdcad0dca734ebf9a6fbedd29534ae49"}
Sep 09 16:18:07.910096 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:07.910074    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-j7hwj" event={"ID":"f45ba4c9-fc40-4998-a7f4-df0799d03123","Type":"ContainerStarted","Data":"40c336b63de4e187ed1c3c02340973ecc97a5efc0d6fffc09235f5a2999c6b5a"}
Sep 09 16:18:08.487372 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:08.487344    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/83ef6f08-6c9b-4e4a-8d3f-2ac0e855bd2c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-cx95g\" (UID: \"83ef6f08-6c9b-4e4a-8d3f-2ac0e855bd2c\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-cx95g"
Sep 09 16:18:08.487507 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:18:08.487493    2583 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 09 16:18:08.487577 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:18:08.487565    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/83ef6f08-6c9b-4e4a-8d3f-2ac0e855bd2c-cluster-monitoring-operator-tls podName:83ef6f08-6c9b-4e4a-8d3f-2ac0e855bd2c nodeName:}" failed. No retries permitted until 2026-09-09 16:18:10.487544142 +0000 UTC m=+272.841273955 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/83ef6f08-6c9b-4e4a-8d3f-2ac0e855bd2c-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-cx95g" (UID: "83ef6f08-6c9b-4e4a-8d3f-2ac0e855bd2c") : secret "cluster-monitoring-operator-tls" not found
Sep 09 16:18:08.588692 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:08.588661    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/42d53258-31de-41f2-8ef9-887e6e89cac2-metrics-certs\") pod \"router-default-55d847bddd-kr8vk\" (UID: \"42d53258-31de-41f2-8ef9-887e6e89cac2\") " pod="openshift-ingress/router-default-55d847bddd-kr8vk"
Sep 09 16:18:08.588801 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:08.588746    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/42d53258-31de-41f2-8ef9-887e6e89cac2-service-ca-bundle\") pod \"router-default-55d847bddd-kr8vk\" (UID: \"42d53258-31de-41f2-8ef9-887e6e89cac2\") " pod="openshift-ingress/router-default-55d847bddd-kr8vk"
Sep 09 16:18:08.588801 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:08.588788    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c39100a1-7825-46ce-9573-de82e10a7772-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-brfr9\" (UID: \"c39100a1-7825-46ce-9573-de82e10a7772\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-brfr9"
Sep 09 16:18:08.588903 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:18:08.588791    2583 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 09 16:18:08.588903 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:18:08.588867    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/42d53258-31de-41f2-8ef9-887e6e89cac2-metrics-certs podName:42d53258-31de-41f2-8ef9-887e6e89cac2 nodeName:}" failed. No retries permitted until 2026-09-09 16:18:10.588854073 +0000 UTC m=+272.942583885 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/42d53258-31de-41f2-8ef9-887e6e89cac2-metrics-certs") pod "router-default-55d847bddd-kr8vk" (UID: "42d53258-31de-41f2-8ef9-887e6e89cac2") : secret "router-metrics-certs-default" not found
Sep 09 16:18:08.588903 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:18:08.588896    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/42d53258-31de-41f2-8ef9-887e6e89cac2-service-ca-bundle podName:42d53258-31de-41f2-8ef9-887e6e89cac2 nodeName:}" failed. No retries permitted until 2026-09-09 16:18:10.588879025 +0000 UTC m=+272.942608840 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/42d53258-31de-41f2-8ef9-887e6e89cac2-service-ca-bundle") pod "router-default-55d847bddd-kr8vk" (UID: "42d53258-31de-41f2-8ef9-887e6e89cac2") : configmap references non-existent config key: service-ca.crt
Sep 09 16:18:08.589048 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:18:08.588925    2583 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 09 16:18:08.589048 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:18:08.588980    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c39100a1-7825-46ce-9573-de82e10a7772-samples-operator-tls podName:c39100a1-7825-46ce-9573-de82e10a7772 nodeName:}" failed. No retries permitted until 2026-09-09 16:18:10.588965718 +0000 UTC m=+272.942695544 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/c39100a1-7825-46ce-9573-de82e10a7772-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-brfr9" (UID: "c39100a1-7825-46ce-9573-de82e10a7772") : secret "samples-operator-tls" not found
Sep 09 16:18:08.915897 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:08.915870    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-j7hwj" event={"ID":"f45ba4c9-fc40-4998-a7f4-df0799d03123","Type":"ContainerStarted","Data":"1fc67f733b537cec8b2c35deacb8788f33d8f80fcb20c9b791431f82108c0119"}
Sep 09 16:18:08.930457 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:08.930411    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-j7hwj" podStartSLOduration=1.800354346 podStartE2EDuration="2.930397644s" totalImagesPullingTime="1.130043298s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 16:18:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:18:08.929876409 +0000 UTC m=+271.283606263" watchObservedRunningTime="2026-09-09 16:18:08.930397644 +0000 UTC m=+271.284127475"
Sep 09 16:18:09.919714 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:09.919651    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-nk2n7" event={"ID":"3126605a-6654-402a-8185-4795e376d566","Type":"ContainerStarted","Data":"cc325c953802b124b3c2c163903d5f48f5f0ac30025aba3e59ad2b9891d3b2fe"}
Sep 09 16:18:09.935473 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:09.935430    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-nk2n7" podStartSLOduration=1.7588962700000002 podStartE2EDuration="3.935411331s" totalImagesPullingTime="2.176515061s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 16:18:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:18:09.934220463 +0000 UTC m=+272.287950295" watchObservedRunningTime="2026-09-09 16:18:09.935411331 +0000 UTC m=+272.289141164"
Sep 09 16:18:10.505669 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:10.505634    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/83ef6f08-6c9b-4e4a-8d3f-2ac0e855bd2c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-cx95g\" (UID: \"83ef6f08-6c9b-4e4a-8d3f-2ac0e855bd2c\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-cx95g"
Sep 09 16:18:10.505805 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:18:10.505728    2583 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 09 16:18:10.505805 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:18:10.505775    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/83ef6f08-6c9b-4e4a-8d3f-2ac0e855bd2c-cluster-monitoring-operator-tls podName:83ef6f08-6c9b-4e4a-8d3f-2ac0e855bd2c nodeName:}" failed. No retries permitted until 2026-09-09 16:18:14.505763174 +0000 UTC m=+276.859492984 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/83ef6f08-6c9b-4e4a-8d3f-2ac0e855bd2c-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-cx95g" (UID: "83ef6f08-6c9b-4e4a-8d3f-2ac0e855bd2c") : secret "cluster-monitoring-operator-tls" not found
Sep 09 16:18:10.606279 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:10.606254    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c39100a1-7825-46ce-9573-de82e10a7772-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-brfr9\" (UID: \"c39100a1-7825-46ce-9573-de82e10a7772\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-brfr9"
Sep 09 16:18:10.606414 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:10.606312    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/42d53258-31de-41f2-8ef9-887e6e89cac2-metrics-certs\") pod \"router-default-55d847bddd-kr8vk\" (UID: \"42d53258-31de-41f2-8ef9-887e6e89cac2\") " pod="openshift-ingress/router-default-55d847bddd-kr8vk"
Sep 09 16:18:10.606414 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:18:10.606381    2583 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 09 16:18:10.606507 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:18:10.606383    2583 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 09 16:18:10.606507 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:18:10.606428    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c39100a1-7825-46ce-9573-de82e10a7772-samples-operator-tls podName:c39100a1-7825-46ce-9573-de82e10a7772 nodeName:}" failed. No retries permitted until 2026-09-09 16:18:14.606415121 +0000 UTC m=+276.960144936 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/c39100a1-7825-46ce-9573-de82e10a7772-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-brfr9" (UID: "c39100a1-7825-46ce-9573-de82e10a7772") : secret "samples-operator-tls" not found
Sep 09 16:18:10.606507 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:10.606444    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/42d53258-31de-41f2-8ef9-887e6e89cac2-service-ca-bundle\") pod \"router-default-55d847bddd-kr8vk\" (UID: \"42d53258-31de-41f2-8ef9-887e6e89cac2\") " pod="openshift-ingress/router-default-55d847bddd-kr8vk"
Sep 09 16:18:10.606507 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:18:10.606464    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/42d53258-31de-41f2-8ef9-887e6e89cac2-metrics-certs podName:42d53258-31de-41f2-8ef9-887e6e89cac2 nodeName:}" failed. No retries permitted until 2026-09-09 16:18:14.606449697 +0000 UTC m=+276.960179508 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/42d53258-31de-41f2-8ef9-887e6e89cac2-metrics-certs") pod "router-default-55d847bddd-kr8vk" (UID: "42d53258-31de-41f2-8ef9-887e6e89cac2") : secret "router-metrics-certs-default" not found
Sep 09 16:18:10.606507 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:18:10.606505    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/42d53258-31de-41f2-8ef9-887e6e89cac2-service-ca-bundle podName:42d53258-31de-41f2-8ef9-887e6e89cac2 nodeName:}" failed. No retries permitted until 2026-09-09 16:18:14.606495185 +0000 UTC m=+276.960225001 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/42d53258-31de-41f2-8ef9-887e6e89cac2-service-ca-bundle") pod "router-default-55d847bddd-kr8vk" (UID: "42d53258-31de-41f2-8ef9-887e6e89cac2") : configmap references non-existent config key: service-ca.crt
Sep 09 16:18:11.400367 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:11.400332    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-hl5wh"]
Sep 09 16:18:11.404021 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:11.403481    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-hl5wh"
Sep 09 16:18:11.406481 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:11.406460    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-q2x6b\""
Sep 09 16:18:11.406690 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:11.406673    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 09 16:18:11.407614 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:11.407593    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 09 16:18:11.407614 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:11.407602    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 09 16:18:11.407736 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:11.407630    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 09 16:18:11.414033 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:11.414013    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-hl5wh"]
Sep 09 16:18:11.437216 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:11.437194    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:18:11.499995 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:11.499957    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:18:11.515086 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:11.515062    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0761a4d2-2ff2-4d33-8462-771ecc0961e6-data-volume\") pod \"insights-runtime-extractor-hl5wh\" (UID: \"0761a4d2-2ff2-4d33-8462-771ecc0961e6\") " pod="openshift-insights/insights-runtime-extractor-hl5wh"
Sep 09 16:18:11.515201 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:11.515134    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0761a4d2-2ff2-4d33-8462-771ecc0961e6-crio-socket\") pod \"insights-runtime-extractor-hl5wh\" (UID: \"0761a4d2-2ff2-4d33-8462-771ecc0961e6\") " pod="openshift-insights/insights-runtime-extractor-hl5wh"
Sep 09 16:18:11.515260 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:11.515177    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-js74j\" (UniqueName: \"kubernetes.io/projected/0761a4d2-2ff2-4d33-8462-771ecc0961e6-kube-api-access-js74j\") pod \"insights-runtime-extractor-hl5wh\" (UID: \"0761a4d2-2ff2-4d33-8462-771ecc0961e6\") " pod="openshift-insights/insights-runtime-extractor-hl5wh"
Sep 09 16:18:11.515312 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:11.515273    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0761a4d2-2ff2-4d33-8462-771ecc0961e6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hl5wh\" (UID: \"0761a4d2-2ff2-4d33-8462-771ecc0961e6\") " pod="openshift-insights/insights-runtime-extractor-hl5wh"
Sep 09 16:18:11.515374 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:11.515357    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0761a4d2-2ff2-4d33-8462-771ecc0961e6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hl5wh\" (UID: \"0761a4d2-2ff2-4d33-8462-771ecc0961e6\") " pod="openshift-insights/insights-runtime-extractor-hl5wh"
Sep 09 16:18:11.616542 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:11.616514    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0761a4d2-2ff2-4d33-8462-771ecc0961e6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hl5wh\" (UID: \"0761a4d2-2ff2-4d33-8462-771ecc0961e6\") " pod="openshift-insights/insights-runtime-extractor-hl5wh"
Sep 09 16:18:11.616676 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:11.616582    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0761a4d2-2ff2-4d33-8462-771ecc0961e6-data-volume\") pod \"insights-runtime-extractor-hl5wh\" (UID: \"0761a4d2-2ff2-4d33-8462-771ecc0961e6\") " pod="openshift-insights/insights-runtime-extractor-hl5wh"
Sep 09 16:18:11.616676 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:18:11.616635    2583 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 09 16:18:11.616676 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:11.616647    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0761a4d2-2ff2-4d33-8462-771ecc0961e6-crio-socket\") pod \"insights-runtime-extractor-hl5wh\" (UID: \"0761a4d2-2ff2-4d33-8462-771ecc0961e6\") " pod="openshift-insights/insights-runtime-extractor-hl5wh"
Sep 09 16:18:11.616830 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:11.616685    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-js74j\" (UniqueName: \"kubernetes.io/projected/0761a4d2-2ff2-4d33-8462-771ecc0961e6-kube-api-access-js74j\") pod \"insights-runtime-extractor-hl5wh\" (UID: \"0761a4d2-2ff2-4d33-8462-771ecc0961e6\") " pod="openshift-insights/insights-runtime-extractor-hl5wh"
Sep 09 16:18:11.616830 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:11.616714    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0761a4d2-2ff2-4d33-8462-771ecc0961e6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hl5wh\" (UID: \"0761a4d2-2ff2-4d33-8462-771ecc0961e6\") " pod="openshift-insights/insights-runtime-extractor-hl5wh"
Sep 09 16:18:11.616830 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:18:11.616776    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0761a4d2-2ff2-4d33-8462-771ecc0961e6-kube-rbac-proxy-cm podName:0761a4d2-2ff2-4d33-8462-771ecc0961e6 nodeName:}" failed. No retries permitted until 2026-09-09 16:18:12.116745343 +0000 UTC m=+274.470475166 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0761a4d2-2ff2-4d33-8462-771ecc0961e6-kube-rbac-proxy-cm") pod "insights-runtime-extractor-hl5wh" (UID: "0761a4d2-2ff2-4d33-8462-771ecc0961e6") : configmap "kube-rbac-proxy" not found
Sep 09 16:18:11.616830 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:18:11.616826    2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 09 16:18:11.617037 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:18:11.616866    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0761a4d2-2ff2-4d33-8462-771ecc0961e6-insights-runtime-extractor-tls podName:0761a4d2-2ff2-4d33-8462-771ecc0961e6 nodeName:}" failed. No retries permitted until 2026-09-09 16:18:12.116853505 +0000 UTC m=+274.470583325 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0761a4d2-2ff2-4d33-8462-771ecc0961e6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hl5wh" (UID: "0761a4d2-2ff2-4d33-8462-771ecc0961e6") : secret "insights-runtime-extractor-tls" not found
Sep 09 16:18:11.617037 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:11.616821    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0761a4d2-2ff2-4d33-8462-771ecc0961e6-crio-socket\") pod \"insights-runtime-extractor-hl5wh\" (UID: \"0761a4d2-2ff2-4d33-8462-771ecc0961e6\") " pod="openshift-insights/insights-runtime-extractor-hl5wh"
Sep 09 16:18:11.617037 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:11.616900    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0761a4d2-2ff2-4d33-8462-771ecc0961e6-data-volume\") pod \"insights-runtime-extractor-hl5wh\" (UID: \"0761a4d2-2ff2-4d33-8462-771ecc0961e6\") " pod="openshift-insights/insights-runtime-extractor-hl5wh"
Sep 09 16:18:11.624225 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:11.624203    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-js74j\" (UniqueName: \"kubernetes.io/projected/0761a4d2-2ff2-4d33-8462-771ecc0961e6-kube-api-access-js74j\") pod \"insights-runtime-extractor-hl5wh\" (UID: \"0761a4d2-2ff2-4d33-8462-771ecc0961e6\") " pod="openshift-insights/insights-runtime-extractor-hl5wh"
Sep 09 16:18:12.121667 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:12.121632    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0761a4d2-2ff2-4d33-8462-771ecc0961e6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hl5wh\" (UID: \"0761a4d2-2ff2-4d33-8462-771ecc0961e6\") " pod="openshift-insights/insights-runtime-extractor-hl5wh"
Sep 09 16:18:12.121809 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:18:12.121745    2583 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 09 16:18:12.121809 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:12.121777    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0761a4d2-2ff2-4d33-8462-771ecc0961e6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hl5wh\" (UID: \"0761a4d2-2ff2-4d33-8462-771ecc0961e6\") " pod="openshift-insights/insights-runtime-extractor-hl5wh"
Sep 09 16:18:12.121809 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:18:12.121795    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0761a4d2-2ff2-4d33-8462-771ecc0961e6-kube-rbac-proxy-cm podName:0761a4d2-2ff2-4d33-8462-771ecc0961e6 nodeName:}" failed. No retries permitted until 2026-09-09 16:18:13.121779193 +0000 UTC m=+275.475509004 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0761a4d2-2ff2-4d33-8462-771ecc0961e6-kube-rbac-proxy-cm") pod "insights-runtime-extractor-hl5wh" (UID: "0761a4d2-2ff2-4d33-8462-771ecc0961e6") : configmap "kube-rbac-proxy" not found
Sep 09 16:18:12.121960 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:18:12.121875    2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 09 16:18:12.121960 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:18:12.121929    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0761a4d2-2ff2-4d33-8462-771ecc0961e6-insights-runtime-extractor-tls podName:0761a4d2-2ff2-4d33-8462-771ecc0961e6 nodeName:}" failed. No retries permitted until 2026-09-09 16:18:13.121914254 +0000 UTC m=+275.475644065 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0761a4d2-2ff2-4d33-8462-771ecc0961e6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hl5wh" (UID: "0761a4d2-2ff2-4d33-8462-771ecc0961e6") : secret "insights-runtime-extractor-tls" not found
Sep 09 16:18:12.930233 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:12.930202    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-dl57k" event={"ID":"2e7595e7-f00a-4fa7-be8e-f8e4adb4e628","Type":"ContainerStarted","Data":"da950f7c01bc50835836666e77735a178df25ea1cb1ca071daa82628ccc71fca"}
Sep 09 16:18:12.948830 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:12.948782    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-dl57k" podStartSLOduration=2.436268779 podStartE2EDuration="6.9487655s" totalImagesPullingTime="4.512496721s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 16:18:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:18:12.94764121 +0000 UTC m=+275.301371041" watchObservedRunningTime="2026-09-09 16:18:12.9487655 +0000 UTC m=+275.302495333"
Sep 09 16:18:12.973584 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:12.973558    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:18:13.075386 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:13.075357    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:18:13.129834 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:13.129797    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0761a4d2-2ff2-4d33-8462-771ecc0961e6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hl5wh\" (UID: \"0761a4d2-2ff2-4d33-8462-771ecc0961e6\") " pod="openshift-insights/insights-runtime-extractor-hl5wh"
Sep 09 16:18:13.129964 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:13.129871    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0761a4d2-2ff2-4d33-8462-771ecc0961e6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hl5wh\" (UID: \"0761a4d2-2ff2-4d33-8462-771ecc0961e6\") " pod="openshift-insights/insights-runtime-extractor-hl5wh"
Sep 09 16:18:13.129964 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:18:13.129939    2583 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 09 16:18:13.130082 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:18:13.129965    2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 09 16:18:13.130082 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:18:13.130015    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0761a4d2-2ff2-4d33-8462-771ecc0961e6-kube-rbac-proxy-cm podName:0761a4d2-2ff2-4d33-8462-771ecc0961e6 nodeName:}" failed. No retries permitted until 2026-09-09 16:18:15.129979257 +0000 UTC m=+277.483709067 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0761a4d2-2ff2-4d33-8462-771ecc0961e6-kube-rbac-proxy-cm") pod "insights-runtime-extractor-hl5wh" (UID: "0761a4d2-2ff2-4d33-8462-771ecc0961e6") : configmap "kube-rbac-proxy" not found
Sep 09 16:18:13.130082 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:18:13.130054    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0761a4d2-2ff2-4d33-8462-771ecc0961e6-insights-runtime-extractor-tls podName:0761a4d2-2ff2-4d33-8462-771ecc0961e6 nodeName:}" failed. No retries permitted until 2026-09-09 16:18:15.130038058 +0000 UTC m=+277.483767871 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0761a4d2-2ff2-4d33-8462-771ecc0961e6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hl5wh" (UID: "0761a4d2-2ff2-4d33-8462-771ecc0961e6") : secret "insights-runtime-extractor-tls" not found
Sep 09 16:18:13.165381 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:13.165360    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-6df6z_b8492dc1-21be-43db-bd0c-8860f4b76f97/dns-node-resolver/0.log"
Sep 09 16:18:13.173817 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:13.173796    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-fdbb8fdff-2pz8r"]
Sep 09 16:18:13.174557 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:13.174529    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:18:13.176403 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:13.176389    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-2pz8r"
Sep 09 16:18:13.178921 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:13.178904    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Sep 09 16:18:13.178921 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:13.178917    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-ztlw7\""
Sep 09 16:18:13.179081 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:13.178903    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Sep 09 16:18:13.186678 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:13.186658    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-fdbb8fdff-2pz8r"]
Sep 09 16:18:13.230647 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:13.230627    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fg65l\" (UniqueName: \"kubernetes.io/projected/350079f0-f663-4f7b-9eda-5e51a24eb243-kube-api-access-fg65l\") pod \"migrator-fdbb8fdff-2pz8r\" (UID: \"350079f0-f663-4f7b-9eda-5e51a24eb243\") " pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-2pz8r"
Sep 09 16:18:13.239355 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:13.239332    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:18:13.331118 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:13.331098    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fg65l\" (UniqueName: \"kubernetes.io/projected/350079f0-f663-4f7b-9eda-5e51a24eb243-kube-api-access-fg65l\") pod \"migrator-fdbb8fdff-2pz8r\" (UID: \"350079f0-f663-4f7b-9eda-5e51a24eb243\") " pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-2pz8r"
Sep 09 16:18:13.339168 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:13.339145    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fg65l\" (UniqueName: \"kubernetes.io/projected/350079f0-f663-4f7b-9eda-5e51a24eb243-kube-api-access-fg65l\") pod \"migrator-fdbb8fdff-2pz8r\" (UID: \"350079f0-f663-4f7b-9eda-5e51a24eb243\") " pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-2pz8r"
Sep 09 16:18:13.485956 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:13.485900    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-2pz8r"
Sep 09 16:18:13.659175 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:13.659145    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:18:13.756783 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:13.756722    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-fdbb8fdff-2pz8r"]
Sep 09 16:18:13.759385 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:18:13.759362    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod350079f0_f663_4f7b_9eda_5e51a24eb243.slice/crio-38e3973e3082cf3adfd1208af9daf3d01a9f1128c5558ebabd10cbb876323352 WatchSource:0}: Error finding container 38e3973e3082cf3adfd1208af9daf3d01a9f1128c5558ebabd10cbb876323352: Status 404 returned error can't find the container with id 38e3973e3082cf3adfd1208af9daf3d01a9f1128c5558ebabd10cbb876323352
Sep 09 16:18:13.911860 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:13.911837    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:18:13.935568 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:13.935544    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-2pz8r" event={"ID":"350079f0-f663-4f7b-9eda-5e51a24eb243","Type":"ContainerStarted","Data":"38e3973e3082cf3adfd1208af9daf3d01a9f1128c5558ebabd10cbb876323352"}
Sep 09 16:18:14.540246 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:14.540217    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/83ef6f08-6c9b-4e4a-8d3f-2ac0e855bd2c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-cx95g\" (UID: \"83ef6f08-6c9b-4e4a-8d3f-2ac0e855bd2c\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-cx95g"
Sep 09 16:18:14.540406 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:18:14.540378    2583 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 09 16:18:14.540513 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:18:14.540459    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/83ef6f08-6c9b-4e4a-8d3f-2ac0e855bd2c-cluster-monitoring-operator-tls podName:83ef6f08-6c9b-4e4a-8d3f-2ac0e855bd2c nodeName:}" failed. No retries permitted until 2026-09-09 16:18:22.540438409 +0000 UTC m=+284.894168219 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/83ef6f08-6c9b-4e4a-8d3f-2ac0e855bd2c-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-cx95g" (UID: "83ef6f08-6c9b-4e4a-8d3f-2ac0e855bd2c") : secret "cluster-monitoring-operator-tls" not found
Sep 09 16:18:14.566976 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:14.566955    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-xfwg5_23975f85-e5cd-4329-9152-0d52fbdefcde/node-ca/0.log"
Sep 09 16:18:14.641516 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:14.641493    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c39100a1-7825-46ce-9573-de82e10a7772-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-brfr9\" (UID: \"c39100a1-7825-46ce-9573-de82e10a7772\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-brfr9"
Sep 09 16:18:14.641601 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:14.641560    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/42d53258-31de-41f2-8ef9-887e6e89cac2-metrics-certs\") pod \"router-default-55d847bddd-kr8vk\" (UID: \"42d53258-31de-41f2-8ef9-887e6e89cac2\") " pod="openshift-ingress/router-default-55d847bddd-kr8vk"
Sep 09 16:18:14.641648 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:14.641599    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/42d53258-31de-41f2-8ef9-887e6e89cac2-service-ca-bundle\") pod \"router-default-55d847bddd-kr8vk\" (UID: \"42d53258-31de-41f2-8ef9-887e6e89cac2\") " pod="openshift-ingress/router-default-55d847bddd-kr8vk"
Sep 09 16:18:14.641648 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:18:14.641618    2583 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 09 16:18:14.641739 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:18:14.641669    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c39100a1-7825-46ce-9573-de82e10a7772-samples-operator-tls podName:c39100a1-7825-46ce-9573-de82e10a7772 nodeName:}" failed. No retries permitted until 2026-09-09 16:18:22.641657124 +0000 UTC m=+284.995386935 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/c39100a1-7825-46ce-9573-de82e10a7772-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-brfr9" (UID: "c39100a1-7825-46ce-9573-de82e10a7772") : secret "samples-operator-tls" not found
Sep 09 16:18:14.641739 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:18:14.641682    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/42d53258-31de-41f2-8ef9-887e6e89cac2-service-ca-bundle podName:42d53258-31de-41f2-8ef9-887e6e89cac2 nodeName:}" failed. No retries permitted until 2026-09-09 16:18:22.641676352 +0000 UTC m=+284.995406163 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/42d53258-31de-41f2-8ef9-887e6e89cac2-service-ca-bundle") pod "router-default-55d847bddd-kr8vk" (UID: "42d53258-31de-41f2-8ef9-887e6e89cac2") : configmap references non-existent config key: service-ca.crt
Sep 09 16:18:14.641739 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:18:14.641695    2583 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 09 16:18:14.641849 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:18:14.641742    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/42d53258-31de-41f2-8ef9-887e6e89cac2-metrics-certs podName:42d53258-31de-41f2-8ef9-887e6e89cac2 nodeName:}" failed. No retries permitted until 2026-09-09 16:18:22.641727609 +0000 UTC m=+284.995457434 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/42d53258-31de-41f2-8ef9-887e6e89cac2-metrics-certs") pod "router-default-55d847bddd-kr8vk" (UID: "42d53258-31de-41f2-8ef9-887e6e89cac2") : secret "router-metrics-certs-default" not found
Sep 09 16:18:15.144849 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:15.144807    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0761a4d2-2ff2-4d33-8462-771ecc0961e6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hl5wh\" (UID: \"0761a4d2-2ff2-4d33-8462-771ecc0961e6\") " pod="openshift-insights/insights-runtime-extractor-hl5wh"
Sep 09 16:18:15.145266 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:18:15.144933    2583 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 09 16:18:15.145266 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:15.144945    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0761a4d2-2ff2-4d33-8462-771ecc0961e6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hl5wh\" (UID: \"0761a4d2-2ff2-4d33-8462-771ecc0961e6\") " pod="openshift-insights/insights-runtime-extractor-hl5wh"
Sep 09 16:18:15.145266 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:18:15.145015    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0761a4d2-2ff2-4d33-8462-771ecc0961e6-kube-rbac-proxy-cm podName:0761a4d2-2ff2-4d33-8462-771ecc0961e6 nodeName:}" failed. No retries permitted until 2026-09-09 16:18:19.144992427 +0000 UTC m=+281.498722252 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0761a4d2-2ff2-4d33-8462-771ecc0961e6-kube-rbac-proxy-cm") pod "insights-runtime-extractor-hl5wh" (UID: "0761a4d2-2ff2-4d33-8462-771ecc0961e6") : configmap "kube-rbac-proxy" not found
Sep 09 16:18:15.145266 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:18:15.145080    2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 09 16:18:15.145266 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:18:15.145140    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0761a4d2-2ff2-4d33-8462-771ecc0961e6-insights-runtime-extractor-tls podName:0761a4d2-2ff2-4d33-8462-771ecc0961e6 nodeName:}" failed. No retries permitted until 2026-09-09 16:18:19.145124853 +0000 UTC m=+281.498854667 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0761a4d2-2ff2-4d33-8462-771ecc0961e6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hl5wh" (UID: "0761a4d2-2ff2-4d33-8462-771ecc0961e6") : secret "insights-runtime-extractor-tls" not found
Sep 09 16:18:15.166007 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:15.165958    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-n7vc2_b16dca46-9632-4408-9ae4-320cc254b225/serve-healthcheck-canary/0.log"
Sep 09 16:18:15.656819 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:18:15.656785    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-xzslz" podUID="3b749ab0-b112-4083-8efc-6d45e9c5e6c2"
Sep 09 16:18:15.656819 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:18:15.656808    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-79977f9844-779cg" podUID="c4338f01-9c80-4c3d-b2e1-187d647cb696"
Sep 09 16:18:15.656963 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:18:15.656848    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-59fcb64bf-tzq28" podUID="f82110b1-4cd3-40e9-b412-ede8228aed4b"
Sep 09 16:18:15.944272 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:15.944207    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-59fcb64bf-tzq28"
Sep 09 16:18:15.944272 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:15.944251    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-2pz8r" event={"ID":"350079f0-f663-4f7b-9eda-5e51a24eb243","Type":"ContainerStarted","Data":"9eefa67b5a358c996b7e35a552d72ae51725a9b724673ff5d1e3ee6a0d09eba7"}
Sep 09 16:18:15.944415 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:15.944345    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-2pz8r" event={"ID":"350079f0-f663-4f7b-9eda-5e51a24eb243","Type":"ContainerStarted","Data":"882b20a43e57430c671654b29eaa7c333f64eff757a75697b643d15499e25b9e"}
Sep 09 16:18:15.944503 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:15.944482    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xzslz"
Sep 09 16:18:15.944683 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:15.944663    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-79977f9844-779cg"
Sep 09 16:18:15.960670 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:15.960616    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-2pz8r" podStartSLOduration=1.563501075 podStartE2EDuration="2.960602685s" totalImagesPullingTime="1.39710161s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 16:18:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:18:15.958736996 +0000 UTC m=+278.312466845" watchObservedRunningTime="2026-09-09 16:18:15.960602685 +0000 UTC m=+278.314332516"
Sep 09 16:18:16.654566 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:16.654531    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:18:18.349306 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:18.349274    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:18:18.479244 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:18.479219    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:18:18.580508 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:18.580485    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:18:18.681418 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:18.681356    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:18:18.781261 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:18.781236    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:18:19.176252 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:19.176220    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0761a4d2-2ff2-4d33-8462-771ecc0961e6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hl5wh\" (UID: \"0761a4d2-2ff2-4d33-8462-771ecc0961e6\") " pod="openshift-insights/insights-runtime-extractor-hl5wh"
Sep 09 16:18:19.176362 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:19.176276    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0761a4d2-2ff2-4d33-8462-771ecc0961e6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hl5wh\" (UID: \"0761a4d2-2ff2-4d33-8462-771ecc0961e6\") " pod="openshift-insights/insights-runtime-extractor-hl5wh"
Sep 09 16:18:19.176405 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:18:19.176366    2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 09 16:18:19.176444 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:18:19.176403    2583 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 09 16:18:19.176444 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:18:19.176427    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0761a4d2-2ff2-4d33-8462-771ecc0961e6-insights-runtime-extractor-tls podName:0761a4d2-2ff2-4d33-8462-771ecc0961e6 nodeName:}" failed. No retries permitted until 2026-09-09 16:18:27.176412612 +0000 UTC m=+289.530142427 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0761a4d2-2ff2-4d33-8462-771ecc0961e6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hl5wh" (UID: "0761a4d2-2ff2-4d33-8462-771ecc0961e6") : secret "insights-runtime-extractor-tls" not found
Sep 09 16:18:19.176509 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:18:19.176455    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0761a4d2-2ff2-4d33-8462-771ecc0961e6-kube-rbac-proxy-cm podName:0761a4d2-2ff2-4d33-8462-771ecc0961e6 nodeName:}" failed. No retries permitted until 2026-09-09 16:18:27.176438875 +0000 UTC m=+289.530168690 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0761a4d2-2ff2-4d33-8462-771ecc0961e6-kube-rbac-proxy-cm") pod "insights-runtime-extractor-hl5wh" (UID: "0761a4d2-2ff2-4d33-8462-771ecc0961e6") : configmap "kube-rbac-proxy" not found
Sep 09 16:18:19.242257 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:19.242227    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:18:19.377646 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:19.377611    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f82110b1-4cd3-40e9-b412-ede8228aed4b-registry-tls\") pod \"image-registry-59fcb64bf-tzq28\" (UID: \"f82110b1-4cd3-40e9-b412-ede8228aed4b\") " pod="openshift-image-registry/image-registry-59fcb64bf-tzq28"
Sep 09 16:18:19.377957 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:19.377666    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c4338f01-9c80-4c3d-b2e1-187d647cb696-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-779cg\" (UID: \"c4338f01-9c80-4c3d-b2e1-187d647cb696\") " pod="openshift-network-console/networking-console-plugin-79977f9844-779cg"
Sep 09 16:18:19.377957 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:19.377693    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3b749ab0-b112-4083-8efc-6d45e9c5e6c2-metrics-tls\") pod \"dns-default-xzslz\" (UID: \"3b749ab0-b112-4083-8efc-6d45e9c5e6c2\") " pod="openshift-dns/dns-default-xzslz"
Sep 09 16:18:19.377957 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:18:19.377762    2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 09 16:18:19.377957 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:18:19.377778    2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-59fcb64bf-tzq28: secret "image-registry-tls" not found
Sep 09 16:18:19.377957 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:18:19.377813    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f82110b1-4cd3-40e9-b412-ede8228aed4b-registry-tls podName:f82110b1-4cd3-40e9-b412-ede8228aed4b nodeName:}" failed. No retries permitted until 2026-09-09 16:20:21.377803785 +0000 UTC m=+403.731533599 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f82110b1-4cd3-40e9-b412-ede8228aed4b-registry-tls") pod "image-registry-59fcb64bf-tzq28" (UID: "f82110b1-4cd3-40e9-b412-ede8228aed4b") : secret "image-registry-tls" not found
Sep 09 16:18:19.377957 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:18:19.377763    2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 09 16:18:19.377957 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:18:19.377870    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b749ab0-b112-4083-8efc-6d45e9c5e6c2-metrics-tls podName:3b749ab0-b112-4083-8efc-6d45e9c5e6c2 nodeName:}" failed. No retries permitted until 2026-09-09 16:20:21.377859151 +0000 UTC m=+403.731589013 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3b749ab0-b112-4083-8efc-6d45e9c5e6c2-metrics-tls") pod "dns-default-xzslz" (UID: "3b749ab0-b112-4083-8efc-6d45e9c5e6c2") : secret "dns-default-metrics-tls" not found
Sep 09 16:18:19.377957 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:18:19.377766    2583 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 09 16:18:19.377957 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:18:19.377909    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c4338f01-9c80-4c3d-b2e1-187d647cb696-networking-console-plugin-cert podName:c4338f01-9c80-4c3d-b2e1-187d647cb696 nodeName:}" failed. No retries permitted until 2026-09-09 16:20:21.377900052 +0000 UTC m=+403.731629867 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c4338f01-9c80-4c3d-b2e1-187d647cb696-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-779cg" (UID: "c4338f01-9c80-4c3d-b2e1-187d647cb696") : secret "networking-console-plugin-cert" not found
Sep 09 16:18:19.848949 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:19.848920    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:18:20.009601 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:20.009577    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:18:20.244819 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:20.244764    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:18:20.648711 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:20.648686    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:18:20.847174 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:20.847146    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:18:21.246347 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:21.246301    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:18:21.827281 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:21.827257    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:18:22.041216 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:22.041188    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:18:22.242440 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:22.242388    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:18:22.440554 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:22.440527    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:18:22.603431 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:22.603401    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/83ef6f08-6c9b-4e4a-8d3f-2ac0e855bd2c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-cx95g\" (UID: \"83ef6f08-6c9b-4e4a-8d3f-2ac0e855bd2c\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-cx95g"
Sep 09 16:18:22.603565 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:18:22.603547    2583 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 09 16:18:22.603623 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:18:22.603611    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/83ef6f08-6c9b-4e4a-8d3f-2ac0e855bd2c-cluster-monitoring-operator-tls podName:83ef6f08-6c9b-4e4a-8d3f-2ac0e855bd2c nodeName:}" failed. No retries permitted until 2026-09-09 16:18:38.603597985 +0000 UTC m=+300.957327799 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/83ef6f08-6c9b-4e4a-8d3f-2ac0e855bd2c-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-cx95g" (UID: "83ef6f08-6c9b-4e4a-8d3f-2ac0e855bd2c") : secret "cluster-monitoring-operator-tls" not found
Sep 09 16:18:22.654508 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:22.654484    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:18:22.704532 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:22.704505    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/42d53258-31de-41f2-8ef9-887e6e89cac2-service-ca-bundle\") pod \"router-default-55d847bddd-kr8vk\" (UID: \"42d53258-31de-41f2-8ef9-887e6e89cac2\") " pod="openshift-ingress/router-default-55d847bddd-kr8vk"
Sep 09 16:18:22.704634 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:22.704565    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c39100a1-7825-46ce-9573-de82e10a7772-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-brfr9\" (UID: \"c39100a1-7825-46ce-9573-de82e10a7772\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-brfr9"
Sep 09 16:18:22.704683 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:18:22.704653    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/42d53258-31de-41f2-8ef9-887e6e89cac2-service-ca-bundle podName:42d53258-31de-41f2-8ef9-887e6e89cac2 nodeName:}" failed. No retries permitted until 2026-09-09 16:18:38.704638089 +0000 UTC m=+301.058367904 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/42d53258-31de-41f2-8ef9-887e6e89cac2-service-ca-bundle") pod "router-default-55d847bddd-kr8vk" (UID: "42d53258-31de-41f2-8ef9-887e6e89cac2") : configmap references non-existent config key: service-ca.crt
Sep 09 16:18:22.704731 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:22.704681    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/42d53258-31de-41f2-8ef9-887e6e89cac2-metrics-certs\") pod \"router-default-55d847bddd-kr8vk\" (UID: \"42d53258-31de-41f2-8ef9-887e6e89cac2\") " pod="openshift-ingress/router-default-55d847bddd-kr8vk"
Sep 09 16:18:22.704796 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:18:22.704781    2583 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 09 16:18:22.704833 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:18:22.704825    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/42d53258-31de-41f2-8ef9-887e6e89cac2-metrics-certs podName:42d53258-31de-41f2-8ef9-887e6e89cac2 nodeName:}" failed. No retries permitted until 2026-09-09 16:18:38.704814061 +0000 UTC m=+301.058543881 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/42d53258-31de-41f2-8ef9-887e6e89cac2-metrics-certs") pod "router-default-55d847bddd-kr8vk" (UID: "42d53258-31de-41f2-8ef9-887e6e89cac2") : secret "router-metrics-certs-default" not found
Sep 09 16:18:22.707100 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:22.707077    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c39100a1-7825-46ce-9573-de82e10a7772-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-brfr9\" (UID: \"c39100a1-7825-46ce-9573-de82e10a7772\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-brfr9"
Sep 09 16:18:22.793348 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:22.793326    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-brfr9"
Sep 09 16:18:22.843925 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:22.843891    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:18:23.052595 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:23.052518    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:18:23.064708 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:23.064687    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-brfr9"]
Sep 09 16:18:23.844143 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:23.844118    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:18:23.969693 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:23.969652    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-brfr9" event={"ID":"c39100a1-7825-46ce-9573-de82e10a7772","Type":"ContainerStarted","Data":"eca6f8f0cc0e4f16084484bd2d335d3806729ac04c7d5a9b0add83392cd7c277"}
Sep 09 16:18:24.071954 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:24.071924    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:18:24.465242 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:24.465218    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:18:24.645412 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:24.645389    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:18:24.835383 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:24.835354    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:18:25.040959 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:25.040926    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:18:25.248802 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:25.248780    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:18:25.839489 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:25.839455    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:18:25.978158 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:25.978127    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-brfr9" event={"ID":"c39100a1-7825-46ce-9573-de82e10a7772","Type":"ContainerStarted","Data":"720d5963610ae99871ee98ca9199d9433f8f11c42da925d6968179c498bffd27"}
Sep 09 16:18:25.978290 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:25.978178    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-brfr9" event={"ID":"c39100a1-7825-46ce-9573-de82e10a7772","Type":"ContainerStarted","Data":"259fcdf25c1cbc55ddf586a8c269617b54d01a7bb7eac52dd07eeecf847b0579"}
Sep 09 16:18:25.994479 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:25.994429    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-brfr9" podStartSLOduration=17.940441813 podStartE2EDuration="19.994411204s" totalImagesPullingTime="2.053969391s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 16:18:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:18:25.993811292 +0000 UTC m=+288.347541144" watchObservedRunningTime="2026-09-09 16:18:25.994411204 +0000 UTC m=+288.348141035"
Sep 09 16:18:26.441571 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:26.441542    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:18:26.641808 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:26.641776    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:18:27.041389 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:27.041362    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:18:27.233790 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:18:27.233758    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-qmp4p" podUID="f8a2ea6e-22df-4b6d-b1b1-e554e877f94c"
Sep 09 16:18:27.241912 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:27.241888    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0761a4d2-2ff2-4d33-8462-771ecc0961e6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hl5wh\" (UID: \"0761a4d2-2ff2-4d33-8462-771ecc0961e6\") " pod="openshift-insights/insights-runtime-extractor-hl5wh"
Sep 09 16:18:27.242025 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:27.242009    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0761a4d2-2ff2-4d33-8462-771ecc0961e6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hl5wh\" (UID: \"0761a4d2-2ff2-4d33-8462-771ecc0961e6\") " pod="openshift-insights/insights-runtime-extractor-hl5wh"
Sep 09 16:18:27.242115 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:18:27.242102    2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 09 16:18:27.242189 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:18:27.242158    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0761a4d2-2ff2-4d33-8462-771ecc0961e6-insights-runtime-extractor-tls podName:0761a4d2-2ff2-4d33-8462-771ecc0961e6 nodeName:}" failed. No retries permitted until 2026-09-09 16:18:43.24214144 +0000 UTC m=+305.595871252 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0761a4d2-2ff2-4d33-8462-771ecc0961e6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hl5wh" (UID: "0761a4d2-2ff2-4d33-8462-771ecc0961e6") : secret "insights-runtime-extractor-tls" not found
Sep 09 16:18:27.242543 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:27.242521    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0761a4d2-2ff2-4d33-8462-771ecc0961e6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hl5wh\" (UID: \"0761a4d2-2ff2-4d33-8462-771ecc0961e6\") " pod="openshift-insights/insights-runtime-extractor-hl5wh"
Sep 09 16:18:27.283405 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:27.283382    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:18:27.384063 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:27.384036    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:18:27.646876 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:27.646823    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:18:28.040049 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:28.039979    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:18:28.772360 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:28.772337    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:18:28.872208 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:28.872188    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:18:29.043047 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:29.043000    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:18:29.720625 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:29.720588    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:18:29.822085 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:29.822061    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:18:30.026594 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:30.026544    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:18:30.397465 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:30.397442    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:18:30.451261 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:30.451237    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:18:30.642881 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:30.642859    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:18:30.709668 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:30.709599    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:18:30.808392 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:30.808367    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:18:31.018587 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:31.018537    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:18:31.141450 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:31.141428    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:18:31.409626 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:31.409605    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:18:31.614997 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:31.614959    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:18:31.713820 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:31.713765    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:18:32.622237 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:32.622186    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:18:33.724762 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:33.724731    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-85d98c998f-wclnp"]
Sep 09 16:18:33.727927 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:33.727906    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-85d98c998f-wclnp"
Sep 09 16:18:33.730764 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:33.730733    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 09 16:18:33.730887 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:33.730869    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 09 16:18:33.730968 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:33.730953    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-brvcs\""
Sep 09 16:18:33.737909 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:33.737887    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-85d98c998f-wclnp"]
Sep 09 16:18:33.797936 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:33.797910    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9mshv\" (UniqueName: \"kubernetes.io/projected/26eb930e-4ab4-45f3-bc28-2e2bdd63e036-kube-api-access-9mshv\") pod \"downloads-85d98c998f-wclnp\" (UID: \"26eb930e-4ab4-45f3-bc28-2e2bdd63e036\") " pod="openshift-console/downloads-85d98c998f-wclnp"
Sep 09 16:18:33.803390 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:33.803371    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:18:33.899179 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:33.899156    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9mshv\" (UniqueName: \"kubernetes.io/projected/26eb930e-4ab4-45f3-bc28-2e2bdd63e036-kube-api-access-9mshv\") pod \"downloads-85d98c998f-wclnp\" (UID: \"26eb930e-4ab4-45f3-bc28-2e2bdd63e036\") " pod="openshift-console/downloads-85d98c998f-wclnp"
Sep 09 16:18:33.902174 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:33.902147    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:18:33.911864 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:33.911846    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9mshv\" (UniqueName: \"kubernetes.io/projected/26eb930e-4ab4-45f3-bc28-2e2bdd63e036-kube-api-access-9mshv\") pod \"downloads-85d98c998f-wclnp\" (UID: \"26eb930e-4ab4-45f3-bc28-2e2bdd63e036\") " pod="openshift-console/downloads-85d98c998f-wclnp"
Sep 09 16:18:34.037126 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:34.037076    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-85d98c998f-wclnp"
Sep 09 16:18:34.303418 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:34.303358    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-85d98c998f-wclnp"]
Sep 09 16:18:34.306338 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:18:34.306311    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26eb930e_4ab4_45f3_bc28_2e2bdd63e036.slice/crio-1b9e44c4c7c4c371548fee47326a4e4541b2f2f060e17a4594b7a98f571a3403 WatchSource:0}: Error finding container 1b9e44c4c7c4c371548fee47326a4e4541b2f2f060e17a4594b7a98f571a3403: Status 404 returned error can't find the container with id 1b9e44c4c7c4c371548fee47326a4e4541b2f2f060e17a4594b7a98f571a3403
Sep 09 16:18:35.006534 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:35.006503    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-85d98c998f-wclnp" event={"ID":"26eb930e-4ab4-45f3-bc28-2e2bdd63e036","Type":"ContainerStarted","Data":"1b9e44c4c7c4c371548fee47326a4e4541b2f2f060e17a4594b7a98f571a3403"}
Sep 09 16:18:38.076464 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:38.076441    2583 kubelet.go:1648] "Image garbage collection succeeded"
Sep 09 16:18:38.626867 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:38.626830    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:18:38.633729 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:38.633705    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/83ef6f08-6c9b-4e4a-8d3f-2ac0e855bd2c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-cx95g\" (UID: \"83ef6f08-6c9b-4e4a-8d3f-2ac0e855bd2c\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-cx95g"
Sep 09 16:18:38.636108 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:38.636089    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/83ef6f08-6c9b-4e4a-8d3f-2ac0e855bd2c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-cx95g\" (UID: \"83ef6f08-6c9b-4e4a-8d3f-2ac0e855bd2c\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-cx95g"
Sep 09 16:18:38.680878 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:38.680858    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:18:38.734185 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:38.734158    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/42d53258-31de-41f2-8ef9-887e6e89cac2-metrics-certs\") pod \"router-default-55d847bddd-kr8vk\" (UID: \"42d53258-31de-41f2-8ef9-887e6e89cac2\") " pod="openshift-ingress/router-default-55d847bddd-kr8vk"
Sep 09 16:18:38.734285 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:38.734250    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/42d53258-31de-41f2-8ef9-887e6e89cac2-service-ca-bundle\") pod \"router-default-55d847bddd-kr8vk\" (UID: \"42d53258-31de-41f2-8ef9-887e6e89cac2\") " pod="openshift-ingress/router-default-55d847bddd-kr8vk"
Sep 09 16:18:38.734804 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:38.734784    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/42d53258-31de-41f2-8ef9-887e6e89cac2-service-ca-bundle\") pod \"router-default-55d847bddd-kr8vk\" (UID: \"42d53258-31de-41f2-8ef9-887e6e89cac2\") " pod="openshift-ingress/router-default-55d847bddd-kr8vk"
Sep 09 16:18:38.736798 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:38.736772    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/42d53258-31de-41f2-8ef9-887e6e89cac2-metrics-certs\") pod \"router-default-55d847bddd-kr8vk\" (UID: \"42d53258-31de-41f2-8ef9-887e6e89cac2\") " pod="openshift-ingress/router-default-55d847bddd-kr8vk"
Sep 09 16:18:38.908196 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:38.908137    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-k5429\""
Sep 09 16:18:38.915448 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:38.915432    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-cx95g"
Sep 09 16:18:39.001562 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:39.001512    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-7mqwh\""
Sep 09 16:18:39.009881 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:39.009855    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-55d847bddd-kr8vk"
Sep 09 16:18:39.186367 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:39.186300    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cdcc96965-cx95g"]
Sep 09 16:18:39.189053 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:18:39.189026    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83ef6f08_6c9b_4e4a_8d3f_2ac0e855bd2c.slice/crio-75f66d918a5c377e2a5353ad040cc5c17bf669f654630961a0670b3bfc2e18de WatchSource:0}: Error finding container 75f66d918a5c377e2a5353ad040cc5c17bf669f654630961a0670b3bfc2e18de: Status 404 returned error can't find the container with id 75f66d918a5c377e2a5353ad040cc5c17bf669f654630961a0670b3bfc2e18de
Sep 09 16:18:39.233106 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:39.233082    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmp4p"
Sep 09 16:18:39.283259 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:39.283231    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-55d847bddd-kr8vk"]
Sep 09 16:18:39.285275 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:18:39.285251    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42d53258_31de_41f2_8ef9_887e6e89cac2.slice/crio-b23c7e2c84e57b4648e995d3805c528f640403333226ad2f07756552acf59550 WatchSource:0}: Error finding container b23c7e2c84e57b4648e995d3805c528f640403333226ad2f07756552acf59550: Status 404 returned error can't find the container with id b23c7e2c84e57b4648e995d3805c528f640403333226ad2f07756552acf59550
Sep 09 16:18:40.025143 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:40.025103    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-cx95g" event={"ID":"83ef6f08-6c9b-4e4a-8d3f-2ac0e855bd2c","Type":"ContainerStarted","Data":"75f66d918a5c377e2a5353ad040cc5c17bf669f654630961a0670b3bfc2e18de"}
Sep 09 16:18:40.027198 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:40.027171    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-55d847bddd-kr8vk" event={"ID":"42d53258-31de-41f2-8ef9-887e6e89cac2","Type":"ContainerStarted","Data":"d40ed5ff60bb45f801910154e4d0ea0f8a7b20de4ac497f92c49c0535f469e60"}
Sep 09 16:18:40.027341 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:40.027216    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-55d847bddd-kr8vk" event={"ID":"42d53258-31de-41f2-8ef9-887e6e89cac2","Type":"ContainerStarted","Data":"b23c7e2c84e57b4648e995d3805c528f640403333226ad2f07756552acf59550"}
Sep 09 16:18:40.047448 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:40.047398    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-55d847bddd-kr8vk" podStartSLOduration=34.047381038 podStartE2EDuration="34.047381038s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 16:18:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:18:40.047234527 +0000 UTC m=+302.400964388" watchObservedRunningTime="2026-09-09 16:18:40.047381038 +0000 UTC m=+302.401110867"
Sep 09 16:18:41.011105 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:41.011071    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-55d847bddd-kr8vk"
Sep 09 16:18:41.013833 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:41.013812    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-55d847bddd-kr8vk"
Sep 09 16:18:41.031429 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:41.031376    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-55d847bddd-kr8vk"
Sep 09 16:18:41.032458 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:41.032436    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-55d847bddd-kr8vk"
Sep 09 16:18:41.418113 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:41.418079    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:18:41.580690 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:41.580656    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-gclwc"]
Sep 09 16:18:41.583875 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:41.583855    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-gclwc"
Sep 09 16:18:41.586601 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:41.586582    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Sep 09 16:18:41.586719 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:41.586613    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-hxkbk\""
Sep 09 16:18:41.594216 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:41.594198    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-gclwc"]
Sep 09 16:18:41.659257 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:41.659236    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/9da2b140-3a48-4380-9c19-fd0ef92e8c26-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-gclwc\" (UID: \"9da2b140-3a48-4380-9c19-fd0ef92e8c26\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-gclwc"
Sep 09 16:18:41.759949 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:41.759884    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/9da2b140-3a48-4380-9c19-fd0ef92e8c26-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-gclwc\" (UID: \"9da2b140-3a48-4380-9c19-fd0ef92e8c26\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-gclwc"
Sep 09 16:18:41.762647 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:41.762627    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/9da2b140-3a48-4380-9c19-fd0ef92e8c26-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-gclwc\" (UID: \"9da2b140-3a48-4380-9c19-fd0ef92e8c26\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-gclwc"
Sep 09 16:18:41.894648 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:41.894626    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-gclwc"
Sep 09 16:18:42.036684 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:42.036570    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-cx95g" event={"ID":"83ef6f08-6c9b-4e4a-8d3f-2ac0e855bd2c","Type":"ContainerStarted","Data":"9823bb782120c2a2d1381d126e87ce29aa4f0e61ebcb669bfd4fb4b072f401fa"}
Sep 09 16:18:42.051913 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:42.051871    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-cx95g" podStartSLOduration=34.152777926 podStartE2EDuration="36.051855002s" totalImagesPullingTime="1.899077076s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 16:18:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:18:42.050789806 +0000 UTC m=+304.404519660" watchObservedRunningTime="2026-09-09 16:18:42.051855002 +0000 UTC m=+304.405584833"
Sep 09 16:18:42.169062 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:42.169033    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-gclwc"]
Sep 09 16:18:42.172154 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:18:42.172127    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9da2b140_3a48_4380_9c19_fd0ef92e8c26.slice/crio-653211efc89935817dc9de6379d271c9fd8e159a8774b96cf3fee9c392385de8 WatchSource:0}: Error finding container 653211efc89935817dc9de6379d271c9fd8e159a8774b96cf3fee9c392385de8: Status 404 returned error can't find the container with id 653211efc89935817dc9de6379d271c9fd8e159a8774b96cf3fee9c392385de8
Sep 09 16:18:42.174873 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:42.174853    2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 09 16:18:42.534195 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:42.534159    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:18:43.041155 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:43.041119    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-gclwc" event={"ID":"9da2b140-3a48-4380-9c19-fd0ef92e8c26","Type":"ContainerStarted","Data":"653211efc89935817dc9de6379d271c9fd8e159a8774b96cf3fee9c392385de8"}
Sep 09 16:18:43.270559 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:43.270527    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0761a4d2-2ff2-4d33-8462-771ecc0961e6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hl5wh\" (UID: \"0761a4d2-2ff2-4d33-8462-771ecc0961e6\") " pod="openshift-insights/insights-runtime-extractor-hl5wh"
Sep 09 16:18:43.272905 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:43.272879    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0761a4d2-2ff2-4d33-8462-771ecc0961e6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hl5wh\" (UID: \"0761a4d2-2ff2-4d33-8462-771ecc0961e6\") " pod="openshift-insights/insights-runtime-extractor-hl5wh"
Sep 09 16:18:43.516952 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:43.516927    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-q2x6b\""
Sep 09 16:18:43.525299 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:43.525273    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-hl5wh"
Sep 09 16:18:43.801541 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:43.801471    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-hl5wh"]
Sep 09 16:18:43.804507 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:18:43.804477    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0761a4d2_2ff2_4d33_8462_771ecc0961e6.slice/crio-0d46b8ea723a33d24d078ad95099b65fb3d59476f0f9d4b108a58e7a4f6be4fa WatchSource:0}: Error finding container 0d46b8ea723a33d24d078ad95099b65fb3d59476f0f9d4b108a58e7a4f6be4fa: Status 404 returned error can't find the container with id 0d46b8ea723a33d24d078ad95099b65fb3d59476f0f9d4b108a58e7a4f6be4fa
Sep 09 16:18:44.045303 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:44.045277    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hl5wh" event={"ID":"0761a4d2-2ff2-4d33-8462-771ecc0961e6","Type":"ContainerStarted","Data":"62776a8ef71d295a4f484e6b66fc2c28aec131d7c5079e6f5da0bdae3282adb3"}
Sep 09 16:18:44.045662 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:44.045326    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hl5wh" event={"ID":"0761a4d2-2ff2-4d33-8462-771ecc0961e6","Type":"ContainerStarted","Data":"0d46b8ea723a33d24d078ad95099b65fb3d59476f0f9d4b108a58e7a4f6be4fa"}
Sep 09 16:18:45.648235 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:45.648187    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:18:47.648694 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:47.648661    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:18:47.708143 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:47.708076    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:18:48.525255 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:48.525209    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:18:48.624751 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:48.624725    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:18:50.252763 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:50.252721    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:18:51.072684 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:51.072632    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hl5wh" event={"ID":"0761a4d2-2ff2-4d33-8462-771ecc0961e6","Type":"ContainerStarted","Data":"9014a700549642ba55891e87c7aa1c63c0e8810a9ebd3fa83a96443524618e28"}
Sep 09 16:18:51.074742 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:51.074709    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-85d98c998f-wclnp" event={"ID":"26eb930e-4ab4-45f3-bc28-2e2bdd63e036","Type":"ContainerStarted","Data":"df9616d0a3dae644470ba8cbcd297bb560c2c04c9e6832a8baad57f9883d9408"}
Sep 09 16:18:51.075434 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:51.075131    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-85d98c998f-wclnp"
Sep 09 16:18:51.090632 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:51.090545    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-85d98c998f-wclnp"
Sep 09 16:18:51.096016 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:51.095954    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-85d98c998f-wclnp" podStartSLOduration=1.829015705 podStartE2EDuration="18.09593858s" totalImagesPullingTime="16.266922875s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 16:18:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:18:51.095748974 +0000 UTC m=+313.449478805" watchObservedRunningTime="2026-09-09 16:18:51.09593858 +0000 UTC m=+313.449668414"
Sep 09 16:18:52.081882 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:52.081838    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-gclwc" event={"ID":"9da2b140-3a48-4380-9c19-fd0ef92e8c26","Type":"ContainerStarted","Data":"db871e04f76c9e0aa2f9d340eb0e2104af65e8b8f821511550282360d0ac645a"}
Sep 09 16:18:52.082362 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:52.082339    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-gclwc"
Sep 09 16:18:52.088229 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:52.088201    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-gclwc"
Sep 09 16:18:52.100717 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:52.100669    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-gclwc" podStartSLOduration=1.764149706 podStartE2EDuration="11.100651818s" totalImagesPullingTime="9.336502112s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 16:18:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:18:52.098795937 +0000 UTC m=+314.452525797" watchObservedRunningTime="2026-09-09 16:18:52.100651818 +0000 UTC m=+314.454381653"
Sep 09 16:18:52.621737 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:52.621706    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:18:52.719462 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:52.719425    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:18:52.888691 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:52.888625    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:18:53.088856 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:53.088754    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hl5wh" event={"ID":"0761a4d2-2ff2-4d33-8462-771ecc0961e6","Type":"ContainerStarted","Data":"b63de5a278038ee3504ead846110572f7b574953a7e914401854a878c37146c1"}
Sep 09 16:18:53.107359 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:53.107318    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-hl5wh" podStartSLOduration=33.771489927 podStartE2EDuration="42.107300961s" totalImagesPullingTime="8.335811034s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 16:18:11 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:18:53.106483379 +0000 UTC m=+315.460213228" watchObservedRunningTime="2026-09-09 16:18:53.107300961 +0000 UTC m=+315.461030792"
Sep 09 16:18:53.458188 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:53.458151    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:18:53.565153 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:53.565120    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:18:55.630254 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:55.630225    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-59fcb64bf-tzq28"]
Sep 09 16:18:55.630614 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:18:55.630402    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-59fcb64bf-tzq28" podUID="f82110b1-4cd3-40e9-b412-ede8228aed4b"
Sep 09 16:18:55.704126 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:55.704097    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:18:55.805332 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:55.805295    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:18:55.905223 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:55.905159    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:18:56.099252 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:56.099227    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-59fcb64bf-tzq28"
Sep 09 16:18:56.127445 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:56.127424    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-59fcb64bf-tzq28"
Sep 09 16:18:56.176694 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:56.176637    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f82110b1-4cd3-40e9-b412-ede8228aed4b-image-registry-private-configuration\") pod \"f82110b1-4cd3-40e9-b412-ede8228aed4b\" (UID: \"f82110b1-4cd3-40e9-b412-ede8228aed4b\") "
Sep 09 16:18:56.176694 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:56.176680    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f82110b1-4cd3-40e9-b412-ede8228aed4b-bound-sa-token\") pod \"f82110b1-4cd3-40e9-b412-ede8228aed4b\" (UID: \"f82110b1-4cd3-40e9-b412-ede8228aed4b\") "
Sep 09 16:18:56.176871 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:56.176719    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f82110b1-4cd3-40e9-b412-ede8228aed4b-registry-certificates\") pod \"f82110b1-4cd3-40e9-b412-ede8228aed4b\" (UID: \"f82110b1-4cd3-40e9-b412-ede8228aed4b\") "
Sep 09 16:18:56.176871 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:56.176746    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f82110b1-4cd3-40e9-b412-ede8228aed4b-trusted-ca\") pod \"f82110b1-4cd3-40e9-b412-ede8228aed4b\" (UID: \"f82110b1-4cd3-40e9-b412-ede8228aed4b\") "
Sep 09 16:18:56.176871 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:56.176788    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f82110b1-4cd3-40e9-b412-ede8228aed4b-installation-pull-secrets\") pod \"f82110b1-4cd3-40e9-b412-ede8228aed4b\" (UID: \"f82110b1-4cd3-40e9-b412-ede8228aed4b\") "
Sep 09 16:18:56.176871 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:56.176814    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g8sjz\" (UniqueName: \"kubernetes.io/projected/f82110b1-4cd3-40e9-b412-ede8228aed4b-kube-api-access-g8sjz\") pod \"f82110b1-4cd3-40e9-b412-ede8228aed4b\" (UID: \"f82110b1-4cd3-40e9-b412-ede8228aed4b\") "
Sep 09 16:18:56.176871 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:56.176840    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f82110b1-4cd3-40e9-b412-ede8228aed4b-ca-trust-extracted\") pod \"f82110b1-4cd3-40e9-b412-ede8228aed4b\" (UID: \"f82110b1-4cd3-40e9-b412-ede8228aed4b\") "
Sep 09 16:18:56.177153 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:56.177126    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f82110b1-4cd3-40e9-b412-ede8228aed4b-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "f82110b1-4cd3-40e9-b412-ede8228aed4b" (UID: "f82110b1-4cd3-40e9-b412-ede8228aed4b"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 16:18:56.177210 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:56.177150    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f82110b1-4cd3-40e9-b412-ede8228aed4b-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "f82110b1-4cd3-40e9-b412-ede8228aed4b" (UID: "f82110b1-4cd3-40e9-b412-ede8228aed4b"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 16:18:56.183117 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:56.179663    2583 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f82110b1-4cd3-40e9-b412-ede8228aed4b-ca-trust-extracted\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\""
Sep 09 16:18:56.183117 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:56.179689    2583 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f82110b1-4cd3-40e9-b412-ede8228aed4b-registry-certificates\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\""
Sep 09 16:18:56.183117 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:56.179970    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f82110b1-4cd3-40e9-b412-ede8228aed4b-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "f82110b1-4cd3-40e9-b412-ede8228aed4b" (UID: "f82110b1-4cd3-40e9-b412-ede8228aed4b"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 16:18:56.185472 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:56.183413    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f82110b1-4cd3-40e9-b412-ede8228aed4b-kube-api-access-g8sjz" (OuterVolumeSpecName: "kube-api-access-g8sjz") pod "f82110b1-4cd3-40e9-b412-ede8228aed4b" (UID: "f82110b1-4cd3-40e9-b412-ede8228aed4b"). InnerVolumeSpecName "kube-api-access-g8sjz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 16:18:56.187289 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:56.187155    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f82110b1-4cd3-40e9-b412-ede8228aed4b-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "f82110b1-4cd3-40e9-b412-ede8228aed4b" (UID: "f82110b1-4cd3-40e9-b412-ede8228aed4b"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 16:18:56.187468 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:56.187429    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f82110b1-4cd3-40e9-b412-ede8228aed4b-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "f82110b1-4cd3-40e9-b412-ede8228aed4b" (UID: "f82110b1-4cd3-40e9-b412-ede8228aed4b"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 16:18:56.187468 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:56.187453    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f82110b1-4cd3-40e9-b412-ede8228aed4b-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "f82110b1-4cd3-40e9-b412-ede8228aed4b" (UID: "f82110b1-4cd3-40e9-b412-ede8228aed4b"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 16:18:56.280839 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:56.280815    2583 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f82110b1-4cd3-40e9-b412-ede8228aed4b-installation-pull-secrets\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\""
Sep 09 16:18:56.280839 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:56.280841    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g8sjz\" (UniqueName: \"kubernetes.io/projected/f82110b1-4cd3-40e9-b412-ede8228aed4b-kube-api-access-g8sjz\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\""
Sep 09 16:18:56.281008 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:56.280852    2583 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f82110b1-4cd3-40e9-b412-ede8228aed4b-image-registry-private-configuration\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\""
Sep 09 16:18:56.281008 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:56.280862    2583 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f82110b1-4cd3-40e9-b412-ede8228aed4b-bound-sa-token\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\""
Sep 09 16:18:56.281008 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:56.280871    2583 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f82110b1-4cd3-40e9-b412-ede8228aed4b-trusted-ca\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\""
Sep 09 16:18:56.623975 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:56.623937    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:18:56.676947 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:56.676893    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:18:57.103317 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:57.103286    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-59fcb64bf-tzq28"
Sep 09 16:18:57.138331 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:57.138300    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:18:57.138522 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:57.138497    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-59fcb64bf-tzq28"]
Sep 09 16:18:57.141746 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:57.141724    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-59fcb64bf-tzq28"]
Sep 09 16:18:57.207328 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:57.207302    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:18:57.288426 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:57.288402    2583 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f82110b1-4cd3-40e9-b412-ede8228aed4b-registry-tls\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\""
Sep 09 16:18:57.621951 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:57.621921    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:18:57.722256 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:57.722231    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:18:58.230534 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:58.230499    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:18:58.237469 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:58.237444    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f82110b1-4cd3-40e9-b412-ede8228aed4b" path="/var/lib/kubelet/pods/f82110b1-4cd3-40e9-b412-ede8228aed4b/volumes"
Sep 09 16:18:58.302712 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:58.302686    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:18:58.754297 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:58.754263    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:18:58.981544 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:58.981505    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:18:58.996801 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:58.996778    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-657fd6c54-qd5n5"]
Sep 09 16:18:59.038283 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:59.038227    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-657fd6c54-qd5n5"]
Sep 09 16:18:59.038427 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:59.038351    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-qd5n5"
Sep 09 16:18:59.040739 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:59.040715    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-c6fx6"]
Sep 09 16:18:59.041754 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:59.041731    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Sep 09 16:18:59.041943 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:59.041741    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 09 16:18:59.042897 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:59.042876    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-wpc6h\""
Sep 09 16:18:59.042897 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:59.042892    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Sep 09 16:18:59.057077 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:59.057056    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-c6fx6"
Sep 09 16:18:59.060434 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:59.060415    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 09 16:18:59.060561 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:59.060530    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-zlvb9\""
Sep 09 16:18:59.060668 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:59.060416    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 09 16:18:59.060745 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:59.060555    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 09 16:18:59.086008 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:59.085961    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:18:59.100231 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:59.100211    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gk54h\" (UniqueName: \"kubernetes.io/projected/467ebbdd-a09d-4509-8bc2-2e13273e1258-kube-api-access-gk54h\") pod \"openshift-state-metrics-657fd6c54-qd5n5\" (UID: \"467ebbdd-a09d-4509-8bc2-2e13273e1258\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-qd5n5"
Sep 09 16:18:59.100340 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:59.100247    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/467ebbdd-a09d-4509-8bc2-2e13273e1258-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-657fd6c54-qd5n5\" (UID: \"467ebbdd-a09d-4509-8bc2-2e13273e1258\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-qd5n5"
Sep 09 16:18:59.100340 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:59.100274    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/467ebbdd-a09d-4509-8bc2-2e13273e1258-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-qd5n5\" (UID: \"467ebbdd-a09d-4509-8bc2-2e13273e1258\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-qd5n5"
Sep 09 16:18:59.100419 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:59.100369    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/467ebbdd-a09d-4509-8bc2-2e13273e1258-metrics-client-ca\") pod \"openshift-state-metrics-657fd6c54-qd5n5\" (UID: \"467ebbdd-a09d-4509-8bc2-2e13273e1258\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-qd5n5"
Sep 09 16:18:59.201185 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:59.201155    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/467ebbdd-a09d-4509-8bc2-2e13273e1258-metrics-client-ca\") pod \"openshift-state-metrics-657fd6c54-qd5n5\" (UID: \"467ebbdd-a09d-4509-8bc2-2e13273e1258\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-qd5n5"
Sep 09 16:18:59.201306 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:59.201188    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e4465728-7c0e-41ab-93d5-1ac31555a62f-sys\") pod \"node-exporter-c6fx6\" (UID: \"e4465728-7c0e-41ab-93d5-1ac31555a62f\") " pod="openshift-monitoring/node-exporter-c6fx6"
Sep 09 16:18:59.201306 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:59.201218    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e4465728-7c0e-41ab-93d5-1ac31555a62f-node-exporter-accelerators-collector-config\") pod \"node-exporter-c6fx6\" (UID: \"e4465728-7c0e-41ab-93d5-1ac31555a62f\") " pod="openshift-monitoring/node-exporter-c6fx6"
Sep 09 16:18:59.201421 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:59.201324    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e4465728-7c0e-41ab-93d5-1ac31555a62f-node-exporter-textfile\") pod \"node-exporter-c6fx6\" (UID: \"e4465728-7c0e-41ab-93d5-1ac31555a62f\") " pod="openshift-monitoring/node-exporter-c6fx6"
Sep 09 16:18:59.201421 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:59.201358    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e4465728-7c0e-41ab-93d5-1ac31555a62f-node-exporter-tls\") pod \"node-exporter-c6fx6\" (UID: \"e4465728-7c0e-41ab-93d5-1ac31555a62f\") " pod="openshift-monitoring/node-exporter-c6fx6"
Sep 09 16:18:59.201421 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:59.201373    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e4465728-7c0e-41ab-93d5-1ac31555a62f-metrics-client-ca\") pod \"node-exporter-c6fx6\" (UID: \"e4465728-7c0e-41ab-93d5-1ac31555a62f\") " pod="openshift-monitoring/node-exporter-c6fx6"
Sep 09 16:18:59.201421 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:59.201398    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dw56l\" (UniqueName: \"kubernetes.io/projected/e4465728-7c0e-41ab-93d5-1ac31555a62f-kube-api-access-dw56l\") pod \"node-exporter-c6fx6\" (UID: \"e4465728-7c0e-41ab-93d5-1ac31555a62f\") " pod="openshift-monitoring/node-exporter-c6fx6"
Sep 09 16:18:59.201574 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:59.201461    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gk54h\" (UniqueName: \"kubernetes.io/projected/467ebbdd-a09d-4509-8bc2-2e13273e1258-kube-api-access-gk54h\") pod \"openshift-state-metrics-657fd6c54-qd5n5\" (UID: \"467ebbdd-a09d-4509-8bc2-2e13273e1258\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-qd5n5"
Sep 09 16:18:59.201574 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:59.201494    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/467ebbdd-a09d-4509-8bc2-2e13273e1258-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-657fd6c54-qd5n5\" (UID: \"467ebbdd-a09d-4509-8bc2-2e13273e1258\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-qd5n5"
Sep 09 16:18:59.201574 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:59.201525    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/467ebbdd-a09d-4509-8bc2-2e13273e1258-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-qd5n5\" (UID: \"467ebbdd-a09d-4509-8bc2-2e13273e1258\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-qd5n5"
Sep 09 16:18:59.201574 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:59.201553    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e4465728-7c0e-41ab-93d5-1ac31555a62f-root\") pod \"node-exporter-c6fx6\" (UID: \"e4465728-7c0e-41ab-93d5-1ac31555a62f\") " pod="openshift-monitoring/node-exporter-c6fx6"
Sep 09 16:18:59.201743 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:59.201670    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e4465728-7c0e-41ab-93d5-1ac31555a62f-node-exporter-wtmp\") pod \"node-exporter-c6fx6\" (UID: \"e4465728-7c0e-41ab-93d5-1ac31555a62f\") " pod="openshift-monitoring/node-exporter-c6fx6"
Sep 09 16:18:59.201743 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:59.201700    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e4465728-7c0e-41ab-93d5-1ac31555a62f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-c6fx6\" (UID: \"e4465728-7c0e-41ab-93d5-1ac31555a62f\") " pod="openshift-monitoring/node-exporter-c6fx6"
Sep 09 16:18:59.201947 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:59.201924    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/467ebbdd-a09d-4509-8bc2-2e13273e1258-metrics-client-ca\") pod \"openshift-state-metrics-657fd6c54-qd5n5\" (UID: \"467ebbdd-a09d-4509-8bc2-2e13273e1258\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-qd5n5"
Sep 09 16:18:59.203903 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:59.203881    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/467ebbdd-a09d-4509-8bc2-2e13273e1258-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-657fd6c54-qd5n5\" (UID: \"467ebbdd-a09d-4509-8bc2-2e13273e1258\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-qd5n5"
Sep 09 16:18:59.204009 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:59.203915    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/467ebbdd-a09d-4509-8bc2-2e13273e1258-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-qd5n5\" (UID: \"467ebbdd-a09d-4509-8bc2-2e13273e1258\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-qd5n5"
Sep 09 16:18:59.209017 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:59.209000    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gk54h\" (UniqueName: \"kubernetes.io/projected/467ebbdd-a09d-4509-8bc2-2e13273e1258-kube-api-access-gk54h\") pod \"openshift-state-metrics-657fd6c54-qd5n5\" (UID: \"467ebbdd-a09d-4509-8bc2-2e13273e1258\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-qd5n5"
Sep 09 16:18:59.302958 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:59.302907    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e4465728-7c0e-41ab-93d5-1ac31555a62f-sys\") pod \"node-exporter-c6fx6\" (UID: \"e4465728-7c0e-41ab-93d5-1ac31555a62f\") " pod="openshift-monitoring/node-exporter-c6fx6"
Sep 09 16:18:59.302958 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:59.302943    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e4465728-7c0e-41ab-93d5-1ac31555a62f-node-exporter-accelerators-collector-config\") pod \"node-exporter-c6fx6\" (UID: \"e4465728-7c0e-41ab-93d5-1ac31555a62f\") " pod="openshift-monitoring/node-exporter-c6fx6"
Sep 09 16:18:59.302958 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:59.302963    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e4465728-7c0e-41ab-93d5-1ac31555a62f-node-exporter-textfile\") pod \"node-exporter-c6fx6\" (UID: \"e4465728-7c0e-41ab-93d5-1ac31555a62f\") " pod="openshift-monitoring/node-exporter-c6fx6"
Sep 09 16:18:59.303190 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:59.303013    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e4465728-7c0e-41ab-93d5-1ac31555a62f-node-exporter-tls\") pod \"node-exporter-c6fx6\" (UID: \"e4465728-7c0e-41ab-93d5-1ac31555a62f\") " pod="openshift-monitoring/node-exporter-c6fx6"
Sep 09 16:18:59.303190 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:59.303046    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e4465728-7c0e-41ab-93d5-1ac31555a62f-sys\") pod \"node-exporter-c6fx6\" (UID: \"e4465728-7c0e-41ab-93d5-1ac31555a62f\") " pod="openshift-monitoring/node-exporter-c6fx6"
Sep 09 16:18:59.303190 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:59.303096    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e4465728-7c0e-41ab-93d5-1ac31555a62f-metrics-client-ca\") pod \"node-exporter-c6fx6\" (UID: \"e4465728-7c0e-41ab-93d5-1ac31555a62f\") " pod="openshift-monitoring/node-exporter-c6fx6"
Sep 09 16:18:59.303190 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:59.303133    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dw56l\" (UniqueName: \"kubernetes.io/projected/e4465728-7c0e-41ab-93d5-1ac31555a62f-kube-api-access-dw56l\") pod \"node-exporter-c6fx6\" (UID: \"e4465728-7c0e-41ab-93d5-1ac31555a62f\") " pod="openshift-monitoring/node-exporter-c6fx6"
Sep 09 16:18:59.303190 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:59.303168    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e4465728-7c0e-41ab-93d5-1ac31555a62f-root\") pod \"node-exporter-c6fx6\" (UID: \"e4465728-7c0e-41ab-93d5-1ac31555a62f\") " pod="openshift-monitoring/node-exporter-c6fx6"
Sep 09 16:18:59.303416 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:59.303193    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e4465728-7c0e-41ab-93d5-1ac31555a62f-node-exporter-wtmp\") pod \"node-exporter-c6fx6\" (UID: \"e4465728-7c0e-41ab-93d5-1ac31555a62f\") " pod="openshift-monitoring/node-exporter-c6fx6"
Sep 09 16:18:59.303416 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:59.303219    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e4465728-7c0e-41ab-93d5-1ac31555a62f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-c6fx6\" (UID: \"e4465728-7c0e-41ab-93d5-1ac31555a62f\") " pod="openshift-monitoring/node-exporter-c6fx6"
Sep 09 16:18:59.303416 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:59.303378    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e4465728-7c0e-41ab-93d5-1ac31555a62f-node-exporter-textfile\") pod \"node-exporter-c6fx6\" (UID: \"e4465728-7c0e-41ab-93d5-1ac31555a62f\") " pod="openshift-monitoring/node-exporter-c6fx6"
Sep 09 16:18:59.303600 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:59.303580    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e4465728-7c0e-41ab-93d5-1ac31555a62f-root\") pod \"node-exporter-c6fx6\" (UID: \"e4465728-7c0e-41ab-93d5-1ac31555a62f\") " pod="openshift-monitoring/node-exporter-c6fx6"
Sep 09 16:18:59.303696 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:59.303671    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e4465728-7c0e-41ab-93d5-1ac31555a62f-node-exporter-accelerators-collector-config\") pod \"node-exporter-c6fx6\" (UID: \"e4465728-7c0e-41ab-93d5-1ac31555a62f\") " pod="openshift-monitoring/node-exporter-c6fx6"
Sep 09 16:18:59.303766 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:59.303672    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e4465728-7c0e-41ab-93d5-1ac31555a62f-node-exporter-wtmp\") pod \"node-exporter-c6fx6\" (UID: \"e4465728-7c0e-41ab-93d5-1ac31555a62f\") " pod="openshift-monitoring/node-exporter-c6fx6"
Sep 09 16:18:59.304059 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:59.304041    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e4465728-7c0e-41ab-93d5-1ac31555a62f-metrics-client-ca\") pod \"node-exporter-c6fx6\" (UID: \"e4465728-7c0e-41ab-93d5-1ac31555a62f\") " pod="openshift-monitoring/node-exporter-c6fx6"
Sep 09 16:18:59.305387 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:59.305368    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e4465728-7c0e-41ab-93d5-1ac31555a62f-node-exporter-tls\") pod \"node-exporter-c6fx6\" (UID: \"e4465728-7c0e-41ab-93d5-1ac31555a62f\") " pod="openshift-monitoring/node-exporter-c6fx6"
Sep 09 16:18:59.305659 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:59.305642    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e4465728-7c0e-41ab-93d5-1ac31555a62f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-c6fx6\" (UID: \"e4465728-7c0e-41ab-93d5-1ac31555a62f\") " pod="openshift-monitoring/node-exporter-c6fx6"
Sep 09 16:18:59.310014 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:59.309997    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dw56l\" (UniqueName: \"kubernetes.io/projected/e4465728-7c0e-41ab-93d5-1ac31555a62f-kube-api-access-dw56l\") pod \"node-exporter-c6fx6\" (UID: \"e4465728-7c0e-41ab-93d5-1ac31555a62f\") " pod="openshift-monitoring/node-exporter-c6fx6"
Sep 09 16:18:59.349704 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:59.349681    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-qd5n5"
Sep 09 16:18:59.366771 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:59.366749    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-c6fx6"
Sep 09 16:18:59.412182 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:18:59.412157    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4465728_7c0e_41ab_93d5_1ac31555a62f.slice/crio-b915e4b738aa7dc60d82c3bb89393052f1b00045c946db1f7f5d91424d24f585 WatchSource:0}: Error finding container b915e4b738aa7dc60d82c3bb89393052f1b00045c946db1f7f5d91424d24f585: Status 404 returned error can't find the container with id b915e4b738aa7dc60d82c3bb89393052f1b00045c946db1f7f5d91424d24f585
Sep 09 16:18:59.436653 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:59.436622    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:18:59.493052 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:59.493022    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:18:59.601050 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:59.601030    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:18:59.642884 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:59.642863    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-657fd6c54-qd5n5"]
Sep 09 16:18:59.644907 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:18:59.644878    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod467ebbdd_a09d_4509_8bc2_2e13273e1258.slice/crio-32b22b1035231aee9237d9490c9e021036790757749cc79ca7bfbbd314c95e33 WatchSource:0}: Error finding container 32b22b1035231aee9237d9490c9e021036790757749cc79ca7bfbbd314c95e33: Status 404 returned error can't find the container with id 32b22b1035231aee9237d9490c9e021036790757749cc79ca7bfbbd314c95e33
Sep 09 16:18:59.997825 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:18:59.997802    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:19:00.074706 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:00.074678    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:19:00.079592 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:00.079568    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 09 16:19:00.099359 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:00.099331    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 09 16:19:00.099469 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:00.099438    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 09 16:19:00.102203 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:00.102185    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Sep 09 16:19:00.102299 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:00.102186    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Sep 09 16:19:00.102614 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:00.102597    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Sep 09 16:19:00.102974 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:00.102816    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Sep 09 16:19:00.102974 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:00.102837    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Sep 09 16:19:00.102974 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:00.102856    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Sep 09 16:19:00.103183 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:00.103029    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Sep 09 16:19:00.103183 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:00.103073    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-dsfnj\""
Sep 09 16:19:00.103283 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:00.103268    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Sep 09 16:19:00.103341 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:00.103274    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Sep 09 16:19:00.114608 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:00.114588    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-c6fx6" event={"ID":"e4465728-7c0e-41ab-93d5-1ac31555a62f","Type":"ContainerStarted","Data":"b915e4b738aa7dc60d82c3bb89393052f1b00045c946db1f7f5d91424d24f585"}
Sep 09 16:19:00.116436 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:00.116417    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-qd5n5" event={"ID":"467ebbdd-a09d-4509-8bc2-2e13273e1258","Type":"ContainerStarted","Data":"97c7be8e09bb57c252938f14bdc91e0973573caa6bd39928c2ff124b5b1dde5f"}
Sep 09 16:19:00.116510 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:00.116464    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-qd5n5" event={"ID":"467ebbdd-a09d-4509-8bc2-2e13273e1258","Type":"ContainerStarted","Data":"5099783e7ce7bf9e2dff814921cb951a36c7c1c4bbcd9e8a00adce1497420ad5"}
Sep 09 16:19:00.116510 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:00.116491    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-qd5n5" event={"ID":"467ebbdd-a09d-4509-8bc2-2e13273e1258","Type":"ContainerStarted","Data":"32b22b1035231aee9237d9490c9e021036790757749cc79ca7bfbbd314c95e33"}
Sep 09 16:19:00.208592 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:00.208542    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-prm8f\" (UniqueName: \"kubernetes.io/projected/38b98bac-a1c9-44e3-8e64-05ddc7fbbda8-kube-api-access-prm8f\") pod \"alertmanager-main-0\" (UID: \"38b98bac-a1c9-44e3-8e64-05ddc7fbbda8\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 16:19:00.208683 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:00.208600    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/38b98bac-a1c9-44e3-8e64-05ddc7fbbda8-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"38b98bac-a1c9-44e3-8e64-05ddc7fbbda8\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 16:19:00.208683 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:00.208639    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/38b98bac-a1c9-44e3-8e64-05ddc7fbbda8-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"38b98bac-a1c9-44e3-8e64-05ddc7fbbda8\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 16:19:00.208683 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:00.208676    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/38b98bac-a1c9-44e3-8e64-05ddc7fbbda8-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"38b98bac-a1c9-44e3-8e64-05ddc7fbbda8\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 16:19:00.208833 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:00.208746    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/38b98bac-a1c9-44e3-8e64-05ddc7fbbda8-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"38b98bac-a1c9-44e3-8e64-05ddc7fbbda8\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 16:19:00.208833 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:00.208782    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/38b98bac-a1c9-44e3-8e64-05ddc7fbbda8-tls-assets\") pod \"alertmanager-main-0\" (UID: \"38b98bac-a1c9-44e3-8e64-05ddc7fbbda8\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 16:19:00.208833 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:00.208810    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/38b98bac-a1c9-44e3-8e64-05ddc7fbbda8-config-out\") pod \"alertmanager-main-0\" (UID: \"38b98bac-a1c9-44e3-8e64-05ddc7fbbda8\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 16:19:00.208965 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:00.208833    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/38b98bac-a1c9-44e3-8e64-05ddc7fbbda8-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"38b98bac-a1c9-44e3-8e64-05ddc7fbbda8\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 16:19:00.208965 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:00.208860    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/38b98bac-a1c9-44e3-8e64-05ddc7fbbda8-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"38b98bac-a1c9-44e3-8e64-05ddc7fbbda8\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 16:19:00.208965 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:00.208890    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/38b98bac-a1c9-44e3-8e64-05ddc7fbbda8-config-volume\") pod \"alertmanager-main-0\" (UID: \"38b98bac-a1c9-44e3-8e64-05ddc7fbbda8\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 16:19:00.208965 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:00.208914    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/38b98bac-a1c9-44e3-8e64-05ddc7fbbda8-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"38b98bac-a1c9-44e3-8e64-05ddc7fbbda8\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 16:19:00.208965 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:00.208952    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/38b98bac-a1c9-44e3-8e64-05ddc7fbbda8-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"38b98bac-a1c9-44e3-8e64-05ddc7fbbda8\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 16:19:00.209218 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:00.208997    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/38b98bac-a1c9-44e3-8e64-05ddc7fbbda8-web-config\") pod \"alertmanager-main-0\" (UID: \"38b98bac-a1c9-44e3-8e64-05ddc7fbbda8\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 16:19:00.309473 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:00.309447    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/38b98bac-a1c9-44e3-8e64-05ddc7fbbda8-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"38b98bac-a1c9-44e3-8e64-05ddc7fbbda8\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 16:19:00.309473 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:00.309471    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/38b98bac-a1c9-44e3-8e64-05ddc7fbbda8-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"38b98bac-a1c9-44e3-8e64-05ddc7fbbda8\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 16:19:00.309622 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:00.309489    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/38b98bac-a1c9-44e3-8e64-05ddc7fbbda8-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"38b98bac-a1c9-44e3-8e64-05ddc7fbbda8\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 16:19:00.309622 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:00.309524    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/38b98bac-a1c9-44e3-8e64-05ddc7fbbda8-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"38b98bac-a1c9-44e3-8e64-05ddc7fbbda8\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 16:19:00.309719 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:00.309643    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/38b98bac-a1c9-44e3-8e64-05ddc7fbbda8-tls-assets\") pod \"alertmanager-main-0\" (UID: \"38b98bac-a1c9-44e3-8e64-05ddc7fbbda8\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 16:19:00.309719 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:00.309672    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/38b98bac-a1c9-44e3-8e64-05ddc7fbbda8-config-out\") pod \"alertmanager-main-0\" (UID: \"38b98bac-a1c9-44e3-8e64-05ddc7fbbda8\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 16:19:00.309719 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:00.309687    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/38b98bac-a1c9-44e3-8e64-05ddc7fbbda8-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"38b98bac-a1c9-44e3-8e64-05ddc7fbbda8\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 16:19:00.309858 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:00.309716    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/38b98bac-a1c9-44e3-8e64-05ddc7fbbda8-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"38b98bac-a1c9-44e3-8e64-05ddc7fbbda8\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 16:19:00.309858 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:00.309745    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/38b98bac-a1c9-44e3-8e64-05ddc7fbbda8-config-volume\") pod \"alertmanager-main-0\" (UID: \"38b98bac-a1c9-44e3-8e64-05ddc7fbbda8\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 16:19:00.309858 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:00.309781    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/38b98bac-a1c9-44e3-8e64-05ddc7fbbda8-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"38b98bac-a1c9-44e3-8e64-05ddc7fbbda8\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 16:19:00.309858 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:00.309815    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/38b98bac-a1c9-44e3-8e64-05ddc7fbbda8-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"38b98bac-a1c9-44e3-8e64-05ddc7fbbda8\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 16:19:00.309858 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:00.309847    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/38b98bac-a1c9-44e3-8e64-05ddc7fbbda8-web-config\") pod \"alertmanager-main-0\" (UID: \"38b98bac-a1c9-44e3-8e64-05ddc7fbbda8\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 16:19:00.310114 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:00.309870    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-prm8f\" (UniqueName: \"kubernetes.io/projected/38b98bac-a1c9-44e3-8e64-05ddc7fbbda8-kube-api-access-prm8f\") pod \"alertmanager-main-0\" (UID: \"38b98bac-a1c9-44e3-8e64-05ddc7fbbda8\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 16:19:00.310701 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:00.310223    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/38b98bac-a1c9-44e3-8e64-05ddc7fbbda8-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"38b98bac-a1c9-44e3-8e64-05ddc7fbbda8\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 16:19:00.310701 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:19:00.310317    2583 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found
Sep 09 16:19:00.310701 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:19:00.310332    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/38b98bac-a1c9-44e3-8e64-05ddc7fbbda8-alertmanager-trusted-ca-bundle podName:38b98bac-a1c9-44e3-8e64-05ddc7fbbda8 nodeName:}" failed. No retries permitted until 2026-09-09 16:19:00.810311574 +0000 UTC m=+323.164041401 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/38b98bac-a1c9-44e3-8e64-05ddc7fbbda8-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "38b98bac-a1c9-44e3-8e64-05ddc7fbbda8") : configmap references non-existent config key: ca-bundle.crt
Sep 09 16:19:00.310701 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:19:00.310361    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38b98bac-a1c9-44e3-8e64-05ddc7fbbda8-secret-alertmanager-main-tls podName:38b98bac-a1c9-44e3-8e64-05ddc7fbbda8 nodeName:}" failed. No retries permitted until 2026-09-09 16:19:00.810346805 +0000 UTC m=+323.164076624 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/38b98bac-a1c9-44e3-8e64-05ddc7fbbda8-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "38b98bac-a1c9-44e3-8e64-05ddc7fbbda8") : secret "alertmanager-main-tls" not found
Sep 09 16:19:00.311132 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:00.311071    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/38b98bac-a1c9-44e3-8e64-05ddc7fbbda8-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"38b98bac-a1c9-44e3-8e64-05ddc7fbbda8\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 16:19:00.312341 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:00.312317    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/38b98bac-a1c9-44e3-8e64-05ddc7fbbda8-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"38b98bac-a1c9-44e3-8e64-05ddc7fbbda8\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 16:19:00.312443 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:00.312362    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/38b98bac-a1c9-44e3-8e64-05ddc7fbbda8-config-out\") pod \"alertmanager-main-0\" (UID: \"38b98bac-a1c9-44e3-8e64-05ddc7fbbda8\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 16:19:00.312505 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:00.312461    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/38b98bac-a1c9-44e3-8e64-05ddc7fbbda8-config-volume\") pod \"alertmanager-main-0\" (UID: \"38b98bac-a1c9-44e3-8e64-05ddc7fbbda8\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 16:19:00.313028 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:00.312980    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/38b98bac-a1c9-44e3-8e64-05ddc7fbbda8-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"38b98bac-a1c9-44e3-8e64-05ddc7fbbda8\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 16:19:00.313257 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:00.313233    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/38b98bac-a1c9-44e3-8e64-05ddc7fbbda8-tls-assets\") pod \"alertmanager-main-0\" (UID: \"38b98bac-a1c9-44e3-8e64-05ddc7fbbda8\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 16:19:00.313436 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:00.313418    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/38b98bac-a1c9-44e3-8e64-05ddc7fbbda8-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"38b98bac-a1c9-44e3-8e64-05ddc7fbbda8\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 16:19:00.313565 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:00.313548    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/38b98bac-a1c9-44e3-8e64-05ddc7fbbda8-web-config\") pod \"alertmanager-main-0\" (UID: \"38b98bac-a1c9-44e3-8e64-05ddc7fbbda8\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 16:19:00.313660 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:00.313645    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/38b98bac-a1c9-44e3-8e64-05ddc7fbbda8-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"38b98bac-a1c9-44e3-8e64-05ddc7fbbda8\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 16:19:00.318290 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:00.318269    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-prm8f\" (UniqueName: \"kubernetes.io/projected/38b98bac-a1c9-44e3-8e64-05ddc7fbbda8-kube-api-access-prm8f\") pod \"alertmanager-main-0\" (UID: \"38b98bac-a1c9-44e3-8e64-05ddc7fbbda8\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 16:19:00.814706 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:00.814669    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/38b98bac-a1c9-44e3-8e64-05ddc7fbbda8-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"38b98bac-a1c9-44e3-8e64-05ddc7fbbda8\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 16:19:00.814926 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:00.814720    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/38b98bac-a1c9-44e3-8e64-05ddc7fbbda8-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"38b98bac-a1c9-44e3-8e64-05ddc7fbbda8\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 16:19:00.815848 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:00.815818    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/38b98bac-a1c9-44e3-8e64-05ddc7fbbda8-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"38b98bac-a1c9-44e3-8e64-05ddc7fbbda8\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 16:19:00.817855 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:00.817832    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/38b98bac-a1c9-44e3-8e64-05ddc7fbbda8-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"38b98bac-a1c9-44e3-8e64-05ddc7fbbda8\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 09 16:19:01.008852 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:01.008826    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 09 16:19:01.897268 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:01.897238    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 09 16:19:01.898598 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:19:01.898574    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38b98bac_a1c9_44e3_8e64_05ddc7fbbda8.slice/crio-2ad9b617658dd1bff4e182edc740c5741909dbbd576b94741d7d92ccdbb2a6f9 WatchSource:0}: Error finding container 2ad9b617658dd1bff4e182edc740c5741909dbbd576b94741d7d92ccdbb2a6f9: Status 404 returned error can't find the container with id 2ad9b617658dd1bff4e182edc740c5741909dbbd576b94741d7d92ccdbb2a6f9
Sep 09 16:19:02.124599 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:02.124570    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"38b98bac-a1c9-44e3-8e64-05ddc7fbbda8","Type":"ContainerStarted","Data":"2ad9b617658dd1bff4e182edc740c5741909dbbd576b94741d7d92ccdbb2a6f9"}
Sep 09 16:19:02.126185 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:02.126162    2583 generic.go:356] "Generic (PLEG): container finished" podID="e4465728-7c0e-41ab-93d5-1ac31555a62f" containerID="0311b06343b4f8e4a6553c5442d2833ca58d348dc8caccb1887250849f714cbb" exitCode=0
Sep 09 16:19:02.126273 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:02.126248    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-c6fx6" event={"ID":"e4465728-7c0e-41ab-93d5-1ac31555a62f","Type":"ContainerDied","Data":"0311b06343b4f8e4a6553c5442d2833ca58d348dc8caccb1887250849f714cbb"}
Sep 09 16:19:02.128516 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:02.128494    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-qd5n5" event={"ID":"467ebbdd-a09d-4509-8bc2-2e13273e1258","Type":"ContainerStarted","Data":"e9b5cbdcf0df2597d6c48d563c1b96bd13cf1256062bc3ec1e69d93f69f3bbf7"}
Sep 09 16:19:02.161328 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:02.161263    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-qd5n5" podStartSLOduration=2.436885355 podStartE2EDuration="4.161248129s" totalImagesPullingTime="1.724362774s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 16:18:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:19:02.161105194 +0000 UTC m=+324.514835035" watchObservedRunningTime="2026-09-09 16:19:02.161248129 +0000 UTC m=+324.514977961"
Sep 09 16:19:02.553348 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:02.553288    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:19:02.653860 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:02.653835    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:19:03.134767 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:03.134733    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-c6fx6" event={"ID":"e4465728-7c0e-41ab-93d5-1ac31555a62f","Type":"ContainerStarted","Data":"e77c20886452a54c018e2f85ceebf9809306fe433204af9daa73672b7c911d10"}
Sep 09 16:19:03.135208 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:03.134797    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-c6fx6" event={"ID":"e4465728-7c0e-41ab-93d5-1ac31555a62f","Type":"ContainerStarted","Data":"ba0611efcfafdcea3fa8524ba321887a1c8cc5bd62a537322b42d95d3dfa8bdf"}
Sep 09 16:19:03.154339 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:03.154288    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-c6fx6" podStartSLOduration=1.87894558 podStartE2EDuration="4.154269655s" totalImagesPullingTime="2.210623566s" totalInitContainerRuntime="64.700509ms" isStatefulPod=true podCreationTimestamp="2026-09-09 16:18:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:19:03.152539745 +0000 UTC m=+325.506269606" watchObservedRunningTime="2026-09-09 16:19:03.154269655 +0000 UTC m=+325.507999488"
Sep 09 16:19:03.408907 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:03.408845    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-6757d4d54b-8nns5"]
Sep 09 16:19:03.427341 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:03.427319    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6757d4d54b-8nns5"]
Sep 09 16:19:03.427478 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:03.427393    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6757d4d54b-8nns5"
Sep 09 16:19:03.429880 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:03.429849    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Sep 09 16:19:03.429880 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:03.429867    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Sep 09 16:19:03.430073 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:03.429915    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Sep 09 16:19:03.430073 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:03.429952    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-c6qlfkntlqrfs\""
Sep 09 16:19:03.431011 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:03.430996    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Sep 09 16:19:03.431259 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:03.431242    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-6cqxw\""
Sep 09 16:19:03.534979 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:03.534957    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/b15afba3-4609-4699-9ec9-870c9353fabb-metrics-server-audit-profiles\") pod \"metrics-server-6757d4d54b-8nns5\" (UID: \"b15afba3-4609-4699-9ec9-870c9353fabb\") " pod="openshift-monitoring/metrics-server-6757d4d54b-8nns5"
Sep 09 16:19:03.535077 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:03.534999    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/b15afba3-4609-4699-9ec9-870c9353fabb-secret-metrics-server-client-certs\") pod \"metrics-server-6757d4d54b-8nns5\" (UID: \"b15afba3-4609-4699-9ec9-870c9353fabb\") " pod="openshift-monitoring/metrics-server-6757d4d54b-8nns5"
Sep 09 16:19:03.535077 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:03.535016    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/b15afba3-4609-4699-9ec9-870c9353fabb-secret-metrics-server-tls\") pod \"metrics-server-6757d4d54b-8nns5\" (UID: \"b15afba3-4609-4699-9ec9-870c9353fabb\") " pod="openshift-monitoring/metrics-server-6757d4d54b-8nns5"
Sep 09 16:19:03.535077 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:03.535063    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b15afba3-4609-4699-9ec9-870c9353fabb-client-ca-bundle\") pod \"metrics-server-6757d4d54b-8nns5\" (UID: \"b15afba3-4609-4699-9ec9-870c9353fabb\") " pod="openshift-monitoring/metrics-server-6757d4d54b-8nns5"
Sep 09 16:19:03.535184 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:03.535099    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b15afba3-4609-4699-9ec9-870c9353fabb-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6757d4d54b-8nns5\" (UID: \"b15afba3-4609-4699-9ec9-870c9353fabb\") " pod="openshift-monitoring/metrics-server-6757d4d54b-8nns5"
Sep 09 16:19:03.535184 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:03.535126    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/b15afba3-4609-4699-9ec9-870c9353fabb-audit-log\") pod \"metrics-server-6757d4d54b-8nns5\" (UID: \"b15afba3-4609-4699-9ec9-870c9353fabb\") " pod="openshift-monitoring/metrics-server-6757d4d54b-8nns5"
Sep 09 16:19:03.535184 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:03.535176    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t67mr\" (UniqueName: \"kubernetes.io/projected/b15afba3-4609-4699-9ec9-870c9353fabb-kube-api-access-t67mr\") pod \"metrics-server-6757d4d54b-8nns5\" (UID: \"b15afba3-4609-4699-9ec9-870c9353fabb\") " pod="openshift-monitoring/metrics-server-6757d4d54b-8nns5"
Sep 09 16:19:03.635447 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:03.635428    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/b15afba3-4609-4699-9ec9-870c9353fabb-audit-log\") pod \"metrics-server-6757d4d54b-8nns5\" (UID: \"b15afba3-4609-4699-9ec9-870c9353fabb\") " pod="openshift-monitoring/metrics-server-6757d4d54b-8nns5"
Sep 09 16:19:03.635547 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:03.635463    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t67mr\" (UniqueName: \"kubernetes.io/projected/b15afba3-4609-4699-9ec9-870c9353fabb-kube-api-access-t67mr\") pod \"metrics-server-6757d4d54b-8nns5\" (UID: \"b15afba3-4609-4699-9ec9-870c9353fabb\") " pod="openshift-monitoring/metrics-server-6757d4d54b-8nns5"
Sep 09 16:19:03.635547 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:03.635482    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/b15afba3-4609-4699-9ec9-870c9353fabb-metrics-server-audit-profiles\") pod \"metrics-server-6757d4d54b-8nns5\" (UID: \"b15afba3-4609-4699-9ec9-870c9353fabb\") " pod="openshift-monitoring/metrics-server-6757d4d54b-8nns5"
Sep 09 16:19:03.635547 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:03.635507    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/b15afba3-4609-4699-9ec9-870c9353fabb-secret-metrics-server-client-certs\") pod \"metrics-server-6757d4d54b-8nns5\" (UID: \"b15afba3-4609-4699-9ec9-870c9353fabb\") " pod="openshift-monitoring/metrics-server-6757d4d54b-8nns5"
Sep 09 16:19:03.635547 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:03.635522    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/b15afba3-4609-4699-9ec9-870c9353fabb-secret-metrics-server-tls\") pod \"metrics-server-6757d4d54b-8nns5\" (UID: \"b15afba3-4609-4699-9ec9-870c9353fabb\") " pod="openshift-monitoring/metrics-server-6757d4d54b-8nns5"
Sep 09 16:19:03.635741 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:03.635645    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b15afba3-4609-4699-9ec9-870c9353fabb-client-ca-bundle\") pod \"metrics-server-6757d4d54b-8nns5\" (UID: \"b15afba3-4609-4699-9ec9-870c9353fabb\") " pod="openshift-monitoring/metrics-server-6757d4d54b-8nns5"
Sep 09 16:19:03.635741 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:03.635690    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b15afba3-4609-4699-9ec9-870c9353fabb-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6757d4d54b-8nns5\" (UID: \"b15afba3-4609-4699-9ec9-870c9353fabb\") " pod="openshift-monitoring/metrics-server-6757d4d54b-8nns5"
Sep 09 16:19:03.635837 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:03.635811    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/b15afba3-4609-4699-9ec9-870c9353fabb-audit-log\") pod \"metrics-server-6757d4d54b-8nns5\" (UID: \"b15afba3-4609-4699-9ec9-870c9353fabb\") " pod="openshift-monitoring/metrics-server-6757d4d54b-8nns5"
Sep 09 16:19:03.636294 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:03.636262    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b15afba3-4609-4699-9ec9-870c9353fabb-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6757d4d54b-8nns5\" (UID: \"b15afba3-4609-4699-9ec9-870c9353fabb\") " pod="openshift-monitoring/metrics-server-6757d4d54b-8nns5"
Sep 09 16:19:03.636483 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:03.636464    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/b15afba3-4609-4699-9ec9-870c9353fabb-metrics-server-audit-profiles\") pod \"metrics-server-6757d4d54b-8nns5\" (UID: \"b15afba3-4609-4699-9ec9-870c9353fabb\") " pod="openshift-monitoring/metrics-server-6757d4d54b-8nns5"
Sep 09 16:19:03.637689 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:03.637668    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/b15afba3-4609-4699-9ec9-870c9353fabb-secret-metrics-server-tls\") pod \"metrics-server-6757d4d54b-8nns5\" (UID: \"b15afba3-4609-4699-9ec9-870c9353fabb\") " pod="openshift-monitoring/metrics-server-6757d4d54b-8nns5"
Sep 09 16:19:03.637871 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:03.637853    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b15afba3-4609-4699-9ec9-870c9353fabb-client-ca-bundle\") pod \"metrics-server-6757d4d54b-8nns5\" (UID: \"b15afba3-4609-4699-9ec9-870c9353fabb\") " pod="openshift-monitoring/metrics-server-6757d4d54b-8nns5"
Sep 09 16:19:03.637909 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:03.637883    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/b15afba3-4609-4699-9ec9-870c9353fabb-secret-metrics-server-client-certs\") pod \"metrics-server-6757d4d54b-8nns5\" (UID: \"b15afba3-4609-4699-9ec9-870c9353fabb\") " pod="openshift-monitoring/metrics-server-6757d4d54b-8nns5"
Sep 09 16:19:03.642414 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:03.642391    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t67mr\" (UniqueName: \"kubernetes.io/projected/b15afba3-4609-4699-9ec9-870c9353fabb-kube-api-access-t67mr\") pod \"metrics-server-6757d4d54b-8nns5\" (UID: \"b15afba3-4609-4699-9ec9-870c9353fabb\") " pod="openshift-monitoring/metrics-server-6757d4d54b-8nns5"
Sep 09 16:19:03.736256 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:03.736217    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6757d4d54b-8nns5"
Sep 09 16:19:03.767018 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:03.766975    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:19:03.851844 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:03.851806    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:19:04.012043 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:04.011969    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6757d4d54b-8nns5"]
Sep 09 16:19:04.015437 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:19:04.015413    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb15afba3_4609_4699_9ec9_870c9353fabb.slice/crio-5740d749f12a4837fab6ed14a211010d268b770edcdcba0d4c79480e19e4c63f WatchSource:0}: Error finding container 5740d749f12a4837fab6ed14a211010d268b770edcdcba0d4c79480e19e4c63f: Status 404 returned error can't find the container with id 5740d749f12a4837fab6ed14a211010d268b770edcdcba0d4c79480e19e4c63f
Sep 09 16:19:04.138939 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:04.138911    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6757d4d54b-8nns5" event={"ID":"b15afba3-4609-4699-9ec9-870c9353fabb","Type":"ContainerStarted","Data":"5740d749f12a4837fab6ed14a211010d268b770edcdcba0d4c79480e19e4c63f"}
Sep 09 16:19:04.140555 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:04.140534    2583 generic.go:356] "Generic (PLEG): container finished" podID="38b98bac-a1c9-44e3-8e64-05ddc7fbbda8" containerID="a7a6e85e2f97a7bef2447d6acf28549c03d7479316982fd6dc56b76f13c60fdd" exitCode=0
Sep 09 16:19:04.140654 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:04.140624    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"38b98bac-a1c9-44e3-8e64-05ddc7fbbda8","Type":"ContainerDied","Data":"a7a6e85e2f97a7bef2447d6acf28549c03d7479316982fd6dc56b76f13c60fdd"}
Sep 09 16:19:05.152245 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:05.152211    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 09 16:19:05.176240 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:05.176211    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 09 16:19:05.176377 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:05.176355    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 16:19:05.179515 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:05.179290    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Sep 09 16:19:05.179515 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:05.179308    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Sep 09 16:19:05.179683 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:05.179632    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Sep 09 16:19:05.179738 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:05.179693    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-cv5ll\""
Sep 09 16:19:05.179786 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:05.179777    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Sep 09 16:19:05.179920 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:05.179897    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Sep 09 16:19:05.180013 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:05.179959    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-6aadqh6ev2gqj\""
Sep 09 16:19:05.180122 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:05.180096    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Sep 09 16:19:05.180285 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:05.180269    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Sep 09 16:19:05.180361 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:05.180276    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Sep 09 16:19:05.180361 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:05.180284    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Sep 09 16:19:05.180741 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:05.180723    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Sep 09 16:19:05.180835 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:05.180774    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Sep 09 16:19:05.180957 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:05.180937    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Sep 09 16:19:05.183780 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:05.183761    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Sep 09 16:19:05.187209 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:05.187180    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Sep 09 16:19:05.250101 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:05.250079    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ef8e4a2f-9d17-47d2-a84f-7bff2123ce84-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"ef8e4a2f-9d17-47d2-a84f-7bff2123ce84\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 16:19:05.250208 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:05.250129    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/ef8e4a2f-9d17-47d2-a84f-7bff2123ce84-config\") pod \"prometheus-k8s-0\" (UID: \"ef8e4a2f-9d17-47d2-a84f-7bff2123ce84\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 16:19:05.250208 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:05.250180    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ef8e4a2f-9d17-47d2-a84f-7bff2123ce84-web-config\") pod \"prometheus-k8s-0\" (UID: \"ef8e4a2f-9d17-47d2-a84f-7bff2123ce84\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 16:19:05.250283 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:05.250205    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ef8e4a2f-9d17-47d2-a84f-7bff2123ce84-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"ef8e4a2f-9d17-47d2-a84f-7bff2123ce84\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 16:19:05.250283 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:05.250234    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ef8e4a2f-9d17-47d2-a84f-7bff2123ce84-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ef8e4a2f-9d17-47d2-a84f-7bff2123ce84\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 16:19:05.250283 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:05.250256    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ef8e4a2f-9d17-47d2-a84f-7bff2123ce84-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"ef8e4a2f-9d17-47d2-a84f-7bff2123ce84\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 16:19:05.250371 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:05.250308    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ef8e4a2f-9d17-47d2-a84f-7bff2123ce84-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"ef8e4a2f-9d17-47d2-a84f-7bff2123ce84\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 16:19:05.250371 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:05.250348    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ef8e4a2f-9d17-47d2-a84f-7bff2123ce84-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"ef8e4a2f-9d17-47d2-a84f-7bff2123ce84\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 16:19:05.250427 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:05.250375    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ef8e4a2f-9d17-47d2-a84f-7bff2123ce84-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"ef8e4a2f-9d17-47d2-a84f-7bff2123ce84\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 16:19:05.250427 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:05.250403    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ef8e4a2f-9d17-47d2-a84f-7bff2123ce84-config-out\") pod \"prometheus-k8s-0\" (UID: \"ef8e4a2f-9d17-47d2-a84f-7bff2123ce84\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 16:19:05.250489 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:05.250473    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ef8e4a2f-9d17-47d2-a84f-7bff2123ce84-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"ef8e4a2f-9d17-47d2-a84f-7bff2123ce84\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 16:19:05.250538 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:05.250501    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ef8e4a2f-9d17-47d2-a84f-7bff2123ce84-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ef8e4a2f-9d17-47d2-a84f-7bff2123ce84\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 16:19:05.250587 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:05.250541    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ef8e4a2f-9d17-47d2-a84f-7bff2123ce84-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"ef8e4a2f-9d17-47d2-a84f-7bff2123ce84\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 16:19:05.250587 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:05.250566    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ef8e4a2f-9d17-47d2-a84f-7bff2123ce84-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"ef8e4a2f-9d17-47d2-a84f-7bff2123ce84\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 16:19:05.250587 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:05.250583    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ef8e4a2f-9d17-47d2-a84f-7bff2123ce84-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"ef8e4a2f-9d17-47d2-a84f-7bff2123ce84\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 16:19:05.250718 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:05.250606    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jq6sh\" (UniqueName: \"kubernetes.io/projected/ef8e4a2f-9d17-47d2-a84f-7bff2123ce84-kube-api-access-jq6sh\") pod \"prometheus-k8s-0\" (UID: \"ef8e4a2f-9d17-47d2-a84f-7bff2123ce84\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 16:19:05.250718 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:05.250629    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ef8e4a2f-9d17-47d2-a84f-7bff2123ce84-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"ef8e4a2f-9d17-47d2-a84f-7bff2123ce84\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 16:19:05.250718 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:05.250648    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ef8e4a2f-9d17-47d2-a84f-7bff2123ce84-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"ef8e4a2f-9d17-47d2-a84f-7bff2123ce84\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 16:19:05.250718 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:05.250670    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ef8e4a2f-9d17-47d2-a84f-7bff2123ce84-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"ef8e4a2f-9d17-47d2-a84f-7bff2123ce84\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 16:19:05.250863 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:05.250743    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ef8e4a2f-9d17-47d2-a84f-7bff2123ce84-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ef8e4a2f-9d17-47d2-a84f-7bff2123ce84\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 16:19:05.351447 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:05.351403    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ef8e4a2f-9d17-47d2-a84f-7bff2123ce84-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"ef8e4a2f-9d17-47d2-a84f-7bff2123ce84\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 16:19:05.351447 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:05.351444    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ef8e4a2f-9d17-47d2-a84f-7bff2123ce84-config-out\") pod \"prometheus-k8s-0\" (UID: \"ef8e4a2f-9d17-47d2-a84f-7bff2123ce84\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 16:19:05.351622 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:05.351481    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ef8e4a2f-9d17-47d2-a84f-7bff2123ce84-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"ef8e4a2f-9d17-47d2-a84f-7bff2123ce84\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 16:19:05.351622 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:05.351504    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ef8e4a2f-9d17-47d2-a84f-7bff2123ce84-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ef8e4a2f-9d17-47d2-a84f-7bff2123ce84\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 16:19:05.351622 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:05.351532    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ef8e4a2f-9d17-47d2-a84f-7bff2123ce84-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"ef8e4a2f-9d17-47d2-a84f-7bff2123ce84\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 16:19:05.351622 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:05.351555    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ef8e4a2f-9d17-47d2-a84f-7bff2123ce84-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"ef8e4a2f-9d17-47d2-a84f-7bff2123ce84\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 16:19:05.351622 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:05.351584    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ef8e4a2f-9d17-47d2-a84f-7bff2123ce84-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"ef8e4a2f-9d17-47d2-a84f-7bff2123ce84\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 16:19:05.351622 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:05.351608    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jq6sh\" (UniqueName: \"kubernetes.io/projected/ef8e4a2f-9d17-47d2-a84f-7bff2123ce84-kube-api-access-jq6sh\") pod \"prometheus-k8s-0\" (UID: \"ef8e4a2f-9d17-47d2-a84f-7bff2123ce84\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 16:19:05.352168 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:05.351634    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ef8e4a2f-9d17-47d2-a84f-7bff2123ce84-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"ef8e4a2f-9d17-47d2-a84f-7bff2123ce84\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 16:19:05.352168 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:05.351659    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ef8e4a2f-9d17-47d2-a84f-7bff2123ce84-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"ef8e4a2f-9d17-47d2-a84f-7bff2123ce84\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 16:19:05.352168 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:05.351913    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ef8e4a2f-9d17-47d2-a84f-7bff2123ce84-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"ef8e4a2f-9d17-47d2-a84f-7bff2123ce84\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 16:19:05.352168 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:05.351965    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ef8e4a2f-9d17-47d2-a84f-7bff2123ce84-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ef8e4a2f-9d17-47d2-a84f-7bff2123ce84\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 16:19:05.352168 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:05.352014    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ef8e4a2f-9d17-47d2-a84f-7bff2123ce84-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"ef8e4a2f-9d17-47d2-a84f-7bff2123ce84\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 16:19:05.352168 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:05.352058    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/ef8e4a2f-9d17-47d2-a84f-7bff2123ce84-config\") pod \"prometheus-k8s-0\" (UID: \"ef8e4a2f-9d17-47d2-a84f-7bff2123ce84\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 16:19:05.352168 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:05.352114    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ef8e4a2f-9d17-47d2-a84f-7bff2123ce84-web-config\") pod \"prometheus-k8s-0\" (UID: \"ef8e4a2f-9d17-47d2-a84f-7bff2123ce84\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 16:19:05.352168 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:05.352140    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ef8e4a2f-9d17-47d2-a84f-7bff2123ce84-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"ef8e4a2f-9d17-47d2-a84f-7bff2123ce84\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 16:19:05.352168 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:05.352171    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ef8e4a2f-9d17-47d2-a84f-7bff2123ce84-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ef8e4a2f-9d17-47d2-a84f-7bff2123ce84\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 16:19:05.352589 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:05.352188    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ef8e4a2f-9d17-47d2-a84f-7bff2123ce84-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"ef8e4a2f-9d17-47d2-a84f-7bff2123ce84\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 16:19:05.352589 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:05.352204    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ef8e4a2f-9d17-47d2-a84f-7bff2123ce84-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"ef8e4a2f-9d17-47d2-a84f-7bff2123ce84\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 16:19:05.352589 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:05.352219    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ef8e4a2f-9d17-47d2-a84f-7bff2123ce84-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"ef8e4a2f-9d17-47d2-a84f-7bff2123ce84\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 16:19:05.352589 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:05.352388    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ef8e4a2f-9d17-47d2-a84f-7bff2123ce84-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"ef8e4a2f-9d17-47d2-a84f-7bff2123ce84\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 16:19:05.354512 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:05.353176    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ef8e4a2f-9d17-47d2-a84f-7bff2123ce84-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ef8e4a2f-9d17-47d2-a84f-7bff2123ce84\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 16:19:05.354512 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:05.353770    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ef8e4a2f-9d17-47d2-a84f-7bff2123ce84-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ef8e4a2f-9d17-47d2-a84f-7bff2123ce84\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 16:19:05.354862 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:05.354818    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ef8e4a2f-9d17-47d2-a84f-7bff2123ce84-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"ef8e4a2f-9d17-47d2-a84f-7bff2123ce84\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 16:19:05.358008 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:05.355750    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ef8e4a2f-9d17-47d2-a84f-7bff2123ce84-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"ef8e4a2f-9d17-47d2-a84f-7bff2123ce84\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 16:19:05.358008 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:05.356582    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ef8e4a2f-9d17-47d2-a84f-7bff2123ce84-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ef8e4a2f-9d17-47d2-a84f-7bff2123ce84\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 16:19:05.358008 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:05.357147    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ef8e4a2f-9d17-47d2-a84f-7bff2123ce84-web-config\") pod \"prometheus-k8s-0\" (UID: \"ef8e4a2f-9d17-47d2-a84f-7bff2123ce84\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 16:19:05.358008 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:05.357698    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ef8e4a2f-9d17-47d2-a84f-7bff2123ce84-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"ef8e4a2f-9d17-47d2-a84f-7bff2123ce84\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 16:19:05.358248 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:05.358193    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ef8e4a2f-9d17-47d2-a84f-7bff2123ce84-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"ef8e4a2f-9d17-47d2-a84f-7bff2123ce84\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 16:19:05.358747 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:05.358708    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ef8e4a2f-9d17-47d2-a84f-7bff2123ce84-config-out\") pod \"prometheus-k8s-0\" (UID: \"ef8e4a2f-9d17-47d2-a84f-7bff2123ce84\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 16:19:05.358857 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:05.358744    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ef8e4a2f-9d17-47d2-a84f-7bff2123ce84-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"ef8e4a2f-9d17-47d2-a84f-7bff2123ce84\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 16:19:05.359751 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:05.359393    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ef8e4a2f-9d17-47d2-a84f-7bff2123ce84-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"ef8e4a2f-9d17-47d2-a84f-7bff2123ce84\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 16:19:05.359751 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:05.359715    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ef8e4a2f-9d17-47d2-a84f-7bff2123ce84-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"ef8e4a2f-9d17-47d2-a84f-7bff2123ce84\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 16:19:05.359978 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:05.359957    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ef8e4a2f-9d17-47d2-a84f-7bff2123ce84-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"ef8e4a2f-9d17-47d2-a84f-7bff2123ce84\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 16:19:05.360716 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:05.360693    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ef8e4a2f-9d17-47d2-a84f-7bff2123ce84-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"ef8e4a2f-9d17-47d2-a84f-7bff2123ce84\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 16:19:05.361190 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:05.361166    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jq6sh\" (UniqueName: \"kubernetes.io/projected/ef8e4a2f-9d17-47d2-a84f-7bff2123ce84-kube-api-access-jq6sh\") pod \"prometheus-k8s-0\" (UID: \"ef8e4a2f-9d17-47d2-a84f-7bff2123ce84\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 16:19:05.362553 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:05.362529    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ef8e4a2f-9d17-47d2-a84f-7bff2123ce84-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"ef8e4a2f-9d17-47d2-a84f-7bff2123ce84\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 16:19:05.362676 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:05.362532    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ef8e4a2f-9d17-47d2-a84f-7bff2123ce84-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"ef8e4a2f-9d17-47d2-a84f-7bff2123ce84\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 16:19:05.364185 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:05.364146    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/ef8e4a2f-9d17-47d2-a84f-7bff2123ce84-config\") pod \"prometheus-k8s-0\" (UID: \"ef8e4a2f-9d17-47d2-a84f-7bff2123ce84\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 16:19:05.364453 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:05.364428    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ef8e4a2f-9d17-47d2-a84f-7bff2123ce84-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"ef8e4a2f-9d17-47d2-a84f-7bff2123ce84\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 16:19:05.489884 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:05.489828    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 16:19:06.032135 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:06.032100    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:19:06.081023 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:06.080994    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:19:06.932779 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:06.932755    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 09 16:19:06.934005 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:19:06.933968    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef8e4a2f_9d17_47d2_a84f_7bff2123ce84.slice/crio-95a3a5adc019929d055395c7cbb87111e74253192446d3acd703d96fe2de6a60 WatchSource:0}: Error finding container 95a3a5adc019929d055395c7cbb87111e74253192446d3acd703d96fe2de6a60: Status 404 returned error can't find the container with id 95a3a5adc019929d055395c7cbb87111e74253192446d3acd703d96fe2de6a60
Sep 09 16:19:07.155029 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:07.154967    2583 generic.go:356] "Generic (PLEG): container finished" podID="ef8e4a2f-9d17-47d2-a84f-7bff2123ce84" containerID="4abc1b3b288a4f8c68dfabf8432e85fe7426413a9eb65836a9a5ccca41bf0408" exitCode=0
Sep 09 16:19:07.155029 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:07.155012    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ef8e4a2f-9d17-47d2-a84f-7bff2123ce84","Type":"ContainerDied","Data":"4abc1b3b288a4f8c68dfabf8432e85fe7426413a9eb65836a9a5ccca41bf0408"}
Sep 09 16:19:07.155173 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:07.155083    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ef8e4a2f-9d17-47d2-a84f-7bff2123ce84","Type":"ContainerStarted","Data":"95a3a5adc019929d055395c7cbb87111e74253192446d3acd703d96fe2de6a60"}
Sep 09 16:19:07.156705 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:07.156682    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6757d4d54b-8nns5" event={"ID":"b15afba3-4609-4699-9ec9-870c9353fabb","Type":"ContainerStarted","Data":"24ffe5a20e1990764b8e4e78c9b2522d275ba9e6bed8dd038b9fadecc8cc0374"}
Sep 09 16:19:07.159611 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:07.159593    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"38b98bac-a1c9-44e3-8e64-05ddc7fbbda8","Type":"ContainerStarted","Data":"4bd1d0ce9bb2ca8a12b413682885f5feea10ea9a59fd23fde12900ab87179121"}
Sep 09 16:19:07.159708 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:07.159638    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"38b98bac-a1c9-44e3-8e64-05ddc7fbbda8","Type":"ContainerStarted","Data":"330a50c3ef52d19d0a1c025ba7c43b09f9936418aa306f7bbaf2b38a0cc1be37"}
Sep 09 16:19:07.159708 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:07.159665    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"38b98bac-a1c9-44e3-8e64-05ddc7fbbda8","Type":"ContainerStarted","Data":"f88072f2833e7dad7fd76a990bcfeda539438bdac0a094812b054a9449da34c8"}
Sep 09 16:19:07.193869 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:07.193832    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-6757d4d54b-8nns5" podStartSLOduration=1.5525748940000001 podStartE2EDuration="4.193821068s" totalImagesPullingTime="2.641246174s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 16:19:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:19:07.193416825 +0000 UTC m=+329.547146657" watchObservedRunningTime="2026-09-09 16:19:07.193821068 +0000 UTC m=+329.547550900"
Sep 09 16:19:08.167656 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:08.167597    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"38b98bac-a1c9-44e3-8e64-05ddc7fbbda8","Type":"ContainerStarted","Data":"dfff7836b59d903b744f4ab766849bef09200df71283aa2ff1be3aa2d1a78d78"}
Sep 09 16:19:08.168089 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:08.167706    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"38b98bac-a1c9-44e3-8e64-05ddc7fbbda8","Type":"ContainerStarted","Data":"05f093092d9a1061a0c0643be69dd57cc0ffa629a1d23b2a75e925b7215548b7"}
Sep 09 16:19:09.176711 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:09.176677    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"38b98bac-a1c9-44e3-8e64-05ddc7fbbda8","Type":"ContainerStarted","Data":"408d1f54770511a66a85e4eb46d07615fdc6aa966a3a10299473f0fbeb0a7629"}
Sep 09 16:19:09.205533 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:09.205474    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.293329709 podStartE2EDuration="9.205452373s" totalImagesPullingTime="5.895136706s" totalInitContainerRuntime="16.985958ms" isStatefulPod=false podCreationTimestamp="2026-09-09 16:19:00 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:19:09.203898102 +0000 UTC m=+331.557627962" watchObservedRunningTime="2026-09-09 16:19:09.205452373 +0000 UTC m=+331.559182205"
Sep 09 16:19:11.132641 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:11.132604    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:19:11.184356 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:11.184325    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:19:11.189295 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:11.189274    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ef8e4a2f-9d17-47d2-a84f-7bff2123ce84","Type":"ContainerStarted","Data":"78f0449255a0015bfe03c1aa1dda8a16a2fba436dbdb3c3a3756b70f842d5927"}
Sep 09 16:19:11.189392 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:11.189327    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ef8e4a2f-9d17-47d2-a84f-7bff2123ce84","Type":"ContainerStarted","Data":"90c338b8a0010d314cc0cf6f0a7a088bde1360870540d1fb816f9a62546c6c14"}
Sep 09 16:19:12.153654 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:12.153623    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:19:12.254643 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:12.254616    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:19:14.204244 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:14.204214    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ef8e4a2f-9d17-47d2-a84f-7bff2123ce84","Type":"ContainerStarted","Data":"6b7547dd64654d41145fc0111457242fccf69a7bdc7e0bbca69333feeebee1a1"}
Sep 09 16:19:14.204568 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:14.204310    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ef8e4a2f-9d17-47d2-a84f-7bff2123ce84","Type":"ContainerStarted","Data":"9bedd5a6ab97a63e839ca20ebdd2d997209b7ef6737bf54068b8debca845c9e9"}
Sep 09 16:19:14.204568 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:14.204337    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ef8e4a2f-9d17-47d2-a84f-7bff2123ce84","Type":"ContainerStarted","Data":"b7caac097b577c3a34acdddb68d562421fb87ae93535849d52029e6253a206e5"}
Sep 09 16:19:14.204568 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:14.204359    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ef8e4a2f-9d17-47d2-a84f-7bff2123ce84","Type":"ContainerStarted","Data":"8eb04ba7ff707924a36278d56fffe05096ab92b7a4926c0662405c1eeadf25e5"}
Sep 09 16:19:14.231753 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:14.231707    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.124108724 podStartE2EDuration="9.23168911s" totalImagesPullingTime="6.071908981s" totalInitContainerRuntime="35.671405ms" isStatefulPod=false podCreationTimestamp="2026-09-09 16:19:05 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:19:14.229827348 +0000 UTC m=+336.583557438" watchObservedRunningTime="2026-09-09 16:19:14.23168911 +0000 UTC m=+336.585418942"
Sep 09 16:19:14.884580 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:14.884547    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:19:14.986742 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:14.986701    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:19:15.041756 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:15.041727    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:19:15.490273 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:15.490246    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 16:19:23.736598 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:23.736564    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-6757d4d54b-8nns5"
Sep 09 16:19:23.737114 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:23.736680    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-6757d4d54b-8nns5"
Sep 09 16:19:25.248190 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:25.248160    2583 generic.go:356] "Generic (PLEG): container finished" podID="3126605a-6654-402a-8185-4795e376d566" containerID="cc325c953802b124b3c2c163903d5f48f5f0ac30025aba3e59ad2b9891d3b2fe" exitCode=0
Sep 09 16:19:25.248573 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:25.248214    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-nk2n7" event={"ID":"3126605a-6654-402a-8185-4795e376d566","Type":"ContainerDied","Data":"cc325c953802b124b3c2c163903d5f48f5f0ac30025aba3e59ad2b9891d3b2fe"}
Sep 09 16:19:25.248573 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:25.248452    2583 scope.go:117] "RemoveContainer" containerID="cc325c953802b124b3c2c163903d5f48f5f0ac30025aba3e59ad2b9891d3b2fe"
Sep 09 16:19:26.253472 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:26.253438    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-nk2n7" event={"ID":"3126605a-6654-402a-8185-4795e376d566","Type":"ContainerStarted","Data":"b596e74830ada30bdd6416f052d64b1b2fcd95b53c36a5a20625761873803c39"}
Sep 09 16:19:27.153093 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:27.153056    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:19:27.253120 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:27.253087    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:19:35.779162 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:35.772376    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:19:35.854803 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:35.854775    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:19:42.251525 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:42.251470    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:19:42.307339 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:42.307296    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:19:43.742649 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:43.742619    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-6757d4d54b-8nns5"
Sep 09 16:19:43.746449 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:43.746424    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-6757d4d54b-8nns5"
Sep 09 16:19:48.340149 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:48.340112    2583 generic.go:356] "Generic (PLEG): container finished" podID="2e7595e7-f00a-4fa7-be8e-f8e4adb4e628" containerID="da950f7c01bc50835836666e77735a178df25ea1cb1ca071daa82628ccc71fca" exitCode=0
Sep 09 16:19:48.340483 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:48.340185    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-dl57k" event={"ID":"2e7595e7-f00a-4fa7-be8e-f8e4adb4e628","Type":"ContainerDied","Data":"da950f7c01bc50835836666e77735a178df25ea1cb1ca071daa82628ccc71fca"}
Sep 09 16:19:48.340530 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:48.340486    2583 scope.go:117] "RemoveContainer" containerID="da950f7c01bc50835836666e77735a178df25ea1cb1ca071daa82628ccc71fca"
Sep 09 16:19:49.346542 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:49.346506    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-dl57k" event={"ID":"2e7595e7-f00a-4fa7-be8e-f8e4adb4e628","Type":"ContainerStarted","Data":"f7475e409723d0de55cedde883f863bad4129ef2f824b6e0c1c1f81e1cdd71ef"}
Sep 09 16:19:51.118493 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:51.118458    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f8a2ea6e-22df-4b6d-b1b1-e554e877f94c-metrics-certs\") pod \"network-metrics-daemon-qmp4p\" (UID: \"f8a2ea6e-22df-4b6d-b1b1-e554e877f94c\") " pod="openshift-multus/network-metrics-daemon-qmp4p"
Sep 09 16:19:51.120801 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:51.120780    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f8a2ea6e-22df-4b6d-b1b1-e554e877f94c-metrics-certs\") pod \"network-metrics-daemon-qmp4p\" (UID: \"f8a2ea6e-22df-4b6d-b1b1-e554e877f94c\") " pod="openshift-multus/network-metrics-daemon-qmp4p"
Sep 09 16:19:51.236689 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:51.236657    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-cjzmn\""
Sep 09 16:19:51.244354 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:51.244334    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qmp4p"
Sep 09 16:19:51.514069 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:51.513789    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-qmp4p"]
Sep 09 16:19:51.516673 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:19:51.516647    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8a2ea6e_22df_4b6d_b1b1_e554e877f94c.slice/crio-64ece0ccf77b1d052cedb3171369a5a23b4b70f1f5172a960f7b2aa5400168b4 WatchSource:0}: Error finding container 64ece0ccf77b1d052cedb3171369a5a23b4b70f1f5172a960f7b2aa5400168b4: Status 404 returned error can't find the container with id 64ece0ccf77b1d052cedb3171369a5a23b4b70f1f5172a960f7b2aa5400168b4
Sep 09 16:19:52.359467 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:52.359429    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qmp4p" event={"ID":"f8a2ea6e-22df-4b6d-b1b1-e554e877f94c","Type":"ContainerStarted","Data":"64ece0ccf77b1d052cedb3171369a5a23b4b70f1f5172a960f7b2aa5400168b4"}
Sep 09 16:19:53.367266 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:53.367232    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qmp4p" event={"ID":"f8a2ea6e-22df-4b6d-b1b1-e554e877f94c","Type":"ContainerStarted","Data":"cc84a52420d0abb7924c8db655613a771f879b74bd8c5076251c68306d50a546"}
Sep 09 16:19:53.367672 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:53.367282    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qmp4p" event={"ID":"f8a2ea6e-22df-4b6d-b1b1-e554e877f94c","Type":"ContainerStarted","Data":"8ab2afb9fe973fe50ad76fd100c3113a98591b338e0b6d6855da8a1491924eeb"}
Sep 09 16:19:53.384892 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:53.384840    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-qmp4p" podStartSLOduration=374.242377418 podStartE2EDuration="6m15.384819958s" totalImagesPullingTime="1.14244254s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 16:13:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:19:53.383009127 +0000 UTC m=+375.736738979" watchObservedRunningTime="2026-09-09 16:19:53.384819958 +0000 UTC m=+375.738549789"
Sep 09 16:19:53.467020 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:53.466974    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:19:53.526167 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:53.526085    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:19:57.802458 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:57.802420    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:19:57.852839 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:19:57.852807    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:20:05.490220 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:05.490176    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 16:20:05.504698 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:05.504673    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 16:20:06.440309 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:06.440278    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 16:20:10.047753 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:10.047714    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:20:10.115949 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:10.115917    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:20:18.155524 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:18.155492    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:20:18.357284 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:18.357237    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:20:18.945969 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:20:18.945918    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-79977f9844-779cg" podUID="c4338f01-9c80-4c3d-b2e1-187d647cb696"
Sep 09 16:20:18.945969 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:20:18.945927    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-xzslz" podUID="3b749ab0-b112-4083-8efc-6d45e9c5e6c2"
Sep 09 16:20:19.204863 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:19.204800    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 09 16:20:19.205231 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:19.205088    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="38b98bac-a1c9-44e3-8e64-05ddc7fbbda8" containerName="alertmanager" containerID="cri-o://f88072f2833e7dad7fd76a990bcfeda539438bdac0a094812b054a9449da34c8" gracePeriod=120
Sep 09 16:20:19.205231 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:19.205185    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="38b98bac-a1c9-44e3-8e64-05ddc7fbbda8" containerName="kube-rbac-proxy-metric" containerID="cri-o://dfff7836b59d903b744f4ab766849bef09200df71283aa2ff1be3aa2d1a78d78" gracePeriod=120
Sep 09 16:20:19.205231 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:19.205196    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="38b98bac-a1c9-44e3-8e64-05ddc7fbbda8" containerName="prom-label-proxy" containerID="cri-o://408d1f54770511a66a85e4eb46d07615fdc6aa966a3a10299473f0fbeb0a7629" gracePeriod=120
Sep 09 16:20:19.205439 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:19.205208    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="38b98bac-a1c9-44e3-8e64-05ddc7fbbda8" containerName="kube-rbac-proxy-web" containerID="cri-o://4bd1d0ce9bb2ca8a12b413682885f5feea10ea9a59fd23fde12900ab87179121" gracePeriod=120
Sep 09 16:20:19.205439 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:19.205245    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="38b98bac-a1c9-44e3-8e64-05ddc7fbbda8" containerName="kube-rbac-proxy" containerID="cri-o://05f093092d9a1061a0c0643be69dd57cc0ffa629a1d23b2a75e925b7215548b7" gracePeriod=120
Sep 09 16:20:19.205972 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:19.205501    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="38b98bac-a1c9-44e3-8e64-05ddc7fbbda8" containerName="config-reloader" containerID="cri-o://330a50c3ef52d19d0a1c025ba7c43b09f9936418aa306f7bbaf2b38a0cc1be37" gracePeriod=120
Sep 09 16:20:19.481030 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:19.480944    2583 generic.go:356] "Generic (PLEG): container finished" podID="38b98bac-a1c9-44e3-8e64-05ddc7fbbda8" containerID="408d1f54770511a66a85e4eb46d07615fdc6aa966a3a10299473f0fbeb0a7629" exitCode=0
Sep 09 16:20:19.481030 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:19.480967    2583 generic.go:356] "Generic (PLEG): container finished" podID="38b98bac-a1c9-44e3-8e64-05ddc7fbbda8" containerID="05f093092d9a1061a0c0643be69dd57cc0ffa629a1d23b2a75e925b7215548b7" exitCode=0
Sep 09 16:20:19.481030 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:19.480974    2583 generic.go:356] "Generic (PLEG): container finished" podID="38b98bac-a1c9-44e3-8e64-05ddc7fbbda8" containerID="330a50c3ef52d19d0a1c025ba7c43b09f9936418aa306f7bbaf2b38a0cc1be37" exitCode=0
Sep 09 16:20:19.481030 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:19.480979    2583 generic.go:356] "Generic (PLEG): container finished" podID="38b98bac-a1c9-44e3-8e64-05ddc7fbbda8" containerID="f88072f2833e7dad7fd76a990bcfeda539438bdac0a094812b054a9449da34c8" exitCode=0
Sep 09 16:20:19.481209 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:19.481029    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"38b98bac-a1c9-44e3-8e64-05ddc7fbbda8","Type":"ContainerDied","Data":"408d1f54770511a66a85e4eb46d07615fdc6aa966a3a10299473f0fbeb0a7629"}
Sep 09 16:20:19.481209 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:19.481107    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"38b98bac-a1c9-44e3-8e64-05ddc7fbbda8","Type":"ContainerDied","Data":"05f093092d9a1061a0c0643be69dd57cc0ffa629a1d23b2a75e925b7215548b7"}
Sep 09 16:20:19.481209 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:19.481140    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-79977f9844-779cg"
Sep 09 16:20:19.481209 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:19.481148    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"38b98bac-a1c9-44e3-8e64-05ddc7fbbda8","Type":"ContainerDied","Data":"330a50c3ef52d19d0a1c025ba7c43b09f9936418aa306f7bbaf2b38a0cc1be37"}
Sep 09 16:20:19.481209 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:19.481184    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"38b98bac-a1c9-44e3-8e64-05ddc7fbbda8","Type":"ContainerDied","Data":"f88072f2833e7dad7fd76a990bcfeda539438bdac0a094812b054a9449da34c8"}
Sep 09 16:20:19.481384 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:19.481146    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xzslz"
Sep 09 16:20:20.488119 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:20.488086    2583 generic.go:356] "Generic (PLEG): container finished" podID="38b98bac-a1c9-44e3-8e64-05ddc7fbbda8" containerID="dfff7836b59d903b744f4ab766849bef09200df71283aa2ff1be3aa2d1a78d78" exitCode=0
Sep 09 16:20:20.488119 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:20.488117    2583 generic.go:356] "Generic (PLEG): container finished" podID="38b98bac-a1c9-44e3-8e64-05ddc7fbbda8" containerID="4bd1d0ce9bb2ca8a12b413682885f5feea10ea9a59fd23fde12900ab87179121" exitCode=0
Sep 09 16:20:20.488472 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:20.488163    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"38b98bac-a1c9-44e3-8e64-05ddc7fbbda8","Type":"ContainerDied","Data":"dfff7836b59d903b744f4ab766849bef09200df71283aa2ff1be3aa2d1a78d78"}
Sep 09 16:20:20.488472 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:20.488257    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"38b98bac-a1c9-44e3-8e64-05ddc7fbbda8","Type":"ContainerDied","Data":"4bd1d0ce9bb2ca8a12b413682885f5feea10ea9a59fd23fde12900ab87179121"}
Sep 09 16:20:20.940182 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:20.940158    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 09 16:20:21.065094 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:21.065067    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-prm8f\" (UniqueName: \"kubernetes.io/projected/38b98bac-a1c9-44e3-8e64-05ddc7fbbda8-kube-api-access-prm8f\") pod \"38b98bac-a1c9-44e3-8e64-05ddc7fbbda8\" (UID: \"38b98bac-a1c9-44e3-8e64-05ddc7fbbda8\") "
Sep 09 16:20:21.065233 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:21.065099    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/38b98bac-a1c9-44e3-8e64-05ddc7fbbda8-secret-alertmanager-kube-rbac-proxy\") pod \"38b98bac-a1c9-44e3-8e64-05ddc7fbbda8\" (UID: \"38b98bac-a1c9-44e3-8e64-05ddc7fbbda8\") "
Sep 09 16:20:21.065233 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:21.065123    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/38b98bac-a1c9-44e3-8e64-05ddc7fbbda8-cluster-tls-config\") pod \"38b98bac-a1c9-44e3-8e64-05ddc7fbbda8\" (UID: \"38b98bac-a1c9-44e3-8e64-05ddc7fbbda8\") "
Sep 09 16:20:21.065233 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:21.065153    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/38b98bac-a1c9-44e3-8e64-05ddc7fbbda8-config-volume\") pod \"38b98bac-a1c9-44e3-8e64-05ddc7fbbda8\" (UID: \"38b98bac-a1c9-44e3-8e64-05ddc7fbbda8\") "
Sep 09 16:20:21.065233 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:21.065184    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/38b98bac-a1c9-44e3-8e64-05ddc7fbbda8-tls-assets\") pod \"38b98bac-a1c9-44e3-8e64-05ddc7fbbda8\" (UID: \"38b98bac-a1c9-44e3-8e64-05ddc7fbbda8\") "
Sep 09 16:20:21.065233 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:21.065222    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/38b98bac-a1c9-44e3-8e64-05ddc7fbbda8-web-config\") pod \"38b98bac-a1c9-44e3-8e64-05ddc7fbbda8\" (UID: \"38b98bac-a1c9-44e3-8e64-05ddc7fbbda8\") "
Sep 09 16:20:21.065474 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:21.065261    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/38b98bac-a1c9-44e3-8e64-05ddc7fbbda8-alertmanager-main-db\") pod \"38b98bac-a1c9-44e3-8e64-05ddc7fbbda8\" (UID: \"38b98bac-a1c9-44e3-8e64-05ddc7fbbda8\") "
Sep 09 16:20:21.065474 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:21.065299    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/38b98bac-a1c9-44e3-8e64-05ddc7fbbda8-secret-alertmanager-main-tls\") pod \"38b98bac-a1c9-44e3-8e64-05ddc7fbbda8\" (UID: \"38b98bac-a1c9-44e3-8e64-05ddc7fbbda8\") "
Sep 09 16:20:21.065474 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:21.065332    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/38b98bac-a1c9-44e3-8e64-05ddc7fbbda8-secret-alertmanager-kube-rbac-proxy-metric\") pod \"38b98bac-a1c9-44e3-8e64-05ddc7fbbda8\" (UID: \"38b98bac-a1c9-44e3-8e64-05ddc7fbbda8\") "
Sep 09 16:20:21.065474 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:21.065374    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/38b98bac-a1c9-44e3-8e64-05ddc7fbbda8-config-out\") pod \"38b98bac-a1c9-44e3-8e64-05ddc7fbbda8\" (UID: \"38b98bac-a1c9-44e3-8e64-05ddc7fbbda8\") "
Sep 09 16:20:21.065474 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:21.065398    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/38b98bac-a1c9-44e3-8e64-05ddc7fbbda8-metrics-client-ca\") pod \"38b98bac-a1c9-44e3-8e64-05ddc7fbbda8\" (UID: \"38b98bac-a1c9-44e3-8e64-05ddc7fbbda8\") "
Sep 09 16:20:21.065474 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:21.065437    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/38b98bac-a1c9-44e3-8e64-05ddc7fbbda8-secret-alertmanager-kube-rbac-proxy-web\") pod \"38b98bac-a1c9-44e3-8e64-05ddc7fbbda8\" (UID: \"38b98bac-a1c9-44e3-8e64-05ddc7fbbda8\") "
Sep 09 16:20:21.065746 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:21.065480    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/38b98bac-a1c9-44e3-8e64-05ddc7fbbda8-alertmanager-trusted-ca-bundle\") pod \"38b98bac-a1c9-44e3-8e64-05ddc7fbbda8\" (UID: \"38b98bac-a1c9-44e3-8e64-05ddc7fbbda8\") "
Sep 09 16:20:21.066341 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:21.065805    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/38b98bac-a1c9-44e3-8e64-05ddc7fbbda8-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "38b98bac-a1c9-44e3-8e64-05ddc7fbbda8" (UID: "38b98bac-a1c9-44e3-8e64-05ddc7fbbda8"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 16:20:21.066341 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:21.066087    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/38b98bac-a1c9-44e3-8e64-05ddc7fbbda8-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "38b98bac-a1c9-44e3-8e64-05ddc7fbbda8" (UID: "38b98bac-a1c9-44e3-8e64-05ddc7fbbda8"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 16:20:21.066341 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:21.066287    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/38b98bac-a1c9-44e3-8e64-05ddc7fbbda8-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "38b98bac-a1c9-44e3-8e64-05ddc7fbbda8" (UID: "38b98bac-a1c9-44e3-8e64-05ddc7fbbda8"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 16:20:21.067789 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:21.067730    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/38b98bac-a1c9-44e3-8e64-05ddc7fbbda8-kube-api-access-prm8f" (OuterVolumeSpecName: "kube-api-access-prm8f") pod "38b98bac-a1c9-44e3-8e64-05ddc7fbbda8" (UID: "38b98bac-a1c9-44e3-8e64-05ddc7fbbda8"). InnerVolumeSpecName "kube-api-access-prm8f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 16:20:21.068427 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:21.068406    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/38b98bac-a1c9-44e3-8e64-05ddc7fbbda8-config-volume" (OuterVolumeSpecName: "config-volume") pod "38b98bac-a1c9-44e3-8e64-05ddc7fbbda8" (UID: "38b98bac-a1c9-44e3-8e64-05ddc7fbbda8"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 16:20:21.068695 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:21.068655    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/38b98bac-a1c9-44e3-8e64-05ddc7fbbda8-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "38b98bac-a1c9-44e3-8e64-05ddc7fbbda8" (UID: "38b98bac-a1c9-44e3-8e64-05ddc7fbbda8"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 16:20:21.068695 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:21.068668    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/38b98bac-a1c9-44e3-8e64-05ddc7fbbda8-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "38b98bac-a1c9-44e3-8e64-05ddc7fbbda8" (UID: "38b98bac-a1c9-44e3-8e64-05ddc7fbbda8"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 16:20:21.068695 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:21.068658    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/38b98bac-a1c9-44e3-8e64-05ddc7fbbda8-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "38b98bac-a1c9-44e3-8e64-05ddc7fbbda8" (UID: "38b98bac-a1c9-44e3-8e64-05ddc7fbbda8"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 16:20:21.069046 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:21.069019    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/38b98bac-a1c9-44e3-8e64-05ddc7fbbda8-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "38b98bac-a1c9-44e3-8e64-05ddc7fbbda8" (UID: "38b98bac-a1c9-44e3-8e64-05ddc7fbbda8"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 16:20:21.069219 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:21.069191    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/38b98bac-a1c9-44e3-8e64-05ddc7fbbda8-config-out" (OuterVolumeSpecName: "config-out") pod "38b98bac-a1c9-44e3-8e64-05ddc7fbbda8" (UID: "38b98bac-a1c9-44e3-8e64-05ddc7fbbda8"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 16:20:21.069546 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:21.069521    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/38b98bac-a1c9-44e3-8e64-05ddc7fbbda8-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "38b98bac-a1c9-44e3-8e64-05ddc7fbbda8" (UID: "38b98bac-a1c9-44e3-8e64-05ddc7fbbda8"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 16:20:21.072804 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:21.072783    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/38b98bac-a1c9-44e3-8e64-05ddc7fbbda8-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "38b98bac-a1c9-44e3-8e64-05ddc7fbbda8" (UID: "38b98bac-a1c9-44e3-8e64-05ddc7fbbda8"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 16:20:21.078819 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:21.078788    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/38b98bac-a1c9-44e3-8e64-05ddc7fbbda8-web-config" (OuterVolumeSpecName: "web-config") pod "38b98bac-a1c9-44e3-8e64-05ddc7fbbda8" (UID: "38b98bac-a1c9-44e3-8e64-05ddc7fbbda8"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 16:20:21.166920 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:21.166898    2583 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/38b98bac-a1c9-44e3-8e64-05ddc7fbbda8-secret-alertmanager-main-tls\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\""
Sep 09 16:20:21.166920 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:21.166919    2583 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/38b98bac-a1c9-44e3-8e64-05ddc7fbbda8-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\""
Sep 09 16:20:21.167065 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:21.166928    2583 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/38b98bac-a1c9-44e3-8e64-05ddc7fbbda8-config-out\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\""
Sep 09 16:20:21.167065 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:21.166936    2583 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/38b98bac-a1c9-44e3-8e64-05ddc7fbbda8-metrics-client-ca\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\""
Sep 09 16:20:21.167065 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:21.166947    2583 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/38b98bac-a1c9-44e3-8e64-05ddc7fbbda8-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\""
Sep 09 16:20:21.167065 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:21.166956    2583 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/38b98bac-a1c9-44e3-8e64-05ddc7fbbda8-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\""
Sep 09 16:20:21.167065 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:21.166964    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-prm8f\" (UniqueName: \"kubernetes.io/projected/38b98bac-a1c9-44e3-8e64-05ddc7fbbda8-kube-api-access-prm8f\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\""
Sep 09 16:20:21.167065 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:21.166973    2583 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/38b98bac-a1c9-44e3-8e64-05ddc7fbbda8-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\""
Sep 09 16:20:21.167065 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:21.166980    2583 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/38b98bac-a1c9-44e3-8e64-05ddc7fbbda8-cluster-tls-config\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\""
Sep 09 16:20:21.167065 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:21.167007    2583 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/38b98bac-a1c9-44e3-8e64-05ddc7fbbda8-config-volume\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\""
Sep 09 16:20:21.167065 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:21.167015    2583 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/38b98bac-a1c9-44e3-8e64-05ddc7fbbda8-tls-assets\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\""
Sep 09 16:20:21.167065 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:21.167022    2583 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/38b98bac-a1c9-44e3-8e64-05ddc7fbbda8-web-config\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\""
Sep 09 16:20:21.167065 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:21.167029    2583 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/38b98bac-a1c9-44e3-8e64-05ddc7fbbda8-alertmanager-main-db\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\""
Sep 09 16:20:21.469102 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:21.469078    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c4338f01-9c80-4c3d-b2e1-187d647cb696-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-779cg\" (UID: \"c4338f01-9c80-4c3d-b2e1-187d647cb696\") " pod="openshift-network-console/networking-console-plugin-79977f9844-779cg"
Sep 09 16:20:21.469203 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:21.469109    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3b749ab0-b112-4083-8efc-6d45e9c5e6c2-metrics-tls\") pod \"dns-default-xzslz\" (UID: \"3b749ab0-b112-4083-8efc-6d45e9c5e6c2\") " pod="openshift-dns/dns-default-xzslz"
Sep 09 16:20:21.471058 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:21.471029    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3b749ab0-b112-4083-8efc-6d45e9c5e6c2-metrics-tls\") pod \"dns-default-xzslz\" (UID: \"3b749ab0-b112-4083-8efc-6d45e9c5e6c2\") " pod="openshift-dns/dns-default-xzslz"
Sep 09 16:20:21.471155 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:21.471034    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c4338f01-9c80-4c3d-b2e1-187d647cb696-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-779cg\" (UID: \"c4338f01-9c80-4c3d-b2e1-187d647cb696\") " pod="openshift-network-console/networking-console-plugin-79977f9844-779cg"
Sep 09 16:20:21.495419 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:21.495399    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"38b98bac-a1c9-44e3-8e64-05ddc7fbbda8","Type":"ContainerDied","Data":"2ad9b617658dd1bff4e182edc740c5741909dbbd576b94741d7d92ccdbb2a6f9"}
Sep 09 16:20:21.495704 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:21.495449    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 09 16:20:21.495704 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:21.495478    2583 scope.go:117] "RemoveContainer" containerID="408d1f54770511a66a85e4eb46d07615fdc6aa966a3a10299473f0fbeb0a7629"
Sep 09 16:20:21.505690 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:21.505674    2583 scope.go:117] "RemoveContainer" containerID="dfff7836b59d903b744f4ab766849bef09200df71283aa2ff1be3aa2d1a78d78"
Sep 09 16:20:21.512648 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:21.512630    2583 scope.go:117] "RemoveContainer" containerID="05f093092d9a1061a0c0643be69dd57cc0ffa629a1d23b2a75e925b7215548b7"
Sep 09 16:20:21.519547 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:21.519528    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 09 16:20:21.519705 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:21.519691    2583 scope.go:117] "RemoveContainer" containerID="4bd1d0ce9bb2ca8a12b413682885f5feea10ea9a59fd23fde12900ab87179121"
Sep 09 16:20:21.524830 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:21.524811    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 09 16:20:21.526716 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:21.526701    2583 scope.go:117] "RemoveContainer" containerID="330a50c3ef52d19d0a1c025ba7c43b09f9936418aa306f7bbaf2b38a0cc1be37"
Sep 09 16:20:21.532946 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:21.532918    2583 scope.go:117] "RemoveContainer" containerID="f88072f2833e7dad7fd76a990bcfeda539438bdac0a094812b054a9449da34c8"
Sep 09 16:20:21.539133 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:21.539111    2583 scope.go:117] "RemoveContainer" containerID="a7a6e85e2f97a7bef2447d6acf28549c03d7479316982fd6dc56b76f13c60fdd"
Sep 09 16:20:21.584773 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:21.584757    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-zjfwh\""
Sep 09 16:20:21.584773 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:21.584775    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-mwg2z\""
Sep 09 16:20:21.593025 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:21.593009    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xzslz"
Sep 09 16:20:21.593025 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:21.593016    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-79977f9844-779cg"
Sep 09 16:20:21.865297 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:21.865265    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-79977f9844-779cg"]
Sep 09 16:20:21.868338 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:21.868318    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-xzslz"]
Sep 09 16:20:21.868876 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:20:21.868854    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4338f01_9c80_4c3d_b2e1_187d647cb696.slice/crio-8d3a78916ee1f50845ba93c095f44393b8fc354eaec35561c328f98c92bef6b4 WatchSource:0}: Error finding container 8d3a78916ee1f50845ba93c095f44393b8fc354eaec35561c328f98c92bef6b4: Status 404 returned error can't find the container with id 8d3a78916ee1f50845ba93c095f44393b8fc354eaec35561c328f98c92bef6b4
Sep 09 16:20:21.870237 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:20:21.870218    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b749ab0_b112_4083_8efc_6d45e9c5e6c2.slice/crio-9702e9063f844ac6cd5a88ac6f3532d3732d7f49ec5bcbed5f5e871ea2cd87f9 WatchSource:0}: Error finding container 9702e9063f844ac6cd5a88ac6f3532d3732d7f49ec5bcbed5f5e871ea2cd87f9: Status 404 returned error can't find the container with id 9702e9063f844ac6cd5a88ac6f3532d3732d7f49ec5bcbed5f5e871ea2cd87f9
Sep 09 16:20:22.237783 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:22.237713    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="38b98bac-a1c9-44e3-8e64-05ddc7fbbda8" path="/var/lib/kubelet/pods/38b98bac-a1c9-44e3-8e64-05ddc7fbbda8/volumes"
Sep 09 16:20:22.502016 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:22.501942    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xzslz" event={"ID":"3b749ab0-b112-4083-8efc-6d45e9c5e6c2","Type":"ContainerStarted","Data":"9702e9063f844ac6cd5a88ac6f3532d3732d7f49ec5bcbed5f5e871ea2cd87f9"}
Sep 09 16:20:22.503399 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:22.503372    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-79977f9844-779cg" event={"ID":"c4338f01-9c80-4c3d-b2e1-187d647cb696","Type":"ContainerStarted","Data":"8d3a78916ee1f50845ba93c095f44393b8fc354eaec35561c328f98c92bef6b4"}
Sep 09 16:20:23.235497 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:23.235463    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-86b488f9f4-fzh9c"]
Sep 09 16:20:23.235972 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:23.235930    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="38b98bac-a1c9-44e3-8e64-05ddc7fbbda8" containerName="kube-rbac-proxy-web"
Sep 09 16:20:23.235972 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:23.235950    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="38b98bac-a1c9-44e3-8e64-05ddc7fbbda8" containerName="kube-rbac-proxy-web"
Sep 09 16:20:23.235972 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:23.235962    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="38b98bac-a1c9-44e3-8e64-05ddc7fbbda8" containerName="kube-rbac-proxy"
Sep 09 16:20:23.235972 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:23.235971    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="38b98bac-a1c9-44e3-8e64-05ddc7fbbda8" containerName="kube-rbac-proxy"
Sep 09 16:20:23.235972 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:23.235994    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="38b98bac-a1c9-44e3-8e64-05ddc7fbbda8" containerName="prom-label-proxy"
Sep 09 16:20:23.236290 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:23.236004    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="38b98bac-a1c9-44e3-8e64-05ddc7fbbda8" containerName="prom-label-proxy"
Sep 09 16:20:23.236290 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:23.236016    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="38b98bac-a1c9-44e3-8e64-05ddc7fbbda8" containerName="kube-rbac-proxy-metric"
Sep 09 16:20:23.236290 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:23.236025    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="38b98bac-a1c9-44e3-8e64-05ddc7fbbda8" containerName="kube-rbac-proxy-metric"
Sep 09 16:20:23.236290 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:23.236040    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="38b98bac-a1c9-44e3-8e64-05ddc7fbbda8" containerName="config-reloader"
Sep 09 16:20:23.236290 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:23.236048    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="38b98bac-a1c9-44e3-8e64-05ddc7fbbda8" containerName="config-reloader"
Sep 09 16:20:23.236290 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:23.236065    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="38b98bac-a1c9-44e3-8e64-05ddc7fbbda8" containerName="alertmanager"
Sep 09 16:20:23.236290 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:23.236074    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="38b98bac-a1c9-44e3-8e64-05ddc7fbbda8" containerName="alertmanager"
Sep 09 16:20:23.236290 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:23.236084    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="38b98bac-a1c9-44e3-8e64-05ddc7fbbda8" containerName="init-config-reloader"
Sep 09 16:20:23.236290 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:23.236092    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="38b98bac-a1c9-44e3-8e64-05ddc7fbbda8" containerName="init-config-reloader"
Sep 09 16:20:23.236290 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:23.236194    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="38b98bac-a1c9-44e3-8e64-05ddc7fbbda8" containerName="kube-rbac-proxy-web"
Sep 09 16:20:23.236290 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:23.236208    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="38b98bac-a1c9-44e3-8e64-05ddc7fbbda8" containerName="kube-rbac-proxy"
Sep 09 16:20:23.236290 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:23.236220    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="38b98bac-a1c9-44e3-8e64-05ddc7fbbda8" containerName="alertmanager"
Sep 09 16:20:23.236290 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:23.236229    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="38b98bac-a1c9-44e3-8e64-05ddc7fbbda8" containerName="config-reloader"
Sep 09 16:20:23.236290 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:23.236236    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="38b98bac-a1c9-44e3-8e64-05ddc7fbbda8" containerName="prom-label-proxy"
Sep 09 16:20:23.236290 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:23.236246    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="38b98bac-a1c9-44e3-8e64-05ddc7fbbda8" containerName="kube-rbac-proxy-metric"
Sep 09 16:20:23.239858 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:23.239832    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-86b488f9f4-fzh9c"
Sep 09 16:20:23.242559 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:23.242518    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Sep 09 16:20:23.242559 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:23.242556    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Sep 09 16:20:23.242719 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:23.242582    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Sep 09 16:20:23.242719 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:23.242602    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Sep 09 16:20:23.242911 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:23.242869    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Sep 09 16:20:23.243014 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:23.242926    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-c9mvl\""
Sep 09 16:20:23.248460 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:23.248344    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Sep 09 16:20:23.252258 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:23.252239    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-86b488f9f4-fzh9c"]
Sep 09 16:20:23.381669 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:23.381635    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7da7fa1f-0b0c-425b-a5f0-136fe665f4a9-metrics-client-ca\") pod \"telemeter-client-86b488f9f4-fzh9c\" (UID: \"7da7fa1f-0b0c-425b-a5f0-136fe665f4a9\") " pod="openshift-monitoring/telemeter-client-86b488f9f4-fzh9c"
Sep 09 16:20:23.381834 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:23.381685    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kdjsg\" (UniqueName: \"kubernetes.io/projected/7da7fa1f-0b0c-425b-a5f0-136fe665f4a9-kube-api-access-kdjsg\") pod \"telemeter-client-86b488f9f4-fzh9c\" (UID: \"7da7fa1f-0b0c-425b-a5f0-136fe665f4a9\") " pod="openshift-monitoring/telemeter-client-86b488f9f4-fzh9c"
Sep 09 16:20:23.381834 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:23.381715    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7da7fa1f-0b0c-425b-a5f0-136fe665f4a9-serving-certs-ca-bundle\") pod \"telemeter-client-86b488f9f4-fzh9c\" (UID: \"7da7fa1f-0b0c-425b-a5f0-136fe665f4a9\") " pod="openshift-monitoring/telemeter-client-86b488f9f4-fzh9c"
Sep 09 16:20:23.381834 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:23.381744    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/7da7fa1f-0b0c-425b-a5f0-136fe665f4a9-federate-client-tls\") pod \"telemeter-client-86b488f9f4-fzh9c\" (UID: \"7da7fa1f-0b0c-425b-a5f0-136fe665f4a9\") " pod="openshift-monitoring/telemeter-client-86b488f9f4-fzh9c"
Sep 09 16:20:23.381834 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:23.381778    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/7da7fa1f-0b0c-425b-a5f0-136fe665f4a9-secret-telemeter-client\") pod \"telemeter-client-86b488f9f4-fzh9c\" (UID: \"7da7fa1f-0b0c-425b-a5f0-136fe665f4a9\") " pod="openshift-monitoring/telemeter-client-86b488f9f4-fzh9c"
Sep 09 16:20:23.381834 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:23.381803    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7da7fa1f-0b0c-425b-a5f0-136fe665f4a9-telemeter-trusted-ca-bundle\") pod \"telemeter-client-86b488f9f4-fzh9c\" (UID: \"7da7fa1f-0b0c-425b-a5f0-136fe665f4a9\") " pod="openshift-monitoring/telemeter-client-86b488f9f4-fzh9c"
Sep 09 16:20:23.382083 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:23.381854    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/7da7fa1f-0b0c-425b-a5f0-136fe665f4a9-telemeter-client-tls\") pod \"telemeter-client-86b488f9f4-fzh9c\" (UID: \"7da7fa1f-0b0c-425b-a5f0-136fe665f4a9\") " pod="openshift-monitoring/telemeter-client-86b488f9f4-fzh9c"
Sep 09 16:20:23.382083 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:23.381936    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7da7fa1f-0b0c-425b-a5f0-136fe665f4a9-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-86b488f9f4-fzh9c\" (UID: \"7da7fa1f-0b0c-425b-a5f0-136fe665f4a9\") " pod="openshift-monitoring/telemeter-client-86b488f9f4-fzh9c"
Sep 09 16:20:23.483081 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:23.483049    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7da7fa1f-0b0c-425b-a5f0-136fe665f4a9-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-86b488f9f4-fzh9c\" (UID: \"7da7fa1f-0b0c-425b-a5f0-136fe665f4a9\") " pod="openshift-monitoring/telemeter-client-86b488f9f4-fzh9c"
Sep 09 16:20:23.483223 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:23.483132    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7da7fa1f-0b0c-425b-a5f0-136fe665f4a9-metrics-client-ca\") pod \"telemeter-client-86b488f9f4-fzh9c\" (UID: \"7da7fa1f-0b0c-425b-a5f0-136fe665f4a9\") " pod="openshift-monitoring/telemeter-client-86b488f9f4-fzh9c"
Sep 09 16:20:23.483223 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:23.483163    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kdjsg\" (UniqueName: \"kubernetes.io/projected/7da7fa1f-0b0c-425b-a5f0-136fe665f4a9-kube-api-access-kdjsg\") pod \"telemeter-client-86b488f9f4-fzh9c\" (UID: \"7da7fa1f-0b0c-425b-a5f0-136fe665f4a9\") " pod="openshift-monitoring/telemeter-client-86b488f9f4-fzh9c"
Sep 09 16:20:23.483223 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:23.483192    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7da7fa1f-0b0c-425b-a5f0-136fe665f4a9-serving-certs-ca-bundle\") pod \"telemeter-client-86b488f9f4-fzh9c\" (UID: \"7da7fa1f-0b0c-425b-a5f0-136fe665f4a9\") " pod="openshift-monitoring/telemeter-client-86b488f9f4-fzh9c"
Sep 09 16:20:23.483383 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:23.483302    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/7da7fa1f-0b0c-425b-a5f0-136fe665f4a9-federate-client-tls\") pod \"telemeter-client-86b488f9f4-fzh9c\" (UID: \"7da7fa1f-0b0c-425b-a5f0-136fe665f4a9\") " pod="openshift-monitoring/telemeter-client-86b488f9f4-fzh9c"
Sep 09 16:20:23.483383 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:23.483351    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/7da7fa1f-0b0c-425b-a5f0-136fe665f4a9-secret-telemeter-client\") pod \"telemeter-client-86b488f9f4-fzh9c\" (UID: \"7da7fa1f-0b0c-425b-a5f0-136fe665f4a9\") " pod="openshift-monitoring/telemeter-client-86b488f9f4-fzh9c"
Sep 09 16:20:23.483383 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:23.483373    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7da7fa1f-0b0c-425b-a5f0-136fe665f4a9-telemeter-trusted-ca-bundle\") pod \"telemeter-client-86b488f9f4-fzh9c\" (UID: \"7da7fa1f-0b0c-425b-a5f0-136fe665f4a9\") " pod="openshift-monitoring/telemeter-client-86b488f9f4-fzh9c"
Sep 09 16:20:23.483527 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:23.483412    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/7da7fa1f-0b0c-425b-a5f0-136fe665f4a9-telemeter-client-tls\") pod \"telemeter-client-86b488f9f4-fzh9c\" (UID: \"7da7fa1f-0b0c-425b-a5f0-136fe665f4a9\") " pod="openshift-monitoring/telemeter-client-86b488f9f4-fzh9c"
Sep 09 16:20:23.484099 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:23.484073    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7da7fa1f-0b0c-425b-a5f0-136fe665f4a9-serving-certs-ca-bundle\") pod \"telemeter-client-86b488f9f4-fzh9c\" (UID: \"7da7fa1f-0b0c-425b-a5f0-136fe665f4a9\") " pod="openshift-monitoring/telemeter-client-86b488f9f4-fzh9c"
Sep 09 16:20:23.484099 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:23.484085    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7da7fa1f-0b0c-425b-a5f0-136fe665f4a9-metrics-client-ca\") pod \"telemeter-client-86b488f9f4-fzh9c\" (UID: \"7da7fa1f-0b0c-425b-a5f0-136fe665f4a9\") " pod="openshift-monitoring/telemeter-client-86b488f9f4-fzh9c"
Sep 09 16:20:23.484305 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:23.484257    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7da7fa1f-0b0c-425b-a5f0-136fe665f4a9-telemeter-trusted-ca-bundle\") pod \"telemeter-client-86b488f9f4-fzh9c\" (UID: \"7da7fa1f-0b0c-425b-a5f0-136fe665f4a9\") " pod="openshift-monitoring/telemeter-client-86b488f9f4-fzh9c"
Sep 09 16:20:23.486179 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:23.486124    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7da7fa1f-0b0c-425b-a5f0-136fe665f4a9-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-86b488f9f4-fzh9c\" (UID: \"7da7fa1f-0b0c-425b-a5f0-136fe665f4a9\") " pod="openshift-monitoring/telemeter-client-86b488f9f4-fzh9c"
Sep 09 16:20:23.486399 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:23.486378    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/7da7fa1f-0b0c-425b-a5f0-136fe665f4a9-telemeter-client-tls\") pod \"telemeter-client-86b488f9f4-fzh9c\" (UID: \"7da7fa1f-0b0c-425b-a5f0-136fe665f4a9\") " pod="openshift-monitoring/telemeter-client-86b488f9f4-fzh9c"
Sep 09 16:20:23.486506 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:23.486482    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/7da7fa1f-0b0c-425b-a5f0-136fe665f4a9-secret-telemeter-client\") pod \"telemeter-client-86b488f9f4-fzh9c\" (UID: \"7da7fa1f-0b0c-425b-a5f0-136fe665f4a9\") " pod="openshift-monitoring/telemeter-client-86b488f9f4-fzh9c"
Sep 09 16:20:23.486788 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:23.486748    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/7da7fa1f-0b0c-425b-a5f0-136fe665f4a9-federate-client-tls\") pod \"telemeter-client-86b488f9f4-fzh9c\" (UID: \"7da7fa1f-0b0c-425b-a5f0-136fe665f4a9\") " pod="openshift-monitoring/telemeter-client-86b488f9f4-fzh9c"
Sep 09 16:20:23.491228 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:23.491211    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kdjsg\" (UniqueName: \"kubernetes.io/projected/7da7fa1f-0b0c-425b-a5f0-136fe665f4a9-kube-api-access-kdjsg\") pod \"telemeter-client-86b488f9f4-fzh9c\" (UID: \"7da7fa1f-0b0c-425b-a5f0-136fe665f4a9\") " pod="openshift-monitoring/telemeter-client-86b488f9f4-fzh9c"
Sep 09 16:20:23.552777 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:23.552749    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 09 16:20:23.553292 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:23.553156    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ef8e4a2f-9d17-47d2-a84f-7bff2123ce84" containerName="prometheus" containerID="cri-o://90c338b8a0010d314cc0cf6f0a7a088bde1360870540d1fb816f9a62546c6c14" gracePeriod=600
Sep 09 16:20:23.553612 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:23.553359    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ef8e4a2f-9d17-47d2-a84f-7bff2123ce84" containerName="kube-rbac-proxy" containerID="cri-o://9bedd5a6ab97a63e839ca20ebdd2d997209b7ef6737bf54068b8debca845c9e9" gracePeriod=600
Sep 09 16:20:23.553612 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:23.553479    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ef8e4a2f-9d17-47d2-a84f-7bff2123ce84" containerName="thanos-sidecar" containerID="cri-o://8eb04ba7ff707924a36278d56fffe05096ab92b7a4926c0662405c1eeadf25e5" gracePeriod=600
Sep 09 16:20:23.553612 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:23.553494    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ef8e4a2f-9d17-47d2-a84f-7bff2123ce84" containerName="config-reloader" containerID="cri-o://78f0449255a0015bfe03c1aa1dda8a16a2fba436dbdb3c3a3756b70f842d5927" gracePeriod=600
Sep 09 16:20:23.553612 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:23.553528    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ef8e4a2f-9d17-47d2-a84f-7bff2123ce84" containerName="kube-rbac-proxy-thanos" containerID="cri-o://6b7547dd64654d41145fc0111457242fccf69a7bdc7e0bbca69333feeebee1a1" gracePeriod=600
Sep 09 16:20:23.553849 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:23.553644    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ef8e4a2f-9d17-47d2-a84f-7bff2123ce84" containerName="kube-rbac-proxy-web" containerID="cri-o://b7caac097b577c3a34acdddb68d562421fb87ae93535849d52029e6253a206e5" gracePeriod=600
Sep 09 16:20:23.553849 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:23.553711    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-86b488f9f4-fzh9c"
Sep 09 16:20:23.875725 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:23.875698    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-86b488f9f4-fzh9c"]
Sep 09 16:20:24.055097 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.055076    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 16:20:24.198798 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.198773    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ef8e4a2f-9d17-47d2-a84f-7bff2123ce84-prometheus-k8s-db\") pod \"ef8e4a2f-9d17-47d2-a84f-7bff2123ce84\" (UID: \"ef8e4a2f-9d17-47d2-a84f-7bff2123ce84\") "
Sep 09 16:20:24.198922 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.198806    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ef8e4a2f-9d17-47d2-a84f-7bff2123ce84-thanos-prometheus-http-client-file\") pod \"ef8e4a2f-9d17-47d2-a84f-7bff2123ce84\" (UID: \"ef8e4a2f-9d17-47d2-a84f-7bff2123ce84\") "
Sep 09 16:20:24.198922 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.198831    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ef8e4a2f-9d17-47d2-a84f-7bff2123ce84-prometheus-k8s-rulefiles-0\") pod \"ef8e4a2f-9d17-47d2-a84f-7bff2123ce84\" (UID: \"ef8e4a2f-9d17-47d2-a84f-7bff2123ce84\") "
Sep 09 16:20:24.198922 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.198847    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jq6sh\" (UniqueName: \"kubernetes.io/projected/ef8e4a2f-9d17-47d2-a84f-7bff2123ce84-kube-api-access-jq6sh\") pod \"ef8e4a2f-9d17-47d2-a84f-7bff2123ce84\" (UID: \"ef8e4a2f-9d17-47d2-a84f-7bff2123ce84\") "
Sep 09 16:20:24.198922 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.198872    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ef8e4a2f-9d17-47d2-a84f-7bff2123ce84-configmap-serving-certs-ca-bundle\") pod \"ef8e4a2f-9d17-47d2-a84f-7bff2123ce84\" (UID: \"ef8e4a2f-9d17-47d2-a84f-7bff2123ce84\") "
Sep 09 16:20:24.198922 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.198896    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ef8e4a2f-9d17-47d2-a84f-7bff2123ce84-configmap-metrics-client-ca\") pod \"ef8e4a2f-9d17-47d2-a84f-7bff2123ce84\" (UID: \"ef8e4a2f-9d17-47d2-a84f-7bff2123ce84\") "
Sep 09 16:20:24.199200 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.198930    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ef8e4a2f-9d17-47d2-a84f-7bff2123ce84-secret-prometheus-k8s-tls\") pod \"ef8e4a2f-9d17-47d2-a84f-7bff2123ce84\" (UID: \"ef8e4a2f-9d17-47d2-a84f-7bff2123ce84\") "
Sep 09 16:20:24.199200 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.198969    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ef8e4a2f-9d17-47d2-a84f-7bff2123ce84-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"ef8e4a2f-9d17-47d2-a84f-7bff2123ce84\" (UID: \"ef8e4a2f-9d17-47d2-a84f-7bff2123ce84\") "
Sep 09 16:20:24.199379 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.199323    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ef8e4a2f-9d17-47d2-a84f-7bff2123ce84-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "ef8e4a2f-9d17-47d2-a84f-7bff2123ce84" (UID: "ef8e4a2f-9d17-47d2-a84f-7bff2123ce84"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 16:20:24.200422 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.199526    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ef8e4a2f-9d17-47d2-a84f-7bff2123ce84-secret-grpc-tls\") pod \"ef8e4a2f-9d17-47d2-a84f-7bff2123ce84\" (UID: \"ef8e4a2f-9d17-47d2-a84f-7bff2123ce84\") "
Sep 09 16:20:24.200422 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.199564    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ef8e4a2f-9d17-47d2-a84f-7bff2123ce84-configmap-kubelet-serving-ca-bundle\") pod \"ef8e4a2f-9d17-47d2-a84f-7bff2123ce84\" (UID: \"ef8e4a2f-9d17-47d2-a84f-7bff2123ce84\") "
Sep 09 16:20:24.200422 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.199623    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ef8e4a2f-9d17-47d2-a84f-7bff2123ce84-prometheus-k8s-rulefiles-1\") pod \"ef8e4a2f-9d17-47d2-a84f-7bff2123ce84\" (UID: \"ef8e4a2f-9d17-47d2-a84f-7bff2123ce84\") "
Sep 09 16:20:24.200422 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.199653    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ef8e4a2f-9d17-47d2-a84f-7bff2123ce84-secret-kube-rbac-proxy\") pod \"ef8e4a2f-9d17-47d2-a84f-7bff2123ce84\" (UID: \"ef8e4a2f-9d17-47d2-a84f-7bff2123ce84\") "
Sep 09 16:20:24.200422 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.199690    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ef8e4a2f-9d17-47d2-a84f-7bff2123ce84-prometheus-trusted-ca-bundle\") pod \"ef8e4a2f-9d17-47d2-a84f-7bff2123ce84\" (UID: \"ef8e4a2f-9d17-47d2-a84f-7bff2123ce84\") "
Sep 09 16:20:24.200422 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.199716    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ef8e4a2f-9d17-47d2-a84f-7bff2123ce84-prometheus-k8s-rulefiles-2\") pod \"ef8e4a2f-9d17-47d2-a84f-7bff2123ce84\" (UID: \"ef8e4a2f-9d17-47d2-a84f-7bff2123ce84\") "
Sep 09 16:20:24.200422 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.199741    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ef8e4a2f-9d17-47d2-a84f-7bff2123ce84-secret-metrics-client-certs\") pod \"ef8e4a2f-9d17-47d2-a84f-7bff2123ce84\" (UID: \"ef8e4a2f-9d17-47d2-a84f-7bff2123ce84\") "
Sep 09 16:20:24.200422 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.199765    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ef8e4a2f-9d17-47d2-a84f-7bff2123ce84-web-config\") pod \"ef8e4a2f-9d17-47d2-a84f-7bff2123ce84\" (UID: \"ef8e4a2f-9d17-47d2-a84f-7bff2123ce84\") "
Sep 09 16:20:24.200422 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.199789    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/ef8e4a2f-9d17-47d2-a84f-7bff2123ce84-config\") pod \"ef8e4a2f-9d17-47d2-a84f-7bff2123ce84\" (UID: \"ef8e4a2f-9d17-47d2-a84f-7bff2123ce84\") "
Sep 09 16:20:24.200422 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.199812    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ef8e4a2f-9d17-47d2-a84f-7bff2123ce84-tls-assets\") pod \"ef8e4a2f-9d17-47d2-a84f-7bff2123ce84\" (UID: \"ef8e4a2f-9d17-47d2-a84f-7bff2123ce84\") "
Sep 09 16:20:24.200422 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.199861    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ef8e4a2f-9d17-47d2-a84f-7bff2123ce84-config-out\") pod \"ef8e4a2f-9d17-47d2-a84f-7bff2123ce84\" (UID: \"ef8e4a2f-9d17-47d2-a84f-7bff2123ce84\") "
Sep 09 16:20:24.200422 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.199887    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ef8e4a2f-9d17-47d2-a84f-7bff2123ce84-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"ef8e4a2f-9d17-47d2-a84f-7bff2123ce84\" (UID: \"ef8e4a2f-9d17-47d2-a84f-7bff2123ce84\") "
Sep 09 16:20:24.200422 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.200160    2583 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ef8e4a2f-9d17-47d2-a84f-7bff2123ce84-configmap-metrics-client-ca\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\""
Sep 09 16:20:24.201134 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.199615    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ef8e4a2f-9d17-47d2-a84f-7bff2123ce84-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "ef8e4a2f-9d17-47d2-a84f-7bff2123ce84" (UID: "ef8e4a2f-9d17-47d2-a84f-7bff2123ce84"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 16:20:24.201134 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.199815    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ef8e4a2f-9d17-47d2-a84f-7bff2123ce84-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "ef8e4a2f-9d17-47d2-a84f-7bff2123ce84" (UID: "ef8e4a2f-9d17-47d2-a84f-7bff2123ce84"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 16:20:24.201134 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.200008    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ef8e4a2f-9d17-47d2-a84f-7bff2123ce84-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "ef8e4a2f-9d17-47d2-a84f-7bff2123ce84" (UID: "ef8e4a2f-9d17-47d2-a84f-7bff2123ce84"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 16:20:24.201134 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.200214    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ef8e4a2f-9d17-47d2-a84f-7bff2123ce84-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "ef8e4a2f-9d17-47d2-a84f-7bff2123ce84" (UID: "ef8e4a2f-9d17-47d2-a84f-7bff2123ce84"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 16:20:24.201134 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.201041    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ef8e4a2f-9d17-47d2-a84f-7bff2123ce84-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "ef8e4a2f-9d17-47d2-a84f-7bff2123ce84" (UID: "ef8e4a2f-9d17-47d2-a84f-7bff2123ce84"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 16:20:24.201382 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.201357    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ef8e4a2f-9d17-47d2-a84f-7bff2123ce84-kube-api-access-jq6sh" (OuterVolumeSpecName: "kube-api-access-jq6sh") pod "ef8e4a2f-9d17-47d2-a84f-7bff2123ce84" (UID: "ef8e4a2f-9d17-47d2-a84f-7bff2123ce84"). InnerVolumeSpecName "kube-api-access-jq6sh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 16:20:24.201436 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.201417    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ef8e4a2f-9d17-47d2-a84f-7bff2123ce84-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "ef8e4a2f-9d17-47d2-a84f-7bff2123ce84" (UID: "ef8e4a2f-9d17-47d2-a84f-7bff2123ce84"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 16:20:24.201499 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.201478    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ef8e4a2f-9d17-47d2-a84f-7bff2123ce84-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "ef8e4a2f-9d17-47d2-a84f-7bff2123ce84" (UID: "ef8e4a2f-9d17-47d2-a84f-7bff2123ce84"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 16:20:24.201682 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.201595    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ef8e4a2f-9d17-47d2-a84f-7bff2123ce84-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "ef8e4a2f-9d17-47d2-a84f-7bff2123ce84" (UID: "ef8e4a2f-9d17-47d2-a84f-7bff2123ce84"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 16:20:24.201682 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.201650    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ef8e4a2f-9d17-47d2-a84f-7bff2123ce84-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "ef8e4a2f-9d17-47d2-a84f-7bff2123ce84" (UID: "ef8e4a2f-9d17-47d2-a84f-7bff2123ce84"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 16:20:24.201900 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.201869    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ef8e4a2f-9d17-47d2-a84f-7bff2123ce84-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "ef8e4a2f-9d17-47d2-a84f-7bff2123ce84" (UID: "ef8e4a2f-9d17-47d2-a84f-7bff2123ce84"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 16:20:24.202459 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.202435    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ef8e4a2f-9d17-47d2-a84f-7bff2123ce84-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "ef8e4a2f-9d17-47d2-a84f-7bff2123ce84" (UID: "ef8e4a2f-9d17-47d2-a84f-7bff2123ce84"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 16:20:24.202905 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.202880    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ef8e4a2f-9d17-47d2-a84f-7bff2123ce84-config" (OuterVolumeSpecName: "config") pod "ef8e4a2f-9d17-47d2-a84f-7bff2123ce84" (UID: "ef8e4a2f-9d17-47d2-a84f-7bff2123ce84"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 16:20:24.203209 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.203184    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ef8e4a2f-9d17-47d2-a84f-7bff2123ce84-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "ef8e4a2f-9d17-47d2-a84f-7bff2123ce84" (UID: "ef8e4a2f-9d17-47d2-a84f-7bff2123ce84"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 16:20:24.203447 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.203423    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ef8e4a2f-9d17-47d2-a84f-7bff2123ce84-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "ef8e4a2f-9d17-47d2-a84f-7bff2123ce84" (UID: "ef8e4a2f-9d17-47d2-a84f-7bff2123ce84"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 16:20:24.203689 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.203665    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ef8e4a2f-9d17-47d2-a84f-7bff2123ce84-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "ef8e4a2f-9d17-47d2-a84f-7bff2123ce84" (UID: "ef8e4a2f-9d17-47d2-a84f-7bff2123ce84"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 16:20:24.203837 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.203819    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ef8e4a2f-9d17-47d2-a84f-7bff2123ce84-config-out" (OuterVolumeSpecName: "config-out") pod "ef8e4a2f-9d17-47d2-a84f-7bff2123ce84" (UID: "ef8e4a2f-9d17-47d2-a84f-7bff2123ce84"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 16:20:24.204145 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.204126    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ef8e4a2f-9d17-47d2-a84f-7bff2123ce84-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "ef8e4a2f-9d17-47d2-a84f-7bff2123ce84" (UID: "ef8e4a2f-9d17-47d2-a84f-7bff2123ce84"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 16:20:24.213287 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.213264    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ef8e4a2f-9d17-47d2-a84f-7bff2123ce84-web-config" (OuterVolumeSpecName: "web-config") pod "ef8e4a2f-9d17-47d2-a84f-7bff2123ce84" (UID: "ef8e4a2f-9d17-47d2-a84f-7bff2123ce84"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 16:20:24.301275 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.301246    2583 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ef8e4a2f-9d17-47d2-a84f-7bff2123ce84-prometheus-k8s-db\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\""
Sep 09 16:20:24.301275 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.301269    2583 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ef8e4a2f-9d17-47d2-a84f-7bff2123ce84-thanos-prometheus-http-client-file\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\""
Sep 09 16:20:24.301400 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.301279    2583 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ef8e4a2f-9d17-47d2-a84f-7bff2123ce84-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\""
Sep 09 16:20:24.301400 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.301287    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jq6sh\" (UniqueName: \"kubernetes.io/projected/ef8e4a2f-9d17-47d2-a84f-7bff2123ce84-kube-api-access-jq6sh\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\""
Sep 09 16:20:24.301400 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.301295    2583 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ef8e4a2f-9d17-47d2-a84f-7bff2123ce84-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\""
Sep 09 16:20:24.301400 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.301303    2583 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ef8e4a2f-9d17-47d2-a84f-7bff2123ce84-secret-prometheus-k8s-tls\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\""
Sep 09 16:20:24.301400 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.301311    2583 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ef8e4a2f-9d17-47d2-a84f-7bff2123ce84-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\""
Sep 09 16:20:24.301400 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.301319    2583 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ef8e4a2f-9d17-47d2-a84f-7bff2123ce84-secret-grpc-tls\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\""
Sep 09 16:20:24.301400 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.301327    2583 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ef8e4a2f-9d17-47d2-a84f-7bff2123ce84-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\""
Sep 09 16:20:24.301400 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.301335    2583 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ef8e4a2f-9d17-47d2-a84f-7bff2123ce84-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\""
Sep 09 16:20:24.301400 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.301343    2583 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ef8e4a2f-9d17-47d2-a84f-7bff2123ce84-secret-kube-rbac-proxy\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\""
Sep 09 16:20:24.301400 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.301352    2583 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ef8e4a2f-9d17-47d2-a84f-7bff2123ce84-prometheus-trusted-ca-bundle\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\""
Sep 09 16:20:24.301400 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.301361    2583 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ef8e4a2f-9d17-47d2-a84f-7bff2123ce84-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\""
Sep 09 16:20:24.301400 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.301369    2583 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ef8e4a2f-9d17-47d2-a84f-7bff2123ce84-secret-metrics-client-certs\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\""
Sep 09 16:20:24.301400 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.301377    2583 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ef8e4a2f-9d17-47d2-a84f-7bff2123ce84-web-config\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\""
Sep 09 16:20:24.301400 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.301385    2583 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/ef8e4a2f-9d17-47d2-a84f-7bff2123ce84-config\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\""
Sep 09 16:20:24.301400 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.301392    2583 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ef8e4a2f-9d17-47d2-a84f-7bff2123ce84-tls-assets\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\""
Sep 09 16:20:24.301400 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.301399    2583 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ef8e4a2f-9d17-47d2-a84f-7bff2123ce84-config-out\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\""
Sep 09 16:20:24.301400 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.301406    2583 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ef8e4a2f-9d17-47d2-a84f-7bff2123ce84-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\""
Sep 09 16:20:24.518039 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.518007    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xzslz" event={"ID":"3b749ab0-b112-4083-8efc-6d45e9c5e6c2","Type":"ContainerStarted","Data":"e159eab913451af84e88ceda8ff2b341c07a8eabd26137460139e6d3c89e3a60"}
Sep 09 16:20:24.518152 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.518059    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xzslz" event={"ID":"3b749ab0-b112-4083-8efc-6d45e9c5e6c2","Type":"ContainerStarted","Data":"15f17e1af31716a256022adbc93369579f889814201ba557916c9ce0d4017819"}
Sep 09 16:20:24.518225 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.518202    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-xzslz"
Sep 09 16:20:24.519792 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.519763    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-79977f9844-779cg" event={"ID":"c4338f01-9c80-4c3d-b2e1-187d647cb696","Type":"ContainerStarted","Data":"4afbb100ca9c41ecb554a0f94a86601ec43c2a6acd61f67a8e186cdbdf1ae7a4"}
Sep 09 16:20:24.523351 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.523327    2583 generic.go:356] "Generic (PLEG): container finished" podID="ef8e4a2f-9d17-47d2-a84f-7bff2123ce84" containerID="6b7547dd64654d41145fc0111457242fccf69a7bdc7e0bbca69333feeebee1a1" exitCode=0
Sep 09 16:20:24.523351 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.523349    2583 generic.go:356] "Generic (PLEG): container finished" podID="ef8e4a2f-9d17-47d2-a84f-7bff2123ce84" containerID="9bedd5a6ab97a63e839ca20ebdd2d997209b7ef6737bf54068b8debca845c9e9" exitCode=0
Sep 09 16:20:24.523516 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.523359    2583 generic.go:356] "Generic (PLEG): container finished" podID="ef8e4a2f-9d17-47d2-a84f-7bff2123ce84" containerID="b7caac097b577c3a34acdddb68d562421fb87ae93535849d52029e6253a206e5" exitCode=0
Sep 09 16:20:24.523516 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.523367    2583 generic.go:356] "Generic (PLEG): container finished" podID="ef8e4a2f-9d17-47d2-a84f-7bff2123ce84" containerID="8eb04ba7ff707924a36278d56fffe05096ab92b7a4926c0662405c1eeadf25e5" exitCode=0
Sep 09 16:20:24.523516 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.523375    2583 generic.go:356] "Generic (PLEG): container finished" podID="ef8e4a2f-9d17-47d2-a84f-7bff2123ce84" containerID="78f0449255a0015bfe03c1aa1dda8a16a2fba436dbdb3c3a3756b70f842d5927" exitCode=0
Sep 09 16:20:24.523516 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.523382    2583 generic.go:356] "Generic (PLEG): container finished" podID="ef8e4a2f-9d17-47d2-a84f-7bff2123ce84" containerID="90c338b8a0010d314cc0cf6f0a7a088bde1360870540d1fb816f9a62546c6c14" exitCode=0
Sep 09 16:20:24.523516 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.523389    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ef8e4a2f-9d17-47d2-a84f-7bff2123ce84","Type":"ContainerDied","Data":"6b7547dd64654d41145fc0111457242fccf69a7bdc7e0bbca69333feeebee1a1"}
Sep 09 16:20:24.523516 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.523403    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 16:20:24.523516 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.523457    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ef8e4a2f-9d17-47d2-a84f-7bff2123ce84","Type":"ContainerDied","Data":"9bedd5a6ab97a63e839ca20ebdd2d997209b7ef6737bf54068b8debca845c9e9"}
Sep 09 16:20:24.523516 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.523474    2583 scope.go:117] "RemoveContainer" containerID="6b7547dd64654d41145fc0111457242fccf69a7bdc7e0bbca69333feeebee1a1"
Sep 09 16:20:24.523516 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.523501    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ef8e4a2f-9d17-47d2-a84f-7bff2123ce84","Type":"ContainerDied","Data":"b7caac097b577c3a34acdddb68d562421fb87ae93535849d52029e6253a206e5"}
Sep 09 16:20:24.523899 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.523544    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ef8e4a2f-9d17-47d2-a84f-7bff2123ce84","Type":"ContainerDied","Data":"8eb04ba7ff707924a36278d56fffe05096ab92b7a4926c0662405c1eeadf25e5"}
Sep 09 16:20:24.523899 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.523585    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ef8e4a2f-9d17-47d2-a84f-7bff2123ce84","Type":"ContainerDied","Data":"78f0449255a0015bfe03c1aa1dda8a16a2fba436dbdb3c3a3756b70f842d5927"}
Sep 09 16:20:24.523899 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.523624    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ef8e4a2f-9d17-47d2-a84f-7bff2123ce84","Type":"ContainerDied","Data":"90c338b8a0010d314cc0cf6f0a7a088bde1360870540d1fb816f9a62546c6c14"}
Sep 09 16:20:24.523899 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.523684    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ef8e4a2f-9d17-47d2-a84f-7bff2123ce84","Type":"ContainerDied","Data":"95a3a5adc019929d055395c7cbb87111e74253192446d3acd703d96fe2de6a60"}
Sep 09 16:20:24.524885 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.524861    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-86b488f9f4-fzh9c" event={"ID":"7da7fa1f-0b0c-425b-a5f0-136fe665f4a9","Type":"ContainerStarted","Data":"efea9b31e9fb9d1846c6006b9cec62d12a573b340d54ede3b7650d244fc4e215"}
Sep 09 16:20:24.531372 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.531353    2583 scope.go:117] "RemoveContainer" containerID="9bedd5a6ab97a63e839ca20ebdd2d997209b7ef6737bf54068b8debca845c9e9"
Sep 09 16:20:24.534331 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.534294    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-xzslz" podStartSLOduration=373.45365229 podStartE2EDuration="6m15.534282068s" totalImagesPullingTime="2.080629778s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 16:14:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:20:24.533569977 +0000 UTC m=+406.887299863" watchObservedRunningTime="2026-09-09 16:20:24.534282068 +0000 UTC m=+406.888011894"
Sep 09 16:20:24.538778 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.538759    2583 scope.go:117] "RemoveContainer" containerID="b7caac097b577c3a34acdddb68d562421fb87ae93535849d52029e6253a206e5"
Sep 09 16:20:24.545415 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.545398    2583 scope.go:117] "RemoveContainer" containerID="8eb04ba7ff707924a36278d56fffe05096ab92b7a4926c0662405c1eeadf25e5"
Sep 09 16:20:24.551736 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.551718    2583 scope.go:117] "RemoveContainer" containerID="78f0449255a0015bfe03c1aa1dda8a16a2fba436dbdb3c3a3756b70f842d5927"
Sep 09 16:20:24.558124 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.557955    2583 scope.go:117] "RemoveContainer" containerID="90c338b8a0010d314cc0cf6f0a7a088bde1360870540d1fb816f9a62546c6c14"
Sep 09 16:20:24.564610 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.564592    2583 scope.go:117] "RemoveContainer" containerID="4abc1b3b288a4f8c68dfabf8432e85fe7426413a9eb65836a9a5ccca41bf0408"
Sep 09 16:20:24.570908 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.570891    2583 scope.go:117] "RemoveContainer" containerID="6b7547dd64654d41145fc0111457242fccf69a7bdc7e0bbca69333feeebee1a1"
Sep 09 16:20:24.571199 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:20:24.571180    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6b7547dd64654d41145fc0111457242fccf69a7bdc7e0bbca69333feeebee1a1\": container with ID starting with 6b7547dd64654d41145fc0111457242fccf69a7bdc7e0bbca69333feeebee1a1 not found: ID does not exist" containerID="6b7547dd64654d41145fc0111457242fccf69a7bdc7e0bbca69333feeebee1a1"
Sep 09 16:20:24.571267 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.571207    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6b7547dd64654d41145fc0111457242fccf69a7bdc7e0bbca69333feeebee1a1"} err="failed to get container status \"6b7547dd64654d41145fc0111457242fccf69a7bdc7e0bbca69333feeebee1a1\": rpc error: code = NotFound desc = could not find container \"6b7547dd64654d41145fc0111457242fccf69a7bdc7e0bbca69333feeebee1a1\": container with ID starting with 6b7547dd64654d41145fc0111457242fccf69a7bdc7e0bbca69333feeebee1a1 not found: ID does not exist"
Sep 09 16:20:24.571267 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.571235    2583 scope.go:117] "RemoveContainer" containerID="9bedd5a6ab97a63e839ca20ebdd2d997209b7ef6737bf54068b8debca845c9e9"
Sep 09 16:20:24.571523 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:20:24.571498    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9bedd5a6ab97a63e839ca20ebdd2d997209b7ef6737bf54068b8debca845c9e9\": container with ID starting with 9bedd5a6ab97a63e839ca20ebdd2d997209b7ef6737bf54068b8debca845c9e9 not found: ID does not exist" containerID="9bedd5a6ab97a63e839ca20ebdd2d997209b7ef6737bf54068b8debca845c9e9"
Sep 09 16:20:24.571570 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.571533    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9bedd5a6ab97a63e839ca20ebdd2d997209b7ef6737bf54068b8debca845c9e9"} err="failed to get container status \"9bedd5a6ab97a63e839ca20ebdd2d997209b7ef6737bf54068b8debca845c9e9\": rpc error: code = NotFound desc = could not find container \"9bedd5a6ab97a63e839ca20ebdd2d997209b7ef6737bf54068b8debca845c9e9\": container with ID starting with 9bedd5a6ab97a63e839ca20ebdd2d997209b7ef6737bf54068b8debca845c9e9 not found: ID does not exist"
Sep 09 16:20:24.571570 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.571554    2583 scope.go:117] "RemoveContainer" containerID="b7caac097b577c3a34acdddb68d562421fb87ae93535849d52029e6253a206e5"
Sep 09 16:20:24.571823 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:20:24.571801    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b7caac097b577c3a34acdddb68d562421fb87ae93535849d52029e6253a206e5\": container with ID starting with b7caac097b577c3a34acdddb68d562421fb87ae93535849d52029e6253a206e5 not found: ID does not exist" containerID="b7caac097b577c3a34acdddb68d562421fb87ae93535849d52029e6253a206e5"
Sep 09 16:20:24.571889 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.571832    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b7caac097b577c3a34acdddb68d562421fb87ae93535849d52029e6253a206e5"} err="failed to get container status \"b7caac097b577c3a34acdddb68d562421fb87ae93535849d52029e6253a206e5\": rpc error: code = NotFound desc = could not find container \"b7caac097b577c3a34acdddb68d562421fb87ae93535849d52029e6253a206e5\": container with ID starting with b7caac097b577c3a34acdddb68d562421fb87ae93535849d52029e6253a206e5 not found: ID does not exist"
Sep 09 16:20:24.571889 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.571850    2583 scope.go:117] "RemoveContainer" containerID="8eb04ba7ff707924a36278d56fffe05096ab92b7a4926c0662405c1eeadf25e5"
Sep 09 16:20:24.573024 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:20:24.572974    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8eb04ba7ff707924a36278d56fffe05096ab92b7a4926c0662405c1eeadf25e5\": container with ID starting with 8eb04ba7ff707924a36278d56fffe05096ab92b7a4926c0662405c1eeadf25e5 not found: ID does not exist" containerID="8eb04ba7ff707924a36278d56fffe05096ab92b7a4926c0662405c1eeadf25e5"
Sep 09 16:20:24.573117 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.573030    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8eb04ba7ff707924a36278d56fffe05096ab92b7a4926c0662405c1eeadf25e5"} err="failed to get container status \"8eb04ba7ff707924a36278d56fffe05096ab92b7a4926c0662405c1eeadf25e5\": rpc error: code = NotFound desc = could not find container \"8eb04ba7ff707924a36278d56fffe05096ab92b7a4926c0662405c1eeadf25e5\": container with ID starting with 8eb04ba7ff707924a36278d56fffe05096ab92b7a4926c0662405c1eeadf25e5 not found: ID does not exist"
Sep 09 16:20:24.573117 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.573043    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 09 16:20:24.573117 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.573048    2583 scope.go:117] "RemoveContainer" containerID="78f0449255a0015bfe03c1aa1dda8a16a2fba436dbdb3c3a3756b70f842d5927"
Sep 09 16:20:24.573378 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:20:24.573317    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"78f0449255a0015bfe03c1aa1dda8a16a2fba436dbdb3c3a3756b70f842d5927\": container with ID starting with 78f0449255a0015bfe03c1aa1dda8a16a2fba436dbdb3c3a3756b70f842d5927 not found: ID does not exist" containerID="78f0449255a0015bfe03c1aa1dda8a16a2fba436dbdb3c3a3756b70f842d5927"
Sep 09 16:20:24.573378 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.573340    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"78f0449255a0015bfe03c1aa1dda8a16a2fba436dbdb3c3a3756b70f842d5927"} err="failed to get container status \"78f0449255a0015bfe03c1aa1dda8a16a2fba436dbdb3c3a3756b70f842d5927\": rpc error: code = NotFound desc = could not find container \"78f0449255a0015bfe03c1aa1dda8a16a2fba436dbdb3c3a3756b70f842d5927\": container with ID starting with 78f0449255a0015bfe03c1aa1dda8a16a2fba436dbdb3c3a3756b70f842d5927 not found: ID does not exist"
Sep 09 16:20:24.573378 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.573354    2583 scope.go:117] "RemoveContainer" containerID="90c338b8a0010d314cc0cf6f0a7a088bde1360870540d1fb816f9a62546c6c14"
Sep 09 16:20:24.573631 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:20:24.573558    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"90c338b8a0010d314cc0cf6f0a7a088bde1360870540d1fb816f9a62546c6c14\": container with ID starting with 90c338b8a0010d314cc0cf6f0a7a088bde1360870540d1fb816f9a62546c6c14 not found: ID does not exist" containerID="90c338b8a0010d314cc0cf6f0a7a088bde1360870540d1fb816f9a62546c6c14"
Sep 09 16:20:24.573631 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.573577    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"90c338b8a0010d314cc0cf6f0a7a088bde1360870540d1fb816f9a62546c6c14"} err="failed to get container status \"90c338b8a0010d314cc0cf6f0a7a088bde1360870540d1fb816f9a62546c6c14\": rpc error: code = NotFound desc = could not find container \"90c338b8a0010d314cc0cf6f0a7a088bde1360870540d1fb816f9a62546c6c14\": container with ID starting with 90c338b8a0010d314cc0cf6f0a7a088bde1360870540d1fb816f9a62546c6c14 not found: ID does not exist"
Sep 09 16:20:24.573631 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.573587    2583 scope.go:117] "RemoveContainer" containerID="4abc1b3b288a4f8c68dfabf8432e85fe7426413a9eb65836a9a5ccca41bf0408"
Sep 09 16:20:24.573801 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:20:24.573782    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4abc1b3b288a4f8c68dfabf8432e85fe7426413a9eb65836a9a5ccca41bf0408\": container with ID starting with 4abc1b3b288a4f8c68dfabf8432e85fe7426413a9eb65836a9a5ccca41bf0408 not found: ID does not exist" containerID="4abc1b3b288a4f8c68dfabf8432e85fe7426413a9eb65836a9a5ccca41bf0408"
Sep 09 16:20:24.573836 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.573806    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4abc1b3b288a4f8c68dfabf8432e85fe7426413a9eb65836a9a5ccca41bf0408"} err="failed to get container status \"4abc1b3b288a4f8c68dfabf8432e85fe7426413a9eb65836a9a5ccca41bf0408\": rpc error: code = NotFound desc = could not find container \"4abc1b3b288a4f8c68dfabf8432e85fe7426413a9eb65836a9a5ccca41bf0408\": container with ID starting with 4abc1b3b288a4f8c68dfabf8432e85fe7426413a9eb65836a9a5ccca41bf0408 not found: ID does not exist"
Sep 09 16:20:24.573836 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.573819    2583 scope.go:117] "RemoveContainer" containerID="6b7547dd64654d41145fc0111457242fccf69a7bdc7e0bbca69333feeebee1a1"
Sep 09 16:20:24.574028 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.574009    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6b7547dd64654d41145fc0111457242fccf69a7bdc7e0bbca69333feeebee1a1"} err="failed to get container status \"6b7547dd64654d41145fc0111457242fccf69a7bdc7e0bbca69333feeebee1a1\": rpc error: code = NotFound desc = could not find container \"6b7547dd64654d41145fc0111457242fccf69a7bdc7e0bbca69333feeebee1a1\": container with ID starting with 6b7547dd64654d41145fc0111457242fccf69a7bdc7e0bbca69333feeebee1a1 not found: ID does not exist"
Sep 09 16:20:24.574074 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.574027    2583 scope.go:117] "RemoveContainer" containerID="9bedd5a6ab97a63e839ca20ebdd2d997209b7ef6737bf54068b8debca845c9e9"
Sep 09 16:20:24.574311 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.574279    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9bedd5a6ab97a63e839ca20ebdd2d997209b7ef6737bf54068b8debca845c9e9"} err="failed to get container status \"9bedd5a6ab97a63e839ca20ebdd2d997209b7ef6737bf54068b8debca845c9e9\": rpc error: code = NotFound desc = could not find container \"9bedd5a6ab97a63e839ca20ebdd2d997209b7ef6737bf54068b8debca845c9e9\": container with ID starting with 9bedd5a6ab97a63e839ca20ebdd2d997209b7ef6737bf54068b8debca845c9e9 not found: ID does not exist"
Sep 09 16:20:24.574311 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.574309    2583 scope.go:117] "RemoveContainer" containerID="b7caac097b577c3a34acdddb68d562421fb87ae93535849d52029e6253a206e5"
Sep 09 16:20:24.574579 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.574553    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b7caac097b577c3a34acdddb68d562421fb87ae93535849d52029e6253a206e5"} err="failed to get container status \"b7caac097b577c3a34acdddb68d562421fb87ae93535849d52029e6253a206e5\": rpc error: code = NotFound desc = could not find container \"b7caac097b577c3a34acdddb68d562421fb87ae93535849d52029e6253a206e5\": container with ID starting with b7caac097b577c3a34acdddb68d562421fb87ae93535849d52029e6253a206e5 not found: ID does not exist"
Sep 09 16:20:24.574617 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.574581    2583 scope.go:117] "RemoveContainer" containerID="8eb04ba7ff707924a36278d56fffe05096ab92b7a4926c0662405c1eeadf25e5"
Sep 09 16:20:24.574851 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.574833    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8eb04ba7ff707924a36278d56fffe05096ab92b7a4926c0662405c1eeadf25e5"} err="failed to get container status \"8eb04ba7ff707924a36278d56fffe05096ab92b7a4926c0662405c1eeadf25e5\": rpc error: code = NotFound desc = could not find container \"8eb04ba7ff707924a36278d56fffe05096ab92b7a4926c0662405c1eeadf25e5\": container with ID starting with 8eb04ba7ff707924a36278d56fffe05096ab92b7a4926c0662405c1eeadf25e5 not found: ID does not exist"
Sep 09 16:20:24.574897 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.574851    2583 scope.go:117] "RemoveContainer" containerID="78f0449255a0015bfe03c1aa1dda8a16a2fba436dbdb3c3a3756b70f842d5927"
Sep 09 16:20:24.575112 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.575094    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"78f0449255a0015bfe03c1aa1dda8a16a2fba436dbdb3c3a3756b70f842d5927"} err="failed to get container status \"78f0449255a0015bfe03c1aa1dda8a16a2fba436dbdb3c3a3756b70f842d5927\": rpc error: code = NotFound desc = could not find container \"78f0449255a0015bfe03c1aa1dda8a16a2fba436dbdb3c3a3756b70f842d5927\": container with ID starting with 78f0449255a0015bfe03c1aa1dda8a16a2fba436dbdb3c3a3756b70f842d5927 not found: ID does not exist"
Sep 09 16:20:24.575163 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.575113    2583 scope.go:117] "RemoveContainer" containerID="90c338b8a0010d314cc0cf6f0a7a088bde1360870540d1fb816f9a62546c6c14"
Sep 09 16:20:24.575347 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.575329    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"90c338b8a0010d314cc0cf6f0a7a088bde1360870540d1fb816f9a62546c6c14"} err="failed to get container status \"90c338b8a0010d314cc0cf6f0a7a088bde1360870540d1fb816f9a62546c6c14\": rpc error: code = NotFound desc = could not find container \"90c338b8a0010d314cc0cf6f0a7a088bde1360870540d1fb816f9a62546c6c14\": container with ID starting with 90c338b8a0010d314cc0cf6f0a7a088bde1360870540d1fb816f9a62546c6c14 not found: ID does not exist"
Sep 09 16:20:24.575392 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.575347    2583 scope.go:117] "RemoveContainer" containerID="4abc1b3b288a4f8c68dfabf8432e85fe7426413a9eb65836a9a5ccca41bf0408"
Sep 09 16:20:24.575596 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.575569    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4abc1b3b288a4f8c68dfabf8432e85fe7426413a9eb65836a9a5ccca41bf0408"} err="failed to get container status \"4abc1b3b288a4f8c68dfabf8432e85fe7426413a9eb65836a9a5ccca41bf0408\": rpc error: code = NotFound desc = could not find container \"4abc1b3b288a4f8c68dfabf8432e85fe7426413a9eb65836a9a5ccca41bf0408\": container with ID starting with 4abc1b3b288a4f8c68dfabf8432e85fe7426413a9eb65836a9a5ccca41bf0408 not found: ID does not exist"
Sep 09 16:20:24.575639 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.575597    2583 scope.go:117] "RemoveContainer" containerID="6b7547dd64654d41145fc0111457242fccf69a7bdc7e0bbca69333feeebee1a1"
Sep 09 16:20:24.575849 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.575834    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6b7547dd64654d41145fc0111457242fccf69a7bdc7e0bbca69333feeebee1a1"} err="failed to get container status \"6b7547dd64654d41145fc0111457242fccf69a7bdc7e0bbca69333feeebee1a1\": rpc error: code = NotFound desc = could not find container \"6b7547dd64654d41145fc0111457242fccf69a7bdc7e0bbca69333feeebee1a1\": container with ID starting with 6b7547dd64654d41145fc0111457242fccf69a7bdc7e0bbca69333feeebee1a1 not found: ID does not exist"
Sep 09 16:20:24.575899 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.575848    2583 scope.go:117] "RemoveContainer" containerID="9bedd5a6ab97a63e839ca20ebdd2d997209b7ef6737bf54068b8debca845c9e9"
Sep 09 16:20:24.576074 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.576058    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9bedd5a6ab97a63e839ca20ebdd2d997209b7ef6737bf54068b8debca845c9e9"} err="failed to get container status \"9bedd5a6ab97a63e839ca20ebdd2d997209b7ef6737bf54068b8debca845c9e9\": rpc error: code = NotFound desc = could not find container \"9bedd5a6ab97a63e839ca20ebdd2d997209b7ef6737bf54068b8debca845c9e9\": container with ID starting with 9bedd5a6ab97a63e839ca20ebdd2d997209b7ef6737bf54068b8debca845c9e9 not found: ID does not exist"
Sep 09 16:20:24.576129 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.576074    2583 scope.go:117] "RemoveContainer" containerID="b7caac097b577c3a34acdddb68d562421fb87ae93535849d52029e6253a206e5"
Sep 09 16:20:24.576298 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.576280    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b7caac097b577c3a34acdddb68d562421fb87ae93535849d52029e6253a206e5"} err="failed to get container status \"b7caac097b577c3a34acdddb68d562421fb87ae93535849d52029e6253a206e5\": rpc error: code = NotFound desc = could not find container \"b7caac097b577c3a34acdddb68d562421fb87ae93535849d52029e6253a206e5\": container with ID starting with b7caac097b577c3a34acdddb68d562421fb87ae93535849d52029e6253a206e5 not found: ID does not exist"
Sep 09 16:20:24.576342 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.576298    2583 scope.go:117] "RemoveContainer" containerID="8eb04ba7ff707924a36278d56fffe05096ab92b7a4926c0662405c1eeadf25e5"
Sep 09 16:20:24.576491 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.576476    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8eb04ba7ff707924a36278d56fffe05096ab92b7a4926c0662405c1eeadf25e5"} err="failed to get container status \"8eb04ba7ff707924a36278d56fffe05096ab92b7a4926c0662405c1eeadf25e5\": rpc error: code = NotFound desc = could not find container \"8eb04ba7ff707924a36278d56fffe05096ab92b7a4926c0662405c1eeadf25e5\": container with ID starting with 8eb04ba7ff707924a36278d56fffe05096ab92b7a4926c0662405c1eeadf25e5 not found: ID does not exist"
Sep 09 16:20:24.576531 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.576491    2583 scope.go:117] "RemoveContainer" containerID="78f0449255a0015bfe03c1aa1dda8a16a2fba436dbdb3c3a3756b70f842d5927"
Sep 09 16:20:24.576708 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.576691    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"78f0449255a0015bfe03c1aa1dda8a16a2fba436dbdb3c3a3756b70f842d5927"} err="failed to get container status \"78f0449255a0015bfe03c1aa1dda8a16a2fba436dbdb3c3a3756b70f842d5927\": rpc error: code = NotFound desc = could not find container \"78f0449255a0015bfe03c1aa1dda8a16a2fba436dbdb3c3a3756b70f842d5927\": container with ID starting with 78f0449255a0015bfe03c1aa1dda8a16a2fba436dbdb3c3a3756b70f842d5927 not found: ID does not exist"
Sep 09 16:20:24.576747 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.576709    2583 scope.go:117] "RemoveContainer" containerID="90c338b8a0010d314cc0cf6f0a7a088bde1360870540d1fb816f9a62546c6c14"
Sep 09 16:20:24.576919 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.576903    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"90c338b8a0010d314cc0cf6f0a7a088bde1360870540d1fb816f9a62546c6c14"} err="failed to get container status \"90c338b8a0010d314cc0cf6f0a7a088bde1360870540d1fb816f9a62546c6c14\": rpc error: code = NotFound desc = could not find container \"90c338b8a0010d314cc0cf6f0a7a088bde1360870540d1fb816f9a62546c6c14\": container with ID starting with 90c338b8a0010d314cc0cf6f0a7a088bde1360870540d1fb816f9a62546c6c14 not found: ID does not exist"
Sep 09 16:20:24.576961 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.576919    2583 scope.go:117] "RemoveContainer" containerID="4abc1b3b288a4f8c68dfabf8432e85fe7426413a9eb65836a9a5ccca41bf0408"
Sep 09 16:20:24.577139 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.577122    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4abc1b3b288a4f8c68dfabf8432e85fe7426413a9eb65836a9a5ccca41bf0408"} err="failed to get container status \"4abc1b3b288a4f8c68dfabf8432e85fe7426413a9eb65836a9a5ccca41bf0408\": rpc error: code = NotFound desc = could not find container \"4abc1b3b288a4f8c68dfabf8432e85fe7426413a9eb65836a9a5ccca41bf0408\": container with ID starting with 4abc1b3b288a4f8c68dfabf8432e85fe7426413a9eb65836a9a5ccca41bf0408 not found: ID does not exist"
Sep 09 16:20:24.577184 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.577139    2583 scope.go:117] "RemoveContainer" containerID="6b7547dd64654d41145fc0111457242fccf69a7bdc7e0bbca69333feeebee1a1"
Sep 09 16:20:24.577328 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.577313    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6b7547dd64654d41145fc0111457242fccf69a7bdc7e0bbca69333feeebee1a1"} err="failed to get container status \"6b7547dd64654d41145fc0111457242fccf69a7bdc7e0bbca69333feeebee1a1\": rpc error: code = NotFound desc = could not find container \"6b7547dd64654d41145fc0111457242fccf69a7bdc7e0bbca69333feeebee1a1\": container with ID starting with 6b7547dd64654d41145fc0111457242fccf69a7bdc7e0bbca69333feeebee1a1 not found: ID does not exist"
Sep 09 16:20:24.577366 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.577328    2583 scope.go:117] "RemoveContainer" containerID="9bedd5a6ab97a63e839ca20ebdd2d997209b7ef6737bf54068b8debca845c9e9"
Sep 09 16:20:24.577537 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.577522    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9bedd5a6ab97a63e839ca20ebdd2d997209b7ef6737bf54068b8debca845c9e9"} err="failed to get container status \"9bedd5a6ab97a63e839ca20ebdd2d997209b7ef6737bf54068b8debca845c9e9\": rpc error: code = NotFound desc = could not find container \"9bedd5a6ab97a63e839ca20ebdd2d997209b7ef6737bf54068b8debca845c9e9\": container with ID starting with 9bedd5a6ab97a63e839ca20ebdd2d997209b7ef6737bf54068b8debca845c9e9 not found: ID does not exist"
Sep 09 16:20:24.577576 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.577536    2583 scope.go:117] "RemoveContainer" containerID="b7caac097b577c3a34acdddb68d562421fb87ae93535849d52029e6253a206e5"
Sep 09 16:20:24.577735 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.577716    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b7caac097b577c3a34acdddb68d562421fb87ae93535849d52029e6253a206e5"} err="failed to get container status \"b7caac097b577c3a34acdddb68d562421fb87ae93535849d52029e6253a206e5\": rpc error: code = NotFound desc = could not find container \"b7caac097b577c3a34acdddb68d562421fb87ae93535849d52029e6253a206e5\": container with ID starting with b7caac097b577c3a34acdddb68d562421fb87ae93535849d52029e6253a206e5 not found: ID does not exist"
Sep 09 16:20:24.577773 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.577737    2583 scope.go:117] "RemoveContainer" containerID="8eb04ba7ff707924a36278d56fffe05096ab92b7a4926c0662405c1eeadf25e5"
Sep 09 16:20:24.577927 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.577910    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8eb04ba7ff707924a36278d56fffe05096ab92b7a4926c0662405c1eeadf25e5"} err="failed to get container status \"8eb04ba7ff707924a36278d56fffe05096ab92b7a4926c0662405c1eeadf25e5\": rpc error: code = NotFound desc = could not find container \"8eb04ba7ff707924a36278d56fffe05096ab92b7a4926c0662405c1eeadf25e5\": container with ID starting with 8eb04ba7ff707924a36278d56fffe05096ab92b7a4926c0662405c1eeadf25e5 not found: ID does not exist"
Sep 09 16:20:24.577964 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.577928    2583 scope.go:117] "RemoveContainer" containerID="78f0449255a0015bfe03c1aa1dda8a16a2fba436dbdb3c3a3756b70f842d5927"
Sep 09 16:20:24.578164 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.578149    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"78f0449255a0015bfe03c1aa1dda8a16a2fba436dbdb3c3a3756b70f842d5927"} err="failed to get container status \"78f0449255a0015bfe03c1aa1dda8a16a2fba436dbdb3c3a3756b70f842d5927\": rpc error: code = NotFound desc = could not find container \"78f0449255a0015bfe03c1aa1dda8a16a2fba436dbdb3c3a3756b70f842d5927\": container with ID starting with 78f0449255a0015bfe03c1aa1dda8a16a2fba436dbdb3c3a3756b70f842d5927 not found: ID does not exist"
Sep 09 16:20:24.578204 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.578164    2583 scope.go:117] "RemoveContainer" containerID="90c338b8a0010d314cc0cf6f0a7a088bde1360870540d1fb816f9a62546c6c14"
Sep 09 16:20:24.578367 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.578352    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"90c338b8a0010d314cc0cf6f0a7a088bde1360870540d1fb816f9a62546c6c14"} err="failed to get container status \"90c338b8a0010d314cc0cf6f0a7a088bde1360870540d1fb816f9a62546c6c14\": rpc error: code = NotFound desc = could not find container \"90c338b8a0010d314cc0cf6f0a7a088bde1360870540d1fb816f9a62546c6c14\": container with ID starting with 90c338b8a0010d314cc0cf6f0a7a088bde1360870540d1fb816f9a62546c6c14 not found: ID does not exist"
Sep 09 16:20:24.578417 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.578367    2583 scope.go:117] "RemoveContainer" containerID="4abc1b3b288a4f8c68dfabf8432e85fe7426413a9eb65836a9a5ccca41bf0408"
Sep 09 16:20:24.578548 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.578526    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4abc1b3b288a4f8c68dfabf8432e85fe7426413a9eb65836a9a5ccca41bf0408"} err="failed to get container status \"4abc1b3b288a4f8c68dfabf8432e85fe7426413a9eb65836a9a5ccca41bf0408\": rpc error: code = NotFound desc = could not find container \"4abc1b3b288a4f8c68dfabf8432e85fe7426413a9eb65836a9a5ccca41bf0408\": container with ID starting with 4abc1b3b288a4f8c68dfabf8432e85fe7426413a9eb65836a9a5ccca41bf0408 not found: ID does not exist"
Sep 09 16:20:24.578548 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.578547    2583 scope.go:117] "RemoveContainer" containerID="6b7547dd64654d41145fc0111457242fccf69a7bdc7e0bbca69333feeebee1a1"
Sep 09 16:20:24.578774 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.578755    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6b7547dd64654d41145fc0111457242fccf69a7bdc7e0bbca69333feeebee1a1"} err="failed to get container status \"6b7547dd64654d41145fc0111457242fccf69a7bdc7e0bbca69333feeebee1a1\": rpc error: code = NotFound desc = could not find container \"6b7547dd64654d41145fc0111457242fccf69a7bdc7e0bbca69333feeebee1a1\": container with ID starting with 6b7547dd64654d41145fc0111457242fccf69a7bdc7e0bbca69333feeebee1a1 not found: ID does not exist"
Sep 09 16:20:24.578850 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.578776    2583 scope.go:117] "RemoveContainer" containerID="9bedd5a6ab97a63e839ca20ebdd2d997209b7ef6737bf54068b8debca845c9e9"
Sep 09 16:20:24.579015 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.578996    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9bedd5a6ab97a63e839ca20ebdd2d997209b7ef6737bf54068b8debca845c9e9"} err="failed to get container status \"9bedd5a6ab97a63e839ca20ebdd2d997209b7ef6737bf54068b8debca845c9e9\": rpc error: code = NotFound desc = could not find container \"9bedd5a6ab97a63e839ca20ebdd2d997209b7ef6737bf54068b8debca845c9e9\": container with ID starting with 9bedd5a6ab97a63e839ca20ebdd2d997209b7ef6737bf54068b8debca845c9e9 not found: ID does not exist"
Sep 09 16:20:24.579068 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.579017    2583 scope.go:117] "RemoveContainer" containerID="b7caac097b577c3a34acdddb68d562421fb87ae93535849d52029e6253a206e5"
Sep 09 16:20:24.579219 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.579200    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b7caac097b577c3a34acdddb68d562421fb87ae93535849d52029e6253a206e5"} err="failed to get container status \"b7caac097b577c3a34acdddb68d562421fb87ae93535849d52029e6253a206e5\": rpc error: code = NotFound desc = could not find container \"b7caac097b577c3a34acdddb68d562421fb87ae93535849d52029e6253a206e5\": container with ID starting with b7caac097b577c3a34acdddb68d562421fb87ae93535849d52029e6253a206e5 not found: ID does not exist"
Sep 09 16:20:24.579262 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.579219    2583 scope.go:117] "RemoveContainer" containerID="8eb04ba7ff707924a36278d56fffe05096ab92b7a4926c0662405c1eeadf25e5"
Sep 09 16:20:24.579410 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.579390    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8eb04ba7ff707924a36278d56fffe05096ab92b7a4926c0662405c1eeadf25e5"} err="failed to get container status \"8eb04ba7ff707924a36278d56fffe05096ab92b7a4926c0662405c1eeadf25e5\": rpc error: code = NotFound desc = could not find container \"8eb04ba7ff707924a36278d56fffe05096ab92b7a4926c0662405c1eeadf25e5\": container with ID starting with 8eb04ba7ff707924a36278d56fffe05096ab92b7a4926c0662405c1eeadf25e5 not found: ID does not exist"
Sep 09 16:20:24.579473 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.579411    2583 scope.go:117] "RemoveContainer" containerID="78f0449255a0015bfe03c1aa1dda8a16a2fba436dbdb3c3a3756b70f842d5927"
Sep 09 16:20:24.579664 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.579649    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"78f0449255a0015bfe03c1aa1dda8a16a2fba436dbdb3c3a3756b70f842d5927"} err="failed to get container status \"78f0449255a0015bfe03c1aa1dda8a16a2fba436dbdb3c3a3756b70f842d5927\": rpc error: code = NotFound desc = could not find container \"78f0449255a0015bfe03c1aa1dda8a16a2fba436dbdb3c3a3756b70f842d5927\": container with ID starting with 78f0449255a0015bfe03c1aa1dda8a16a2fba436dbdb3c3a3756b70f842d5927 not found: ID does not exist"
Sep 09 16:20:24.579705 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.579664    2583 scope.go:117] "RemoveContainer" containerID="90c338b8a0010d314cc0cf6f0a7a088bde1360870540d1fb816f9a62546c6c14"
Sep 09 16:20:24.579860 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.579843    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"90c338b8a0010d314cc0cf6f0a7a088bde1360870540d1fb816f9a62546c6c14"} err="failed to get container status \"90c338b8a0010d314cc0cf6f0a7a088bde1360870540d1fb816f9a62546c6c14\": rpc error: code = NotFound desc = could not find container \"90c338b8a0010d314cc0cf6f0a7a088bde1360870540d1fb816f9a62546c6c14\": container with ID starting with 90c338b8a0010d314cc0cf6f0a7a088bde1360870540d1fb816f9a62546c6c14 not found: ID does not exist"
Sep 09 16:20:24.579926 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.579861    2583 scope.go:117] "RemoveContainer" containerID="4abc1b3b288a4f8c68dfabf8432e85fe7426413a9eb65836a9a5ccca41bf0408"
Sep 09 16:20:24.580069 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.580053    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4abc1b3b288a4f8c68dfabf8432e85fe7426413a9eb65836a9a5ccca41bf0408"} err="failed to get container status \"4abc1b3b288a4f8c68dfabf8432e85fe7426413a9eb65836a9a5ccca41bf0408\": rpc error: code = NotFound desc = could not find container \"4abc1b3b288a4f8c68dfabf8432e85fe7426413a9eb65836a9a5ccca41bf0408\": container with ID starting with 4abc1b3b288a4f8c68dfabf8432e85fe7426413a9eb65836a9a5ccca41bf0408 not found: ID does not exist"
Sep 09 16:20:24.580124 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.580070    2583 scope.go:117] "RemoveContainer" containerID="6b7547dd64654d41145fc0111457242fccf69a7bdc7e0bbca69333feeebee1a1"
Sep 09 16:20:24.580279 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.580261    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6b7547dd64654d41145fc0111457242fccf69a7bdc7e0bbca69333feeebee1a1"} err="failed to get container status \"6b7547dd64654d41145fc0111457242fccf69a7bdc7e0bbca69333feeebee1a1\": rpc error: code = NotFound desc = could not find container \"6b7547dd64654d41145fc0111457242fccf69a7bdc7e0bbca69333feeebee1a1\": container with ID starting with 6b7547dd64654d41145fc0111457242fccf69a7bdc7e0bbca69333feeebee1a1 not found: ID does not exist"
Sep 09 16:20:24.580337 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.580280    2583 scope.go:117] "RemoveContainer" containerID="9bedd5a6ab97a63e839ca20ebdd2d997209b7ef6737bf54068b8debca845c9e9"
Sep 09 16:20:24.580471 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.580455    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9bedd5a6ab97a63e839ca20ebdd2d997209b7ef6737bf54068b8debca845c9e9"} err="failed to get container status \"9bedd5a6ab97a63e839ca20ebdd2d997209b7ef6737bf54068b8debca845c9e9\": rpc error: code = NotFound desc = could not find container \"9bedd5a6ab97a63e839ca20ebdd2d997209b7ef6737bf54068b8debca845c9e9\": container with ID starting with 9bedd5a6ab97a63e839ca20ebdd2d997209b7ef6737bf54068b8debca845c9e9 not found: ID does not exist"
Sep 09 16:20:24.580524 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.580472    2583 scope.go:117] "RemoveContainer" containerID="b7caac097b577c3a34acdddb68d562421fb87ae93535849d52029e6253a206e5"
Sep 09 16:20:24.580645 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.580629    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b7caac097b577c3a34acdddb68d562421fb87ae93535849d52029e6253a206e5"} err="failed to get container status \"b7caac097b577c3a34acdddb68d562421fb87ae93535849d52029e6253a206e5\": rpc error: code = NotFound desc = could not find container \"b7caac097b577c3a34acdddb68d562421fb87ae93535849d52029e6253a206e5\": container with ID starting with b7caac097b577c3a34acdddb68d562421fb87ae93535849d52029e6253a206e5 not found: ID does not exist"
Sep 09 16:20:24.580702 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.580646    2583 scope.go:117] "RemoveContainer" containerID="8eb04ba7ff707924a36278d56fffe05096ab92b7a4926c0662405c1eeadf25e5"
Sep 09 16:20:24.580821 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.580807    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8eb04ba7ff707924a36278d56fffe05096ab92b7a4926c0662405c1eeadf25e5"} err="failed to get container status \"8eb04ba7ff707924a36278d56fffe05096ab92b7a4926c0662405c1eeadf25e5\": rpc error: code = NotFound desc = could not find container \"8eb04ba7ff707924a36278d56fffe05096ab92b7a4926c0662405c1eeadf25e5\": container with ID starting with 8eb04ba7ff707924a36278d56fffe05096ab92b7a4926c0662405c1eeadf25e5 not found: ID does not exist"
Sep 09 16:20:24.580864 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.580820    2583 scope.go:117] "RemoveContainer" containerID="78f0449255a0015bfe03c1aa1dda8a16a2fba436dbdb3c3a3756b70f842d5927"
Sep 09 16:20:24.581053 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.581033    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"78f0449255a0015bfe03c1aa1dda8a16a2fba436dbdb3c3a3756b70f842d5927"} err="failed to get container status \"78f0449255a0015bfe03c1aa1dda8a16a2fba436dbdb3c3a3756b70f842d5927\": rpc error: code = NotFound desc = could not find container \"78f0449255a0015bfe03c1aa1dda8a16a2fba436dbdb3c3a3756b70f842d5927\": container with ID starting with 78f0449255a0015bfe03c1aa1dda8a16a2fba436dbdb3c3a3756b70f842d5927 not found: ID does not exist"
Sep 09 16:20:24.581102 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.581055    2583 scope.go:117] "RemoveContainer" containerID="90c338b8a0010d314cc0cf6f0a7a088bde1360870540d1fb816f9a62546c6c14"
Sep 09 16:20:24.581271 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.581254    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"90c338b8a0010d314cc0cf6f0a7a088bde1360870540d1fb816f9a62546c6c14"} err="failed to get container status \"90c338b8a0010d314cc0cf6f0a7a088bde1360870540d1fb816f9a62546c6c14\": rpc error: code = NotFound desc = could not find container \"90c338b8a0010d314cc0cf6f0a7a088bde1360870540d1fb816f9a62546c6c14\": container with ID starting with 90c338b8a0010d314cc0cf6f0a7a088bde1360870540d1fb816f9a62546c6c14 not found: ID does not exist"
Sep 09 16:20:24.581318 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.581270    2583 scope.go:117] "RemoveContainer" containerID="4abc1b3b288a4f8c68dfabf8432e85fe7426413a9eb65836a9a5ccca41bf0408"
Sep 09 16:20:24.581509 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.581493    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4abc1b3b288a4f8c68dfabf8432e85fe7426413a9eb65836a9a5ccca41bf0408"} err="failed to get container status \"4abc1b3b288a4f8c68dfabf8432e85fe7426413a9eb65836a9a5ccca41bf0408\": rpc error: code = NotFound desc = could not find container \"4abc1b3b288a4f8c68dfabf8432e85fe7426413a9eb65836a9a5ccca41bf0408\": container with ID starting with 4abc1b3b288a4f8c68dfabf8432e85fe7426413a9eb65836a9a5ccca41bf0408 not found: ID does not exist"
Sep 09 16:20:24.591450 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.591429    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 09 16:20:24.604779 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.604742    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-79977f9844-779cg" podStartSLOduration=379.525084809 podStartE2EDuration="6m21.604731233s" totalImagesPullingTime="2.079646424s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 16:14:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:20:24.604667866 +0000 UTC m=+406.958397717" watchObservedRunningTime="2026-09-09 16:20:24.604731233 +0000 UTC m=+406.958461064"
Sep 09 16:20:24.617946 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.617920    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 09 16:20:24.618349 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.618331    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef8e4a2f-9d17-47d2-a84f-7bff2123ce84" containerName="prometheus"
Sep 09 16:20:24.618390 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.618353    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef8e4a2f-9d17-47d2-a84f-7bff2123ce84" containerName="prometheus"
Sep 09 16:20:24.618390 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.618364    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef8e4a2f-9d17-47d2-a84f-7bff2123ce84" containerName="config-reloader"
Sep 09 16:20:24.618390 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.618372    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef8e4a2f-9d17-47d2-a84f-7bff2123ce84" containerName="config-reloader"
Sep 09 16:20:24.618390 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.618382    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef8e4a2f-9d17-47d2-a84f-7bff2123ce84" containerName="thanos-sidecar"
Sep 09 16:20:24.618390 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.618389    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef8e4a2f-9d17-47d2-a84f-7bff2123ce84" containerName="thanos-sidecar"
Sep 09 16:20:24.618528 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.618409    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef8e4a2f-9d17-47d2-a84f-7bff2123ce84" containerName="init-config-reloader"
Sep 09 16:20:24.618528 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.618418    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef8e4a2f-9d17-47d2-a84f-7bff2123ce84" containerName="init-config-reloader"
Sep 09 16:20:24.618528 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.618430    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef8e4a2f-9d17-47d2-a84f-7bff2123ce84" containerName="kube-rbac-proxy-web"
Sep 09 16:20:24.618528 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.618438    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef8e4a2f-9d17-47d2-a84f-7bff2123ce84" containerName="kube-rbac-proxy-web"
Sep 09 16:20:24.618528 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.618449    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef8e4a2f-9d17-47d2-a84f-7bff2123ce84" containerName="kube-rbac-proxy"
Sep 09 16:20:24.618528 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.618457    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef8e4a2f-9d17-47d2-a84f-7bff2123ce84" containerName="kube-rbac-proxy"
Sep 09 16:20:24.618528 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.618473    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef8e4a2f-9d17-47d2-a84f-7bff2123ce84" containerName="kube-rbac-proxy-thanos"
Sep 09 16:20:24.618528 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.618481    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef8e4a2f-9d17-47d2-a84f-7bff2123ce84" containerName="kube-rbac-proxy-thanos"
Sep 09 16:20:24.618726 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.618557    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="ef8e4a2f-9d17-47d2-a84f-7bff2123ce84" containerName="kube-rbac-proxy-web"
Sep 09 16:20:24.618726 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.618569    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="ef8e4a2f-9d17-47d2-a84f-7bff2123ce84" containerName="kube-rbac-proxy"
Sep 09 16:20:24.618726 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.618579    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="ef8e4a2f-9d17-47d2-a84f-7bff2123ce84" containerName="kube-rbac-proxy-thanos"
Sep 09 16:20:24.618726 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.618586    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="ef8e4a2f-9d17-47d2-a84f-7bff2123ce84" containerName="thanos-sidecar"
Sep 09 16:20:24.618726 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.618594    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="ef8e4a2f-9d17-47d2-a84f-7bff2123ce84" containerName="config-reloader"
Sep 09 16:20:24.618726 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.618601    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="ef8e4a2f-9d17-47d2-a84f-7bff2123ce84" containerName="prometheus"
Sep 09 16:20:24.624277 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.624260    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 16:20:24.626713 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.626697    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Sep 09 16:20:24.627043 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.627024    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Sep 09 16:20:24.627253 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.627238    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Sep 09 16:20:24.627340 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.627300    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Sep 09 16:20:24.627395 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.627348    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Sep 09 16:20:24.627494 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.627442    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Sep 09 16:20:24.627672 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.627653    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Sep 09 16:20:24.627762 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.627698    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Sep 09 16:20:24.627819 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.627779    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Sep 09 16:20:24.627866 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.627840    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-cv5ll\""
Sep 09 16:20:24.627912 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.627885    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Sep 09 16:20:24.627956 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.627944    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-6aadqh6ev2gqj\""
Sep 09 16:20:24.628094 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.628080    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Sep 09 16:20:24.628274 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.628256    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Sep 09 16:20:24.637714 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.637677    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 09 16:20:24.639361 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.639343    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Sep 09 16:20:24.639946 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.639926    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Sep 09 16:20:24.704256 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.704233    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a2b8c539-75f8-46d4-b173-7bf84f07b147-web-config\") pod \"prometheus-k8s-0\" (UID: \"a2b8c539-75f8-46d4-b173-7bf84f07b147\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 16:20:24.704340 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.704258    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a2b8c539-75f8-46d4-b173-7bf84f07b147-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a2b8c539-75f8-46d4-b173-7bf84f07b147\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 16:20:24.704340 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.704275    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a2b8c539-75f8-46d4-b173-7bf84f07b147-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a2b8c539-75f8-46d4-b173-7bf84f07b147\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 16:20:24.704340 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.704297    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a2b8c539-75f8-46d4-b173-7bf84f07b147-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a2b8c539-75f8-46d4-b173-7bf84f07b147\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 16:20:24.704340 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.704316    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a2b8c539-75f8-46d4-b173-7bf84f07b147-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a2b8c539-75f8-46d4-b173-7bf84f07b147\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 16:20:24.704340 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.704332    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a2b8c539-75f8-46d4-b173-7bf84f07b147-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"a2b8c539-75f8-46d4-b173-7bf84f07b147\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 16:20:24.704507 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.704346    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a2b8c539-75f8-46d4-b173-7bf84f07b147-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a2b8c539-75f8-46d4-b173-7bf84f07b147\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 16:20:24.704507 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.704363    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a2b8c539-75f8-46d4-b173-7bf84f07b147-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a2b8c539-75f8-46d4-b173-7bf84f07b147\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 16:20:24.704507 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.704381    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a2b8c539-75f8-46d4-b173-7bf84f07b147-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a2b8c539-75f8-46d4-b173-7bf84f07b147\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 16:20:24.704507 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.704426    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a2b8c539-75f8-46d4-b173-7bf84f07b147-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a2b8c539-75f8-46d4-b173-7bf84f07b147\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 16:20:24.704507 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.704480    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a2b8c539-75f8-46d4-b173-7bf84f07b147-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a2b8c539-75f8-46d4-b173-7bf84f07b147\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 16:20:24.704507 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.704498    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a2b8c539-75f8-46d4-b173-7bf84f07b147-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a2b8c539-75f8-46d4-b173-7bf84f07b147\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 16:20:24.704746 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.704512    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a2b8c539-75f8-46d4-b173-7bf84f07b147-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a2b8c539-75f8-46d4-b173-7bf84f07b147\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 16:20:24.704746 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.704526    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a2b8c539-75f8-46d4-b173-7bf84f07b147-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a2b8c539-75f8-46d4-b173-7bf84f07b147\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 16:20:24.704746 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.704559    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9ps6r\" (UniqueName: \"kubernetes.io/projected/a2b8c539-75f8-46d4-b173-7bf84f07b147-kube-api-access-9ps6r\") pod \"prometheus-k8s-0\" (UID: \"a2b8c539-75f8-46d4-b173-7bf84f07b147\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 16:20:24.704746 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.704573    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a2b8c539-75f8-46d4-b173-7bf84f07b147-config-out\") pod \"prometheus-k8s-0\" (UID: \"a2b8c539-75f8-46d4-b173-7bf84f07b147\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 16:20:24.704746 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.704599    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a2b8c539-75f8-46d4-b173-7bf84f07b147-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a2b8c539-75f8-46d4-b173-7bf84f07b147\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 16:20:24.704746 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.704646    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/a2b8c539-75f8-46d4-b173-7bf84f07b147-config\") pod \"prometheus-k8s-0\" (UID: \"a2b8c539-75f8-46d4-b173-7bf84f07b147\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 16:20:24.704746 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.704678    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a2b8c539-75f8-46d4-b173-7bf84f07b147-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a2b8c539-75f8-46d4-b173-7bf84f07b147\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 16:20:24.704746 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.704710    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a2b8c539-75f8-46d4-b173-7bf84f07b147-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"a2b8c539-75f8-46d4-b173-7bf84f07b147\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 16:20:24.728348 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.728325    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:20:24.782879 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.782831    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:20:24.805822 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.805790    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a2b8c539-75f8-46d4-b173-7bf84f07b147-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a2b8c539-75f8-46d4-b173-7bf84f07b147\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 16:20:24.805822 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.805826    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a2b8c539-75f8-46d4-b173-7bf84f07b147-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a2b8c539-75f8-46d4-b173-7bf84f07b147\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 16:20:24.805914 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.805850    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a2b8c539-75f8-46d4-b173-7bf84f07b147-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a2b8c539-75f8-46d4-b173-7bf84f07b147\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 16:20:24.805914 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.805877    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a2b8c539-75f8-46d4-b173-7bf84f07b147-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a2b8c539-75f8-46d4-b173-7bf84f07b147\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 16:20:24.805914 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.805898    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a2b8c539-75f8-46d4-b173-7bf84f07b147-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a2b8c539-75f8-46d4-b173-7bf84f07b147\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 16:20:24.806056 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.805917    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a2b8c539-75f8-46d4-b173-7bf84f07b147-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a2b8c539-75f8-46d4-b173-7bf84f07b147\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 16:20:24.806056 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.805941    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9ps6r\" (UniqueName: \"kubernetes.io/projected/a2b8c539-75f8-46d4-b173-7bf84f07b147-kube-api-access-9ps6r\") pod \"prometheus-k8s-0\" (UID: \"a2b8c539-75f8-46d4-b173-7bf84f07b147\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 16:20:24.806056 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.805963    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a2b8c539-75f8-46d4-b173-7bf84f07b147-config-out\") pod \"prometheus-k8s-0\" (UID: \"a2b8c539-75f8-46d4-b173-7bf84f07b147\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 16:20:24.806056 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.806028    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a2b8c539-75f8-46d4-b173-7bf84f07b147-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a2b8c539-75f8-46d4-b173-7bf84f07b147\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 16:20:24.806237 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.806059    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/a2b8c539-75f8-46d4-b173-7bf84f07b147-config\") pod \"prometheus-k8s-0\" (UID: \"a2b8c539-75f8-46d4-b173-7bf84f07b147\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 16:20:24.806237 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.806082    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a2b8c539-75f8-46d4-b173-7bf84f07b147-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a2b8c539-75f8-46d4-b173-7bf84f07b147\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 16:20:24.806237 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.806111    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a2b8c539-75f8-46d4-b173-7bf84f07b147-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"a2b8c539-75f8-46d4-b173-7bf84f07b147\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 16:20:24.806237 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.806139    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a2b8c539-75f8-46d4-b173-7bf84f07b147-web-config\") pod \"prometheus-k8s-0\" (UID: \"a2b8c539-75f8-46d4-b173-7bf84f07b147\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 16:20:24.806237 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.806165    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a2b8c539-75f8-46d4-b173-7bf84f07b147-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a2b8c539-75f8-46d4-b173-7bf84f07b147\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 16:20:24.806237 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.806189    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a2b8c539-75f8-46d4-b173-7bf84f07b147-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a2b8c539-75f8-46d4-b173-7bf84f07b147\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 16:20:24.806237 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.806220    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a2b8c539-75f8-46d4-b173-7bf84f07b147-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a2b8c539-75f8-46d4-b173-7bf84f07b147\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 16:20:24.806551 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.806245    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a2b8c539-75f8-46d4-b173-7bf84f07b147-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a2b8c539-75f8-46d4-b173-7bf84f07b147\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 16:20:24.806551 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.806273    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a2b8c539-75f8-46d4-b173-7bf84f07b147-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"a2b8c539-75f8-46d4-b173-7bf84f07b147\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 16:20:24.806551 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.806295    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a2b8c539-75f8-46d4-b173-7bf84f07b147-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a2b8c539-75f8-46d4-b173-7bf84f07b147\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 16:20:24.806551 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.806326    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a2b8c539-75f8-46d4-b173-7bf84f07b147-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a2b8c539-75f8-46d4-b173-7bf84f07b147\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 16:20:24.806915 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.806892    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a2b8c539-75f8-46d4-b173-7bf84f07b147-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a2b8c539-75f8-46d4-b173-7bf84f07b147\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 16:20:24.807320 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.807295    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a2b8c539-75f8-46d4-b173-7bf84f07b147-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a2b8c539-75f8-46d4-b173-7bf84f07b147\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 16:20:24.807320 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.807315    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a2b8c539-75f8-46d4-b173-7bf84f07b147-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"a2b8c539-75f8-46d4-b173-7bf84f07b147\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 16:20:24.807814 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.807787    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a2b8c539-75f8-46d4-b173-7bf84f07b147-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"a2b8c539-75f8-46d4-b173-7bf84f07b147\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 16:20:24.808025 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.808000    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a2b8c539-75f8-46d4-b173-7bf84f07b147-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a2b8c539-75f8-46d4-b173-7bf84f07b147\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 16:20:24.808845 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.808817    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a2b8c539-75f8-46d4-b173-7bf84f07b147-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a2b8c539-75f8-46d4-b173-7bf84f07b147\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 16:20:24.809618 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.809042    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a2b8c539-75f8-46d4-b173-7bf84f07b147-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a2b8c539-75f8-46d4-b173-7bf84f07b147\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 16:20:24.809618 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.809296    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a2b8c539-75f8-46d4-b173-7bf84f07b147-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a2b8c539-75f8-46d4-b173-7bf84f07b147\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 16:20:24.809618 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.809347    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a2b8c539-75f8-46d4-b173-7bf84f07b147-config-out\") pod \"prometheus-k8s-0\" (UID: \"a2b8c539-75f8-46d4-b173-7bf84f07b147\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 16:20:24.809618 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.809581    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a2b8c539-75f8-46d4-b173-7bf84f07b147-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a2b8c539-75f8-46d4-b173-7bf84f07b147\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 16:20:24.810493 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.810448    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a2b8c539-75f8-46d4-b173-7bf84f07b147-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a2b8c539-75f8-46d4-b173-7bf84f07b147\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 16:20:24.810493 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.810484    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a2b8c539-75f8-46d4-b173-7bf84f07b147-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a2b8c539-75f8-46d4-b173-7bf84f07b147\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 16:20:24.810639 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.810548    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a2b8c539-75f8-46d4-b173-7bf84f07b147-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a2b8c539-75f8-46d4-b173-7bf84f07b147\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 16:20:24.810693 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.810632    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a2b8c539-75f8-46d4-b173-7bf84f07b147-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a2b8c539-75f8-46d4-b173-7bf84f07b147\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 16:20:24.810971 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.810952    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/a2b8c539-75f8-46d4-b173-7bf84f07b147-config\") pod \"prometheus-k8s-0\" (UID: \"a2b8c539-75f8-46d4-b173-7bf84f07b147\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 16:20:24.811228 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.811210    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a2b8c539-75f8-46d4-b173-7bf84f07b147-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a2b8c539-75f8-46d4-b173-7bf84f07b147\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 16:20:24.811539 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.811518    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a2b8c539-75f8-46d4-b173-7bf84f07b147-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a2b8c539-75f8-46d4-b173-7bf84f07b147\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 16:20:24.811842 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.811823    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a2b8c539-75f8-46d4-b173-7bf84f07b147-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a2b8c539-75f8-46d4-b173-7bf84f07b147\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 16:20:24.812186 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.812168    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a2b8c539-75f8-46d4-b173-7bf84f07b147-web-config\") pod \"prometheus-k8s-0\" (UID: \"a2b8c539-75f8-46d4-b173-7bf84f07b147\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 16:20:24.813591 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.813575    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9ps6r\" (UniqueName: \"kubernetes.io/projected/a2b8c539-75f8-46d4-b173-7bf84f07b147-kube-api-access-9ps6r\") pod \"prometheus-k8s-0\" (UID: \"a2b8c539-75f8-46d4-b173-7bf84f07b147\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 16:20:24.940416 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:24.940393    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 16:20:25.220785 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:25.220757    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 09 16:20:25.221569 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:20:25.221544    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2b8c539_75f8_46d4_b173_7bf84f07b147.slice/crio-71e16d9ae283df204a6adfd41729a600ea91b594e5a6e104cb01dc8d03d7cf93 WatchSource:0}: Error finding container 71e16d9ae283df204a6adfd41729a600ea91b594e5a6e104cb01dc8d03d7cf93: Status 404 returned error can't find the container with id 71e16d9ae283df204a6adfd41729a600ea91b594e5a6e104cb01dc8d03d7cf93
Sep 09 16:20:25.531283 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:25.531228    2583 generic.go:356] "Generic (PLEG): container finished" podID="a2b8c539-75f8-46d4-b173-7bf84f07b147" containerID="c2addfec8debe3269293161b2f2ada77fb95ff6944c119e506afac5420d80b45" exitCode=0
Sep 09 16:20:25.531377 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:25.531327    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a2b8c539-75f8-46d4-b173-7bf84f07b147","Type":"ContainerDied","Data":"c2addfec8debe3269293161b2f2ada77fb95ff6944c119e506afac5420d80b45"}
Sep 09 16:20:25.531418 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:25.531399    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a2b8c539-75f8-46d4-b173-7bf84f07b147","Type":"ContainerStarted","Data":"71e16d9ae283df204a6adfd41729a600ea91b594e5a6e104cb01dc8d03d7cf93"}
Sep 09 16:20:26.237671 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:26.237644    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ef8e4a2f-9d17-47d2-a84f-7bff2123ce84" path="/var/lib/kubelet/pods/ef8e4a2f-9d17-47d2-a84f-7bff2123ce84/volumes"
Sep 09 16:20:26.547928 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:26.547850    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a2b8c539-75f8-46d4-b173-7bf84f07b147","Type":"ContainerStarted","Data":"390ef0f66e2061851294bde285fec694b8b4f9200215c22923a898c55d9a6b99"}
Sep 09 16:20:26.548084 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:26.547939    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a2b8c539-75f8-46d4-b173-7bf84f07b147","Type":"ContainerStarted","Data":"ae581f143bbec4d9fe480dc48c7a3b69b7a309e0eb395805765e273e474b7866"}
Sep 09 16:20:26.548084 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:26.547967    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a2b8c539-75f8-46d4-b173-7bf84f07b147","Type":"ContainerStarted","Data":"36a999de0694e001a0605d48d260281ea96b5feb85b6d7f330757b0347d903c1"}
Sep 09 16:20:26.548084 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:26.548005    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a2b8c539-75f8-46d4-b173-7bf84f07b147","Type":"ContainerStarted","Data":"ae82c812969724cc20a1d96b29f913b85515e51aaf8440b08f3429515adf1fe1"}
Sep 09 16:20:26.548084 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:26.548038    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a2b8c539-75f8-46d4-b173-7bf84f07b147","Type":"ContainerStarted","Data":"747db97fd852addadb06de2db2a0accc8855b566de4d5d6500dc75b7331ecaff"}
Sep 09 16:20:26.548084 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:26.548062    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a2b8c539-75f8-46d4-b173-7bf84f07b147","Type":"ContainerStarted","Data":"f283620a983833d1e1334f5b1454e7b3110480757973e3a3f77288c51f997de6"}
Sep 09 16:20:26.574440 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:26.574391    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.557729002 podStartE2EDuration="2.574375251s" totalImagesPullingTime="0s" totalInitContainerRuntime="16.646249ms" isStatefulPod=false podCreationTimestamp="2026-09-09 16:20:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:20:26.572949313 +0000 UTC m=+408.926679213" watchObservedRunningTime="2026-09-09 16:20:26.574375251 +0000 UTC m=+408.928105131"
Sep 09 16:20:29.564487 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:29.564407    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-86b488f9f4-fzh9c" event={"ID":"7da7fa1f-0b0c-425b-a5f0-136fe665f4a9","Type":"ContainerStarted","Data":"7dd6e1dfae0268547bcd0fdc4ee11fa0def6b301847f6b4e6a95846ed5e8697d"}
Sep 09 16:20:29.564807 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:29.564519    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-86b488f9f4-fzh9c" event={"ID":"7da7fa1f-0b0c-425b-a5f0-136fe665f4a9","Type":"ContainerStarted","Data":"f6338671fb001c3dd7fd977a82424750727996d6073bdf575dbdae42801ad120"}
Sep 09 16:20:29.564807 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:29.564541    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-86b488f9f4-fzh9c" event={"ID":"7da7fa1f-0b0c-425b-a5f0-136fe665f4a9","Type":"ContainerStarted","Data":"369591e8691b13c427a4b4d2d72bfca3adadd7673daffd33c811fe37df7da655"}
Sep 09 16:20:29.586432 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:29.586375    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-86b488f9f4-fzh9c" podStartSLOduration=1.37623065 podStartE2EDuration="6.586359058s" totalImagesPullingTime="5.210128408s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 16:20:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:20:29.585387488 +0000 UTC m=+411.939117337" watchObservedRunningTime="2026-09-09 16:20:29.586359058 +0000 UTC m=+411.940088889"
Sep 09 16:20:29.709278 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:29.709249    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:20:29.941142 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:29.941109    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 16:20:30.076705 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:30.076672    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:20:30.176424 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:30.176398    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:20:30.678691 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:30.678661    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:20:30.735158 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:30.735132    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:20:34.533876 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:34.533838    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-xzslz"
Sep 09 16:20:43.055230 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:43.055168    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:20:43.105706 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:43.105655    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:20:46.350959 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:46.350901    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:20:46.404875 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:20:46.404834    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:21:11.922900 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:21:11.922760    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:21:11.972469 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:21:11.972430    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:21:24.941227 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:21:24.941189    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 16:21:24.956970 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:21:24.956940    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 16:21:25.806107 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:21:25.806072    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 16:21:33.360781 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:21:33.360723    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:21:33.461365 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:21:33.461337    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:21:35.448106 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:21:35.448068    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:21:35.503878 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:21:35.503800    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:21:45.280498 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:21:45.280460    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:21:45.381513 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:21:45.381478    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:21:46.437374 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:21:46.437337    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:21:49.110245 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:21:49.110206    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:21:49.159526 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:21:49.159490    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:21:57.167652 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:21:57.167605    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:21:57.452773 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:21:57.452694    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:21:57.503710 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:21:57.503686    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:22:34.809485 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:22:34.809382    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:23:07.541149 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:23:07.541107    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:23:07.591640 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:23:07.591607    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:23:31.970437 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:23:31.970395    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:23:32.741344 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:23:32.741313    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:23:35.554667 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:23:35.554631    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:23:35.608355 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:23:35.608319    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:23:37.112096 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:23:37.112062    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:23:37.353135 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:23:37.353096    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:23:37.444040 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:23:37.443952    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:23:39.694826 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:23:39.694787    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:23:39.892269 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:23:39.892238    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:23:42.376396 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:23:42.376355    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:23:44.176610 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:23:44.176576    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:23:47.365136 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:23:47.365099    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:23:47.509846 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:23:47.509805    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:23:48.373058 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:23:48.373016    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:23:48.472481 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:23:48.472443    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:23:51.620776 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:23:51.620739    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:23:51.675141 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:23:51.675107    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:23:54.628645 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:23:54.628596    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:23:54.728796 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:23:54.728761    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:23:56.897692 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:23:56.897653    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:24:02.997566 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:02.997481    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:24:03.102150 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:03.102115    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:24:03.199140 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:03.199117    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:24:09.055425 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:09.055395    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:24:09.154545 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:09.154518    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:24:09.206028 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:09.206002    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-6bb9f9f6c8-4f64g"]
Sep 09 16:24:09.209105 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:09.209090    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6bb9f9f6c8-4f64g"
Sep 09 16:24:09.217085 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:09.216601    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Sep 09 16:24:09.217085 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:09.216624    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Sep 09 16:24:09.217085 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:09.216818    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Sep 09 16:24:09.221118 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:09.218191    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-mlmxp\""
Sep 09 16:24:09.221118 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:09.218313    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Sep 09 16:24:09.221118 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:09.218683    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Sep 09 16:24:09.236227 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:09.236205    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6bb9f9f6c8-4f64g"]
Sep 09 16:24:09.263332 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:09.263309    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:24:09.320858 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:09.320802    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/b9ca8bf6-8122-4240-9044-0b5bc2e215f4-metrics-cert\") pod \"lws-controller-manager-6bb9f9f6c8-4f64g\" (UID: \"b9ca8bf6-8122-4240-9044-0b5bc2e215f4\") " pod="openshift-lws-operator/lws-controller-manager-6bb9f9f6c8-4f64g"
Sep 09 16:24:09.320858 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:09.320852    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b9ca8bf6-8122-4240-9044-0b5bc2e215f4-cert\") pod \"lws-controller-manager-6bb9f9f6c8-4f64g\" (UID: \"b9ca8bf6-8122-4240-9044-0b5bc2e215f4\") " pod="openshift-lws-operator/lws-controller-manager-6bb9f9f6c8-4f64g"
Sep 09 16:24:09.321020 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:09.320880    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j95dq\" (UniqueName: \"kubernetes.io/projected/b9ca8bf6-8122-4240-9044-0b5bc2e215f4-kube-api-access-j95dq\") pod \"lws-controller-manager-6bb9f9f6c8-4f64g\" (UID: \"b9ca8bf6-8122-4240-9044-0b5bc2e215f4\") " pod="openshift-lws-operator/lws-controller-manager-6bb9f9f6c8-4f64g"
Sep 09 16:24:09.321020 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:09.320909    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/b9ca8bf6-8122-4240-9044-0b5bc2e215f4-manager-config\") pod \"lws-controller-manager-6bb9f9f6c8-4f64g\" (UID: \"b9ca8bf6-8122-4240-9044-0b5bc2e215f4\") " pod="openshift-lws-operator/lws-controller-manager-6bb9f9f6c8-4f64g"
Sep 09 16:24:09.422095 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:09.422071    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j95dq\" (UniqueName: \"kubernetes.io/projected/b9ca8bf6-8122-4240-9044-0b5bc2e215f4-kube-api-access-j95dq\") pod \"lws-controller-manager-6bb9f9f6c8-4f64g\" (UID: \"b9ca8bf6-8122-4240-9044-0b5bc2e215f4\") " pod="openshift-lws-operator/lws-controller-manager-6bb9f9f6c8-4f64g"
Sep 09 16:24:09.422195 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:09.422104    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/b9ca8bf6-8122-4240-9044-0b5bc2e215f4-manager-config\") pod \"lws-controller-manager-6bb9f9f6c8-4f64g\" (UID: \"b9ca8bf6-8122-4240-9044-0b5bc2e215f4\") " pod="openshift-lws-operator/lws-controller-manager-6bb9f9f6c8-4f64g"
Sep 09 16:24:09.422195 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:09.422171    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/b9ca8bf6-8122-4240-9044-0b5bc2e215f4-metrics-cert\") pod \"lws-controller-manager-6bb9f9f6c8-4f64g\" (UID: \"b9ca8bf6-8122-4240-9044-0b5bc2e215f4\") " pod="openshift-lws-operator/lws-controller-manager-6bb9f9f6c8-4f64g"
Sep 09 16:24:09.422298 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:09.422215    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b9ca8bf6-8122-4240-9044-0b5bc2e215f4-cert\") pod \"lws-controller-manager-6bb9f9f6c8-4f64g\" (UID: \"b9ca8bf6-8122-4240-9044-0b5bc2e215f4\") " pod="openshift-lws-operator/lws-controller-manager-6bb9f9f6c8-4f64g"
Sep 09 16:24:09.422711 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:09.422684    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/b9ca8bf6-8122-4240-9044-0b5bc2e215f4-manager-config\") pod \"lws-controller-manager-6bb9f9f6c8-4f64g\" (UID: \"b9ca8bf6-8122-4240-9044-0b5bc2e215f4\") " pod="openshift-lws-operator/lws-controller-manager-6bb9f9f6c8-4f64g"
Sep 09 16:24:09.424469 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:09.424442    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b9ca8bf6-8122-4240-9044-0b5bc2e215f4-cert\") pod \"lws-controller-manager-6bb9f9f6c8-4f64g\" (UID: \"b9ca8bf6-8122-4240-9044-0b5bc2e215f4\") " pod="openshift-lws-operator/lws-controller-manager-6bb9f9f6c8-4f64g"
Sep 09 16:24:09.424548 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:09.424495    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/b9ca8bf6-8122-4240-9044-0b5bc2e215f4-metrics-cert\") pod \"lws-controller-manager-6bb9f9f6c8-4f64g\" (UID: \"b9ca8bf6-8122-4240-9044-0b5bc2e215f4\") " pod="openshift-lws-operator/lws-controller-manager-6bb9f9f6c8-4f64g"
Sep 09 16:24:09.430435 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:09.430412    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j95dq\" (UniqueName: \"kubernetes.io/projected/b9ca8bf6-8122-4240-9044-0b5bc2e215f4-kube-api-access-j95dq\") pod \"lws-controller-manager-6bb9f9f6c8-4f64g\" (UID: \"b9ca8bf6-8122-4240-9044-0b5bc2e215f4\") " pod="openshift-lws-operator/lws-controller-manager-6bb9f9f6c8-4f64g"
Sep 09 16:24:09.520991 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:09.520970    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6bb9f9f6c8-4f64g"
Sep 09 16:24:09.708472 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:09.708444    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:24:09.790978 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:09.790955    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6bb9f9f6c8-4f64g"]
Sep 09 16:24:09.793375 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:24:09.793348    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9ca8bf6_8122_4240_9044_0b5bc2e215f4.slice/crio-85e5408cd321a80112fbc1b0f20f3147eef914e6b6c2732a287c35e511db7f30 WatchSource:0}: Error finding container 85e5408cd321a80112fbc1b0f20f3147eef914e6b6c2732a287c35e511db7f30: Status 404 returned error can't find the container with id 85e5408cd321a80112fbc1b0f20f3147eef914e6b6c2732a287c35e511db7f30
Sep 09 16:24:09.795180 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:09.795164    2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 09 16:24:10.181893 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:10.181868    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:24:10.290083 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:10.290045    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:24:10.323881 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:10.323862    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-b9b77fc68-ks84g"]
Sep 09 16:24:10.328444 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:10.328427    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-b9b77fc68-ks84g"
Sep 09 16:24:10.333234 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:10.333219    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-q77nk\""
Sep 09 16:24:10.333234 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:10.333230    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 09 16:24:10.333384 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:10.333249    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 09 16:24:10.333384 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:10.333310    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 09 16:24:10.333637 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:10.333619    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 09 16:24:10.343657 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:10.343640    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-b9b77fc68-ks84g"]
Sep 09 16:24:10.431526 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:10.431503    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l5h9v\" (UniqueName: \"kubernetes.io/projected/894e3a75-e711-4ae0-8e0e-f642fb002381-kube-api-access-l5h9v\") pod \"opendatahub-operator-controller-manager-b9b77fc68-ks84g\" (UID: \"894e3a75-e711-4ae0-8e0e-f642fb002381\") " pod="opendatahub/opendatahub-operator-controller-manager-b9b77fc68-ks84g"
Sep 09 16:24:10.431620 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:10.431533    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/894e3a75-e711-4ae0-8e0e-f642fb002381-webhook-cert\") pod \"opendatahub-operator-controller-manager-b9b77fc68-ks84g\" (UID: \"894e3a75-e711-4ae0-8e0e-f642fb002381\") " pod="opendatahub/opendatahub-operator-controller-manager-b9b77fc68-ks84g"
Sep 09 16:24:10.431620 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:10.431563    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/894e3a75-e711-4ae0-8e0e-f642fb002381-tmp\") pod \"opendatahub-operator-controller-manager-b9b77fc68-ks84g\" (UID: \"894e3a75-e711-4ae0-8e0e-f642fb002381\") " pod="opendatahub/opendatahub-operator-controller-manager-b9b77fc68-ks84g"
Sep 09 16:24:10.431727 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:10.431710    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/894e3a75-e711-4ae0-8e0e-f642fb002381-manifests\") pod \"opendatahub-operator-controller-manager-b9b77fc68-ks84g\" (UID: \"894e3a75-e711-4ae0-8e0e-f642fb002381\") " pod="opendatahub/opendatahub-operator-controller-manager-b9b77fc68-ks84g"
Sep 09 16:24:10.431781 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:10.431740    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/894e3a75-e711-4ae0-8e0e-f642fb002381-apiservice-cert\") pod \"opendatahub-operator-controller-manager-b9b77fc68-ks84g\" (UID: \"894e3a75-e711-4ae0-8e0e-f642fb002381\") " pod="opendatahub/opendatahub-operator-controller-manager-b9b77fc68-ks84g"
Sep 09 16:24:10.446547 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:10.446467    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:24:10.459551 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:10.459528    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6bb9f9f6c8-4f64g" event={"ID":"b9ca8bf6-8122-4240-9044-0b5bc2e215f4","Type":"ContainerStarted","Data":"85e5408cd321a80112fbc1b0f20f3147eef914e6b6c2732a287c35e511db7f30"}
Sep 09 16:24:10.532224 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:10.532204    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l5h9v\" (UniqueName: \"kubernetes.io/projected/894e3a75-e711-4ae0-8e0e-f642fb002381-kube-api-access-l5h9v\") pod \"opendatahub-operator-controller-manager-b9b77fc68-ks84g\" (UID: \"894e3a75-e711-4ae0-8e0e-f642fb002381\") " pod="opendatahub/opendatahub-operator-controller-manager-b9b77fc68-ks84g"
Sep 09 16:24:10.532297 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:10.532239    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/894e3a75-e711-4ae0-8e0e-f642fb002381-webhook-cert\") pod \"opendatahub-operator-controller-manager-b9b77fc68-ks84g\" (UID: \"894e3a75-e711-4ae0-8e0e-f642fb002381\") " pod="opendatahub/opendatahub-operator-controller-manager-b9b77fc68-ks84g"
Sep 09 16:24:10.532297 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:10.532285    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/894e3a75-e711-4ae0-8e0e-f642fb002381-tmp\") pod \"opendatahub-operator-controller-manager-b9b77fc68-ks84g\" (UID: \"894e3a75-e711-4ae0-8e0e-f642fb002381\") " pod="opendatahub/opendatahub-operator-controller-manager-b9b77fc68-ks84g"
Sep 09 16:24:10.532389 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:10.532332    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/894e3a75-e711-4ae0-8e0e-f642fb002381-manifests\") pod \"opendatahub-operator-controller-manager-b9b77fc68-ks84g\" (UID: \"894e3a75-e711-4ae0-8e0e-f642fb002381\") " pod="opendatahub/opendatahub-operator-controller-manager-b9b77fc68-ks84g"
Sep 09 16:24:10.532389 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:10.532361    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/894e3a75-e711-4ae0-8e0e-f642fb002381-apiservice-cert\") pod \"opendatahub-operator-controller-manager-b9b77fc68-ks84g\" (UID: \"894e3a75-e711-4ae0-8e0e-f642fb002381\") " pod="opendatahub/opendatahub-operator-controller-manager-b9b77fc68-ks84g"
Sep 09 16:24:10.532799 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:10.532775    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/894e3a75-e711-4ae0-8e0e-f642fb002381-manifests\") pod \"opendatahub-operator-controller-manager-b9b77fc68-ks84g\" (UID: \"894e3a75-e711-4ae0-8e0e-f642fb002381\") " pod="opendatahub/opendatahub-operator-controller-manager-b9b77fc68-ks84g"
Sep 09 16:24:10.534129 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:10.534103    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:24:10.534692 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:10.534669    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/894e3a75-e711-4ae0-8e0e-f642fb002381-tmp\") pod \"opendatahub-operator-controller-manager-b9b77fc68-ks84g\" (UID: \"894e3a75-e711-4ae0-8e0e-f642fb002381\") " pod="opendatahub/opendatahub-operator-controller-manager-b9b77fc68-ks84g"
Sep 09 16:24:10.535126 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:10.535105    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/894e3a75-e711-4ae0-8e0e-f642fb002381-webhook-cert\") pod \"opendatahub-operator-controller-manager-b9b77fc68-ks84g\" (UID: \"894e3a75-e711-4ae0-8e0e-f642fb002381\") " pod="opendatahub/opendatahub-operator-controller-manager-b9b77fc68-ks84g"
Sep 09 16:24:10.535174 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:10.535105    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/894e3a75-e711-4ae0-8e0e-f642fb002381-apiservice-cert\") pod \"opendatahub-operator-controller-manager-b9b77fc68-ks84g\" (UID: \"894e3a75-e711-4ae0-8e0e-f642fb002381\") " pod="opendatahub/opendatahub-operator-controller-manager-b9b77fc68-ks84g"
Sep 09 16:24:10.539568 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:10.539546    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l5h9v\" (UniqueName: \"kubernetes.io/projected/894e3a75-e711-4ae0-8e0e-f642fb002381-kube-api-access-l5h9v\") pod \"opendatahub-operator-controller-manager-b9b77fc68-ks84g\" (UID: \"894e3a75-e711-4ae0-8e0e-f642fb002381\") " pod="opendatahub/opendatahub-operator-controller-manager-b9b77fc68-ks84g"
Sep 09 16:24:10.634548 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:10.634527    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:24:10.638528 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:10.638509    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-b9b77fc68-ks84g"
Sep 09 16:24:10.735361 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:10.735304    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:24:10.835076 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:10.835040    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:24:10.925657 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:10.925588    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-b9b77fc68-ks84g"]
Sep 09 16:24:10.928527 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:24:10.928491    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod894e3a75_e711_4ae0_8e0e_f642fb002381.slice/crio-b5131a7a3e0088fb31b9542c64d2a3653b1339fbc7534046d98e6763d8e3debf WatchSource:0}: Error finding container b5131a7a3e0088fb31b9542c64d2a3653b1339fbc7534046d98e6763d8e3debf: Status 404 returned error can't find the container with id b5131a7a3e0088fb31b9542c64d2a3653b1339fbc7534046d98e6763d8e3debf
Sep 09 16:24:11.466759 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:11.466710    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-b9b77fc68-ks84g" event={"ID":"894e3a75-e711-4ae0-8e0e-f642fb002381","Type":"ContainerStarted","Data":"b5131a7a3e0088fb31b9542c64d2a3653b1339fbc7534046d98e6763d8e3debf"}
Sep 09 16:24:14.483358 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:14.483312    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6bb9f9f6c8-4f64g" event={"ID":"b9ca8bf6-8122-4240-9044-0b5bc2e215f4","Type":"ContainerStarted","Data":"2a134e03735ea3651ffd0a4fc1941451bbc7819fa9b23f955c244aad75c2834b"}
Sep 09 16:24:14.483779 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:14.483368    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-6bb9f9f6c8-4f64g"
Sep 09 16:24:14.484911 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:14.484889    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-b9b77fc68-ks84g" event={"ID":"894e3a75-e711-4ae0-8e0e-f642fb002381","Type":"ContainerStarted","Data":"b6973ce1a4045c3826608c0b46dfbc98160a1e41f868d31584de50f2f817a4d7"}
Sep 09 16:24:14.500430 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:14.500391    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-6bb9f9f6c8-4f64g" podStartSLOduration=1.320997906 podStartE2EDuration="5.500377705s" totalImagesPullingTime="4.179379799s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 16:24:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:24:14.49918998 +0000 UTC m=+636.852919830" watchObservedRunningTime="2026-09-09 16:24:14.500377705 +0000 UTC m=+636.854107613"
Sep 09 16:24:15.491547 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:15.491468    2583 generic.go:356] "Generic (PLEG): container finished" podID="894e3a75-e711-4ae0-8e0e-f642fb002381" containerID="b6973ce1a4045c3826608c0b46dfbc98160a1e41f868d31584de50f2f817a4d7" exitCode=0
Sep 09 16:24:15.491847 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:15.491565    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-b9b77fc68-ks84g" event={"ID":"894e3a75-e711-4ae0-8e0e-f642fb002381","Type":"ContainerDied","Data":"b6973ce1a4045c3826608c0b46dfbc98160a1e41f868d31584de50f2f817a4d7"}
Sep 09 16:24:18.508059 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:18.508024    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-b9b77fc68-ks84g" event={"ID":"894e3a75-e711-4ae0-8e0e-f642fb002381","Type":"ContainerStarted","Data":"d28d82f8aea768156920787a391e5f571e834791bfd5c276c8ce1336f6e8c97e"}
Sep 09 16:24:18.508479 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:18.508127    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-b9b77fc68-ks84g"
Sep 09 16:24:18.531563 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:18.531514    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-b9b77fc68-ks84g" podStartSLOduration=2.054554334 podStartE2EDuration="8.531500082s" totalImagesPullingTime="5.44988057s" totalInitContainerRuntime="1.027065178s" isStatefulPod=false podCreationTimestamp="2026-09-09 16:24:10 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:24:18.528662447 +0000 UTC m=+640.882392298" watchObservedRunningTime="2026-09-09 16:24:18.531500082 +0000 UTC m=+640.885229914"
Sep 09 16:24:19.948306 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:19.948265    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:24:20.594358 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:20.594321    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:24:20.694857 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:20.694828    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:24:25.494583 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:25.494550    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-6bb9f9f6c8-4f64g"
Sep 09 16:24:29.514238 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:29.514156    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-b9b77fc68-ks84g"
Sep 09 16:24:31.200710 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:31.200668    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:24:31.307422 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:31.307398    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:24:31.574058 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:31.574037    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:24:31.864635 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:31.864570    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:24:32.881755 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:32.881723    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:24:32.956241 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:32.956215    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:24:33.716524 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:33.716488    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:24:37.821116 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:37.821073    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:24:37.969737 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:37.969700    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-5lcjh"]
Sep 09 16:24:37.973232 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:37.973204    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-5lcjh"
Sep 09 16:24:37.975848 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:37.975821    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 09 16:24:37.976010 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:37.975864    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-xd4rz\""
Sep 09 16:24:37.985621 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:37.985593    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-5lcjh"]
Sep 09 16:24:38.027736 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:38.027710    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:24:38.096447 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:38.096422    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:24:38.138085 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:38.138057    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/51b2b28b-cd33-4309-a1e9-a27f86a9dcfc-istio-data\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-5lcjh\" (UID: \"51b2b28b-cd33-4309-a1e9-a27f86a9dcfc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-5lcjh"
Sep 09 16:24:38.138191 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:38.138098    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/51b2b28b-cd33-4309-a1e9-a27f86a9dcfc-istio-token\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-5lcjh\" (UID: \"51b2b28b-cd33-4309-a1e9-a27f86a9dcfc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-5lcjh"
Sep 09 16:24:38.138191 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:38.138128    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/51b2b28b-cd33-4309-a1e9-a27f86a9dcfc-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-5lcjh\" (UID: \"51b2b28b-cd33-4309-a1e9-a27f86a9dcfc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-5lcjh"
Sep 09 16:24:38.138261 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:38.138192    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qvp4p\" (UniqueName: \"kubernetes.io/projected/51b2b28b-cd33-4309-a1e9-a27f86a9dcfc-kube-api-access-qvp4p\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-5lcjh\" (UID: \"51b2b28b-cd33-4309-a1e9-a27f86a9dcfc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-5lcjh"
Sep 09 16:24:38.138261 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:38.138229    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/51b2b28b-cd33-4309-a1e9-a27f86a9dcfc-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-5lcjh\" (UID: \"51b2b28b-cd33-4309-a1e9-a27f86a9dcfc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-5lcjh"
Sep 09 16:24:38.138261 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:38.138250    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/51b2b28b-cd33-4309-a1e9-a27f86a9dcfc-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-5lcjh\" (UID: \"51b2b28b-cd33-4309-a1e9-a27f86a9dcfc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-5lcjh"
Sep 09 16:24:38.138376 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:38.138302    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/51b2b28b-cd33-4309-a1e9-a27f86a9dcfc-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-5lcjh\" (UID: \"51b2b28b-cd33-4309-a1e9-a27f86a9dcfc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-5lcjh"
Sep 09 16:24:38.138376 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:38.138326    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/51b2b28b-cd33-4309-a1e9-a27f86a9dcfc-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-5lcjh\" (UID: \"51b2b28b-cd33-4309-a1e9-a27f86a9dcfc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-5lcjh"
Sep 09 16:24:38.138376 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:38.138346    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/51b2b28b-cd33-4309-a1e9-a27f86a9dcfc-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-5lcjh\" (UID: \"51b2b28b-cd33-4309-a1e9-a27f86a9dcfc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-5lcjh"
Sep 09 16:24:38.215706 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:38.215657    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cb22vs"]
Sep 09 16:24:38.220129 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:38.220113    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cb22vs"
Sep 09 16:24:38.221136 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:38.221113    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:24:38.239566 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:38.239542    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cb22vs"]
Sep 09 16:24:38.239672 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:38.239654    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/51b2b28b-cd33-4309-a1e9-a27f86a9dcfc-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-5lcjh\" (UID: \"51b2b28b-cd33-4309-a1e9-a27f86a9dcfc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-5lcjh"
Sep 09 16:24:38.239721 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:38.239678    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/51b2b28b-cd33-4309-a1e9-a27f86a9dcfc-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-5lcjh\" (UID: \"51b2b28b-cd33-4309-a1e9-a27f86a9dcfc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-5lcjh"
Sep 09 16:24:38.239721 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:38.239702    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/51b2b28b-cd33-4309-a1e9-a27f86a9dcfc-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-5lcjh\" (UID: \"51b2b28b-cd33-4309-a1e9-a27f86a9dcfc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-5lcjh"
Sep 09 16:24:38.240033 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:38.239726    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/51b2b28b-cd33-4309-a1e9-a27f86a9dcfc-istio-data\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-5lcjh\" (UID: \"51b2b28b-cd33-4309-a1e9-a27f86a9dcfc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-5lcjh"
Sep 09 16:24:38.240033 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:38.239759    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/51b2b28b-cd33-4309-a1e9-a27f86a9dcfc-istio-token\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-5lcjh\" (UID: \"51b2b28b-cd33-4309-a1e9-a27f86a9dcfc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-5lcjh"
Sep 09 16:24:38.240033 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:38.239786    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/51b2b28b-cd33-4309-a1e9-a27f86a9dcfc-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-5lcjh\" (UID: \"51b2b28b-cd33-4309-a1e9-a27f86a9dcfc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-5lcjh"
Sep 09 16:24:38.240033 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:38.239822    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qvp4p\" (UniqueName: \"kubernetes.io/projected/51b2b28b-cd33-4309-a1e9-a27f86a9dcfc-kube-api-access-qvp4p\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-5lcjh\" (UID: \"51b2b28b-cd33-4309-a1e9-a27f86a9dcfc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-5lcjh"
Sep 09 16:24:38.240033 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:38.239912    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/51b2b28b-cd33-4309-a1e9-a27f86a9dcfc-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-5lcjh\" (UID: \"51b2b28b-cd33-4309-a1e9-a27f86a9dcfc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-5lcjh"
Sep 09 16:24:38.240033 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:38.239963    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/51b2b28b-cd33-4309-a1e9-a27f86a9dcfc-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-5lcjh\" (UID: \"51b2b28b-cd33-4309-a1e9-a27f86a9dcfc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-5lcjh"
Sep 09 16:24:38.240429 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:38.240136    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/51b2b28b-cd33-4309-a1e9-a27f86a9dcfc-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-5lcjh\" (UID: \"51b2b28b-cd33-4309-a1e9-a27f86a9dcfc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-5lcjh"
Sep 09 16:24:38.240429 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:38.240171    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/51b2b28b-cd33-4309-a1e9-a27f86a9dcfc-istio-data\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-5lcjh\" (UID: \"51b2b28b-cd33-4309-a1e9-a27f86a9dcfc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-5lcjh"
Sep 09 16:24:38.240429 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:38.240396    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/51b2b28b-cd33-4309-a1e9-a27f86a9dcfc-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-5lcjh\" (UID: \"51b2b28b-cd33-4309-a1e9-a27f86a9dcfc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-5lcjh"
Sep 09 16:24:38.240590 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:38.240462    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/51b2b28b-cd33-4309-a1e9-a27f86a9dcfc-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-5lcjh\" (UID: \"51b2b28b-cd33-4309-a1e9-a27f86a9dcfc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-5lcjh"
Sep 09 16:24:38.242116 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:38.242092    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/51b2b28b-cd33-4309-a1e9-a27f86a9dcfc-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-5lcjh\" (UID: \"51b2b28b-cd33-4309-a1e9-a27f86a9dcfc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-5lcjh"
Sep 09 16:24:38.242572 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:38.242550    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/51b2b28b-cd33-4309-a1e9-a27f86a9dcfc-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-5lcjh\" (UID: \"51b2b28b-cd33-4309-a1e9-a27f86a9dcfc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-5lcjh"
Sep 09 16:24:38.242915 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:38.242895    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 09 16:24:38.250722 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:38.250674    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/51b2b28b-cd33-4309-a1e9-a27f86a9dcfc-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-5lcjh\" (UID: \"51b2b28b-cd33-4309-a1e9-a27f86a9dcfc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-5lcjh"
Sep 09 16:24:38.251051 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:38.251027    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/51b2b28b-cd33-4309-a1e9-a27f86a9dcfc-istio-token\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-5lcjh\" (UID: \"51b2b28b-cd33-4309-a1e9-a27f86a9dcfc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-5lcjh"
Sep 09 16:24:38.251386 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:38.251363    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qvp4p\" (UniqueName: \"kubernetes.io/projected/51b2b28b-cd33-4309-a1e9-a27f86a9dcfc-kube-api-access-qvp4p\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-5lcjh\" (UID: \"51b2b28b-cd33-4309-a1e9-a27f86a9dcfc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-5lcjh"
Sep 09 16:24:38.287252 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:38.287235    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-xd4rz\""
Sep 09 16:24:38.295237 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:38.295221    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-5lcjh"
Sep 09 16:24:38.313633 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:38.313605    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:24:38.341492 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:38.341467    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/411bb526-f17b-4fed-9822-40ab7d718269-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cb22vs\" (UID: \"411bb526-f17b-4fed-9822-40ab7d718269\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cb22vs"
Sep 09 16:24:38.341593 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:38.341507    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/411bb526-f17b-4fed-9822-40ab7d718269-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cb22vs\" (UID: \"411bb526-f17b-4fed-9822-40ab7d718269\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cb22vs"
Sep 09 16:24:38.341653 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:38.341593    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/411bb526-f17b-4fed-9822-40ab7d718269-istio-token\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cb22vs\" (UID: \"411bb526-f17b-4fed-9822-40ab7d718269\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cb22vs"
Sep 09 16:24:38.341653 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:38.341634    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/411bb526-f17b-4fed-9822-40ab7d718269-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cb22vs\" (UID: \"411bb526-f17b-4fed-9822-40ab7d718269\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cb22vs"
Sep 09 16:24:38.342181 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:38.341662    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/411bb526-f17b-4fed-9822-40ab7d718269-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cb22vs\" (UID: \"411bb526-f17b-4fed-9822-40ab7d718269\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cb22vs"
Sep 09 16:24:38.342181 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:38.341708    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/411bb526-f17b-4fed-9822-40ab7d718269-istio-data\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cb22vs\" (UID: \"411bb526-f17b-4fed-9822-40ab7d718269\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cb22vs"
Sep 09 16:24:38.342181 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:38.341742    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/411bb526-f17b-4fed-9822-40ab7d718269-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cb22vs\" (UID: \"411bb526-f17b-4fed-9822-40ab7d718269\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cb22vs"
Sep 09 16:24:38.342181 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:38.341775    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vp4p7\" (UniqueName: \"kubernetes.io/projected/411bb526-f17b-4fed-9822-40ab7d718269-kube-api-access-vp4p7\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cb22vs\" (UID: \"411bb526-f17b-4fed-9822-40ab7d718269\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cb22vs"
Sep 09 16:24:38.342181 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:38.341808    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/411bb526-f17b-4fed-9822-40ab7d718269-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cb22vs\" (UID: \"411bb526-f17b-4fed-9822-40ab7d718269\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cb22vs"
Sep 09 16:24:38.442605 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:38.442541    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vp4p7\" (UniqueName: \"kubernetes.io/projected/411bb526-f17b-4fed-9822-40ab7d718269-kube-api-access-vp4p7\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cb22vs\" (UID: \"411bb526-f17b-4fed-9822-40ab7d718269\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cb22vs"
Sep 09 16:24:38.442605 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:38.442585    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/411bb526-f17b-4fed-9822-40ab7d718269-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cb22vs\" (UID: \"411bb526-f17b-4fed-9822-40ab7d718269\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cb22vs"
Sep 09 16:24:38.442758 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:38.442623    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/411bb526-f17b-4fed-9822-40ab7d718269-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cb22vs\" (UID: \"411bb526-f17b-4fed-9822-40ab7d718269\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cb22vs"
Sep 09 16:24:38.442758 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:38.442647    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/411bb526-f17b-4fed-9822-40ab7d718269-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cb22vs\" (UID: \"411bb526-f17b-4fed-9822-40ab7d718269\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cb22vs"
Sep 09 16:24:38.442758 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:38.442694    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/411bb526-f17b-4fed-9822-40ab7d718269-istio-token\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cb22vs\" (UID: \"411bb526-f17b-4fed-9822-40ab7d718269\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cb22vs"
Sep 09 16:24:38.442758 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:38.442726    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/411bb526-f17b-4fed-9822-40ab7d718269-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cb22vs\" (UID: \"411bb526-f17b-4fed-9822-40ab7d718269\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cb22vs"
Sep 09 16:24:38.442758 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:38.442749    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/411bb526-f17b-4fed-9822-40ab7d718269-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cb22vs\" (UID: \"411bb526-f17b-4fed-9822-40ab7d718269\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cb22vs"
Sep 09 16:24:38.443024 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:38.442795    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/411bb526-f17b-4fed-9822-40ab7d718269-istio-data\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cb22vs\" (UID: \"411bb526-f17b-4fed-9822-40ab7d718269\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cb22vs"
Sep 09 16:24:38.443024 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:38.442830    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/411bb526-f17b-4fed-9822-40ab7d718269-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cb22vs\" (UID: \"411bb526-f17b-4fed-9822-40ab7d718269\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cb22vs"
Sep 09 16:24:38.443140 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:38.443074    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/411bb526-f17b-4fed-9822-40ab7d718269-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cb22vs\" (UID: \"411bb526-f17b-4fed-9822-40ab7d718269\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cb22vs"
Sep 09 16:24:38.443251 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:38.443231    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/411bb526-f17b-4fed-9822-40ab7d718269-istio-data\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cb22vs\" (UID: \"411bb526-f17b-4fed-9822-40ab7d718269\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cb22vs"
Sep 09 16:24:38.443313 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:38.443262    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/411bb526-f17b-4fed-9822-40ab7d718269-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cb22vs\" (UID: \"411bb526-f17b-4fed-9822-40ab7d718269\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cb22vs"
Sep 09 16:24:38.443371 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:38.443340    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/411bb526-f17b-4fed-9822-40ab7d718269-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cb22vs\" (UID: \"411bb526-f17b-4fed-9822-40ab7d718269\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cb22vs"
Sep 09 16:24:38.443506 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:38.443486    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/411bb526-f17b-4fed-9822-40ab7d718269-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cb22vs\" (UID: \"411bb526-f17b-4fed-9822-40ab7d718269\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cb22vs"
Sep 09 16:24:38.444902 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:38.444881    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/411bb526-f17b-4fed-9822-40ab7d718269-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cb22vs\" (UID: \"411bb526-f17b-4fed-9822-40ab7d718269\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cb22vs"
Sep 09 16:24:38.444965 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:38.444949    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/411bb526-f17b-4fed-9822-40ab7d718269-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cb22vs\" (UID: \"411bb526-f17b-4fed-9822-40ab7d718269\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cb22vs"
Sep 09 16:24:38.450501 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:38.450475    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/411bb526-f17b-4fed-9822-40ab7d718269-istio-token\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cb22vs\" (UID: \"411bb526-f17b-4fed-9822-40ab7d718269\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cb22vs"
Sep 09 16:24:38.450738 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:38.450721    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vp4p7\" (UniqueName: \"kubernetes.io/projected/411bb526-f17b-4fed-9822-40ab7d718269-kube-api-access-vp4p7\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cb22vs\" (UID: \"411bb526-f17b-4fed-9822-40ab7d718269\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cb22vs"
Sep 09 16:24:38.528779 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:38.528756    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cb22vs"
Sep 09 16:24:38.568113 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:38.568084    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-5lcjh"]
Sep 09 16:24:38.571181 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:24:38.571153    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51b2b28b_cd33_4309_a1e9_a27f86a9dcfc.slice/crio-6935c60e69002312d9a440dc801bc4af1ec9bf5b155cdea8ac619ea9d2434fb5 WatchSource:0}: Error finding container 6935c60e69002312d9a440dc801bc4af1ec9bf5b155cdea8ac619ea9d2434fb5: Status 404 returned error can't find the container with id 6935c60e69002312d9a440dc801bc4af1ec9bf5b155cdea8ac619ea9d2434fb5
Sep 09 16:24:38.597484 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:38.597461    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-5lcjh" event={"ID":"51b2b28b-cd33-4309-a1e9-a27f86a9dcfc","Type":"ContainerStarted","Data":"6935c60e69002312d9a440dc801bc4af1ec9bf5b155cdea8ac619ea9d2434fb5"}
Sep 09 16:24:38.803800 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:38.803732    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cb22vs"]
Sep 09 16:24:38.806168 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:24:38.806141    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod411bb526_f17b_4fed_9822_40ab7d718269.slice/crio-3e1ea5cff07a7c366e04c6342df0b8c54263a893af151eefc1c1870a41c80796 WatchSource:0}: Error finding container 3e1ea5cff07a7c366e04c6342df0b8c54263a893af151eefc1c1870a41c80796: Status 404 returned error can't find the container with id 3e1ea5cff07a7c366e04c6342df0b8c54263a893af151eefc1c1870a41c80796
Sep 09 16:24:39.604590 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:39.604555    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cb22vs" event={"ID":"411bb526-f17b-4fed-9822-40ab7d718269","Type":"ContainerStarted","Data":"3e1ea5cff07a7c366e04c6342df0b8c54263a893af151eefc1c1870a41c80796"}
Sep 09 16:24:40.633152 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:40.633111    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:24:41.310960 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:41.310926    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 09 16:24:41.311093 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:41.311009    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 09 16:24:41.311093 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:41.311039    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 09 16:24:41.316579 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:41.316554    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 09 16:24:41.316628 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:41.316607    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 09 16:24:41.316662 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:41.316635    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 09 16:24:41.615696 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:41.615665    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-5lcjh" event={"ID":"51b2b28b-cd33-4309-a1e9-a27f86a9dcfc","Type":"ContainerStarted","Data":"5415f3d5170273f79aaf3566a2321361ff0d8308e85c4e96bf71e3a3d1ff3c41"}
Sep 09 16:24:41.617200 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:41.617173    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cb22vs" event={"ID":"411bb526-f17b-4fed-9822-40ab7d718269","Type":"ContainerStarted","Data":"ed48eb633d089b9149095dbd9722d85d010a5cde8324dc9be975ecfe1b607702"}
Sep 09 16:24:41.639939 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:41.639880    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-5lcjh" podStartSLOduration=1.902444799 podStartE2EDuration="4.639862152s" totalImagesPullingTime="2.737417353s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 16:24:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:24:41.63934304 +0000 UTC m=+663.993072874" watchObservedRunningTime="2026-09-09 16:24:41.639862152 +0000 UTC m=+663.993591984"
Sep 09 16:24:41.665102 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:41.665064    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cb22vs" podStartSLOduration=1.156774362 podStartE2EDuration="3.665050476s" totalImagesPullingTime="2.508276114s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 16:24:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:24:41.663272898 +0000 UTC m=+664.017002731" watchObservedRunningTime="2026-09-09 16:24:41.665050476 +0000 UTC m=+664.018780307"
Sep 09 16:24:42.052435 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:42.052352    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:24:42.296381 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:42.296350    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-5lcjh"
Sep 09 16:24:42.297720 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:42.297691    2583 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-fddd6c88c-5lcjh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.29:15021/healthz/ready\": dial tcp 10.132.0.29:15021: connect: connection refused" start-of-body=
Sep 09 16:24:42.297836 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:42.297748    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-5lcjh" podUID="51b2b28b-cd33-4309-a1e9-a27f86a9dcfc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.29:15021/healthz/ready\": dial tcp 10.132.0.29:15021: connect: connection refused"
Sep 09 16:24:42.425129 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:42.425098    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-hkfmx"]
Sep 09 16:24:42.428816 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:42.428798    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-hkfmx"
Sep 09 16:24:42.431511 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:42.431482    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Sep 09 16:24:42.431615 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:42.431579    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-bml9r\""
Sep 09 16:24:42.437402 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:42.437376    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-hkfmx"]
Sep 09 16:24:42.454539 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:42.454508    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:24:42.529861 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:42.529836    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cb22vs"
Sep 09 16:24:42.534331 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:42.534311    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cb22vs"
Sep 09 16:24:42.557817 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:42.557793    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:24:42.578900 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:42.578872    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/57f825c6-5686-4bfa-8628-0462c34b985e-cert\") pod \"odh-model-controller-7998c67dc4-hkfmx\" (UID: \"57f825c6-5686-4bfa-8628-0462c34b985e\") " pod="opendatahub/odh-model-controller-7998c67dc4-hkfmx"
Sep 09 16:24:42.579017 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:42.578949    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pql45\" (UniqueName: \"kubernetes.io/projected/57f825c6-5686-4bfa-8628-0462c34b985e-kube-api-access-pql45\") pod \"odh-model-controller-7998c67dc4-hkfmx\" (UID: \"57f825c6-5686-4bfa-8628-0462c34b985e\") " pod="opendatahub/odh-model-controller-7998c67dc4-hkfmx"
Sep 09 16:24:42.621940 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:42.621919    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cb22vs"
Sep 09 16:24:42.622647 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:42.622632    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cb22vs"
Sep 09 16:24:42.656508 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:42.656488    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:24:42.679702 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:42.679650    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/57f825c6-5686-4bfa-8628-0462c34b985e-cert\") pod \"odh-model-controller-7998c67dc4-hkfmx\" (UID: \"57f825c6-5686-4bfa-8628-0462c34b985e\") " pod="opendatahub/odh-model-controller-7998c67dc4-hkfmx"
Sep 09 16:24:42.679788 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:42.679740    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pql45\" (UniqueName: \"kubernetes.io/projected/57f825c6-5686-4bfa-8628-0462c34b985e-kube-api-access-pql45\") pod \"odh-model-controller-7998c67dc4-hkfmx\" (UID: \"57f825c6-5686-4bfa-8628-0462c34b985e\") " pod="opendatahub/odh-model-controller-7998c67dc4-hkfmx"
Sep 09 16:24:42.679835 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:24:42.679803    2583 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Sep 09 16:24:42.679898 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:24:42.679887    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/57f825c6-5686-4bfa-8628-0462c34b985e-cert podName:57f825c6-5686-4bfa-8628-0462c34b985e nodeName:}" failed. No retries permitted until 2026-09-09 16:24:43.179867076 +0000 UTC m=+665.533596909 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/57f825c6-5686-4bfa-8628-0462c34b985e-cert") pod "odh-model-controller-7998c67dc4-hkfmx" (UID: "57f825c6-5686-4bfa-8628-0462c34b985e") : secret "odh-model-controller-webhook-cert" not found
Sep 09 16:24:42.696882 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:42.696865    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pql45\" (UniqueName: \"kubernetes.io/projected/57f825c6-5686-4bfa-8628-0462c34b985e-kube-api-access-pql45\") pod \"odh-model-controller-7998c67dc4-hkfmx\" (UID: \"57f825c6-5686-4bfa-8628-0462c34b985e\") " pod="opendatahub/odh-model-controller-7998c67dc4-hkfmx"
Sep 09 16:24:42.701388 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:42.701365    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-5lcjh"]
Sep 09 16:24:42.752555 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:42.752529    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:24:42.915878 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:42.915852    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:24:43.020024 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:43.019955    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-tbnr4"]
Sep 09 16:24:43.023322 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:43.023307    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-tbnr4"
Sep 09 16:24:43.028406 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:43.028386    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Sep 09 16:24:43.050451 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:43.050431    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-tbnr4"]
Sep 09 16:24:43.072434 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:43.072414    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:24:43.170680 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:43.170659    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:24:43.184509 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:43.184486    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/57f825c6-5686-4bfa-8628-0462c34b985e-cert\") pod \"odh-model-controller-7998c67dc4-hkfmx\" (UID: \"57f825c6-5686-4bfa-8628-0462c34b985e\") " pod="opendatahub/odh-model-controller-7998c67dc4-hkfmx"
Sep 09 16:24:43.184602 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:43.184520    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fd72319f-be1e-426b-be2d-2f205c3ff2ff-tls-certs\") pod \"model-serving-api-54d89bd5fc-tbnr4\" (UID: \"fd72319f-be1e-426b-be2d-2f205c3ff2ff\") " pod="opendatahub/model-serving-api-54d89bd5fc-tbnr4"
Sep 09 16:24:43.184654 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:43.184616    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4bmpw\" (UniqueName: \"kubernetes.io/projected/fd72319f-be1e-426b-be2d-2f205c3ff2ff-kube-api-access-4bmpw\") pod \"model-serving-api-54d89bd5fc-tbnr4\" (UID: \"fd72319f-be1e-426b-be2d-2f205c3ff2ff\") " pod="opendatahub/model-serving-api-54d89bd5fc-tbnr4"
Sep 09 16:24:43.186663 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:43.186644    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/57f825c6-5686-4bfa-8628-0462c34b985e-cert\") pod \"odh-model-controller-7998c67dc4-hkfmx\" (UID: \"57f825c6-5686-4bfa-8628-0462c34b985e\") " pod="opendatahub/odh-model-controller-7998c67dc4-hkfmx"
Sep 09 16:24:43.285519 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:43.285456    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4bmpw\" (UniqueName: \"kubernetes.io/projected/fd72319f-be1e-426b-be2d-2f205c3ff2ff-kube-api-access-4bmpw\") pod \"model-serving-api-54d89bd5fc-tbnr4\" (UID: \"fd72319f-be1e-426b-be2d-2f205c3ff2ff\") " pod="opendatahub/model-serving-api-54d89bd5fc-tbnr4"
Sep 09 16:24:43.285623 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:43.285525    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fd72319f-be1e-426b-be2d-2f205c3ff2ff-tls-certs\") pod \"model-serving-api-54d89bd5fc-tbnr4\" (UID: \"fd72319f-be1e-426b-be2d-2f205c3ff2ff\") " pod="opendatahub/model-serving-api-54d89bd5fc-tbnr4"
Sep 09 16:24:43.287806 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:43.287786    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fd72319f-be1e-426b-be2d-2f205c3ff2ff-tls-certs\") pod \"model-serving-api-54d89bd5fc-tbnr4\" (UID: \"fd72319f-be1e-426b-be2d-2f205c3ff2ff\") " pod="opendatahub/model-serving-api-54d89bd5fc-tbnr4"
Sep 09 16:24:43.293039 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:43.293020    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4bmpw\" (UniqueName: \"kubernetes.io/projected/fd72319f-be1e-426b-be2d-2f205c3ff2ff-kube-api-access-4bmpw\") pod \"model-serving-api-54d89bd5fc-tbnr4\" (UID: \"fd72319f-be1e-426b-be2d-2f205c3ff2ff\") " pod="opendatahub/model-serving-api-54d89bd5fc-tbnr4"
Sep 09 16:24:43.295994 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:43.295967    2583 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-fddd6c88c-5lcjh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.29:15021/healthz/ready\": dial tcp 10.132.0.29:15021: connect: connection refused" start-of-body=
Sep 09 16:24:43.296061 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:43.296022    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-5lcjh" podUID="51b2b28b-cd33-4309-a1e9-a27f86a9dcfc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.29:15021/healthz/ready\": dial tcp 10.132.0.29:15021: connect: connection refused"
Sep 09 16:24:43.333156 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:43.333135    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-tbnr4"
Sep 09 16:24:43.340165 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:43.340146    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-hkfmx"
Sep 09 16:24:43.611601 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:43.611578    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-hkfmx"]
Sep 09 16:24:43.613589 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:24:43.613566    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57f825c6_5686_4bfa_8628_0462c34b985e.slice/crio-1ecb84b767146f0fb5d5b7d6023e152e79175ebf718dddec84f098e73ff05d84 WatchSource:0}: Error finding container 1ecb84b767146f0fb5d5b7d6023e152e79175ebf718dddec84f098e73ff05d84: Status 404 returned error can't find the container with id 1ecb84b767146f0fb5d5b7d6023e152e79175ebf718dddec84f098e73ff05d84
Sep 09 16:24:43.614139 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:43.614125    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-tbnr4"]
Sep 09 16:24:43.616528 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:24:43.616510    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd72319f_be1e_426b_be2d_2f205c3ff2ff.slice/crio-22ab50fa4703511ff927bceaf4a2f1ba9f17aef5c9f1801a20382ec809dd5388 WatchSource:0}: Error finding container 22ab50fa4703511ff927bceaf4a2f1ba9f17aef5c9f1801a20382ec809dd5388: Status 404 returned error can't find the container with id 22ab50fa4703511ff927bceaf4a2f1ba9f17aef5c9f1801a20382ec809dd5388
Sep 09 16:24:43.626498 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:43.626472    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-hkfmx" event={"ID":"57f825c6-5686-4bfa-8628-0462c34b985e","Type":"ContainerStarted","Data":"1ecb84b767146f0fb5d5b7d6023e152e79175ebf718dddec84f098e73ff05d84"}
Sep 09 16:24:43.627591 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:43.627570    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-tbnr4" event={"ID":"fd72319f-be1e-426b-be2d-2f205c3ff2ff","Type":"ContainerStarted","Data":"22ab50fa4703511ff927bceaf4a2f1ba9f17aef5c9f1801a20382ec809dd5388"}
Sep 09 16:24:44.296073 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:44.296041    2583 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-fddd6c88c-5lcjh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.29:15021/healthz/ready\": dial tcp 10.132.0.29:15021: connect: connection refused" start-of-body=
Sep 09 16:24:44.296479 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:44.296106    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-5lcjh" podUID="51b2b28b-cd33-4309-a1e9-a27f86a9dcfc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.29:15021/healthz/ready\": dial tcp 10.132.0.29:15021: connect: connection refused"
Sep 09 16:24:44.633814 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:44.633699    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-5lcjh" podUID="51b2b28b-cd33-4309-a1e9-a27f86a9dcfc" containerName="istio-proxy" containerID="cri-o://5415f3d5170273f79aaf3566a2321361ff0d8308e85c4e96bf71e3a3d1ff3c41" gracePeriod=30
Sep 09 16:24:46.645728 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:46.645684    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-tbnr4" event={"ID":"fd72319f-be1e-426b-be2d-2f205c3ff2ff","Type":"ContainerStarted","Data":"edfd78eeb5710a2fe060af5f45be6a6485376ad1a90b0a333540cfa21439a48a"}
Sep 09 16:24:46.646283 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:46.645799    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-tbnr4"
Sep 09 16:24:46.662835 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:46.662784    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-tbnr4" podStartSLOduration=2.402891005 podStartE2EDuration="4.662767191s" totalImagesPullingTime="2.259876186s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 16:24:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:24:46.660748914 +0000 UTC m=+669.014478770" watchObservedRunningTime="2026-09-09 16:24:46.662767191 +0000 UTC m=+669.016497018"
Sep 09 16:24:48.656888 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:48.656850    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-hkfmx" event={"ID":"57f825c6-5686-4bfa-8628-0462c34b985e","Type":"ContainerStarted","Data":"51cd2172423490d95f89f375ff70fa0104cb28c2695f5349a9f468bb64b7f6f3"}
Sep 09 16:24:48.657288 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:48.656921    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-hkfmx"
Sep 09 16:24:48.676656 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:48.676581    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-hkfmx" podStartSLOduration=2.134674084 podStartE2EDuration="6.676563264s" totalImagesPullingTime="4.54188918s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 16:24:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:24:48.676016206 +0000 UTC m=+671.029746053" watchObservedRunningTime="2026-09-09 16:24:48.676563264 +0000 UTC m=+671.030293096"
Sep 09 16:24:49.003155 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:49.003087    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-rfp6l"]
Sep 09 16:24:49.006486 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:49.006471    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rfp6l"
Sep 09 16:24:49.008934 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:49.008913    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Sep 09 16:24:49.009202 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:49.009183    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Sep 09 16:24:49.009277 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:49.009203    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-qbgwk\""
Sep 09 16:24:49.009277 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:49.009205    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Sep 09 16:24:49.018634 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:49.018613    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-rfp6l"]
Sep 09 16:24:49.032384 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:49.032360    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/858db771-fbc1-4365-abd7-7364b86f3627-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-rfp6l\" (UID: \"858db771-fbc1-4365-abd7-7364b86f3627\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rfp6l"
Sep 09 16:24:49.032460 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:49.032419    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/858db771-fbc1-4365-abd7-7364b86f3627-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-rfp6l\" (UID: \"858db771-fbc1-4365-abd7-7364b86f3627\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rfp6l"
Sep 09 16:24:49.032460 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:49.032447    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mq8rw\" (UniqueName: \"kubernetes.io/projected/858db771-fbc1-4365-abd7-7364b86f3627-kube-api-access-mq8rw\") pod \"istiod-openshift-gateway-5677ccb49b-rfp6l\" (UID: \"858db771-fbc1-4365-abd7-7364b86f3627\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rfp6l"
Sep 09 16:24:49.032549 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:49.032476    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/858db771-fbc1-4365-abd7-7364b86f3627-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-rfp6l\" (UID: \"858db771-fbc1-4365-abd7-7364b86f3627\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rfp6l"
Sep 09 16:24:49.032549 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:49.032526    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/858db771-fbc1-4365-abd7-7364b86f3627-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-rfp6l\" (UID: \"858db771-fbc1-4365-abd7-7364b86f3627\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rfp6l"
Sep 09 16:24:49.032622 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:49.032559    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/858db771-fbc1-4365-abd7-7364b86f3627-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-rfp6l\" (UID: \"858db771-fbc1-4365-abd7-7364b86f3627\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rfp6l"
Sep 09 16:24:49.032660 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:49.032637    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/858db771-fbc1-4365-abd7-7364b86f3627-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-rfp6l\" (UID: \"858db771-fbc1-4365-abd7-7364b86f3627\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rfp6l"
Sep 09 16:24:49.133249 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:49.133219    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/858db771-fbc1-4365-abd7-7364b86f3627-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-rfp6l\" (UID: \"858db771-fbc1-4365-abd7-7364b86f3627\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rfp6l"
Sep 09 16:24:49.133249 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:49.133252    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mq8rw\" (UniqueName: \"kubernetes.io/projected/858db771-fbc1-4365-abd7-7364b86f3627-kube-api-access-mq8rw\") pod \"istiod-openshift-gateway-5677ccb49b-rfp6l\" (UID: \"858db771-fbc1-4365-abd7-7364b86f3627\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rfp6l"
Sep 09 16:24:49.133412 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:49.133270    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/858db771-fbc1-4365-abd7-7364b86f3627-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-rfp6l\" (UID: \"858db771-fbc1-4365-abd7-7364b86f3627\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rfp6l"
Sep 09 16:24:49.133412 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:49.133298    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/858db771-fbc1-4365-abd7-7364b86f3627-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-rfp6l\" (UID: \"858db771-fbc1-4365-abd7-7364b86f3627\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rfp6l"
Sep 09 16:24:49.133412 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:49.133335    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/858db771-fbc1-4365-abd7-7364b86f3627-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-rfp6l\" (UID: \"858db771-fbc1-4365-abd7-7364b86f3627\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rfp6l"
Sep 09 16:24:49.133412 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:49.133393    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/858db771-fbc1-4365-abd7-7364b86f3627-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-rfp6l\" (UID: \"858db771-fbc1-4365-abd7-7364b86f3627\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rfp6l"
Sep 09 16:24:49.133617 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:49.133441    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/858db771-fbc1-4365-abd7-7364b86f3627-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-rfp6l\" (UID: \"858db771-fbc1-4365-abd7-7364b86f3627\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rfp6l"
Sep 09 16:24:49.134059 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:49.134027    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/858db771-fbc1-4365-abd7-7364b86f3627-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-rfp6l\" (UID: \"858db771-fbc1-4365-abd7-7364b86f3627\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rfp6l"
Sep 09 16:24:49.135650 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:49.135621    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/858db771-fbc1-4365-abd7-7364b86f3627-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-rfp6l\" (UID: \"858db771-fbc1-4365-abd7-7364b86f3627\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rfp6l"
Sep 09 16:24:49.135739 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:49.135687    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/858db771-fbc1-4365-abd7-7364b86f3627-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-rfp6l\" (UID: \"858db771-fbc1-4365-abd7-7364b86f3627\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rfp6l"
Sep 09 16:24:49.135841 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:49.135823    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/858db771-fbc1-4365-abd7-7364b86f3627-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-rfp6l\" (UID: \"858db771-fbc1-4365-abd7-7364b86f3627\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rfp6l"
Sep 09 16:24:49.135925 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:49.135909    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/858db771-fbc1-4365-abd7-7364b86f3627-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-rfp6l\" (UID: \"858db771-fbc1-4365-abd7-7364b86f3627\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rfp6l"
Sep 09 16:24:49.141081 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:49.141058    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mq8rw\" (UniqueName: \"kubernetes.io/projected/858db771-fbc1-4365-abd7-7364b86f3627-kube-api-access-mq8rw\") pod \"istiod-openshift-gateway-5677ccb49b-rfp6l\" (UID: \"858db771-fbc1-4365-abd7-7364b86f3627\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rfp6l"
Sep 09 16:24:49.141359 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:49.141343    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/858db771-fbc1-4365-abd7-7364b86f3627-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-rfp6l\" (UID: \"858db771-fbc1-4365-abd7-7364b86f3627\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rfp6l"
Sep 09 16:24:49.315777 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:49.315725    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rfp6l"
Sep 09 16:24:49.590706 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:49.590683    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-rfp6l"]
Sep 09 16:24:49.592764 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:24:49.592738    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod858db771_fbc1_4365_abd7_7364b86f3627.slice/crio-8239dd0fbad26c3aa5f749e02bad2c5b2562260b38702bd6f6cda48ae9777747 WatchSource:0}: Error finding container 8239dd0fbad26c3aa5f749e02bad2c5b2562260b38702bd6f6cda48ae9777747: Status 404 returned error can't find the container with id 8239dd0fbad26c3aa5f749e02bad2c5b2562260b38702bd6f6cda48ae9777747
Sep 09 16:24:49.662408 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:49.662382    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rfp6l" event={"ID":"858db771-fbc1-4365-abd7-7364b86f3627","Type":"ContainerStarted","Data":"8239dd0fbad26c3aa5f749e02bad2c5b2562260b38702bd6f6cda48ae9777747"}
Sep 09 16:24:49.868668 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:49.868643    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-5lcjh"
Sep 09 16:24:49.939341 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:49.939316    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/51b2b28b-cd33-4309-a1e9-a27f86a9dcfc-istio-data\") pod \"51b2b28b-cd33-4309-a1e9-a27f86a9dcfc\" (UID: \"51b2b28b-cd33-4309-a1e9-a27f86a9dcfc\") "
Sep 09 16:24:49.939474 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:49.939344    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/51b2b28b-cd33-4309-a1e9-a27f86a9dcfc-workload-certs\") pod \"51b2b28b-cd33-4309-a1e9-a27f86a9dcfc\" (UID: \"51b2b28b-cd33-4309-a1e9-a27f86a9dcfc\") "
Sep 09 16:24:49.939474 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:49.939361    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/51b2b28b-cd33-4309-a1e9-a27f86a9dcfc-credential-socket\") pod \"51b2b28b-cd33-4309-a1e9-a27f86a9dcfc\" (UID: \"51b2b28b-cd33-4309-a1e9-a27f86a9dcfc\") "
Sep 09 16:24:49.939474 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:49.939423    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/51b2b28b-cd33-4309-a1e9-a27f86a9dcfc-istiod-ca-cert\") pod \"51b2b28b-cd33-4309-a1e9-a27f86a9dcfc\" (UID: \"51b2b28b-cd33-4309-a1e9-a27f86a9dcfc\") "
Sep 09 16:24:49.939474 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:49.939438    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/51b2b28b-cd33-4309-a1e9-a27f86a9dcfc-istio-envoy\") pod \"51b2b28b-cd33-4309-a1e9-a27f86a9dcfc\" (UID: \"51b2b28b-cd33-4309-a1e9-a27f86a9dcfc\") "
Sep 09 16:24:49.939474 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:49.939458    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/51b2b28b-cd33-4309-a1e9-a27f86a9dcfc-istio-token\") pod \"51b2b28b-cd33-4309-a1e9-a27f86a9dcfc\" (UID: \"51b2b28b-cd33-4309-a1e9-a27f86a9dcfc\") "
Sep 09 16:24:49.939723 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:49.939480    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/51b2b28b-cd33-4309-a1e9-a27f86a9dcfc-workload-socket\") pod \"51b2b28b-cd33-4309-a1e9-a27f86a9dcfc\" (UID: \"51b2b28b-cd33-4309-a1e9-a27f86a9dcfc\") "
Sep 09 16:24:49.939723 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:49.939520    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qvp4p\" (UniqueName: \"kubernetes.io/projected/51b2b28b-cd33-4309-a1e9-a27f86a9dcfc-kube-api-access-qvp4p\") pod \"51b2b28b-cd33-4309-a1e9-a27f86a9dcfc\" (UID: \"51b2b28b-cd33-4309-a1e9-a27f86a9dcfc\") "
Sep 09 16:24:49.939723 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:49.939562    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/51b2b28b-cd33-4309-a1e9-a27f86a9dcfc-istio-podinfo\") pod \"51b2b28b-cd33-4309-a1e9-a27f86a9dcfc\" (UID: \"51b2b28b-cd33-4309-a1e9-a27f86a9dcfc\") "
Sep 09 16:24:49.939723 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:49.939604    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/51b2b28b-cd33-4309-a1e9-a27f86a9dcfc-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "51b2b28b-cd33-4309-a1e9-a27f86a9dcfc" (UID: "51b2b28b-cd33-4309-a1e9-a27f86a9dcfc"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 16:24:49.939723 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:49.939615    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/51b2b28b-cd33-4309-a1e9-a27f86a9dcfc-istio-data" (OuterVolumeSpecName: "istio-data") pod "51b2b28b-cd33-4309-a1e9-a27f86a9dcfc" (UID: "51b2b28b-cd33-4309-a1e9-a27f86a9dcfc"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 16:24:49.939951 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:49.939725    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/51b2b28b-cd33-4309-a1e9-a27f86a9dcfc-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "51b2b28b-cd33-4309-a1e9-a27f86a9dcfc" (UID: "51b2b28b-cd33-4309-a1e9-a27f86a9dcfc"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 16:24:49.939951 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:49.939844    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/51b2b28b-cd33-4309-a1e9-a27f86a9dcfc-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "51b2b28b-cd33-4309-a1e9-a27f86a9dcfc" (UID: "51b2b28b-cd33-4309-a1e9-a27f86a9dcfc"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 16:24:49.939951 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:49.939879    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/51b2b28b-cd33-4309-a1e9-a27f86a9dcfc-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "51b2b28b-cd33-4309-a1e9-a27f86a9dcfc" (UID: "51b2b28b-cd33-4309-a1e9-a27f86a9dcfc"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 16:24:49.939951 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:49.939892    2583 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/51b2b28b-cd33-4309-a1e9-a27f86a9dcfc-workload-certs\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\""
Sep 09 16:24:49.939951 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:49.939909    2583 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/51b2b28b-cd33-4309-a1e9-a27f86a9dcfc-credential-socket\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\""
Sep 09 16:24:49.939951 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:49.939920    2583 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/51b2b28b-cd33-4309-a1e9-a27f86a9dcfc-istio-data\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\""
Sep 09 16:24:49.941735 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:49.941707    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/51b2b28b-cd33-4309-a1e9-a27f86a9dcfc-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "51b2b28b-cd33-4309-a1e9-a27f86a9dcfc" (UID: "51b2b28b-cd33-4309-a1e9-a27f86a9dcfc"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 16:24:49.941847 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:49.941760    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/51b2b28b-cd33-4309-a1e9-a27f86a9dcfc-kube-api-access-qvp4p" (OuterVolumeSpecName: "kube-api-access-qvp4p") pod "51b2b28b-cd33-4309-a1e9-a27f86a9dcfc" (UID: "51b2b28b-cd33-4309-a1e9-a27f86a9dcfc"). InnerVolumeSpecName "kube-api-access-qvp4p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 16:24:49.941847 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:49.941772    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/51b2b28b-cd33-4309-a1e9-a27f86a9dcfc-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "51b2b28b-cd33-4309-a1e9-a27f86a9dcfc" (UID: "51b2b28b-cd33-4309-a1e9-a27f86a9dcfc"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 09 16:24:49.941934 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:49.941844    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/51b2b28b-cd33-4309-a1e9-a27f86a9dcfc-istio-token" (OuterVolumeSpecName: "istio-token") pod "51b2b28b-cd33-4309-a1e9-a27f86a9dcfc" (UID: "51b2b28b-cd33-4309-a1e9-a27f86a9dcfc"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 16:24:50.041100 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:50.041081    2583 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/51b2b28b-cd33-4309-a1e9-a27f86a9dcfc-istiod-ca-cert\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\""
Sep 09 16:24:50.041100 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:50.041099    2583 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/51b2b28b-cd33-4309-a1e9-a27f86a9dcfc-istio-envoy\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\""
Sep 09 16:24:50.041220 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:50.041107    2583 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/51b2b28b-cd33-4309-a1e9-a27f86a9dcfc-istio-token\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\""
Sep 09 16:24:50.041220 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:50.041114    2583 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/51b2b28b-cd33-4309-a1e9-a27f86a9dcfc-workload-socket\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\""
Sep 09 16:24:50.041220 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:50.041121    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qvp4p\" (UniqueName: \"kubernetes.io/projected/51b2b28b-cd33-4309-a1e9-a27f86a9dcfc-kube-api-access-qvp4p\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\""
Sep 09 16:24:50.041220 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:50.041130    2583 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/51b2b28b-cd33-4309-a1e9-a27f86a9dcfc-istio-podinfo\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\""
Sep 09 16:24:50.671084 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:50.671048    2583 generic.go:356] "Generic (PLEG): container finished" podID="51b2b28b-cd33-4309-a1e9-a27f86a9dcfc" containerID="5415f3d5170273f79aaf3566a2321361ff0d8308e85c4e96bf71e3a3d1ff3c41" exitCode=0
Sep 09 16:24:50.671499 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:50.671115    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-5lcjh" event={"ID":"51b2b28b-cd33-4309-a1e9-a27f86a9dcfc","Type":"ContainerDied","Data":"5415f3d5170273f79aaf3566a2321361ff0d8308e85c4e96bf71e3a3d1ff3c41"}
Sep 09 16:24:50.671499 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:50.671129    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-5lcjh"
Sep 09 16:24:50.671499 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:50.671161    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-5lcjh" event={"ID":"51b2b28b-cd33-4309-a1e9-a27f86a9dcfc","Type":"ContainerDied","Data":"6935c60e69002312d9a440dc801bc4af1ec9bf5b155cdea8ac619ea9d2434fb5"}
Sep 09 16:24:50.671499 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:50.671183    2583 scope.go:117] "RemoveContainer" containerID="5415f3d5170273f79aaf3566a2321361ff0d8308e85c4e96bf71e3a3d1ff3c41"
Sep 09 16:24:50.680757 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:50.680741    2583 scope.go:117] "RemoveContainer" containerID="5415f3d5170273f79aaf3566a2321361ff0d8308e85c4e96bf71e3a3d1ff3c41"
Sep 09 16:24:50.681089 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:24:50.681064    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5415f3d5170273f79aaf3566a2321361ff0d8308e85c4e96bf71e3a3d1ff3c41\": container with ID starting with 5415f3d5170273f79aaf3566a2321361ff0d8308e85c4e96bf71e3a3d1ff3c41 not found: ID does not exist" containerID="5415f3d5170273f79aaf3566a2321361ff0d8308e85c4e96bf71e3a3d1ff3c41"
Sep 09 16:24:50.681203 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:50.681097    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5415f3d5170273f79aaf3566a2321361ff0d8308e85c4e96bf71e3a3d1ff3c41"} err="failed to get container status \"5415f3d5170273f79aaf3566a2321361ff0d8308e85c4e96bf71e3a3d1ff3c41\": rpc error: code = NotFound desc = could not find container \"5415f3d5170273f79aaf3566a2321361ff0d8308e85c4e96bf71e3a3d1ff3c41\": container with ID starting with 5415f3d5170273f79aaf3566a2321361ff0d8308e85c4e96bf71e3a3d1ff3c41 not found: ID does not exist"
Sep 09 16:24:50.699014 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:50.698978    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-5lcjh"]
Sep 09 16:24:50.714977 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:50.714957    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-5lcjh"]
Sep 09 16:24:51.662565 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:51.662530    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 09 16:24:51.662664 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:51.662606    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 09 16:24:51.713692 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:51.713664    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:24:51.814127 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:51.814091    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:24:52.022079 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:52.021992    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:24:52.238672 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:52.238642    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="51b2b28b-cd33-4309-a1e9-a27f86a9dcfc" path="/var/lib/kubelet/pods/51b2b28b-cd33-4309-a1e9-a27f86a9dcfc/volumes"
Sep 09 16:24:52.685372 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:52.685327    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rfp6l" event={"ID":"858db771-fbc1-4365-abd7-7364b86f3627","Type":"ContainerStarted","Data":"a0c42ac1e72ccd29404410909f4e9996c991911fa738a19af5b099f7593d43cf"}
Sep 09 16:24:52.685553 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:52.685401    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rfp6l"
Sep 09 16:24:52.686978 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:52.686954    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rfp6l"
Sep 09 16:24:52.706750 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:52.706703    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rfp6l" podStartSLOduration=2.639187518 podStartE2EDuration="4.706688318s" totalImagesPullingTime="2.0675008s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 16:24:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:24:52.704878637 +0000 UTC m=+675.058608489" watchObservedRunningTime="2026-09-09 16:24:52.706688318 +0000 UTC m=+675.060418147"
Sep 09 16:24:52.964209 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:52.964129    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:24:53.039424 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:53.039396    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:24:53.166699 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:53.166675    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:24:57.654755 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:57.654725    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-tbnr4"
Sep 09 16:24:58.865084 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:58.865050    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:24:58.919504 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:58.919473    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:24:59.664806 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:24:59.664785    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-hkfmx"
Sep 09 16:25:01.166375 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:25:01.166345    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:25:01.238078 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:25:01.238054    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:25:16.042235 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:25:16.042196    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:25:43.559687 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:25:43.559654    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:25:43.659286 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:25:43.659255    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:25:56.983718 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:25:56.983684    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:25:59.770325 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:25:59.770289    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:26:01.440568 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:26:01.440540    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:26:01.576282 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:26:01.576257    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:26:03.520606 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:26:03.520569    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:26:03.621331 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:26:03.621292    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:26:03.872741 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:26:03.872698    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:26:05.557087 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:26:05.557057    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:26:07.074496 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:26:07.074462    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:26:07.820437 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:26:07.820402    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:26:09.379695 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:26:09.379660    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:26:09.607934 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:26:09.607902    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:26:13.194262 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:26:13.194222    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:26:13.268474 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:26:13.268436    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:26:13.335364 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:26:13.335309    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:26:13.528595 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:26:13.528523    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:26:16.943156 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:26:16.943126    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:26:17.041407 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:26:17.041377    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:26:17.136474 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:26:17.136445    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:26:17.235560 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:26:17.235498    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:26:25.868705 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:26:25.868673    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:26:25.950157 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:26:25.950133    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:26:28.385836 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:26:28.385808    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:26:28.483475 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:26:28.483446    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:26:29.721993 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:26:29.721955    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:26:31.558204 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:26:31.558172    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:26:32.163708 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:26:32.163683    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:26:36.386864 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:26:36.386831    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:26:36.444419 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:26:36.444389    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:26:37.240695 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:26:37.240668    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:26:37.340612 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:26:37.340584    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:26:44.751889 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:26:44.751847    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:26:44.851546 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:26:44.851487    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:26:54.651155 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:26:54.651121    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:26:55.041270 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:26:55.041182    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:27:08.638617 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:27:08.638530    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:27:08.739719 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:27:08.739685    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:27:08.798260 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:27:08.798214    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:27:09.469129 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:27:09.469091    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:27:09.535065 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:27:09.535036    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:27:23.296291 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:27:23.296249    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:27:25.368528 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:27:25.368489    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:27:25.462015 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:27:25.461967    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:27:25.844711 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:27:25.844679    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-w6cmq"]
Sep 09 16:27:25.845267 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:27:25.845251    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="51b2b28b-cd33-4309-a1e9-a27f86a9dcfc" containerName="istio-proxy"
Sep 09 16:27:25.845320 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:27:25.845271    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="51b2b28b-cd33-4309-a1e9-a27f86a9dcfc" containerName="istio-proxy"
Sep 09 16:27:25.845394 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:27:25.845381    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="51b2b28b-cd33-4309-a1e9-a27f86a9dcfc" containerName="istio-proxy"
Sep 09 16:27:25.848726 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:27:25.848703    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-w6cmq"
Sep 09 16:27:25.851318 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:27:25.851294    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 09 16:27:25.851452 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:27:25.851339    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Sep 09 16:27:25.851558 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:27:25.851451    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 09 16:27:25.852414 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:27:25.852392    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-zrs82\""
Sep 09 16:27:25.855330 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:27:25.855306    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-w6cmq"]
Sep 09 16:27:25.886815 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:27:25.886794    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:27:25.924017 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:27:25.923972    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jm7j5\" (UniqueName: \"kubernetes.io/projected/d1cbe05e-e99d-48c8-a70f-5eecb668a546-kube-api-access-jm7j5\") pod \"postgres-69fb4594cf-w6cmq\" (UID: \"d1cbe05e-e99d-48c8-a70f-5eecb668a546\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-w6cmq"
Sep 09 16:27:25.924119 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:27:25.924086    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/d1cbe05e-e99d-48c8-a70f-5eecb668a546-data\") pod \"postgres-69fb4594cf-w6cmq\" (UID: \"d1cbe05e-e99d-48c8-a70f-5eecb668a546\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-w6cmq"
Sep 09 16:27:26.025146 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:27:26.025120    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/d1cbe05e-e99d-48c8-a70f-5eecb668a546-data\") pod \"postgres-69fb4594cf-w6cmq\" (UID: \"d1cbe05e-e99d-48c8-a70f-5eecb668a546\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-w6cmq"
Sep 09 16:27:26.025253 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:27:26.025178    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jm7j5\" (UniqueName: \"kubernetes.io/projected/d1cbe05e-e99d-48c8-a70f-5eecb668a546-kube-api-access-jm7j5\") pod \"postgres-69fb4594cf-w6cmq\" (UID: \"d1cbe05e-e99d-48c8-a70f-5eecb668a546\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-w6cmq"
Sep 09 16:27:26.025446 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:27:26.025431    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/d1cbe05e-e99d-48c8-a70f-5eecb668a546-data\") pod \"postgres-69fb4594cf-w6cmq\" (UID: \"d1cbe05e-e99d-48c8-a70f-5eecb668a546\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-w6cmq"
Sep 09 16:27:26.033570 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:27:26.033546    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jm7j5\" (UniqueName: \"kubernetes.io/projected/d1cbe05e-e99d-48c8-a70f-5eecb668a546-kube-api-access-jm7j5\") pod \"postgres-69fb4594cf-w6cmq\" (UID: \"d1cbe05e-e99d-48c8-a70f-5eecb668a546\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-w6cmq"
Sep 09 16:27:26.160680 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:27:26.160623    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-w6cmq"
Sep 09 16:27:26.428768 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:27:26.428707    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-w6cmq"]
Sep 09 16:27:26.431964 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:27:26.431944    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1cbe05e_e99d_48c8_a70f_5eecb668a546.slice/crio-7095b816b9e0b04289e107ff6ac2bd24f3385977a84909242ad7fdb977407019 WatchSource:0}: Error finding container 7095b816b9e0b04289e107ff6ac2bd24f3385977a84909242ad7fdb977407019: Status 404 returned error can't find the container with id 7095b816b9e0b04289e107ff6ac2bd24f3385977a84909242ad7fdb977407019
Sep 09 16:27:27.404497 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:27:27.404457    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-w6cmq" event={"ID":"d1cbe05e-e99d-48c8-a70f-5eecb668a546","Type":"ContainerStarted","Data":"7095b816b9e0b04289e107ff6ac2bd24f3385977a84909242ad7fdb977407019"}
Sep 09 16:27:31.427555 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:27:31.427485    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-w6cmq" event={"ID":"d1cbe05e-e99d-48c8-a70f-5eecb668a546","Type":"ContainerStarted","Data":"e0751e45624a73128c8adfb070d7daacd8a293701805110605ade58057fe1084"}
Sep 09 16:27:31.427890 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:27:31.427646    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-w6cmq"
Sep 09 16:27:31.440725 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:27:31.440683    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-w6cmq" podStartSLOduration=1.738690512 podStartE2EDuration="6.440669881s" totalImagesPullingTime="4.701979369s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 16:27:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:27:31.439893375 +0000 UTC m=+833.793623231" watchObservedRunningTime="2026-09-09 16:27:31.440669881 +0000 UTC m=+833.794399740"
Sep 09 16:27:37.460738 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:27:37.460702    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-w6cmq"
Sep 09 16:27:37.787563 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:27:37.787483    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:27:37.886963 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:27:37.886933    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:27:45.424725 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:27:45.424689    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:27:45.498012 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:27:45.497965    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:27:45.551052 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:27:45.551027    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:27:45.640759 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:27:45.640732    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:27:45.644886 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:27:45.644867    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5c78477868-76mcj"]
Sep 09 16:27:45.660318 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:27:45.660300    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5c78477868-76mcj"]
Sep 09 16:27:45.660397 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:27:45.660385    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5c78477868-76mcj"
Sep 09 16:27:45.665087 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:27:45.665070    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 09 16:27:45.665183 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:27:45.665072    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 09 16:27:45.665183 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:27:45.665072    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-nm5jk\""
Sep 09 16:27:45.665183 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:27:45.665075    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 09 16:27:45.786819 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:27:45.786755    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x482v\" (UniqueName: \"kubernetes.io/projected/33da4159-33c7-4fbb-838d-cc094a12c744-kube-api-access-x482v\") pod \"maas-controller-5c78477868-76mcj\" (UID: \"33da4159-33c7-4fbb-838d-cc094a12c744\") " pod="opendatahub/maas-controller-5c78477868-76mcj"
Sep 09 16:27:45.786819 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:27:45.786796    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/33da4159-33c7-4fbb-838d-cc094a12c744-webhook-cert\") pod \"maas-controller-5c78477868-76mcj\" (UID: \"33da4159-33c7-4fbb-838d-cc094a12c744\") " pod="opendatahub/maas-controller-5c78477868-76mcj"
Sep 09 16:27:45.786944 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:27:45.786834    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/33da4159-33c7-4fbb-838d-cc094a12c744-metrics-certs\") pod \"maas-controller-5c78477868-76mcj\" (UID: \"33da4159-33c7-4fbb-838d-cc094a12c744\") " pod="opendatahub/maas-controller-5c78477868-76mcj"
Sep 09 16:27:45.887920 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:27:45.887889    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x482v\" (UniqueName: \"kubernetes.io/projected/33da4159-33c7-4fbb-838d-cc094a12c744-kube-api-access-x482v\") pod \"maas-controller-5c78477868-76mcj\" (UID: \"33da4159-33c7-4fbb-838d-cc094a12c744\") " pod="opendatahub/maas-controller-5c78477868-76mcj"
Sep 09 16:27:45.888048 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:27:45.887933    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/33da4159-33c7-4fbb-838d-cc094a12c744-webhook-cert\") pod \"maas-controller-5c78477868-76mcj\" (UID: \"33da4159-33c7-4fbb-838d-cc094a12c744\") " pod="opendatahub/maas-controller-5c78477868-76mcj"
Sep 09 16:27:45.888048 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:27:45.888014    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/33da4159-33c7-4fbb-838d-cc094a12c744-metrics-certs\") pod \"maas-controller-5c78477868-76mcj\" (UID: \"33da4159-33c7-4fbb-838d-cc094a12c744\") " pod="opendatahub/maas-controller-5c78477868-76mcj"
Sep 09 16:27:45.890087 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:27:45.890069    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/33da4159-33c7-4fbb-838d-cc094a12c744-webhook-cert\") pod \"maas-controller-5c78477868-76mcj\" (UID: \"33da4159-33c7-4fbb-838d-cc094a12c744\") " pod="opendatahub/maas-controller-5c78477868-76mcj"
Sep 09 16:27:45.890179 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:27:45.890167    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/33da4159-33c7-4fbb-838d-cc094a12c744-metrics-certs\") pod \"maas-controller-5c78477868-76mcj\" (UID: \"33da4159-33c7-4fbb-838d-cc094a12c744\") " pod="opendatahub/maas-controller-5c78477868-76mcj"
Sep 09 16:27:45.895508 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:27:45.895487    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x482v\" (UniqueName: \"kubernetes.io/projected/33da4159-33c7-4fbb-838d-cc094a12c744-kube-api-access-x482v\") pod \"maas-controller-5c78477868-76mcj\" (UID: \"33da4159-33c7-4fbb-838d-cc094a12c744\") " pod="opendatahub/maas-controller-5c78477868-76mcj"
Sep 09 16:27:45.971592 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:27:45.971570    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5c78477868-76mcj"
Sep 09 16:27:46.239683 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:27:46.239659    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5c78477868-76mcj"]
Sep 09 16:27:46.241821 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:27:46.241795    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33da4159_33c7_4fbb_838d_cc094a12c744.slice/crio-864f611cba5aaf56fb004f6b36a73b850497a6cca63a1c3b34e9caf2ce288d32 WatchSource:0}: Error finding container 864f611cba5aaf56fb004f6b36a73b850497a6cca63a1c3b34e9caf2ce288d32: Status 404 returned error can't find the container with id 864f611cba5aaf56fb004f6b36a73b850497a6cca63a1c3b34e9caf2ce288d32
Sep 09 16:27:46.498502 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:27:46.498432    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5c78477868-76mcj" event={"ID":"33da4159-33c7-4fbb-838d-cc094a12c744","Type":"ContainerStarted","Data":"864f611cba5aaf56fb004f6b36a73b850497a6cca63a1c3b34e9caf2ce288d32"}
Sep 09 16:27:48.569913 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:27:48.569881    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:27:48.669281 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:27:48.669259    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:27:49.516800 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:27:49.516745    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5c78477868-76mcj" event={"ID":"33da4159-33c7-4fbb-838d-cc094a12c744","Type":"ContainerStarted","Data":"7b2e798982f71a71e1a106810f9a357abc3d3ffbbafa37aaa4d3025ed675f72a"}
Sep 09 16:27:49.517049 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:27:49.516943    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5c78477868-76mcj"
Sep 09 16:27:49.534454 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:27:49.534407    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5c78477868-76mcj" podStartSLOduration=2.307577065 podStartE2EDuration="4.534392676s" totalImagesPullingTime="2.226815611s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 16:27:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:27:49.533591341 +0000 UTC m=+851.887321212" watchObservedRunningTime="2026-09-09 16:27:49.534392676 +0000 UTC m=+851.888122508"
Sep 09 16:27:58.231748 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:27:58.231713    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:28:00.524475 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:28:00.524439    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5c78477868-76mcj"
Sep 09 16:28:18.192706 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:28:18.192676    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:28:18.259357 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:28:18.259326    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:28:19.825585 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:28:19.825553    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:28:19.941893 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:28:19.941861    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:28:20.031001 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:28:20.030966    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:28:20.369293 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:28:20.369265    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:28:20.463559 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:28:20.463532    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:28:20.505211 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:28:20.505184    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-nwt87"]
Sep 09 16:28:20.508476 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:28:20.508460    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-nwt87"
Sep 09 16:28:20.510993 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:28:20.510961    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-mpc7z\""
Sep 09 16:28:20.511218 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:28:20.511203    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Sep 09 16:28:20.517993 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:28:20.517965    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-nwt87"]
Sep 09 16:28:20.548566 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:28:20.548544    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-k6wtl"]
Sep 09 16:28:20.551793 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:28:20.551779    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-k6wtl"
Sep 09 16:28:20.563534 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:28:20.563513    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-k6wtl"]
Sep 09 16:28:20.569793 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:28:20.569775    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/15bad01e-04b1-432d-8f0d-72b35180aece-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-nwt87\" (UID: \"15bad01e-04b1-432d-8f0d-72b35180aece\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-nwt87"
Sep 09 16:28:20.569869 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:28:20.569798    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7rj5t\" (UniqueName: \"kubernetes.io/projected/15bad01e-04b1-432d-8f0d-72b35180aece-kube-api-access-7rj5t\") pod \"payload-pre-processing-59fbc47bf8-nwt87\" (UID: \"15bad01e-04b1-432d-8f0d-72b35180aece\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-nwt87"
Sep 09 16:28:20.670820 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:28:20.670731    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/15bad01e-04b1-432d-8f0d-72b35180aece-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-nwt87\" (UID: \"15bad01e-04b1-432d-8f0d-72b35180aece\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-nwt87"
Sep 09 16:28:20.670820 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:28:20.670782    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7rj5t\" (UniqueName: \"kubernetes.io/projected/15bad01e-04b1-432d-8f0d-72b35180aece-kube-api-access-7rj5t\") pod \"payload-pre-processing-59fbc47bf8-nwt87\" (UID: \"15bad01e-04b1-432d-8f0d-72b35180aece\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-nwt87"
Sep 09 16:28:20.671037 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:28:20.670835    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-brr5z\" (UniqueName: \"kubernetes.io/projected/1670d619-612d-46e4-b6a7-f1ed8ccc0fc4-kube-api-access-brr5z\") pod \"payload-processing-5b54b7fbb7-k6wtl\" (UID: \"1670d619-612d-46e4-b6a7-f1ed8ccc0fc4\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-k6wtl"
Sep 09 16:28:20.671037 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:28:20.670918    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1670d619-612d-46e4-b6a7-f1ed8ccc0fc4-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-k6wtl\" (UID: \"1670d619-612d-46e4-b6a7-f1ed8ccc0fc4\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-k6wtl"
Sep 09 16:28:20.671493 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:28:20.671468    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/15bad01e-04b1-432d-8f0d-72b35180aece-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-nwt87\" (UID: \"15bad01e-04b1-432d-8f0d-72b35180aece\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-nwt87"
Sep 09 16:28:20.683775 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:28:20.683748    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7rj5t\" (UniqueName: \"kubernetes.io/projected/15bad01e-04b1-432d-8f0d-72b35180aece-kube-api-access-7rj5t\") pod \"payload-pre-processing-59fbc47bf8-nwt87\" (UID: \"15bad01e-04b1-432d-8f0d-72b35180aece\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-nwt87"
Sep 09 16:28:20.772380 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:28:20.772354    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-brr5z\" (UniqueName: \"kubernetes.io/projected/1670d619-612d-46e4-b6a7-f1ed8ccc0fc4-kube-api-access-brr5z\") pod \"payload-processing-5b54b7fbb7-k6wtl\" (UID: \"1670d619-612d-46e4-b6a7-f1ed8ccc0fc4\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-k6wtl"
Sep 09 16:28:20.772531 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:28:20.772500    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1670d619-612d-46e4-b6a7-f1ed8ccc0fc4-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-k6wtl\" (UID: \"1670d619-612d-46e4-b6a7-f1ed8ccc0fc4\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-k6wtl"
Sep 09 16:28:20.773347 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:28:20.773240    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1670d619-612d-46e4-b6a7-f1ed8ccc0fc4-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-k6wtl\" (UID: \"1670d619-612d-46e4-b6a7-f1ed8ccc0fc4\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-k6wtl"
Sep 09 16:28:20.779815 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:28:20.779795    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-brr5z\" (UniqueName: \"kubernetes.io/projected/1670d619-612d-46e4-b6a7-f1ed8ccc0fc4-kube-api-access-brr5z\") pod \"payload-processing-5b54b7fbb7-k6wtl\" (UID: \"1670d619-612d-46e4-b6a7-f1ed8ccc0fc4\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-k6wtl"
Sep 09 16:28:20.819095 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:28:20.819073    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-nwt87"
Sep 09 16:28:20.861730 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:28:20.861694    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-k6wtl"
Sep 09 16:28:21.091500 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:28:21.091467    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-nwt87"]
Sep 09 16:28:21.094700 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:28:21.094676    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15bad01e_04b1_432d_8f0d_72b35180aece.slice/crio-4ae5111db533fc5ee96927d9751abd1518669b422fbad38eb9facf30567d25ac WatchSource:0}: Error finding container 4ae5111db533fc5ee96927d9751abd1518669b422fbad38eb9facf30567d25ac: Status 404 returned error can't find the container with id 4ae5111db533fc5ee96927d9751abd1518669b422fbad38eb9facf30567d25ac
Sep 09 16:28:21.140021 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:28:21.139999    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-k6wtl"]
Sep 09 16:28:21.142192 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:28:21.142172    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1670d619_612d_46e4_b6a7_f1ed8ccc0fc4.slice/crio-afe724b1f64e6f638266a571d1f3efb8d7a556baf8999aa0fd6814d694790e6d WatchSource:0}: Error finding container afe724b1f64e6f638266a571d1f3efb8d7a556baf8999aa0fd6814d694790e6d: Status 404 returned error can't find the container with id afe724b1f64e6f638266a571d1f3efb8d7a556baf8999aa0fd6814d694790e6d
Sep 09 16:28:21.514332 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:28:21.514252    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:28:21.677258 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:28:21.677222    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-nwt87" event={"ID":"15bad01e-04b1-432d-8f0d-72b35180aece","Type":"ContainerStarted","Data":"4ae5111db533fc5ee96927d9751abd1518669b422fbad38eb9facf30567d25ac"}
Sep 09 16:28:21.678628 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:28:21.678601    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-k6wtl" event={"ID":"1670d619-612d-46e4-b6a7-f1ed8ccc0fc4","Type":"ContainerStarted","Data":"afe724b1f64e6f638266a571d1f3efb8d7a556baf8999aa0fd6814d694790e6d"}
Sep 09 16:28:23.691064 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:28:23.691027    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-nwt87" event={"ID":"15bad01e-04b1-432d-8f0d-72b35180aece","Type":"ContainerStarted","Data":"55b257fc326e9106bb17cb31fc0daa139c75746dad7420604692db099f896431"}
Sep 09 16:28:23.691510 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:28:23.691167    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-nwt87"
Sep 09 16:28:23.692893 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:28:23.692863    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-k6wtl" event={"ID":"1670d619-612d-46e4-b6a7-f1ed8ccc0fc4","Type":"ContainerStarted","Data":"8b38496df3b30bab0c5035d6bc5705d55d5f4dfd08b98f27846c1270ed9454c3"}
Sep 09 16:28:23.693048 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:28:23.692940    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-k6wtl"
Sep 09 16:28:23.707746 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:28:23.707702    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-nwt87" podStartSLOduration=1.280173496 podStartE2EDuration="3.707686067s" totalImagesPullingTime="2.427512571s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 16:28:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:28:23.706532812 +0000 UTC m=+886.060262665" watchObservedRunningTime="2026-09-09 16:28:23.707686067 +0000 UTC m=+886.061415901"
Sep 09 16:28:23.722765 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:28:23.722710    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5b54b7fbb7-k6wtl" podStartSLOduration=1.343150125 podStartE2EDuration="3.722694785s" totalImagesPullingTime="2.37954466s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 16:28:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:28:23.720427446 +0000 UTC m=+886.074157298" watchObservedRunningTime="2026-09-09 16:28:23.722694785 +0000 UTC m=+886.076424619"
Sep 09 16:28:31.462913 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:28:31.462837    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:28:31.527028 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:28:31.527003    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:28:34.700085 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:28:34.700049    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-k6wtl"
Sep 09 16:28:34.700718 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:28:34.700119    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-nwt87"
Sep 09 16:28:45.422184 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:28:45.422152    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:28:57.036293 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:28:57.036248    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:29:10.269116 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:29:10.269057    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:29:13.977121 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:29:13.977086    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-kjm44"]
Sep 09 16:29:13.980671 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:29:13.980652    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-kjm44"
Sep 09 16:29:13.983261 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:29:13.983205    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-x7dhn\""
Sep 09 16:29:13.983391 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:29:13.983279    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 09 16:29:13.983391 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:29:13.983332    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 09 16:29:13.983567 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:29:13.983547    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-embedding-simulated-kserve-self-signed-certs\""
Sep 09 16:29:13.989590 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:29:13.989568    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-kjm44"]
Sep 09 16:29:14.018150 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:29:14.018104    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:29:14.100466 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:29:14.100448    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/84d16051-d700-46e4-8f2b-69b1ef21e0a4-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-kjm44\" (UID: \"84d16051-d700-46e4-8f2b-69b1ef21e0a4\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-kjm44"
Sep 09 16:29:14.100576 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:29:14.100471    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/84d16051-d700-46e4-8f2b-69b1ef21e0a4-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-kjm44\" (UID: \"84d16051-d700-46e4-8f2b-69b1ef21e0a4\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-kjm44"
Sep 09 16:29:14.100576 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:29:14.100497    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/84d16051-d700-46e4-8f2b-69b1ef21e0a4-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-kjm44\" (UID: \"84d16051-d700-46e4-8f2b-69b1ef21e0a4\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-kjm44"
Sep 09 16:29:14.100576 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:29:14.100526    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/84d16051-d700-46e4-8f2b-69b1ef21e0a4-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-kjm44\" (UID: \"84d16051-d700-46e4-8f2b-69b1ef21e0a4\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-kjm44"
Sep 09 16:29:14.100678 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:29:14.100587    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ctrnv\" (UniqueName: \"kubernetes.io/projected/84d16051-d700-46e4-8f2b-69b1ef21e0a4-kube-api-access-ctrnv\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-kjm44\" (UID: \"84d16051-d700-46e4-8f2b-69b1ef21e0a4\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-kjm44"
Sep 09 16:29:14.100678 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:29:14.100636    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/84d16051-d700-46e4-8f2b-69b1ef21e0a4-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-kjm44\" (UID: \"84d16051-d700-46e4-8f2b-69b1ef21e0a4\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-kjm44"
Sep 09 16:29:14.201927 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:29:14.201902    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/84d16051-d700-46e4-8f2b-69b1ef21e0a4-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-kjm44\" (UID: \"84d16051-d700-46e4-8f2b-69b1ef21e0a4\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-kjm44"
Sep 09 16:29:14.202047 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:29:14.201931    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/84d16051-d700-46e4-8f2b-69b1ef21e0a4-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-kjm44\" (UID: \"84d16051-d700-46e4-8f2b-69b1ef21e0a4\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-kjm44"
Sep 09 16:29:14.202047 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:29:14.201960    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/84d16051-d700-46e4-8f2b-69b1ef21e0a4-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-kjm44\" (UID: \"84d16051-d700-46e4-8f2b-69b1ef21e0a4\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-kjm44"
Sep 09 16:29:14.202047 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:29:14.202012    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/84d16051-d700-46e4-8f2b-69b1ef21e0a4-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-kjm44\" (UID: \"84d16051-d700-46e4-8f2b-69b1ef21e0a4\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-kjm44"
Sep 09 16:29:14.202047 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:29:14.202035    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ctrnv\" (UniqueName: \"kubernetes.io/projected/84d16051-d700-46e4-8f2b-69b1ef21e0a4-kube-api-access-ctrnv\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-kjm44\" (UID: \"84d16051-d700-46e4-8f2b-69b1ef21e0a4\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-kjm44"
Sep 09 16:29:14.202218 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:29:14.202091    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/84d16051-d700-46e4-8f2b-69b1ef21e0a4-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-kjm44\" (UID: \"84d16051-d700-46e4-8f2b-69b1ef21e0a4\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-kjm44"
Sep 09 16:29:14.202348 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:29:14.202325    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/84d16051-d700-46e4-8f2b-69b1ef21e0a4-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-kjm44\" (UID: \"84d16051-d700-46e4-8f2b-69b1ef21e0a4\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-kjm44"
Sep 09 16:29:14.202437 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:29:14.202378    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/84d16051-d700-46e4-8f2b-69b1ef21e0a4-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-kjm44\" (UID: \"84d16051-d700-46e4-8f2b-69b1ef21e0a4\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-kjm44"
Sep 09 16:29:14.202437 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:29:14.202413    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/84d16051-d700-46e4-8f2b-69b1ef21e0a4-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-kjm44\" (UID: \"84d16051-d700-46e4-8f2b-69b1ef21e0a4\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-kjm44"
Sep 09 16:29:14.204279 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:29:14.204253    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/84d16051-d700-46e4-8f2b-69b1ef21e0a4-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-kjm44\" (UID: \"84d16051-d700-46e4-8f2b-69b1ef21e0a4\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-kjm44"
Sep 09 16:29:14.204498 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:29:14.204475    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/84d16051-d700-46e4-8f2b-69b1ef21e0a4-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-kjm44\" (UID: \"84d16051-d700-46e4-8f2b-69b1ef21e0a4\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-kjm44"
Sep 09 16:29:14.209551 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:29:14.209523    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ctrnv\" (UniqueName: \"kubernetes.io/projected/84d16051-d700-46e4-8f2b-69b1ef21e0a4-kube-api-access-ctrnv\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-kjm44\" (UID: \"84d16051-d700-46e4-8f2b-69b1ef21e0a4\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-kjm44"
Sep 09 16:29:14.293388 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:29:14.293332    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-kjm44"
Sep 09 16:29:14.560324 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:29:14.560300    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-kjm44"]
Sep 09 16:29:14.563551 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:29:14.563526    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84d16051_d700_46e4_8f2b_69b1ef21e0a4.slice/crio-5cd89dee1c8c41b1a10f0797b26f2f0e7e6bfe5b10da87ca6733f200d4c5db02 WatchSource:0}: Error finding container 5cd89dee1c8c41b1a10f0797b26f2f0e7e6bfe5b10da87ca6733f200d4c5db02: Status 404 returned error can't find the container with id 5cd89dee1c8c41b1a10f0797b26f2f0e7e6bfe5b10da87ca6733f200d4c5db02
Sep 09 16:29:14.564826 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:29:14.564810    2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 09 16:29:14.946227 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:29:14.946189    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-kjm44" event={"ID":"84d16051-d700-46e4-8f2b-69b1ef21e0a4","Type":"ContainerStarted","Data":"5cd89dee1c8c41b1a10f0797b26f2f0e7e6bfe5b10da87ca6733f200d4c5db02"}
Sep 09 16:29:15.952041 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:29:15.952003    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-kjm44" event={"ID":"84d16051-d700-46e4-8f2b-69b1ef21e0a4","Type":"ContainerStarted","Data":"d8b88dbdb059d03c61c770b1f98dec5fdd74ec4f54f5b64282b08627ff0960c6"}
Sep 09 16:29:15.968177 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:29:15.968128    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-kjm44" podStartSLOduration=2.022414934 podStartE2EDuration="2.968112802s" totalImagesPullingTime="945.697868ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 16:29:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:29:15.967061433 +0000 UTC m=+938.320791276" watchObservedRunningTime="2026-09-09 16:29:15.968112802 +0000 UTC m=+938.321842679"
Sep 09 16:29:24.293914 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:29:24.293879    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-kjm44"
Sep 09 16:29:24.294322 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:29:24.293943    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-kjm44"
Sep 09 16:29:24.305784 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:29:24.305755    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-kjm44"
Sep 09 16:29:25.004649 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:29:25.004622    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-kjm44"
Sep 09 16:29:37.418277 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:29:37.418249    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:29:45.491301 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:29:45.491268    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc99ql"]
Sep 09 16:29:45.495736 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:29:45.495714    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc99ql"
Sep 09 16:29:45.498253 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:29:45.498227    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Sep 09 16:29:45.505090 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:29:45.505065    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc99ql"]
Sep 09 16:29:45.518374 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:29:45.518356    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:29:45.660653 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:29:45.660628    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7893110f-67fc-4091-9f94-141037357086-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc99ql\" (UID: \"7893110f-67fc-4091-9f94-141037357086\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc99ql"
Sep 09 16:29:45.660756 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:29:45.660684    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l8xkh\" (UniqueName: \"kubernetes.io/projected/7893110f-67fc-4091-9f94-141037357086-kube-api-access-l8xkh\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc99ql\" (UID: \"7893110f-67fc-4091-9f94-141037357086\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc99ql"
Sep 09 16:29:45.660805 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:29:45.660753    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7893110f-67fc-4091-9f94-141037357086-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc99ql\" (UID: \"7893110f-67fc-4091-9f94-141037357086\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc99ql"
Sep 09 16:29:45.660847 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:29:45.660815    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7893110f-67fc-4091-9f94-141037357086-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc99ql\" (UID: \"7893110f-67fc-4091-9f94-141037357086\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc99ql"
Sep 09 16:29:45.660847 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:29:45.660840    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7893110f-67fc-4091-9f94-141037357086-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc99ql\" (UID: \"7893110f-67fc-4091-9f94-141037357086\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc99ql"
Sep 09 16:29:45.661027 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:29:45.660971    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7893110f-67fc-4091-9f94-141037357086-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc99ql\" (UID: \"7893110f-67fc-4091-9f94-141037357086\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc99ql"
Sep 09 16:29:45.761980 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:29:45.761912    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7893110f-67fc-4091-9f94-141037357086-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc99ql\" (UID: \"7893110f-67fc-4091-9f94-141037357086\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc99ql"
Sep 09 16:29:45.761980 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:29:45.761957    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7893110f-67fc-4091-9f94-141037357086-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc99ql\" (UID: \"7893110f-67fc-4091-9f94-141037357086\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc99ql"
Sep 09 16:29:45.762125 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:29:45.762017    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l8xkh\" (UniqueName: \"kubernetes.io/projected/7893110f-67fc-4091-9f94-141037357086-kube-api-access-l8xkh\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc99ql\" (UID: \"7893110f-67fc-4091-9f94-141037357086\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc99ql"
Sep 09 16:29:45.762125 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:29:45.762084    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7893110f-67fc-4091-9f94-141037357086-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc99ql\" (UID: \"7893110f-67fc-4091-9f94-141037357086\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc99ql"
Sep 09 16:29:45.762125 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:29:45.762120    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7893110f-67fc-4091-9f94-141037357086-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc99ql\" (UID: \"7893110f-67fc-4091-9f94-141037357086\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc99ql"
Sep 09 16:29:45.762256 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:29:45.762142    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7893110f-67fc-4091-9f94-141037357086-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc99ql\" (UID: \"7893110f-67fc-4091-9f94-141037357086\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc99ql"
Sep 09 16:29:45.762346 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:29:45.762321    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7893110f-67fc-4091-9f94-141037357086-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc99ql\" (UID: \"7893110f-67fc-4091-9f94-141037357086\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc99ql"
Sep 09 16:29:45.762401 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:29:45.762379    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7893110f-67fc-4091-9f94-141037357086-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc99ql\" (UID: \"7893110f-67fc-4091-9f94-141037357086\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc99ql"
Sep 09 16:29:45.762489 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:29:45.762470    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7893110f-67fc-4091-9f94-141037357086-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc99ql\" (UID: \"7893110f-67fc-4091-9f94-141037357086\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc99ql"
Sep 09 16:29:45.764334 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:29:45.764313    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7893110f-67fc-4091-9f94-141037357086-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc99ql\" (UID: \"7893110f-67fc-4091-9f94-141037357086\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc99ql"
Sep 09 16:29:45.764589 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:29:45.764569    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7893110f-67fc-4091-9f94-141037357086-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc99ql\" (UID: \"7893110f-67fc-4091-9f94-141037357086\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc99ql"
Sep 09 16:29:45.770343 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:29:45.770321    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l8xkh\" (UniqueName: \"kubernetes.io/projected/7893110f-67fc-4091-9f94-141037357086-kube-api-access-l8xkh\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc99ql\" (UID: \"7893110f-67fc-4091-9f94-141037357086\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc99ql"
Sep 09 16:29:45.806475 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:29:45.806457    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc99ql"
Sep 09 16:29:46.079161 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:29:46.079137    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc99ql"]
Sep 09 16:29:46.080881 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:29:46.080844    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7893110f_67fc_4091_9f94_141037357086.slice/crio-4736a1c7c7c3f9d6e3432ad03fbf5c2383e29bdc2186dfeb90fbfa2960d732f7 WatchSource:0}: Error finding container 4736a1c7c7c3f9d6e3432ad03fbf5c2383e29bdc2186dfeb90fbfa2960d732f7: Status 404 returned error can't find the container with id 4736a1c7c7c3f9d6e3432ad03fbf5c2383e29bdc2186dfeb90fbfa2960d732f7
Sep 09 16:29:46.097901 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:29:46.097866    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc99ql" event={"ID":"7893110f-67fc-4091-9f94-141037357086","Type":"ContainerStarted","Data":"4736a1c7c7c3f9d6e3432ad03fbf5c2383e29bdc2186dfeb90fbfa2960d732f7"}
Sep 09 16:29:47.105472 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:29:47.105439    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc99ql" event={"ID":"7893110f-67fc-4091-9f94-141037357086","Type":"ContainerStarted","Data":"6aaa10ae8fdfb40eff9af5696ee5b703f1f4a6c4a10a9f77eeb854a59733ed26"}
Sep 09 16:29:47.123426 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:29:47.123031    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc99ql" podStartSLOduration=1.899465491 podStartE2EDuration="2.123013937s" totalImagesPullingTime="223.548446ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 16:29:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:29:47.122790116 +0000 UTC m=+969.476519969" watchObservedRunningTime="2026-09-09 16:29:47.123013937 +0000 UTC m=+969.476743768"
Sep 09 16:29:51.810011 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:29:51.809968    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:29:55.807595 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:29:55.807552    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc99ql"
Sep 09 16:29:55.808040 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:29:55.807624    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc99ql"
Sep 09 16:29:55.819963 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:29:55.819938    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc99ql"
Sep 09 16:29:56.168775 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:29:56.168749    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc99ql"
Sep 09 16:30:00.139336 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:30:00.139293    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29816190-vrtv4"]
Sep 09 16:30:00.144013 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:30:00.143972    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29816190-vrtv4"
Sep 09 16:30:00.146922 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:30:00.146895    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jz5ff\""
Sep 09 16:30:00.149837 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:30:00.149810    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29816190-vrtv4"]
Sep 09 16:30:00.157448 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:30:00.157427    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29816190-vrtv4"
Sep 09 16:30:00.424686 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:30:00.424662    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29816190-vrtv4"]
Sep 09 16:30:00.426678 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:30:00.426651    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod518132fd_45a2_4aa8_9830_a04f7f813ac1.slice/crio-4280ddd1f6779c2be8ffc80cc063d0c2e98bc2876190509bc67476ec28f8608e WatchSource:0}: Error finding container 4280ddd1f6779c2be8ffc80cc063d0c2e98bc2876190509bc67476ec28f8608e: Status 404 returned error can't find the container with id 4280ddd1f6779c2be8ffc80cc063d0c2e98bc2876190509bc67476ec28f8608e
Sep 09 16:30:01.187579 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:30:01.187515    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29816190-vrtv4" event={"ID":"518132fd-45a2-4aa8-9830-a04f7f813ac1","Type":"ContainerStarted","Data":"4280ddd1f6779c2be8ffc80cc063d0c2e98bc2876190509bc67476ec28f8608e"}
Sep 09 16:30:03.792063 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:30:03.792031    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:30:04.213184 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:30:04.213151    2583 generic.go:356] "Generic (PLEG): container finished" podID="518132fd-45a2-4aa8-9830-a04f7f813ac1" containerID="f1c0cadffc8d00f31ab54ea0c3da0a60727265150c81fc4af3916a720d21234a" exitCode=0
Sep 09 16:30:04.213346 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:30:04.213241    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29816190-vrtv4" event={"ID":"518132fd-45a2-4aa8-9830-a04f7f813ac1","Type":"ContainerDied","Data":"f1c0cadffc8d00f31ab54ea0c3da0a60727265150c81fc4af3916a720d21234a"}
Sep 09 16:30:04.432415 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:30:04.432391    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:30:04.636414 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:30:04.636389    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:30:05.353220 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:30:05.353199    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29816190-vrtv4"
Sep 09 16:30:06.224929 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:30:06.224903    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29816190-vrtv4"
Sep 09 16:30:06.225118 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:30:06.224935    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29816190-vrtv4" event={"ID":"518132fd-45a2-4aa8-9830-a04f7f813ac1","Type":"ContainerDied","Data":"4280ddd1f6779c2be8ffc80cc063d0c2e98bc2876190509bc67476ec28f8608e"}
Sep 09 16:30:06.225118 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:30:06.224998    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4280ddd1f6779c2be8ffc80cc063d0c2e98bc2876190509bc67476ec28f8608e"
Sep 09 16:31:06.423414 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:31:06.423376    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:31:07.116604 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:31:07.116559    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:31:07.379436 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:31:07.379363    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:31:59.721997 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:31:59.721960    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:31:59.822176 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:31:59.822145    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:32:01.737388 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:32:01.737355    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:32:01.833177 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:32:01.833149    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:32:24.468188 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:32:24.468158    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:32:24.568462 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:32:24.568433    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:32:27.386667 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:32:27.386628    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:32:27.435121 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:32:27.435092    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:32:27.733210 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:32:27.733110    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:32:27.830691 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:32:27.830662    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:32:28.870569 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:32:28.870536    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:32:28.977725 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:32:28.977698    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:32:29.376406 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:32:29.376377    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:32:29.464316 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:32:29.464286    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:32:29.504379 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:32:29.504318    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-630acf-746fb75d87-8lcbj"]
Sep 09 16:32:29.504857 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:32:29.504833    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="518132fd-45a2-4aa8-9830-a04f7f813ac1" containerName="cleanup"
Sep 09 16:32:29.505021 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:32:29.504975    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="518132fd-45a2-4aa8-9830-a04f7f813ac1" containerName="cleanup"
Sep 09 16:32:29.505167 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:32:29.505153    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="518132fd-45a2-4aa8-9830-a04f7f813ac1" containerName="cleanup"
Sep 09 16:32:29.508680 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:32:29.508658    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-630acf-746fb75d87-8lcbj"
Sep 09 16:32:29.511487 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:32:29.511466    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-a-630acf-dockercfg-pq87p\""
Sep 09 16:32:29.511605 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:32:29.511540    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-a-630acf\""
Sep 09 16:32:29.520651 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:32:29.520626    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-630acf-746fb75d87-8lcbj"]
Sep 09 16:32:29.591410 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:32:29.591378    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f8aab71c-bd4c-4590-a7e2-a4eabe41f215-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-630acf-746fb75d87-8lcbj\" (UID: \"f8aab71c-bd4c-4590-a7e2-a4eabe41f215\") " pod="openshift-ingress/payload-processing-e2e-inf-a-630acf-746fb75d87-8lcbj"
Sep 09 16:32:29.591584 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:32:29.591445    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sm5sx\" (UniqueName: \"kubernetes.io/projected/f8aab71c-bd4c-4590-a7e2-a4eabe41f215-kube-api-access-sm5sx\") pod \"payload-processing-e2e-inf-a-630acf-746fb75d87-8lcbj\" (UID: \"f8aab71c-bd4c-4590-a7e2-a4eabe41f215\") " pod="openshift-ingress/payload-processing-e2e-inf-a-630acf-746fb75d87-8lcbj"
Sep 09 16:32:29.692352 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:32:29.692323    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sm5sx\" (UniqueName: \"kubernetes.io/projected/f8aab71c-bd4c-4590-a7e2-a4eabe41f215-kube-api-access-sm5sx\") pod \"payload-processing-e2e-inf-a-630acf-746fb75d87-8lcbj\" (UID: \"f8aab71c-bd4c-4590-a7e2-a4eabe41f215\") " pod="openshift-ingress/payload-processing-e2e-inf-a-630acf-746fb75d87-8lcbj"
Sep 09 16:32:29.692526 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:32:29.692451    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f8aab71c-bd4c-4590-a7e2-a4eabe41f215-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-630acf-746fb75d87-8lcbj\" (UID: \"f8aab71c-bd4c-4590-a7e2-a4eabe41f215\") " pod="openshift-ingress/payload-processing-e2e-inf-a-630acf-746fb75d87-8lcbj"
Sep 09 16:32:29.693155 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:32:29.693138    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f8aab71c-bd4c-4590-a7e2-a4eabe41f215-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-630acf-746fb75d87-8lcbj\" (UID: \"f8aab71c-bd4c-4590-a7e2-a4eabe41f215\") " pod="openshift-ingress/payload-processing-e2e-inf-a-630acf-746fb75d87-8lcbj"
Sep 09 16:32:29.699736 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:32:29.699702    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sm5sx\" (UniqueName: \"kubernetes.io/projected/f8aab71c-bd4c-4590-a7e2-a4eabe41f215-kube-api-access-sm5sx\") pod \"payload-processing-e2e-inf-a-630acf-746fb75d87-8lcbj\" (UID: \"f8aab71c-bd4c-4590-a7e2-a4eabe41f215\") " pod="openshift-ingress/payload-processing-e2e-inf-a-630acf-746fb75d87-8lcbj"
Sep 09 16:32:29.821557 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:32:29.821496    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-630acf-746fb75d87-8lcbj"
Sep 09 16:32:30.099763 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:32:30.092245    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-630acf-746fb75d87-8lcbj"]
Sep 09 16:32:30.971889 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:32:30.971840    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-630acf-746fb75d87-8lcbj" event={"ID":"f8aab71c-bd4c-4590-a7e2-a4eabe41f215","Type":"ContainerStarted","Data":"9719f63ac11ccfcf8124ff302b1783fcf85378ebf42c38e967098093b8554bcb"}
Sep 09 16:32:30.972167 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:32:30.971905    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-630acf-746fb75d87-8lcbj" event={"ID":"f8aab71c-bd4c-4590-a7e2-a4eabe41f215","Type":"ContainerStarted","Data":"6ba3cb4790944ebfed2b1ede80ed37a32d4480fcf881eabbca15c0f6e238d654"}
Sep 09 16:32:30.972167 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:32:30.972049    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-a-630acf-746fb75d87-8lcbj"
Sep 09 16:32:30.989558 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:32:30.989508    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-a-630acf-746fb75d87-8lcbj" podStartSLOduration=1.98949137 podStartE2EDuration="1.98949137s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 16:32:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:32:30.987826652 +0000 UTC m=+1133.341556508" watchObservedRunningTime="2026-09-09 16:32:30.98949137 +0000 UTC m=+1133.343221202"
Sep 09 16:32:32.578044 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:32:32.578011    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-e94c211c-openshift-default-6f595c5868-d7rtf"]
Sep 09 16:32:32.581950 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:32:32.581928    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-e94c211c-openshift-default-6f595c5868-d7rtf"
Sep 09 16:32:32.584618 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:32:32.584600    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-e94c211c-openshift-default-dockercfg-9mdbv\""
Sep 09 16:32:32.592233 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:32:32.592214    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-e94c211c-openshift-default-6f595c5868-d7rtf"]
Sep 09 16:32:32.719618 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:32:32.719582    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/818177e3-feb5-407c-b291-36e66a252425-istio-podinfo\") pod \"e2e-ait-e94c211c-openshift-default-6f595c5868-d7rtf\" (UID: \"818177e3-feb5-407c-b291-36e66a252425\") " pod="openshift-ingress/e2e-ait-e94c211c-openshift-default-6f595c5868-d7rtf"
Sep 09 16:32:32.719785 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:32:32.719627    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/818177e3-feb5-407c-b291-36e66a252425-workload-socket\") pod \"e2e-ait-e94c211c-openshift-default-6f595c5868-d7rtf\" (UID: \"818177e3-feb5-407c-b291-36e66a252425\") " pod="openshift-ingress/e2e-ait-e94c211c-openshift-default-6f595c5868-d7rtf"
Sep 09 16:32:32.719785 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:32:32.719729    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/818177e3-feb5-407c-b291-36e66a252425-workload-certs\") pod \"e2e-ait-e94c211c-openshift-default-6f595c5868-d7rtf\" (UID: \"818177e3-feb5-407c-b291-36e66a252425\") " pod="openshift-ingress/e2e-ait-e94c211c-openshift-default-6f595c5868-d7rtf"
Sep 09 16:32:32.719785 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:32:32.719770    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/818177e3-feb5-407c-b291-36e66a252425-istio-envoy\") pod \"e2e-ait-e94c211c-openshift-default-6f595c5868-d7rtf\" (UID: \"818177e3-feb5-407c-b291-36e66a252425\") " pod="openshift-ingress/e2e-ait-e94c211c-openshift-default-6f595c5868-d7rtf"
Sep 09 16:32:32.719953 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:32:32.719831    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/818177e3-feb5-407c-b291-36e66a252425-credential-socket\") pod \"e2e-ait-e94c211c-openshift-default-6f595c5868-d7rtf\" (UID: \"818177e3-feb5-407c-b291-36e66a252425\") " pod="openshift-ingress/e2e-ait-e94c211c-openshift-default-6f595c5868-d7rtf"
Sep 09 16:32:32.719953 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:32:32.719889    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/818177e3-feb5-407c-b291-36e66a252425-istio-data\") pod \"e2e-ait-e94c211c-openshift-default-6f595c5868-d7rtf\" (UID: \"818177e3-feb5-407c-b291-36e66a252425\") " pod="openshift-ingress/e2e-ait-e94c211c-openshift-default-6f595c5868-d7rtf"
Sep 09 16:32:32.720043 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:32:32.719956    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/818177e3-feb5-407c-b291-36e66a252425-istiod-ca-cert\") pod \"e2e-ait-e94c211c-openshift-default-6f595c5868-d7rtf\" (UID: \"818177e3-feb5-407c-b291-36e66a252425\") " pod="openshift-ingress/e2e-ait-e94c211c-openshift-default-6f595c5868-d7rtf"
Sep 09 16:32:32.720093 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:32:32.720081    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c7g8j\" (UniqueName: \"kubernetes.io/projected/818177e3-feb5-407c-b291-36e66a252425-kube-api-access-c7g8j\") pod \"e2e-ait-e94c211c-openshift-default-6f595c5868-d7rtf\" (UID: \"818177e3-feb5-407c-b291-36e66a252425\") " pod="openshift-ingress/e2e-ait-e94c211c-openshift-default-6f595c5868-d7rtf"
Sep 09 16:32:32.720128 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:32:32.720115    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/818177e3-feb5-407c-b291-36e66a252425-istio-token\") pod \"e2e-ait-e94c211c-openshift-default-6f595c5868-d7rtf\" (UID: \"818177e3-feb5-407c-b291-36e66a252425\") " pod="openshift-ingress/e2e-ait-e94c211c-openshift-default-6f595c5868-d7rtf"
Sep 09 16:32:32.820784 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:32:32.820757    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/818177e3-feb5-407c-b291-36e66a252425-credential-socket\") pod \"e2e-ait-e94c211c-openshift-default-6f595c5868-d7rtf\" (UID: \"818177e3-feb5-407c-b291-36e66a252425\") " pod="openshift-ingress/e2e-ait-e94c211c-openshift-default-6f595c5868-d7rtf"
Sep 09 16:32:32.820943 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:32:32.820802    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/818177e3-feb5-407c-b291-36e66a252425-istio-data\") pod \"e2e-ait-e94c211c-openshift-default-6f595c5868-d7rtf\" (UID: \"818177e3-feb5-407c-b291-36e66a252425\") " pod="openshift-ingress/e2e-ait-e94c211c-openshift-default-6f595c5868-d7rtf"
Sep 09 16:32:32.820943 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:32:32.820834    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/818177e3-feb5-407c-b291-36e66a252425-istiod-ca-cert\") pod \"e2e-ait-e94c211c-openshift-default-6f595c5868-d7rtf\" (UID: \"818177e3-feb5-407c-b291-36e66a252425\") " pod="openshift-ingress/e2e-ait-e94c211c-openshift-default-6f595c5868-d7rtf"
Sep 09 16:32:32.820943 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:32:32.820868    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c7g8j\" (UniqueName: \"kubernetes.io/projected/818177e3-feb5-407c-b291-36e66a252425-kube-api-access-c7g8j\") pod \"e2e-ait-e94c211c-openshift-default-6f595c5868-d7rtf\" (UID: \"818177e3-feb5-407c-b291-36e66a252425\") " pod="openshift-ingress/e2e-ait-e94c211c-openshift-default-6f595c5868-d7rtf"
Sep 09 16:32:32.820943 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:32:32.820909    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/818177e3-feb5-407c-b291-36e66a252425-istio-token\") pod \"e2e-ait-e94c211c-openshift-default-6f595c5868-d7rtf\" (UID: \"818177e3-feb5-407c-b291-36e66a252425\") " pod="openshift-ingress/e2e-ait-e94c211c-openshift-default-6f595c5868-d7rtf"
Sep 09 16:32:32.820943 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:32:32.820939    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/818177e3-feb5-407c-b291-36e66a252425-istio-podinfo\") pod \"e2e-ait-e94c211c-openshift-default-6f595c5868-d7rtf\" (UID: \"818177e3-feb5-407c-b291-36e66a252425\") " pod="openshift-ingress/e2e-ait-e94c211c-openshift-default-6f595c5868-d7rtf"
Sep 09 16:32:32.821304 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:32:32.820962    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/818177e3-feb5-407c-b291-36e66a252425-workload-socket\") pod \"e2e-ait-e94c211c-openshift-default-6f595c5868-d7rtf\" (UID: \"818177e3-feb5-407c-b291-36e66a252425\") " pod="openshift-ingress/e2e-ait-e94c211c-openshift-default-6f595c5868-d7rtf"
Sep 09 16:32:32.821304 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:32:32.821041    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/818177e3-feb5-407c-b291-36e66a252425-workload-certs\") pod \"e2e-ait-e94c211c-openshift-default-6f595c5868-d7rtf\" (UID: \"818177e3-feb5-407c-b291-36e66a252425\") " pod="openshift-ingress/e2e-ait-e94c211c-openshift-default-6f595c5868-d7rtf"
Sep 09 16:32:32.821304 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:32:32.821069    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/818177e3-feb5-407c-b291-36e66a252425-istio-envoy\") pod \"e2e-ait-e94c211c-openshift-default-6f595c5868-d7rtf\" (UID: \"818177e3-feb5-407c-b291-36e66a252425\") " pod="openshift-ingress/e2e-ait-e94c211c-openshift-default-6f595c5868-d7rtf"
Sep 09 16:32:32.821451 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:32:32.821357    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/818177e3-feb5-407c-b291-36e66a252425-istio-data\") pod \"e2e-ait-e94c211c-openshift-default-6f595c5868-d7rtf\" (UID: \"818177e3-feb5-407c-b291-36e66a252425\") " pod="openshift-ingress/e2e-ait-e94c211c-openshift-default-6f595c5868-d7rtf"
Sep 09 16:32:32.821780 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:32:32.821759    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/818177e3-feb5-407c-b291-36e66a252425-istiod-ca-cert\") pod \"e2e-ait-e94c211c-openshift-default-6f595c5868-d7rtf\" (UID: \"818177e3-feb5-407c-b291-36e66a252425\") " pod="openshift-ingress/e2e-ait-e94c211c-openshift-default-6f595c5868-d7rtf"
Sep 09 16:32:32.821970 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:32:32.821948    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/818177e3-feb5-407c-b291-36e66a252425-workload-certs\") pod \"e2e-ait-e94c211c-openshift-default-6f595c5868-d7rtf\" (UID: \"818177e3-feb5-407c-b291-36e66a252425\") " pod="openshift-ingress/e2e-ait-e94c211c-openshift-default-6f595c5868-d7rtf"
Sep 09 16:32:32.822064 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:32:32.822015    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/818177e3-feb5-407c-b291-36e66a252425-credential-socket\") pod \"e2e-ait-e94c211c-openshift-default-6f595c5868-d7rtf\" (UID: \"818177e3-feb5-407c-b291-36e66a252425\") " pod="openshift-ingress/e2e-ait-e94c211c-openshift-default-6f595c5868-d7rtf"
Sep 09 16:32:32.822064 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:32:32.822042    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/818177e3-feb5-407c-b291-36e66a252425-workload-socket\") pod \"e2e-ait-e94c211c-openshift-default-6f595c5868-d7rtf\" (UID: \"818177e3-feb5-407c-b291-36e66a252425\") " pod="openshift-ingress/e2e-ait-e94c211c-openshift-default-6f595c5868-d7rtf"
Sep 09 16:32:32.823351 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:32:32.823321    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/818177e3-feb5-407c-b291-36e66a252425-istio-envoy\") pod \"e2e-ait-e94c211c-openshift-default-6f595c5868-d7rtf\" (UID: \"818177e3-feb5-407c-b291-36e66a252425\") " pod="openshift-ingress/e2e-ait-e94c211c-openshift-default-6f595c5868-d7rtf"
Sep 09 16:32:32.823627 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:32:32.823607    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/818177e3-feb5-407c-b291-36e66a252425-istio-podinfo\") pod \"e2e-ait-e94c211c-openshift-default-6f595c5868-d7rtf\" (UID: \"818177e3-feb5-407c-b291-36e66a252425\") " pod="openshift-ingress/e2e-ait-e94c211c-openshift-default-6f595c5868-d7rtf"
Sep 09 16:32:32.831890 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:32:32.831834    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/818177e3-feb5-407c-b291-36e66a252425-istio-token\") pod \"e2e-ait-e94c211c-openshift-default-6f595c5868-d7rtf\" (UID: \"818177e3-feb5-407c-b291-36e66a252425\") " pod="openshift-ingress/e2e-ait-e94c211c-openshift-default-6f595c5868-d7rtf"
Sep 09 16:32:32.832524 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:32:32.832416    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c7g8j\" (UniqueName: \"kubernetes.io/projected/818177e3-feb5-407c-b291-36e66a252425-kube-api-access-c7g8j\") pod \"e2e-ait-e94c211c-openshift-default-6f595c5868-d7rtf\" (UID: \"818177e3-feb5-407c-b291-36e66a252425\") " pod="openshift-ingress/e2e-ait-e94c211c-openshift-default-6f595c5868-d7rtf"
Sep 09 16:32:32.894287 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:32:32.894267    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-e94c211c-openshift-default-6f595c5868-d7rtf"
Sep 09 16:32:33.171335 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:32:33.171312    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-e94c211c-openshift-default-6f595c5868-d7rtf"]
Sep 09 16:32:33.173265 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:32:33.173241    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod818177e3_feb5_407c_b291_36e66a252425.slice/crio-745a07c5d05ffa380ac283cb700267caf07717e7204bec72fa39cc3e191823fb WatchSource:0}: Error finding container 745a07c5d05ffa380ac283cb700267caf07717e7204bec72fa39cc3e191823fb: Status 404 returned error can't find the container with id 745a07c5d05ffa380ac283cb700267caf07717e7204bec72fa39cc3e191823fb
Sep 09 16:32:33.175325 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:32:33.175298    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 09 16:32:33.175389 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:32:33.175354    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 09 16:32:33.175423 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:32:33.175390    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 09 16:32:33.992749 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:32:33.992709    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e94c211c-openshift-default-6f595c5868-d7rtf" event={"ID":"818177e3-feb5-407c-b291-36e66a252425","Type":"ContainerStarted","Data":"a6fd943a2155f9ac4602895e6c0765d9558b19ece38691e27717d0252a14a961"}
Sep 09 16:32:33.993200 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:32:33.992769    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e94c211c-openshift-default-6f595c5868-d7rtf" event={"ID":"818177e3-feb5-407c-b291-36e66a252425","Type":"ContainerStarted","Data":"745a07c5d05ffa380ac283cb700267caf07717e7204bec72fa39cc3e191823fb"}
Sep 09 16:32:34.016281 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:32:34.016226    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-e94c211c-openshift-default-6f595c5868-d7rtf" podStartSLOduration=2.016206126 podStartE2EDuration="2.016206126s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 16:32:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:32:34.014511317 +0000 UTC m=+1136.368241168" watchObservedRunningTime="2026-09-09 16:32:34.016206126 +0000 UTC m=+1136.369936019"
Sep 09 16:32:34.312555 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:32:34.312479    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:32:34.414078 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:32:34.414048    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:32:34.739442 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:32:34.739414    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:32:34.894790 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:32:34.894757    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-e94c211c-openshift-default-6f595c5868-d7rtf"
Sep 09 16:32:34.899600 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:32:34.899575    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-e94c211c-openshift-default-6f595c5868-d7rtf"
Sep 09 16:32:34.997909 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:32:34.997833    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-e94c211c-openshift-default-6f595c5868-d7rtf"
Sep 09 16:32:34.999448 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:32:34.999429    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-e94c211c-openshift-default-6f595c5868-d7rtf"
Sep 09 16:32:35.665548 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:32:35.665505    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:32:35.764937 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:32:35.764891    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:32:36.784744 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:32:36.784716    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:32:36.989064 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:32:36.989035    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:32:39.252376 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:32:39.252335    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:32:39.330240 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:32:39.330212    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:32:39.398242 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:32:39.398212    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:32:39.463148 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:32:39.463122    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:32:39.963087 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:32:39.963058    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:32:40.106872 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:32:40.106841    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-05e496-c677877f5-j7rtm"]
Sep 09 16:32:40.108365 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:32:40.108339    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:32:40.110529 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:32:40.110511    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-05e496-c677877f5-j7rtm"
Sep 09 16:32:40.113184 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:32:40.113163    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-autores-05e496-dockercfg-8qv5w\""
Sep 09 16:32:40.113284 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:32:40.113165    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-autores-05e496\""
Sep 09 16:32:40.120442 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:32:40.120421    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-05e496-c677877f5-j7rtm"]
Sep 09 16:32:40.297224 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:32:40.297146    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5wzqx\" (UniqueName: \"kubernetes.io/projected/585601a2-357d-41bd-8e51-b1553fe3dbf4-kube-api-access-5wzqx\") pod \"payload-processing-e2e-autores-05e496-c677877f5-j7rtm\" (UID: \"585601a2-357d-41bd-8e51-b1553fe3dbf4\") " pod="openshift-ingress/payload-processing-e2e-autores-05e496-c677877f5-j7rtm"
Sep 09 16:32:40.297224 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:32:40.297209    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/585601a2-357d-41bd-8e51-b1553fe3dbf4-plugins-config-volume\") pod \"payload-processing-e2e-autores-05e496-c677877f5-j7rtm\" (UID: \"585601a2-357d-41bd-8e51-b1553fe3dbf4\") " pod="openshift-ingress/payload-processing-e2e-autores-05e496-c677877f5-j7rtm"
Sep 09 16:32:40.333107 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:32:40.333081    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:32:40.398024 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:32:40.397978    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/585601a2-357d-41bd-8e51-b1553fe3dbf4-plugins-config-volume\") pod \"payload-processing-e2e-autores-05e496-c677877f5-j7rtm\" (UID: \"585601a2-357d-41bd-8e51-b1553fe3dbf4\") " pod="openshift-ingress/payload-processing-e2e-autores-05e496-c677877f5-j7rtm"
Sep 09 16:32:40.398146 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:32:40.398097    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5wzqx\" (UniqueName: \"kubernetes.io/projected/585601a2-357d-41bd-8e51-b1553fe3dbf4-kube-api-access-5wzqx\") pod \"payload-processing-e2e-autores-05e496-c677877f5-j7rtm\" (UID: \"585601a2-357d-41bd-8e51-b1553fe3dbf4\") " pod="openshift-ingress/payload-processing-e2e-autores-05e496-c677877f5-j7rtm"
Sep 09 16:32:40.398698 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:32:40.398675    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/585601a2-357d-41bd-8e51-b1553fe3dbf4-plugins-config-volume\") pod \"payload-processing-e2e-autores-05e496-c677877f5-j7rtm\" (UID: \"585601a2-357d-41bd-8e51-b1553fe3dbf4\") " pod="openshift-ingress/payload-processing-e2e-autores-05e496-c677877f5-j7rtm"
Sep 09 16:32:40.405891 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:32:40.405833    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5wzqx\" (UniqueName: \"kubernetes.io/projected/585601a2-357d-41bd-8e51-b1553fe3dbf4-kube-api-access-5wzqx\") pod \"payload-processing-e2e-autores-05e496-c677877f5-j7rtm\" (UID: \"585601a2-357d-41bd-8e51-b1553fe3dbf4\") " pod="openshift-ingress/payload-processing-e2e-autores-05e496-c677877f5-j7rtm"
Sep 09 16:32:40.421614 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:32:40.421592    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-05e496-c677877f5-j7rtm"
Sep 09 16:32:40.434747 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:32:40.434721    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:32:40.690066 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:32:40.690040    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-05e496-c677877f5-j7rtm"]
Sep 09 16:32:40.692293 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:32:40.692268    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod585601a2_357d_41bd_8e51_b1553fe3dbf4.slice/crio-cdf5ec4fb4d352ee661a0956e9de3a95696a65eb90817725d679eb10f02770ef WatchSource:0}: Error finding container cdf5ec4fb4d352ee661a0956e9de3a95696a65eb90817725d679eb10f02770ef: Status 404 returned error can't find the container with id cdf5ec4fb4d352ee661a0956e9de3a95696a65eb90817725d679eb10f02770ef
Sep 09 16:32:41.029454 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:32:41.029379    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-05e496-c677877f5-j7rtm" event={"ID":"585601a2-357d-41bd-8e51-b1553fe3dbf4","Type":"ContainerStarted","Data":"13454406534b760589f4cacd45b40c57732cfb047263e20a2167023c137f01ad"}
Sep 09 16:32:41.029586 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:32:41.029475    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-05e496-c677877f5-j7rtm" event={"ID":"585601a2-357d-41bd-8e51-b1553fe3dbf4","Type":"ContainerStarted","Data":"cdf5ec4fb4d352ee661a0956e9de3a95696a65eb90817725d679eb10f02770ef"}
Sep 09 16:32:41.029586 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:32:41.029506    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-autores-05e496-c677877f5-j7rtm"
Sep 09 16:32:41.047833 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:32:41.047780    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-autores-05e496-c677877f5-j7rtm" podStartSLOduration=1.047761668 podStartE2EDuration="1.047761668s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 16:32:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:32:41.045701399 +0000 UTC m=+1143.399431253" watchObservedRunningTime="2026-09-09 16:32:41.047761668 +0000 UTC m=+1143.401491503"
Sep 09 16:32:41.062321 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:32:41.062288    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:32:41.981420 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:32:41.981393    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-a-630acf-746fb75d87-8lcbj"
Sep 09 16:32:43.877446 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:32:43.877418    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:32:43.986313 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:32:43.986270    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:32:44.083568 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:32:44.083538    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:32:44.183353 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:32:44.183278    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:32:46.978574 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:32:46.978534    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:32:49.675159 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:32:49.675121    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:32:49.894898 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:32:49.894867    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:32:49.995818 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:32:49.995688    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:32:50.112228 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:32:50.112196    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:32:50.279771 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:32:50.279698    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:32:52.037269 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:32:52.037235    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-autores-05e496-c677877f5-j7rtm"
Sep 09 16:32:53.185704 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:32:53.185624    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:32:53.286651 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:32:53.286618    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:32:53.366556 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:32:53.366527    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-34141f-openshift-default-75c8656694-8p8mp"]
Sep 09 16:32:53.371296 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:32:53.371276    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-34141f-openshift-default-75c8656694-8p8mp"
Sep 09 16:32:53.374203 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:32:53.373903    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-34141f-openshift-default-dockercfg-xsvcx\""
Sep 09 16:32:53.381394 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:32:53.381350    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-34141f-openshift-default-75c8656694-8p8mp"]
Sep 09 16:32:53.393159 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:32:53.393138    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:32:53.421068 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:32:53.421040    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/28222823-dc46-49c7-b949-b76951d639dc-istio-data\") pod \"e2e-inf-b-34141f-openshift-default-75c8656694-8p8mp\" (UID: \"28222823-dc46-49c7-b949-b76951d639dc\") " pod="openshift-ingress/e2e-inf-b-34141f-openshift-default-75c8656694-8p8mp"
Sep 09 16:32:53.421186 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:32:53.421080    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/28222823-dc46-49c7-b949-b76951d639dc-istio-token\") pod \"e2e-inf-b-34141f-openshift-default-75c8656694-8p8mp\" (UID: \"28222823-dc46-49c7-b949-b76951d639dc\") " pod="openshift-ingress/e2e-inf-b-34141f-openshift-default-75c8656694-8p8mp"
Sep 09 16:32:53.421247 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:32:53.421184    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/28222823-dc46-49c7-b949-b76951d639dc-workload-certs\") pod \"e2e-inf-b-34141f-openshift-default-75c8656694-8p8mp\" (UID: \"28222823-dc46-49c7-b949-b76951d639dc\") " pod="openshift-ingress/e2e-inf-b-34141f-openshift-default-75c8656694-8p8mp"
Sep 09 16:32:53.421247 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:32:53.421235    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/28222823-dc46-49c7-b949-b76951d639dc-credential-socket\") pod \"e2e-inf-b-34141f-openshift-default-75c8656694-8p8mp\" (UID: \"28222823-dc46-49c7-b949-b76951d639dc\") " pod="openshift-ingress/e2e-inf-b-34141f-openshift-default-75c8656694-8p8mp"
Sep 09 16:32:53.421349 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:32:53.421332    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hmjq5\" (UniqueName: \"kubernetes.io/projected/28222823-dc46-49c7-b949-b76951d639dc-kube-api-access-hmjq5\") pod \"e2e-inf-b-34141f-openshift-default-75c8656694-8p8mp\" (UID: \"28222823-dc46-49c7-b949-b76951d639dc\") " pod="openshift-ingress/e2e-inf-b-34141f-openshift-default-75c8656694-8p8mp"
Sep 09 16:32:53.421402 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:32:53.421363    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/28222823-dc46-49c7-b949-b76951d639dc-istiod-ca-cert\") pod \"e2e-inf-b-34141f-openshift-default-75c8656694-8p8mp\" (UID: \"28222823-dc46-49c7-b949-b76951d639dc\") " pod="openshift-ingress/e2e-inf-b-34141f-openshift-default-75c8656694-8p8mp"
Sep 09 16:32:53.421446 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:32:53.421404    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/28222823-dc46-49c7-b949-b76951d639dc-istio-podinfo\") pod \"e2e-inf-b-34141f-openshift-default-75c8656694-8p8mp\" (UID: \"28222823-dc46-49c7-b949-b76951d639dc\") " pod="openshift-ingress/e2e-inf-b-34141f-openshift-default-75c8656694-8p8mp"
Sep 09 16:32:53.421493 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:32:53.421446    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/28222823-dc46-49c7-b949-b76951d639dc-istio-envoy\") pod \"e2e-inf-b-34141f-openshift-default-75c8656694-8p8mp\" (UID: \"28222823-dc46-49c7-b949-b76951d639dc\") " pod="openshift-ingress/e2e-inf-b-34141f-openshift-default-75c8656694-8p8mp"
Sep 09 16:32:53.421493 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:32:53.421482    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/28222823-dc46-49c7-b949-b76951d639dc-workload-socket\") pod \"e2e-inf-b-34141f-openshift-default-75c8656694-8p8mp\" (UID: \"28222823-dc46-49c7-b949-b76951d639dc\") " pod="openshift-ingress/e2e-inf-b-34141f-openshift-default-75c8656694-8p8mp"
Sep 09 16:32:53.522574 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:32:53.522500    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hmjq5\" (UniqueName: \"kubernetes.io/projected/28222823-dc46-49c7-b949-b76951d639dc-kube-api-access-hmjq5\") pod \"e2e-inf-b-34141f-openshift-default-75c8656694-8p8mp\" (UID: \"28222823-dc46-49c7-b949-b76951d639dc\") " pod="openshift-ingress/e2e-inf-b-34141f-openshift-default-75c8656694-8p8mp"
Sep 09 16:32:53.522574 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:32:53.522537    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/28222823-dc46-49c7-b949-b76951d639dc-istiod-ca-cert\") pod \"e2e-inf-b-34141f-openshift-default-75c8656694-8p8mp\" (UID: \"28222823-dc46-49c7-b949-b76951d639dc\") " pod="openshift-ingress/e2e-inf-b-34141f-openshift-default-75c8656694-8p8mp"
Sep 09 16:32:53.522574 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:32:53.522565    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/28222823-dc46-49c7-b949-b76951d639dc-istio-podinfo\") pod \"e2e-inf-b-34141f-openshift-default-75c8656694-8p8mp\" (UID: \"28222823-dc46-49c7-b949-b76951d639dc\") " pod="openshift-ingress/e2e-inf-b-34141f-openshift-default-75c8656694-8p8mp"
Sep 09 16:32:53.522818 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:32:53.522589    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/28222823-dc46-49c7-b949-b76951d639dc-istio-envoy\") pod \"e2e-inf-b-34141f-openshift-default-75c8656694-8p8mp\" (UID: \"28222823-dc46-49c7-b949-b76951d639dc\") " pod="openshift-ingress/e2e-inf-b-34141f-openshift-default-75c8656694-8p8mp"
Sep 09 16:32:53.522818 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:32:53.522634    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/28222823-dc46-49c7-b949-b76951d639dc-workload-socket\") pod \"e2e-inf-b-34141f-openshift-default-75c8656694-8p8mp\" (UID: \"28222823-dc46-49c7-b949-b76951d639dc\") " pod="openshift-ingress/e2e-inf-b-34141f-openshift-default-75c8656694-8p8mp"
Sep 09 16:32:53.522818 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:32:53.522657    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/28222823-dc46-49c7-b949-b76951d639dc-istio-data\") pod \"e2e-inf-b-34141f-openshift-default-75c8656694-8p8mp\" (UID: \"28222823-dc46-49c7-b949-b76951d639dc\") " pod="openshift-ingress/e2e-inf-b-34141f-openshift-default-75c8656694-8p8mp"
Sep 09 16:32:53.522818 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:32:53.522683    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/28222823-dc46-49c7-b949-b76951d639dc-istio-token\") pod \"e2e-inf-b-34141f-openshift-default-75c8656694-8p8mp\" (UID: \"28222823-dc46-49c7-b949-b76951d639dc\") " pod="openshift-ingress/e2e-inf-b-34141f-openshift-default-75c8656694-8p8mp"
Sep 09 16:32:53.522818 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:32:53.522735    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/28222823-dc46-49c7-b949-b76951d639dc-workload-certs\") pod \"e2e-inf-b-34141f-openshift-default-75c8656694-8p8mp\" (UID: \"28222823-dc46-49c7-b949-b76951d639dc\") " pod="openshift-ingress/e2e-inf-b-34141f-openshift-default-75c8656694-8p8mp"
Sep 09 16:32:53.522818 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:32:53.522766    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/28222823-dc46-49c7-b949-b76951d639dc-credential-socket\") pod \"e2e-inf-b-34141f-openshift-default-75c8656694-8p8mp\" (UID: \"28222823-dc46-49c7-b949-b76951d639dc\") " pod="openshift-ingress/e2e-inf-b-34141f-openshift-default-75c8656694-8p8mp"
Sep 09 16:32:53.523284 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:32:53.523236    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/28222823-dc46-49c7-b949-b76951d639dc-istiod-ca-cert\") pod \"e2e-inf-b-34141f-openshift-default-75c8656694-8p8mp\" (UID: \"28222823-dc46-49c7-b949-b76951d639dc\") " pod="openshift-ingress/e2e-inf-b-34141f-openshift-default-75c8656694-8p8mp"
Sep 09 16:32:53.523405 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:32:53.523321    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/28222823-dc46-49c7-b949-b76951d639dc-istio-data\") pod \"e2e-inf-b-34141f-openshift-default-75c8656694-8p8mp\" (UID: \"28222823-dc46-49c7-b949-b76951d639dc\") " pod="openshift-ingress/e2e-inf-b-34141f-openshift-default-75c8656694-8p8mp"
Sep 09 16:32:53.523464 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:32:53.523413    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/28222823-dc46-49c7-b949-b76951d639dc-workload-socket\") pod \"e2e-inf-b-34141f-openshift-default-75c8656694-8p8mp\" (UID: \"28222823-dc46-49c7-b949-b76951d639dc\") " pod="openshift-ingress/e2e-inf-b-34141f-openshift-default-75c8656694-8p8mp"
Sep 09 16:32:53.523535 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:32:53.523475    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/28222823-dc46-49c7-b949-b76951d639dc-workload-certs\") pod \"e2e-inf-b-34141f-openshift-default-75c8656694-8p8mp\" (UID: \"28222823-dc46-49c7-b949-b76951d639dc\") " pod="openshift-ingress/e2e-inf-b-34141f-openshift-default-75c8656694-8p8mp"
Sep 09 16:32:53.523535 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:32:53.523513    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/28222823-dc46-49c7-b949-b76951d639dc-credential-socket\") pod \"e2e-inf-b-34141f-openshift-default-75c8656694-8p8mp\" (UID: \"28222823-dc46-49c7-b949-b76951d639dc\") " pod="openshift-ingress/e2e-inf-b-34141f-openshift-default-75c8656694-8p8mp"
Sep 09 16:32:53.525314 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:32:53.525287    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/28222823-dc46-49c7-b949-b76951d639dc-istio-envoy\") pod \"e2e-inf-b-34141f-openshift-default-75c8656694-8p8mp\" (UID: \"28222823-dc46-49c7-b949-b76951d639dc\") " pod="openshift-ingress/e2e-inf-b-34141f-openshift-default-75c8656694-8p8mp"
Sep 09 16:32:53.525411 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:32:53.525334    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/28222823-dc46-49c7-b949-b76951d639dc-istio-podinfo\") pod \"e2e-inf-b-34141f-openshift-default-75c8656694-8p8mp\" (UID: \"28222823-dc46-49c7-b949-b76951d639dc\") " pod="openshift-ingress/e2e-inf-b-34141f-openshift-default-75c8656694-8p8mp"
Sep 09 16:32:53.532845 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:32:53.532824    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/28222823-dc46-49c7-b949-b76951d639dc-istio-token\") pod \"e2e-inf-b-34141f-openshift-default-75c8656694-8p8mp\" (UID: \"28222823-dc46-49c7-b949-b76951d639dc\") " pod="openshift-ingress/e2e-inf-b-34141f-openshift-default-75c8656694-8p8mp"
Sep 09 16:32:53.533035 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:32:53.532967    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hmjq5\" (UniqueName: \"kubernetes.io/projected/28222823-dc46-49c7-b949-b76951d639dc-kube-api-access-hmjq5\") pod \"e2e-inf-b-34141f-openshift-default-75c8656694-8p8mp\" (UID: \"28222823-dc46-49c7-b949-b76951d639dc\") " pod="openshift-ingress/e2e-inf-b-34141f-openshift-default-75c8656694-8p8mp"
Sep 09 16:32:53.683256 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:32:53.683225    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-34141f-openshift-default-75c8656694-8p8mp"
Sep 09 16:32:53.769257 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:32:53.769227    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:32:53.965822 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:32:53.965789    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-34141f-openshift-default-75c8656694-8p8mp"]
Sep 09 16:32:53.967400 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:32:53.967371    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28222823_dc46_49c7_b949_b76951d639dc.slice/crio-3a45e95e9e668f80fafc3f583c6517cf29fb34494a2dea21518685ff84ad0fef WatchSource:0}: Error finding container 3a45e95e9e668f80fafc3f583c6517cf29fb34494a2dea21518685ff84ad0fef: Status 404 returned error can't find the container with id 3a45e95e9e668f80fafc3f583c6517cf29fb34494a2dea21518685ff84ad0fef
Sep 09 16:32:53.969713 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:32:53.969672    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 09 16:32:53.969792 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:32:53.969763    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 09 16:32:53.969832 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:32:53.969805    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 09 16:32:54.059383 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:32:54.059355    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:32:54.101723 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:32:54.101673    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-34141f-openshift-default-75c8656694-8p8mp" event={"ID":"28222823-dc46-49c7-b949-b76951d639dc","Type":"ContainerStarted","Data":"52b9c91504e148be2476c06fb8f3c708e55a768e928bd3f67015963c13bda1ce"}
Sep 09 16:32:54.101881 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:32:54.101749    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-34141f-openshift-default-75c8656694-8p8mp" event={"ID":"28222823-dc46-49c7-b949-b76951d639dc","Type":"ContainerStarted","Data":"3a45e95e9e668f80fafc3f583c6517cf29fb34494a2dea21518685ff84ad0fef"}
Sep 09 16:32:54.124322 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:32:54.124265    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-34141f-openshift-default-75c8656694-8p8mp" podStartSLOduration=1.124243817 podStartE2EDuration="1.124243817s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 16:32:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:32:54.122576088 +0000 UTC m=+1156.476305921" watchObservedRunningTime="2026-09-09 16:32:54.124243817 +0000 UTC m=+1156.477973651"
Sep 09 16:32:54.459260 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:32:54.459230    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:32:54.684100 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:32:54.684068    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-34141f-openshift-default-75c8656694-8p8mp"
Sep 09 16:32:55.109183 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:32:55.109158    2583 generic.go:356] "Generic (PLEG): container finished" podID="818177e3-feb5-407c-b291-36e66a252425" containerID="a6fd943a2155f9ac4602895e6c0765d9558b19ece38691e27717d0252a14a961" exitCode=0
Sep 09 16:32:55.109342 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:32:55.109235    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e94c211c-openshift-default-6f595c5868-d7rtf" event={"ID":"818177e3-feb5-407c-b291-36e66a252425","Type":"ContainerDied","Data":"a6fd943a2155f9ac4602895e6c0765d9558b19ece38691e27717d0252a14a961"}
Sep 09 16:32:55.109830 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:32:55.109812    2583 scope.go:117] "RemoveContainer" containerID="a6fd943a2155f9ac4602895e6c0765d9558b19ece38691e27717d0252a14a961"
Sep 09 16:32:55.110922 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:32:55.110896    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 09 16:32:55.111111 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:32:55.110976    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 09 16:32:55.111111 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:32:55.111044    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 09 16:32:55.286354 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:32:55.286237    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:32:55.697456 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:32:55.691180    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-34141f-openshift-default-75c8656694-8p8mp"
Sep 09 16:32:56.118703 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:32:56.118664    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e94c211c-openshift-default-6f595c5868-d7rtf" event={"ID":"818177e3-feb5-407c-b291-36e66a252425","Type":"ContainerStarted","Data":"e99ad80ca689fe19304ef11c907914e9d568434c6af0143c0e03f6c27e74ce10"}
Sep 09 16:32:56.118890 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:32:56.118862    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-34141f-openshift-default-75c8656694-8p8mp"
Sep 09 16:32:56.120079 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:32:56.120059    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-34141f-openshift-default-75c8656694-8p8mp"
Sep 09 16:32:56.229927 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:32:56.229890    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:32:56.895365 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:32:56.895328    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-e94c211c-openshift-default-6f595c5868-d7rtf"
Sep 09 16:32:56.895834 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:32:56.895444    2583 patch_prober.go:28] interesting pod/e2e-ait-e94c211c-openshift-default-6f595c5868-d7rtf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body=
Sep 09 16:32:56.895834 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:32:56.895497    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-e94c211c-openshift-default-6f595c5868-d7rtf" podUID="818177e3-feb5-407c-b291-36e66a252425" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused"
Sep 09 16:32:57.897462 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:32:57.897420    2583 patch_prober.go:28] interesting pod/e2e-ait-e94c211c-openshift-default-6f595c5868-d7rtf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body=
Sep 09 16:32:57.897933 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:32:57.897496    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-e94c211c-openshift-default-6f595c5868-d7rtf" podUID="818177e3-feb5-407c-b291-36e66a252425" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused"
Sep 09 16:32:58.894999 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:32:58.894948    2583 patch_prober.go:28] interesting pod/e2e-ait-e94c211c-openshift-default-6f595c5868-d7rtf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body=
Sep 09 16:32:58.895305 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:32:58.895276    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-e94c211c-openshift-default-6f595c5868-d7rtf" podUID="818177e3-feb5-407c-b291-36e66a252425" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused"
Sep 09 16:32:59.868400 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:32:59.868372    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:32:59.895706 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:32:59.895668    2583 patch_prober.go:28] interesting pod/e2e-ait-e94c211c-openshift-default-6f595c5868-d7rtf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body=
Sep 09 16:32:59.895860 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:32:59.895762    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-e94c211c-openshift-default-6f595c5868-d7rtf" podUID="818177e3-feb5-407c-b291-36e66a252425" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused"
Sep 09 16:32:59.969348 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:32:59.969317    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:33:00.297279 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:33:00.297195    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:33:00.898999 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:33:00.898963    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-e94c211c-openshift-default-6f595c5868-d7rtf"
Sep 09 16:33:00.899451 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:33:00.899276    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-e94c211c-openshift-default-6f595c5868-d7rtf"
Sep 09 16:33:00.899929 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:33:00.899911    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-e94c211c-openshift-default-6f595c5868-d7rtf"
Sep 09 16:33:01.078956 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:33:01.078923    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:33:01.853199 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:33:01.853163    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:33:02.979358 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:33:02.979329    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:33:03.074472 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:33:03.074432    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:33:06.377886 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:33:06.377860    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:33:06.896152 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:33:06.896120    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:33:06.952113 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:33:06.952083    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:33:07.009728 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:33:07.009701    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:33:07.070503 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:33:07.070474    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:33:07.190389 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:33:07.190293    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-e94c211c-openshift-default-6f595c5868-d7rtf"]
Sep 09 16:33:07.190552 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:33:07.190509    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-e94c211c-openshift-default-6f595c5868-d7rtf" podUID="818177e3-feb5-407c-b291-36e66a252425" containerName="istio-proxy" containerID="cri-o://e99ad80ca689fe19304ef11c907914e9d568434c6af0143c0e03f6c27e74ce10" gracePeriod=30
Sep 09 16:33:07.219180 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:33:07.219123    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:33:07.584036 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:33:07.584009    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:33:09.485438 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:33:09.485408    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:33:09.585919 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:33:09.585885    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:33:09.692192 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:33:09.692155    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:33:10.604082 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:33:10.603974    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:33:10.711098 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:33:10.711050    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:33:10.814505 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:33:10.811331    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:33:10.911569 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:33:10.911484    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:33:11.713616 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:33:11.713578    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:33:11.803467 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:33:11.803423    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:33:12.199008 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:33:12.192481    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:33:12.303926 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:33:12.303896    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:33:12.584255 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:33:12.584234    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-e94c211c-openshift-default-6f595c5868-d7rtf"
Sep 09 16:33:12.600275 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:33:12.600162    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:33:12.721538 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:33:12.721506    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/818177e3-feb5-407c-b291-36e66a252425-credential-socket\") pod \"818177e3-feb5-407c-b291-36e66a252425\" (UID: \"818177e3-feb5-407c-b291-36e66a252425\") "
Sep 09 16:33:12.721538 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:33:12.721540    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/818177e3-feb5-407c-b291-36e66a252425-workload-socket\") pod \"818177e3-feb5-407c-b291-36e66a252425\" (UID: \"818177e3-feb5-407c-b291-36e66a252425\") "
Sep 09 16:33:12.722059 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:33:12.721583    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/818177e3-feb5-407c-b291-36e66a252425-istio-podinfo\") pod \"818177e3-feb5-407c-b291-36e66a252425\" (UID: \"818177e3-feb5-407c-b291-36e66a252425\") "
Sep 09 16:33:12.722059 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:33:12.721598    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/818177e3-feb5-407c-b291-36e66a252425-workload-certs\") pod \"818177e3-feb5-407c-b291-36e66a252425\" (UID: \"818177e3-feb5-407c-b291-36e66a252425\") "
Sep 09 16:33:12.722059 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:33:12.721636    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/818177e3-feb5-407c-b291-36e66a252425-istiod-ca-cert\") pod \"818177e3-feb5-407c-b291-36e66a252425\" (UID: \"818177e3-feb5-407c-b291-36e66a252425\") "
Sep 09 16:33:12.722059 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:33:12.721683    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/818177e3-feb5-407c-b291-36e66a252425-istio-data\") pod \"818177e3-feb5-407c-b291-36e66a252425\" (UID: \"818177e3-feb5-407c-b291-36e66a252425\") "
Sep 09 16:33:12.722059 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:33:12.721715    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/818177e3-feb5-407c-b291-36e66a252425-istio-envoy\") pod \"818177e3-feb5-407c-b291-36e66a252425\" (UID: \"818177e3-feb5-407c-b291-36e66a252425\") "
Sep 09 16:33:12.722059 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:33:12.721738    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/818177e3-feb5-407c-b291-36e66a252425-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "818177e3-feb5-407c-b291-36e66a252425" (UID: "818177e3-feb5-407c-b291-36e66a252425"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 16:33:12.722059 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:33:12.721751    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/818177e3-feb5-407c-b291-36e66a252425-istio-token\") pod \"818177e3-feb5-407c-b291-36e66a252425\" (UID: \"818177e3-feb5-407c-b291-36e66a252425\") "
Sep 09 16:33:12.722059 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:33:12.721814    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/818177e3-feb5-407c-b291-36e66a252425-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "818177e3-feb5-407c-b291-36e66a252425" (UID: "818177e3-feb5-407c-b291-36e66a252425"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 16:33:12.722059 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:33:12.721825    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c7g8j\" (UniqueName: \"kubernetes.io/projected/818177e3-feb5-407c-b291-36e66a252425-kube-api-access-c7g8j\") pod \"818177e3-feb5-407c-b291-36e66a252425\" (UID: \"818177e3-feb5-407c-b291-36e66a252425\") "
Sep 09 16:33:12.722059 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:33:12.721933    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/818177e3-feb5-407c-b291-36e66a252425-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "818177e3-feb5-407c-b291-36e66a252425" (UID: "818177e3-feb5-407c-b291-36e66a252425"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 16:33:12.722059 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:33:12.721948    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/818177e3-feb5-407c-b291-36e66a252425-istio-data" (OuterVolumeSpecName: "istio-data") pod "818177e3-feb5-407c-b291-36e66a252425" (UID: "818177e3-feb5-407c-b291-36e66a252425"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 16:33:12.722585 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:33:12.722220    2583 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/818177e3-feb5-407c-b291-36e66a252425-istio-data\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\""
Sep 09 16:33:12.722585 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:33:12.722239    2583 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/818177e3-feb5-407c-b291-36e66a252425-credential-socket\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\""
Sep 09 16:33:12.722585 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:33:12.722257    2583 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/818177e3-feb5-407c-b291-36e66a252425-workload-socket\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\""
Sep 09 16:33:12.722585 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:33:12.722276    2583 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/818177e3-feb5-407c-b291-36e66a252425-workload-certs\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\""
Sep 09 16:33:12.722585 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:33:12.722303    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/818177e3-feb5-407c-b291-36e66a252425-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "818177e3-feb5-407c-b291-36e66a252425" (UID: "818177e3-feb5-407c-b291-36e66a252425"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 16:33:12.723848 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:33:12.723814    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/818177e3-feb5-407c-b291-36e66a252425-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "818177e3-feb5-407c-b291-36e66a252425" (UID: "818177e3-feb5-407c-b291-36e66a252425"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 09 16:33:12.724059 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:33:12.723999    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/818177e3-feb5-407c-b291-36e66a252425-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "818177e3-feb5-407c-b291-36e66a252425" (UID: "818177e3-feb5-407c-b291-36e66a252425"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 16:33:12.724250 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:33:12.724217    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/818177e3-feb5-407c-b291-36e66a252425-istio-token" (OuterVolumeSpecName: "istio-token") pod "818177e3-feb5-407c-b291-36e66a252425" (UID: "818177e3-feb5-407c-b291-36e66a252425"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 16:33:12.724333 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:33:12.724300    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/818177e3-feb5-407c-b291-36e66a252425-kube-api-access-c7g8j" (OuterVolumeSpecName: "kube-api-access-c7g8j") pod "818177e3-feb5-407c-b291-36e66a252425" (UID: "818177e3-feb5-407c-b291-36e66a252425"). InnerVolumeSpecName "kube-api-access-c7g8j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 16:33:12.823080 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:33:12.823054    2583 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/818177e3-feb5-407c-b291-36e66a252425-istio-podinfo\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\""
Sep 09 16:33:12.823080 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:33:12.823074    2583 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/818177e3-feb5-407c-b291-36e66a252425-istiod-ca-cert\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\""
Sep 09 16:33:12.823080 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:33:12.823083    2583 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/818177e3-feb5-407c-b291-36e66a252425-istio-envoy\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\""
Sep 09 16:33:12.823244 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:33:12.823090    2583 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/818177e3-feb5-407c-b291-36e66a252425-istio-token\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\""
Sep 09 16:33:12.823244 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:33:12.823098    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c7g8j\" (UniqueName: \"kubernetes.io/projected/818177e3-feb5-407c-b291-36e66a252425-kube-api-access-c7g8j\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\""
Sep 09 16:33:13.231571 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:33:13.231535    2583 generic.go:356] "Generic (PLEG): container finished" podID="818177e3-feb5-407c-b291-36e66a252425" containerID="e99ad80ca689fe19304ef11c907914e9d568434c6af0143c0e03f6c27e74ce10" exitCode=0
Sep 09 16:33:13.231758 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:33:13.231577    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-e94c211c-openshift-default-6f595c5868-d7rtf"
Sep 09 16:33:13.231758 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:33:13.231584    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e94c211c-openshift-default-6f595c5868-d7rtf" event={"ID":"818177e3-feb5-407c-b291-36e66a252425","Type":"ContainerDied","Data":"e99ad80ca689fe19304ef11c907914e9d568434c6af0143c0e03f6c27e74ce10"}
Sep 09 16:33:13.231758 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:33:13.231685    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e94c211c-openshift-default-6f595c5868-d7rtf" event={"ID":"818177e3-feb5-407c-b291-36e66a252425","Type":"ContainerDied","Data":"745a07c5d05ffa380ac283cb700267caf07717e7204bec72fa39cc3e191823fb"}
Sep 09 16:33:13.231758 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:33:13.231715    2583 scope.go:117] "RemoveContainer" containerID="e99ad80ca689fe19304ef11c907914e9d568434c6af0143c0e03f6c27e74ce10"
Sep 09 16:33:13.241155 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:33:13.241136    2583 scope.go:117] "RemoveContainer" containerID="a6fd943a2155f9ac4602895e6c0765d9558b19ece38691e27717d0252a14a961"
Sep 09 16:33:13.248734 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:33:13.248711    2583 scope.go:117] "RemoveContainer" containerID="e99ad80ca689fe19304ef11c907914e9d568434c6af0143c0e03f6c27e74ce10"
Sep 09 16:33:13.249024 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:33:13.248980    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e99ad80ca689fe19304ef11c907914e9d568434c6af0143c0e03f6c27e74ce10\": container with ID starting with e99ad80ca689fe19304ef11c907914e9d568434c6af0143c0e03f6c27e74ce10 not found: ID does not exist" containerID="e99ad80ca689fe19304ef11c907914e9d568434c6af0143c0e03f6c27e74ce10"
Sep 09 16:33:13.249091 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:33:13.249031    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e99ad80ca689fe19304ef11c907914e9d568434c6af0143c0e03f6c27e74ce10"} err="failed to get container status \"e99ad80ca689fe19304ef11c907914e9d568434c6af0143c0e03f6c27e74ce10\": rpc error: code = NotFound desc = could not find container \"e99ad80ca689fe19304ef11c907914e9d568434c6af0143c0e03f6c27e74ce10\": container with ID starting with e99ad80ca689fe19304ef11c907914e9d568434c6af0143c0e03f6c27e74ce10 not found: ID does not exist"
Sep 09 16:33:13.249091 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:33:13.249048    2583 scope.go:117] "RemoveContainer" containerID="a6fd943a2155f9ac4602895e6c0765d9558b19ece38691e27717d0252a14a961"
Sep 09 16:33:13.249415 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:33:13.249386    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a6fd943a2155f9ac4602895e6c0765d9558b19ece38691e27717d0252a14a961\": container with ID starting with a6fd943a2155f9ac4602895e6c0765d9558b19ece38691e27717d0252a14a961 not found: ID does not exist" containerID="a6fd943a2155f9ac4602895e6c0765d9558b19ece38691e27717d0252a14a961"
Sep 09 16:33:13.249510 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:33:13.249420    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a6fd943a2155f9ac4602895e6c0765d9558b19ece38691e27717d0252a14a961"} err="failed to get container status \"a6fd943a2155f9ac4602895e6c0765d9558b19ece38691e27717d0252a14a961\": rpc error: code = NotFound desc = could not find container \"a6fd943a2155f9ac4602895e6c0765d9558b19ece38691e27717d0252a14a961\": container with ID starting with a6fd943a2155f9ac4602895e6c0765d9558b19ece38691e27717d0252a14a961 not found: ID does not exist"
Sep 09 16:33:13.255029 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:33:13.255003    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-e94c211c-openshift-default-6f595c5868-d7rtf"]
Sep 09 16:33:13.259975 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:33:13.259951    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-e94c211c-openshift-default-6f595c5868-d7rtf"]
Sep 09 16:33:14.238726 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:33:14.238696    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="818177e3-feb5-407c-b291-36e66a252425" path="/var/lib/kubelet/pods/818177e3-feb5-407c-b291-36e66a252425/volumes"
Sep 09 16:33:15.031284 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:33:15.031248    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:33:15.131416 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:33:15.131385    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:33:15.580752 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:33:15.580715    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:33:18.258520 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:33:18.258491    2583 generic.go:356] "Generic (PLEG): container finished" podID="28222823-dc46-49c7-b949-b76951d639dc" containerID="52b9c91504e148be2476c06fb8f3c708e55a768e928bd3f67015963c13bda1ce" exitCode=0
Sep 09 16:33:18.259044 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:33:18.258568    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-34141f-openshift-default-75c8656694-8p8mp" event={"ID":"28222823-dc46-49c7-b949-b76951d639dc","Type":"ContainerDied","Data":"52b9c91504e148be2476c06fb8f3c708e55a768e928bd3f67015963c13bda1ce"}
Sep 09 16:33:18.259044 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:33:18.259036    2583 scope.go:117] "RemoveContainer" containerID="52b9c91504e148be2476c06fb8f3c708e55a768e928bd3f67015963c13bda1ce"
Sep 09 16:33:18.260092 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:33:18.260066    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 09 16:33:18.260192 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:33:18.260131    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 09 16:33:18.260192 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:33:18.260159    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 09 16:33:18.354379 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:33:18.354354    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:33:18.707170 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:33:18.707138    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:33:19.265305 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:33:19.265273    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-34141f-openshift-default-75c8656694-8p8mp" event={"ID":"28222823-dc46-49c7-b949-b76951d639dc","Type":"ContainerStarted","Data":"3c26c170f68d3d86f116f74e732bdcede794b958423e15f45ba10f40c4e3019b"}
Sep 09 16:33:19.683617 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:33:19.683581    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-34141f-openshift-default-75c8656694-8p8mp"
Sep 09 16:33:19.683798 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:33:19.683736    2583 patch_prober.go:28] interesting pod/e2e-inf-b-34141f-openshift-default-75c8656694-8p8mp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" start-of-body=
Sep 09 16:33:19.683847 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:33:19.683799    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-34141f-openshift-default-75c8656694-8p8mp" podUID="28222823-dc46-49c7-b949-b76951d639dc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused"
Sep 09 16:33:20.684170 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:33:20.684134    2583 patch_prober.go:28] interesting pod/e2e-inf-b-34141f-openshift-default-75c8656694-8p8mp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" start-of-body=
Sep 09 16:33:20.684531 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:33:20.684220    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-34141f-openshift-default-75c8656694-8p8mp" podUID="28222823-dc46-49c7-b949-b76951d639dc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused"
Sep 09 16:33:21.684602 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:33:21.684570    2583 patch_prober.go:28] interesting pod/e2e-inf-b-34141f-openshift-default-75c8656694-8p8mp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" start-of-body=
Sep 09 16:33:21.684937 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:33:21.684624    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-34141f-openshift-default-75c8656694-8p8mp" podUID="28222823-dc46-49c7-b949-b76951d639dc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused"
Sep 09 16:33:22.683772 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:33:22.683731    2583 patch_prober.go:28] interesting pod/e2e-inf-b-34141f-openshift-default-75c8656694-8p8mp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" start-of-body=
Sep 09 16:33:22.683970 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:33:22.683799    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-34141f-openshift-default-75c8656694-8p8mp" podUID="28222823-dc46-49c7-b949-b76951d639dc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused"
Sep 09 16:33:23.684236 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:33:23.684199    2583 patch_prober.go:28] interesting pod/e2e-inf-b-34141f-openshift-default-75c8656694-8p8mp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" start-of-body=
Sep 09 16:33:23.684598 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:33:23.684265    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-34141f-openshift-default-75c8656694-8p8mp" podUID="28222823-dc46-49c7-b949-b76951d639dc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused"
Sep 09 16:33:24.688572 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:33:24.688538    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-34141f-openshift-default-75c8656694-8p8mp"
Sep 09 16:33:24.689037 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:33:24.688830    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-34141f-openshift-default-75c8656694-8p8mp"
Sep 09 16:33:24.689623 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:33:24.689601    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-34141f-openshift-default-75c8656694-8p8mp"
Sep 09 16:33:32.716803 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:33:32.716771    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:33:34.004136 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:33:34.004105    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:33:34.651604 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:33:34.651569    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:33:35.294859 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:33:35.294832    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:33:35.568886 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:33:35.568811    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-9e0f78a3-2vx7j"]
Sep 09 16:33:35.569507 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:33:35.569489    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="818177e3-feb5-407c-b291-36e66a252425" containerName="istio-proxy"
Sep 09 16:33:35.569559 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:33:35.569511    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="818177e3-feb5-407c-b291-36e66a252425" containerName="istio-proxy"
Sep 09 16:33:35.569559 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:33:35.569530    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="818177e3-feb5-407c-b291-36e66a252425" containerName="istio-proxy"
Sep 09 16:33:35.569559 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:33:35.569538    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="818177e3-feb5-407c-b291-36e66a252425" containerName="istio-proxy"
Sep 09 16:33:35.569670 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:33:35.569660    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="818177e3-feb5-407c-b291-36e66a252425" containerName="istio-proxy"
Sep 09 16:33:35.569710 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:33:35.569677    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="818177e3-feb5-407c-b291-36e66a252425" containerName="istio-proxy"
Sep 09 16:33:35.574752 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:33:35.574710    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-9e0f78a3-2vx7j"
Sep 09 16:33:35.576159 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:33:35.576135    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-9e0f78a3-2vx7j"]
Sep 09 16:33:35.577632 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:33:35.577609    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jz5ff\""
Sep 09 16:33:35.646630 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:33:35.646601    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/050254e5-0d96-4c1e-9876-a30002c9058f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-9e0f78a3-2vx7j\" (UID: \"050254e5-0d96-4c1e-9876-a30002c9058f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-9e0f78a3-2vx7j"
Sep 09 16:33:35.747721 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:33:35.747682    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/050254e5-0d96-4c1e-9876-a30002c9058f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-9e0f78a3-2vx7j\" (UID: \"050254e5-0d96-4c1e-9876-a30002c9058f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-9e0f78a3-2vx7j"
Sep 09 16:33:35.748356 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:33:35.748331    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/050254e5-0d96-4c1e-9876-a30002c9058f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-9e0f78a3-2vx7j\" (UID: \"050254e5-0d96-4c1e-9876-a30002c9058f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-9e0f78a3-2vx7j"
Sep 09 16:33:35.888576 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:33:35.888548    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-9e0f78a3-2vx7j"
Sep 09 16:33:36.068148 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:33:36.068105    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:33:36.158538 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:33:36.158503    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-9e0f78a3-2vx7j"]
Sep 09 16:33:36.160361 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:33:36.160335    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod050254e5_0d96_4c1e_9876_a30002c9058f.slice/crio-6fec09708a79bac0bed788fa2b4039d80242fa29aa283b9a35fbef0001b07338 WatchSource:0}: Error finding container 6fec09708a79bac0bed788fa2b4039d80242fa29aa283b9a35fbef0001b07338: Status 404 returned error can't find the container with id 6fec09708a79bac0bed788fa2b4039d80242fa29aa283b9a35fbef0001b07338
Sep 09 16:33:36.349774 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:33:36.349746    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-9e0f78a3-2vx7j" event={"ID":"050254e5-0d96-4c1e-9876-a30002c9058f","Type":"ContainerStarted","Data":"6fec09708a79bac0bed788fa2b4039d80242fa29aa283b9a35fbef0001b07338"}
Sep 09 16:33:36.775027 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:33:36.774935    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:33:37.357344 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:33:37.357310    2583 generic.go:356] "Generic (PLEG): container finished" podID="050254e5-0d96-4c1e-9876-a30002c9058f" containerID="4b3a2fa28e24aca3b82ef8ed75c0b173f624d6e02366ac9dc31b57bcf27a0ce4" exitCode=0
Sep 09 16:33:37.357756 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:33:37.357391    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-9e0f78a3-2vx7j" event={"ID":"050254e5-0d96-4c1e-9876-a30002c9058f","Type":"ContainerDied","Data":"4b3a2fa28e24aca3b82ef8ed75c0b173f624d6e02366ac9dc31b57bcf27a0ce4"}
Sep 09 16:33:37.360700 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:33:37.360673    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:33:38.075777 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:33:38.075748    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:33:38.507898 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:33:38.507875    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-9e0f78a3-2vx7j"
Sep 09 16:33:38.571610 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:33:38.571580    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/050254e5-0d96-4c1e-9876-a30002c9058f-maas-api-service-ca\") pod \"050254e5-0d96-4c1e-9876-a30002c9058f\" (UID: \"050254e5-0d96-4c1e-9876-a30002c9058f\") "
Sep 09 16:33:38.571908 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:33:38.571886    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/050254e5-0d96-4c1e-9876-a30002c9058f-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "050254e5-0d96-4c1e-9876-a30002c9058f" (UID: "050254e5-0d96-4c1e-9876-a30002c9058f"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 16:33:38.673138 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:33:38.673067    2583 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/050254e5-0d96-4c1e-9876-a30002c9058f-maas-api-service-ca\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\""
Sep 09 16:33:39.369899 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:33:39.369864    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-9e0f78a3-2vx7j" event={"ID":"050254e5-0d96-4c1e-9876-a30002c9058f","Type":"ContainerDied","Data":"6fec09708a79bac0bed788fa2b4039d80242fa29aa283b9a35fbef0001b07338"}
Sep 09 16:33:39.369899 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:33:39.369890    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-9e0f78a3-2vx7j"
Sep 09 16:33:39.370152 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:33:39.369911    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6fec09708a79bac0bed788fa2b4039d80242fa29aa283b9a35fbef0001b07338"
Sep 09 16:33:40.221570 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:33:40.221539    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:33:41.899254 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:33:41.899219    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:33:42.414223 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:33:42.414189    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:33:42.479950 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:33:42.479919    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:33:42.576474 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:33:42.576445    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:33:42.583783 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:33:42.583754    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-9e0f78a3-2vx7j"]
Sep 09 16:33:42.588436 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:33:42.588411    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-9e0f78a3-2vx7j"]
Sep 09 16:33:42.629810 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:33:42.629787    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:33:42.737913 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:33:42.737839    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:33:42.973742 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:33:42.973712    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:33:43.180627 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:33:43.180599    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:33:43.474786 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:33:43.474706    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-49eb9be1-openshift-default-7987c44958-fhgxn"]
Sep 09 16:33:43.475182 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:33:43.475164    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="050254e5-0d96-4c1e-9876-a30002c9058f" containerName="revoke-keys"
Sep 09 16:33:43.475182 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:33:43.475181    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="050254e5-0d96-4c1e-9876-a30002c9058f" containerName="revoke-keys"
Sep 09 16:33:43.475341 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:33:43.475245    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="050254e5-0d96-4c1e-9876-a30002c9058f" containerName="revoke-keys"
Sep 09 16:33:43.480675 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:33:43.479452    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-49eb9be1-openshift-default-7987c44958-fhgxn"
Sep 09 16:33:43.484207 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:33:43.484186    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-49eb9be1-openshift-default-dockercfg-zhkbt\""
Sep 09 16:33:43.488705 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:33:43.488683    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-49eb9be1-openshift-default-7987c44958-fhgxn"]
Sep 09 16:33:43.612426 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:33:43.612391    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c69qm\" (UniqueName: \"kubernetes.io/projected/e31d87fd-97b0-4e08-b086-9db1ee5fedcc-kube-api-access-c69qm\") pod \"e2e-ait-49eb9be1-openshift-default-7987c44958-fhgxn\" (UID: \"e31d87fd-97b0-4e08-b086-9db1ee5fedcc\") " pod="openshift-ingress/e2e-ait-49eb9be1-openshift-default-7987c44958-fhgxn"
Sep 09 16:33:43.612592 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:33:43.612434    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e31d87fd-97b0-4e08-b086-9db1ee5fedcc-workload-certs\") pod \"e2e-ait-49eb9be1-openshift-default-7987c44958-fhgxn\" (UID: \"e31d87fd-97b0-4e08-b086-9db1ee5fedcc\") " pod="openshift-ingress/e2e-ait-49eb9be1-openshift-default-7987c44958-fhgxn"
Sep 09 16:33:43.612592 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:33:43.612574    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e31d87fd-97b0-4e08-b086-9db1ee5fedcc-istiod-ca-cert\") pod \"e2e-ait-49eb9be1-openshift-default-7987c44958-fhgxn\" (UID: \"e31d87fd-97b0-4e08-b086-9db1ee5fedcc\") " pod="openshift-ingress/e2e-ait-49eb9be1-openshift-default-7987c44958-fhgxn"
Sep 09 16:33:43.612678 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:33:43.612614    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e31d87fd-97b0-4e08-b086-9db1ee5fedcc-istio-token\") pod \"e2e-ait-49eb9be1-openshift-default-7987c44958-fhgxn\" (UID: \"e31d87fd-97b0-4e08-b086-9db1ee5fedcc\") " pod="openshift-ingress/e2e-ait-49eb9be1-openshift-default-7987c44958-fhgxn"
Sep 09 16:33:43.612678 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:33:43.612641    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e31d87fd-97b0-4e08-b086-9db1ee5fedcc-workload-socket\") pod \"e2e-ait-49eb9be1-openshift-default-7987c44958-fhgxn\" (UID: \"e31d87fd-97b0-4e08-b086-9db1ee5fedcc\") " pod="openshift-ingress/e2e-ait-49eb9be1-openshift-default-7987c44958-fhgxn"
Sep 09 16:33:43.612678 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:33:43.612658    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e31d87fd-97b0-4e08-b086-9db1ee5fedcc-istio-podinfo\") pod \"e2e-ait-49eb9be1-openshift-default-7987c44958-fhgxn\" (UID: \"e31d87fd-97b0-4e08-b086-9db1ee5fedcc\") " pod="openshift-ingress/e2e-ait-49eb9be1-openshift-default-7987c44958-fhgxn"
Sep 09 16:33:43.612791 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:33:43.612696    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e31d87fd-97b0-4e08-b086-9db1ee5fedcc-istio-data\") pod \"e2e-ait-49eb9be1-openshift-default-7987c44958-fhgxn\" (UID: \"e31d87fd-97b0-4e08-b086-9db1ee5fedcc\") " pod="openshift-ingress/e2e-ait-49eb9be1-openshift-default-7987c44958-fhgxn"
Sep 09 16:33:43.612791 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:33:43.612724    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e31d87fd-97b0-4e08-b086-9db1ee5fedcc-credential-socket\") pod \"e2e-ait-49eb9be1-openshift-default-7987c44958-fhgxn\" (UID: \"e31d87fd-97b0-4e08-b086-9db1ee5fedcc\") " pod="openshift-ingress/e2e-ait-49eb9be1-openshift-default-7987c44958-fhgxn"
Sep 09 16:33:43.612791 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:33:43.612743    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e31d87fd-97b0-4e08-b086-9db1ee5fedcc-istio-envoy\") pod \"e2e-ait-49eb9be1-openshift-default-7987c44958-fhgxn\" (UID: \"e31d87fd-97b0-4e08-b086-9db1ee5fedcc\") " pod="openshift-ingress/e2e-ait-49eb9be1-openshift-default-7987c44958-fhgxn"
Sep 09 16:33:43.713777 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:33:43.713749    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e31d87fd-97b0-4e08-b086-9db1ee5fedcc-istio-envoy\") pod \"e2e-ait-49eb9be1-openshift-default-7987c44958-fhgxn\" (UID: \"e31d87fd-97b0-4e08-b086-9db1ee5fedcc\") " pod="openshift-ingress/e2e-ait-49eb9be1-openshift-default-7987c44958-fhgxn"
Sep 09 16:33:43.713924 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:33:43.713800    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c69qm\" (UniqueName: \"kubernetes.io/projected/e31d87fd-97b0-4e08-b086-9db1ee5fedcc-kube-api-access-c69qm\") pod \"e2e-ait-49eb9be1-openshift-default-7987c44958-fhgxn\" (UID: \"e31d87fd-97b0-4e08-b086-9db1ee5fedcc\") " pod="openshift-ingress/e2e-ait-49eb9be1-openshift-default-7987c44958-fhgxn"
Sep 09 16:33:43.713924 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:33:43.713824    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e31d87fd-97b0-4e08-b086-9db1ee5fedcc-workload-certs\") pod \"e2e-ait-49eb9be1-openshift-default-7987c44958-fhgxn\" (UID: \"e31d87fd-97b0-4e08-b086-9db1ee5fedcc\") " pod="openshift-ingress/e2e-ait-49eb9be1-openshift-default-7987c44958-fhgxn"
Sep 09 16:33:43.713924 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:33:43.713874    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e31d87fd-97b0-4e08-b086-9db1ee5fedcc-istiod-ca-cert\") pod \"e2e-ait-49eb9be1-openshift-default-7987c44958-fhgxn\" (UID: \"e31d87fd-97b0-4e08-b086-9db1ee5fedcc\") " pod="openshift-ingress/e2e-ait-49eb9be1-openshift-default-7987c44958-fhgxn"
Sep 09 16:33:43.713924 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:33:43.713904    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e31d87fd-97b0-4e08-b086-9db1ee5fedcc-istio-token\") pod \"e2e-ait-49eb9be1-openshift-default-7987c44958-fhgxn\" (UID: \"e31d87fd-97b0-4e08-b086-9db1ee5fedcc\") " pod="openshift-ingress/e2e-ait-49eb9be1-openshift-default-7987c44958-fhgxn"
Sep 09 16:33:43.714174 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:33:43.713940    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e31d87fd-97b0-4e08-b086-9db1ee5fedcc-workload-socket\") pod \"e2e-ait-49eb9be1-openshift-default-7987c44958-fhgxn\" (UID: \"e31d87fd-97b0-4e08-b086-9db1ee5fedcc\") " pod="openshift-ingress/e2e-ait-49eb9be1-openshift-default-7987c44958-fhgxn"
Sep 09 16:33:43.714174 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:33:43.713962    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e31d87fd-97b0-4e08-b086-9db1ee5fedcc-istio-podinfo\") pod \"e2e-ait-49eb9be1-openshift-default-7987c44958-fhgxn\" (UID: \"e31d87fd-97b0-4e08-b086-9db1ee5fedcc\") " pod="openshift-ingress/e2e-ait-49eb9be1-openshift-default-7987c44958-fhgxn"
Sep 09 16:33:43.714174 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:33:43.714035    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e31d87fd-97b0-4e08-b086-9db1ee5fedcc-istio-data\") pod \"e2e-ait-49eb9be1-openshift-default-7987c44958-fhgxn\" (UID: \"e31d87fd-97b0-4e08-b086-9db1ee5fedcc\") " pod="openshift-ingress/e2e-ait-49eb9be1-openshift-default-7987c44958-fhgxn"
Sep 09 16:33:43.714174 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:33:43.714063    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e31d87fd-97b0-4e08-b086-9db1ee5fedcc-credential-socket\") pod \"e2e-ait-49eb9be1-openshift-default-7987c44958-fhgxn\" (UID: \"e31d87fd-97b0-4e08-b086-9db1ee5fedcc\") " pod="openshift-ingress/e2e-ait-49eb9be1-openshift-default-7987c44958-fhgxn"
Sep 09 16:33:43.714351 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:33:43.714274    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e31d87fd-97b0-4e08-b086-9db1ee5fedcc-workload-certs\") pod \"e2e-ait-49eb9be1-openshift-default-7987c44958-fhgxn\" (UID: \"e31d87fd-97b0-4e08-b086-9db1ee5fedcc\") " pod="openshift-ingress/e2e-ait-49eb9be1-openshift-default-7987c44958-fhgxn"
Sep 09 16:33:43.714407 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:33:43.714359    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e31d87fd-97b0-4e08-b086-9db1ee5fedcc-credential-socket\") pod \"e2e-ait-49eb9be1-openshift-default-7987c44958-fhgxn\" (UID: \"e31d87fd-97b0-4e08-b086-9db1ee5fedcc\") " pod="openshift-ingress/e2e-ait-49eb9be1-openshift-default-7987c44958-fhgxn"
Sep 09 16:33:43.714493 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:33:43.714466    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e31d87fd-97b0-4e08-b086-9db1ee5fedcc-workload-socket\") pod \"e2e-ait-49eb9be1-openshift-default-7987c44958-fhgxn\" (UID: \"e31d87fd-97b0-4e08-b086-9db1ee5fedcc\") " pod="openshift-ingress/e2e-ait-49eb9be1-openshift-default-7987c44958-fhgxn"
Sep 09 16:33:43.714629 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:33:43.714516    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e31d87fd-97b0-4e08-b086-9db1ee5fedcc-istio-data\") pod \"e2e-ait-49eb9be1-openshift-default-7987c44958-fhgxn\" (UID: \"e31d87fd-97b0-4e08-b086-9db1ee5fedcc\") " pod="openshift-ingress/e2e-ait-49eb9be1-openshift-default-7987c44958-fhgxn"
Sep 09 16:33:43.714688 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:33:43.714626    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e31d87fd-97b0-4e08-b086-9db1ee5fedcc-istiod-ca-cert\") pod \"e2e-ait-49eb9be1-openshift-default-7987c44958-fhgxn\" (UID: \"e31d87fd-97b0-4e08-b086-9db1ee5fedcc\") " pod="openshift-ingress/e2e-ait-49eb9be1-openshift-default-7987c44958-fhgxn"
Sep 09 16:33:43.716172 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:33:43.716145    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e31d87fd-97b0-4e08-b086-9db1ee5fedcc-istio-envoy\") pod \"e2e-ait-49eb9be1-openshift-default-7987c44958-fhgxn\" (UID: \"e31d87fd-97b0-4e08-b086-9db1ee5fedcc\") " pod="openshift-ingress/e2e-ait-49eb9be1-openshift-default-7987c44958-fhgxn"
Sep 09 16:33:43.716385 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:33:43.716367    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e31d87fd-97b0-4e08-b086-9db1ee5fedcc-istio-podinfo\") pod \"e2e-ait-49eb9be1-openshift-default-7987c44958-fhgxn\" (UID: \"e31d87fd-97b0-4e08-b086-9db1ee5fedcc\") " pod="openshift-ingress/e2e-ait-49eb9be1-openshift-default-7987c44958-fhgxn"
Sep 09 16:33:43.720779 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:33:43.720761    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e31d87fd-97b0-4e08-b086-9db1ee5fedcc-istio-token\") pod \"e2e-ait-49eb9be1-openshift-default-7987c44958-fhgxn\" (UID: \"e31d87fd-97b0-4e08-b086-9db1ee5fedcc\") " pod="openshift-ingress/e2e-ait-49eb9be1-openshift-default-7987c44958-fhgxn"
Sep 09 16:33:43.721238 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:33:43.721221    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c69qm\" (UniqueName: \"kubernetes.io/projected/e31d87fd-97b0-4e08-b086-9db1ee5fedcc-kube-api-access-c69qm\") pod \"e2e-ait-49eb9be1-openshift-default-7987c44958-fhgxn\" (UID: \"e31d87fd-97b0-4e08-b086-9db1ee5fedcc\") " pod="openshift-ingress/e2e-ait-49eb9be1-openshift-default-7987c44958-fhgxn"
Sep 09 16:33:43.795130 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:33:43.795074    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-49eb9be1-openshift-default-7987c44958-fhgxn"
Sep 09 16:33:44.078062 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:33:44.078038    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-49eb9be1-openshift-default-7987c44958-fhgxn"]
Sep 09 16:33:44.079764 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:33:44.079737    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode31d87fd_97b0_4e08_b086_9db1ee5fedcc.slice/crio-d2d3d6bfe4612a6193fb6f7d80b32472118703eaed7f79918bf66258bded2d97 WatchSource:0}: Error finding container d2d3d6bfe4612a6193fb6f7d80b32472118703eaed7f79918bf66258bded2d97: Status 404 returned error can't find the container with id d2d3d6bfe4612a6193fb6f7d80b32472118703eaed7f79918bf66258bded2d97
Sep 09 16:33:44.082103 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:33:44.082072    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 09 16:33:44.082206 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:33:44.082147    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 09 16:33:44.082206 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:33:44.082188    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 09 16:33:44.239196 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:33:44.239166    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="050254e5-0d96-4c1e-9876-a30002c9058f" path="/var/lib/kubelet/pods/050254e5-0d96-4c1e-9876-a30002c9058f/volumes"
Sep 09 16:33:44.406099 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:33:44.406016    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-49eb9be1-openshift-default-7987c44958-fhgxn" event={"ID":"e31d87fd-97b0-4e08-b086-9db1ee5fedcc","Type":"ContainerStarted","Data":"9f6e6c39fb065cbd59afb673fd4b0595583140ea02265cc30ac7c3b57b951037"}
Sep 09 16:33:44.406099 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:33:44.406080    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-49eb9be1-openshift-default-7987c44958-fhgxn" event={"ID":"e31d87fd-97b0-4e08-b086-9db1ee5fedcc","Type":"ContainerStarted","Data":"d2d3d6bfe4612a6193fb6f7d80b32472118703eaed7f79918bf66258bded2d97"}
Sep 09 16:33:44.425023 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:33:44.424953    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-49eb9be1-openshift-default-7987c44958-fhgxn" podStartSLOduration=1.424933649 podStartE2EDuration="1.424933649s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 16:33:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:33:44.424008456 +0000 UTC m=+1206.777738304" watchObservedRunningTime="2026-09-09 16:33:44.424933649 +0000 UTC m=+1206.778663480"
Sep 09 16:33:44.796139 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:33:44.796067    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-49eb9be1-openshift-default-7987c44958-fhgxn"
Sep 09 16:33:45.801626 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:33:45.801600    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-49eb9be1-openshift-default-7987c44958-fhgxn"
Sep 09 16:33:46.417134 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:33:46.417099    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-49eb9be1-openshift-default-7987c44958-fhgxn"
Sep 09 16:33:46.418017 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:33:46.417979    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-49eb9be1-openshift-default-7987c44958-fhgxn"
Sep 09 16:33:46.679410 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:33:46.679327    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:33:46.779767 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:33:46.779735    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:33:47.469673 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:33:47.469645    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:33:48.191830 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:33:48.191799    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:33:48.254395 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:33:48.254364    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:33:48.349061 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:33:48.349032    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:33:48.737134 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:33:48.737103    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:33:48.831889 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:33:48.831859    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:34:06.525248 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:34:06.525192    2583 generic.go:356] "Generic (PLEG): container finished" podID="e31d87fd-97b0-4e08-b086-9db1ee5fedcc" containerID="9f6e6c39fb065cbd59afb673fd4b0595583140ea02265cc30ac7c3b57b951037" exitCode=0
Sep 09 16:34:06.525566 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:34:06.525266    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-49eb9be1-openshift-default-7987c44958-fhgxn" event={"ID":"e31d87fd-97b0-4e08-b086-9db1ee5fedcc","Type":"ContainerDied","Data":"9f6e6c39fb065cbd59afb673fd4b0595583140ea02265cc30ac7c3b57b951037"}
Sep 09 16:34:06.530002 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:34:06.525912    2583 scope.go:117] "RemoveContainer" containerID="9f6e6c39fb065cbd59afb673fd4b0595583140ea02265cc30ac7c3b57b951037"
Sep 09 16:34:06.532327 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:34:06.532281    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 09 16:34:06.532632 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:34:06.532606    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 09 16:34:06.532686 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:34:06.532662    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 09 16:34:07.532681 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:34:07.532646    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-49eb9be1-openshift-default-7987c44958-fhgxn" event={"ID":"e31d87fd-97b0-4e08-b086-9db1ee5fedcc","Type":"ContainerStarted","Data":"df030ef0170b0b03f38dd0cd5586a35dfee263ea0fc55fc873e6262ed6c485e1"}
Sep 09 16:34:07.795846 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:34:07.795751    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-49eb9be1-openshift-default-7987c44958-fhgxn"
Sep 09 16:34:07.796025 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:34:07.795870    2583 patch_prober.go:28] interesting pod/e2e-ait-49eb9be1-openshift-default-7987c44958-fhgxn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body=
Sep 09 16:34:07.796025 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:34:07.795914    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-49eb9be1-openshift-default-7987c44958-fhgxn" podUID="e31d87fd-97b0-4e08-b086-9db1ee5fedcc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused"
Sep 09 16:34:08.795839 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:34:08.795791    2583 patch_prober.go:28] interesting pod/e2e-ait-49eb9be1-openshift-default-7987c44958-fhgxn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body=
Sep 09 16:34:08.796307 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:34:08.795856    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-49eb9be1-openshift-default-7987c44958-fhgxn" podUID="e31d87fd-97b0-4e08-b086-9db1ee5fedcc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused"
Sep 09 16:34:09.796324 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:34:09.796284    2583 patch_prober.go:28] interesting pod/e2e-ait-49eb9be1-openshift-default-7987c44958-fhgxn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body=
Sep 09 16:34:09.796868 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:34:09.796360    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-49eb9be1-openshift-default-7987c44958-fhgxn" podUID="e31d87fd-97b0-4e08-b086-9db1ee5fedcc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused"
Sep 09 16:34:10.366736 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:34:10.366701    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:34:10.799061 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:34:10.795527    2583 patch_prober.go:28] interesting pod/e2e-ait-49eb9be1-openshift-default-7987c44958-fhgxn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body=
Sep 09 16:34:10.799061 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:34:10.795582    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-49eb9be1-openshift-default-7987c44958-fhgxn" podUID="e31d87fd-97b0-4e08-b086-9db1ee5fedcc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused"
Sep 09 16:34:11.601897 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:34:11.601861    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-49eb9be1-sbl7l"]
Sep 09 16:34:11.605516 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:34:11.605490    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-49eb9be1-sbl7l"
Sep 09 16:34:11.609873 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:34:11.609848    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jz5ff\""
Sep 09 16:34:11.616616 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:34:11.616595    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-49eb9be1-sbl7l"]
Sep 09 16:34:11.670105 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:34:11.670074    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e3683e0e-0289-4552-87e0-056eb2074fe5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-49eb9be1-sbl7l\" (UID: \"e3683e0e-0289-4552-87e0-056eb2074fe5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-49eb9be1-sbl7l"
Sep 09 16:34:11.684707 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:34:11.684683    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:34:11.771275 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:34:11.771243    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e3683e0e-0289-4552-87e0-056eb2074fe5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-49eb9be1-sbl7l\" (UID: \"e3683e0e-0289-4552-87e0-056eb2074fe5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-49eb9be1-sbl7l"
Sep 09 16:34:11.771934 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:34:11.771915    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e3683e0e-0289-4552-87e0-056eb2074fe5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-49eb9be1-sbl7l\" (UID: \"e3683e0e-0289-4552-87e0-056eb2074fe5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-49eb9be1-sbl7l"
Sep 09 16:34:11.796386 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:34:11.796357    2583 patch_prober.go:28] interesting pod/e2e-ait-49eb9be1-openshift-default-7987c44958-fhgxn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body=
Sep 09 16:34:11.796619 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:34:11.796592    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-49eb9be1-openshift-default-7987c44958-fhgxn" podUID="e31d87fd-97b0-4e08-b086-9db1ee5fedcc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused"
Sep 09 16:34:11.922873 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:34:11.922798    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-49eb9be1-sbl7l"
Sep 09 16:34:11.985893 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:34:11.985833    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:34:12.194589 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:34:12.194558    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-49eb9be1-sbl7l"]
Sep 09 16:34:12.196071 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:34:12.196039    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3683e0e_0289_4552_87e0_056eb2074fe5.slice/crio-9fdc87dea682d889f12beeb7132b61c3bf47fd2973f63fb891a213b6f324d25b WatchSource:0}: Error finding container 9fdc87dea682d889f12beeb7132b61c3bf47fd2973f63fb891a213b6f324d25b: Status 404 returned error can't find the container with id 9fdc87dea682d889f12beeb7132b61c3bf47fd2973f63fb891a213b6f324d25b
Sep 09 16:34:12.561338 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:34:12.561310    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-49eb9be1-sbl7l" event={"ID":"e3683e0e-0289-4552-87e0-056eb2074fe5","Type":"ContainerStarted","Data":"006e83faf4bf7f7e1b12e2efe7da165dfc71a15b36c20e93c9d35421eb954c0c"}
Sep 09 16:34:12.561437 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:34:12.561369    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-49eb9be1-sbl7l" event={"ID":"e3683e0e-0289-4552-87e0-056eb2074fe5","Type":"ContainerStarted","Data":"9fdc87dea682d889f12beeb7132b61c3bf47fd2973f63fb891a213b6f324d25b"}
Sep 09 16:34:12.575776 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:34:12.575733    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-49eb9be1-sbl7l" podStartSLOduration=1.5757183540000002 podStartE2EDuration="1.575718354s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 16:34:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:34:12.573945897 +0000 UTC m=+1234.927675749" watchObservedRunningTime="2026-09-09 16:34:12.575718354 +0000 UTC m=+1234.929448188"
Sep 09 16:34:12.800168 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:34:12.800083    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-49eb9be1-openshift-default-7987c44958-fhgxn"
Sep 09 16:34:12.800544 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:34:12.800526    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-49eb9be1-openshift-default-7987c44958-fhgxn"
Sep 09 16:34:12.801149 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:34:12.801132    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-49eb9be1-openshift-default-7987c44958-fhgxn"
Sep 09 16:34:13.438237 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:34:13.438205    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:34:13.538574 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:34:13.538546    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:34:13.567679 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:34:13.567650    2583 generic.go:356] "Generic (PLEG): container finished" podID="e3683e0e-0289-4552-87e0-056eb2074fe5" containerID="006e83faf4bf7f7e1b12e2efe7da165dfc71a15b36c20e93c9d35421eb954c0c" exitCode=0
Sep 09 16:34:13.567826 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:34:13.567724    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-49eb9be1-sbl7l" event={"ID":"e3683e0e-0289-4552-87e0-056eb2074fe5","Type":"ContainerDied","Data":"006e83faf4bf7f7e1b12e2efe7da165dfc71a15b36c20e93c9d35421eb954c0c"}
Sep 09 16:34:13.903274 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:34:13.903248    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:34:14.479018 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:34:14.478968    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:34:14.710757 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:34:14.710738    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-49eb9be1-sbl7l"
Sep 09 16:34:14.798656 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:34:14.798587    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e3683e0e-0289-4552-87e0-056eb2074fe5-maas-api-service-ca\") pod \"e3683e0e-0289-4552-87e0-056eb2074fe5\" (UID: \"e3683e0e-0289-4552-87e0-056eb2074fe5\") "
Sep 09 16:34:14.798918 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:34:14.798898    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e3683e0e-0289-4552-87e0-056eb2074fe5-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "e3683e0e-0289-4552-87e0-056eb2074fe5" (UID: "e3683e0e-0289-4552-87e0-056eb2074fe5"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 16:34:14.899634 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:34:14.899612    2583 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e3683e0e-0289-4552-87e0-056eb2074fe5-maas-api-service-ca\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\""
Sep 09 16:34:15.203629 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:34:15.203605    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:34:15.578517 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:34:15.578482    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-49eb9be1-sbl7l" event={"ID":"e3683e0e-0289-4552-87e0-056eb2074fe5","Type":"ContainerDied","Data":"9fdc87dea682d889f12beeb7132b61c3bf47fd2973f63fb891a213b6f324d25b"}
Sep 09 16:34:15.578517 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:34:15.578515    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-49eb9be1-sbl7l"
Sep 09 16:34:15.578893 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:34:15.578528    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9fdc87dea682d889f12beeb7132b61c3bf47fd2973f63fb891a213b6f324d25b"
Sep 09 16:34:17.194016 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:34:17.193968    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:34:17.661440 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:34:17.661408    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:34:17.730552 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:34:17.730515    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:34:17.831922 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:34:17.831747    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:34:17.831922 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:34:17.831821    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-49eb9be1-sbl7l"]
Sep 09 16:34:17.835822 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:34:17.835798    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-49eb9be1-sbl7l"]
Sep 09 16:34:18.239140 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:34:18.239110    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e3683e0e-0289-4552-87e0-056eb2074fe5" path="/var/lib/kubelet/pods/e3683e0e-0289-4552-87e0-056eb2074fe5/volumes"
Sep 09 16:34:18.982616 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:34:18.982587    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-49eb9be1-openshift-default-7987c44958-fhgxn"]
Sep 09 16:34:18.982809 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:34:18.982780    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-49eb9be1-openshift-default-7987c44958-fhgxn" podUID="e31d87fd-97b0-4e08-b086-9db1ee5fedcc" containerName="istio-proxy" containerID="cri-o://df030ef0170b0b03f38dd0cd5586a35dfee263ea0fc55fc873e6262ed6c485e1" gracePeriod=30
Sep 09 16:34:21.309606 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:34:21.309577    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:34:21.409647 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:34:21.409609    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:34:21.974327 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:34:21.974283    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:34:22.084495 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:34:22.084458    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:34:22.652773 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:34:22.652730    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:34:23.749791 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:34:23.749752    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:34:24.073241 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:34:24.073213    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:34:24.174213 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:34:24.174185    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:34:24.239009 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:34:24.238971    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-49eb9be1-openshift-default-7987c44958-fhgxn"
Sep 09 16:34:24.392655 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:34:24.392625    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e31d87fd-97b0-4e08-b086-9db1ee5fedcc-istio-podinfo\") pod \"e31d87fd-97b0-4e08-b086-9db1ee5fedcc\" (UID: \"e31d87fd-97b0-4e08-b086-9db1ee5fedcc\") "
Sep 09 16:34:24.392791 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:34:24.392680    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e31d87fd-97b0-4e08-b086-9db1ee5fedcc-istio-envoy\") pod \"e31d87fd-97b0-4e08-b086-9db1ee5fedcc\" (UID: \"e31d87fd-97b0-4e08-b086-9db1ee5fedcc\") "
Sep 09 16:34:24.392791 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:34:24.392709    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c69qm\" (UniqueName: \"kubernetes.io/projected/e31d87fd-97b0-4e08-b086-9db1ee5fedcc-kube-api-access-c69qm\") pod \"e31d87fd-97b0-4e08-b086-9db1ee5fedcc\" (UID: \"e31d87fd-97b0-4e08-b086-9db1ee5fedcc\") "
Sep 09 16:34:24.392791 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:34:24.392757    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e31d87fd-97b0-4e08-b086-9db1ee5fedcc-istio-data\") pod \"e31d87fd-97b0-4e08-b086-9db1ee5fedcc\" (UID: \"e31d87fd-97b0-4e08-b086-9db1ee5fedcc\") "
Sep 09 16:34:24.392791 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:34:24.392781    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e31d87fd-97b0-4e08-b086-9db1ee5fedcc-istio-token\") pod \"e31d87fd-97b0-4e08-b086-9db1ee5fedcc\" (UID: \"e31d87fd-97b0-4e08-b086-9db1ee5fedcc\") "
Sep 09 16:34:24.392968 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:34:24.392818    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e31d87fd-97b0-4e08-b086-9db1ee5fedcc-workload-certs\") pod \"e31d87fd-97b0-4e08-b086-9db1ee5fedcc\" (UID: \"e31d87fd-97b0-4e08-b086-9db1ee5fedcc\") "
Sep 09 16:34:24.392968 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:34:24.392846    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e31d87fd-97b0-4e08-b086-9db1ee5fedcc-credential-socket\") pod \"e31d87fd-97b0-4e08-b086-9db1ee5fedcc\" (UID: \"e31d87fd-97b0-4e08-b086-9db1ee5fedcc\") "
Sep 09 16:34:24.392968 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:34:24.392877    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e31d87fd-97b0-4e08-b086-9db1ee5fedcc-istiod-ca-cert\") pod \"e31d87fd-97b0-4e08-b086-9db1ee5fedcc\" (UID: \"e31d87fd-97b0-4e08-b086-9db1ee5fedcc\") "
Sep 09 16:34:24.392968 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:34:24.392910    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e31d87fd-97b0-4e08-b086-9db1ee5fedcc-workload-socket\") pod \"e31d87fd-97b0-4e08-b086-9db1ee5fedcc\" (UID: \"e31d87fd-97b0-4e08-b086-9db1ee5fedcc\") "
Sep 09 16:34:24.393190 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:34:24.393132    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e31d87fd-97b0-4e08-b086-9db1ee5fedcc-istio-data" (OuterVolumeSpecName: "istio-data") pod "e31d87fd-97b0-4e08-b086-9db1ee5fedcc" (UID: "e31d87fd-97b0-4e08-b086-9db1ee5fedcc"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 16:34:24.393338 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:34:24.393295    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e31d87fd-97b0-4e08-b086-9db1ee5fedcc-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e31d87fd-97b0-4e08-b086-9db1ee5fedcc" (UID: "e31d87fd-97b0-4e08-b086-9db1ee5fedcc"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 16:34:24.393338 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:34:24.393279    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e31d87fd-97b0-4e08-b086-9db1ee5fedcc-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e31d87fd-97b0-4e08-b086-9db1ee5fedcc" (UID: "e31d87fd-97b0-4e08-b086-9db1ee5fedcc"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 16:34:24.393338 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:34:24.393321    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e31d87fd-97b0-4e08-b086-9db1ee5fedcc-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e31d87fd-97b0-4e08-b086-9db1ee5fedcc" (UID: "e31d87fd-97b0-4e08-b086-9db1ee5fedcc"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 16:34:24.393532 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:34:24.393353    2583 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e31d87fd-97b0-4e08-b086-9db1ee5fedcc-istio-data\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\""
Sep 09 16:34:24.393593 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:34:24.393577    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e31d87fd-97b0-4e08-b086-9db1ee5fedcc-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e31d87fd-97b0-4e08-b086-9db1ee5fedcc" (UID: "e31d87fd-97b0-4e08-b086-9db1ee5fedcc"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 16:34:24.394718 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:34:24.394689    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e31d87fd-97b0-4e08-b086-9db1ee5fedcc-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e31d87fd-97b0-4e08-b086-9db1ee5fedcc" (UID: "e31d87fd-97b0-4e08-b086-9db1ee5fedcc"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 09 16:34:24.394833 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:34:24.394783    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e31d87fd-97b0-4e08-b086-9db1ee5fedcc-kube-api-access-c69qm" (OuterVolumeSpecName: "kube-api-access-c69qm") pod "e31d87fd-97b0-4e08-b086-9db1ee5fedcc" (UID: "e31d87fd-97b0-4e08-b086-9db1ee5fedcc"). InnerVolumeSpecName "kube-api-access-c69qm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 16:34:24.395195 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:34:24.395177    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e31d87fd-97b0-4e08-b086-9db1ee5fedcc-istio-token" (OuterVolumeSpecName: "istio-token") pod "e31d87fd-97b0-4e08-b086-9db1ee5fedcc" (UID: "e31d87fd-97b0-4e08-b086-9db1ee5fedcc"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 16:34:24.395253 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:34:24.395194    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e31d87fd-97b0-4e08-b086-9db1ee5fedcc-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e31d87fd-97b0-4e08-b086-9db1ee5fedcc" (UID: "e31d87fd-97b0-4e08-b086-9db1ee5fedcc"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 16:34:24.414593 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:34:24.414567    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:34:24.494802 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:34:24.494770    2583 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e31d87fd-97b0-4e08-b086-9db1ee5fedcc-istio-podinfo\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\""
Sep 09 16:34:24.494802 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:34:24.494802    2583 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e31d87fd-97b0-4e08-b086-9db1ee5fedcc-istio-envoy\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\""
Sep 09 16:34:24.494960 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:34:24.494816    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c69qm\" (UniqueName: \"kubernetes.io/projected/e31d87fd-97b0-4e08-b086-9db1ee5fedcc-kube-api-access-c69qm\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\""
Sep 09 16:34:24.494960 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:34:24.494829    2583 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e31d87fd-97b0-4e08-b086-9db1ee5fedcc-istio-token\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\""
Sep 09 16:34:24.494960 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:34:24.494841    2583 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e31d87fd-97b0-4e08-b086-9db1ee5fedcc-workload-certs\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\""
Sep 09 16:34:24.494960 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:34:24.494853    2583 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e31d87fd-97b0-4e08-b086-9db1ee5fedcc-credential-socket\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\""
Sep 09 16:34:24.494960 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:34:24.494863    2583 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e31d87fd-97b0-4e08-b086-9db1ee5fedcc-istiod-ca-cert\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\""
Sep 09 16:34:24.494960 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:34:24.494875    2583 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e31d87fd-97b0-4e08-b086-9db1ee5fedcc-workload-socket\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\""
Sep 09 16:34:24.515323 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:34:24.515294    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:34:24.593839 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:34:24.593813    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:34:24.629194 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:34:24.629131    2583 generic.go:356] "Generic (PLEG): container finished" podID="e31d87fd-97b0-4e08-b086-9db1ee5fedcc" containerID="df030ef0170b0b03f38dd0cd5586a35dfee263ea0fc55fc873e6262ed6c485e1" exitCode=0
Sep 09 16:34:24.629194 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:34:24.629192    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-49eb9be1-openshift-default-7987c44958-fhgxn"
Sep 09 16:34:24.629439 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:34:24.629187    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-49eb9be1-openshift-default-7987c44958-fhgxn" event={"ID":"e31d87fd-97b0-4e08-b086-9db1ee5fedcc","Type":"ContainerDied","Data":"df030ef0170b0b03f38dd0cd5586a35dfee263ea0fc55fc873e6262ed6c485e1"}
Sep 09 16:34:24.629439 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:34:24.629309    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-49eb9be1-openshift-default-7987c44958-fhgxn" event={"ID":"e31d87fd-97b0-4e08-b086-9db1ee5fedcc","Type":"ContainerDied","Data":"d2d3d6bfe4612a6193fb6f7d80b32472118703eaed7f79918bf66258bded2d97"}
Sep 09 16:34:24.629439 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:34:24.629335    2583 scope.go:117] "RemoveContainer" containerID="df030ef0170b0b03f38dd0cd5586a35dfee263ea0fc55fc873e6262ed6c485e1"
Sep 09 16:34:24.638926 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:34:24.638906    2583 scope.go:117] "RemoveContainer" containerID="9f6e6c39fb065cbd59afb673fd4b0595583140ea02265cc30ac7c3b57b951037"
Sep 09 16:34:24.646625 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:34:24.646611    2583 scope.go:117] "RemoveContainer" containerID="df030ef0170b0b03f38dd0cd5586a35dfee263ea0fc55fc873e6262ed6c485e1"
Sep 09 16:34:24.646907 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:34:24.646889    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"df030ef0170b0b03f38dd0cd5586a35dfee263ea0fc55fc873e6262ed6c485e1\": container with ID starting with df030ef0170b0b03f38dd0cd5586a35dfee263ea0fc55fc873e6262ed6c485e1 not found: ID does not exist" containerID="df030ef0170b0b03f38dd0cd5586a35dfee263ea0fc55fc873e6262ed6c485e1"
Sep 09 16:34:24.646954 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:34:24.646914    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df030ef0170b0b03f38dd0cd5586a35dfee263ea0fc55fc873e6262ed6c485e1"} err="failed to get container status \"df030ef0170b0b03f38dd0cd5586a35dfee263ea0fc55fc873e6262ed6c485e1\": rpc error: code = NotFound desc = could not find container \"df030ef0170b0b03f38dd0cd5586a35dfee263ea0fc55fc873e6262ed6c485e1\": container with ID starting with df030ef0170b0b03f38dd0cd5586a35dfee263ea0fc55fc873e6262ed6c485e1 not found: ID does not exist"
Sep 09 16:34:24.646954 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:34:24.646931    2583 scope.go:117] "RemoveContainer" containerID="9f6e6c39fb065cbd59afb673fd4b0595583140ea02265cc30ac7c3b57b951037"
Sep 09 16:34:24.647200 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:34:24.647184    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9f6e6c39fb065cbd59afb673fd4b0595583140ea02265cc30ac7c3b57b951037\": container with ID starting with 9f6e6c39fb065cbd59afb673fd4b0595583140ea02265cc30ac7c3b57b951037 not found: ID does not exist" containerID="9f6e6c39fb065cbd59afb673fd4b0595583140ea02265cc30ac7c3b57b951037"
Sep 09 16:34:24.647239 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:34:24.647204    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9f6e6c39fb065cbd59afb673fd4b0595583140ea02265cc30ac7c3b57b951037"} err="failed to get container status \"9f6e6c39fb065cbd59afb673fd4b0595583140ea02265cc30ac7c3b57b951037\": rpc error: code = NotFound desc = could not find container \"9f6e6c39fb065cbd59afb673fd4b0595583140ea02265cc30ac7c3b57b951037\": container with ID starting with 9f6e6c39fb065cbd59afb673fd4b0595583140ea02265cc30ac7c3b57b951037 not found: ID does not exist"
Sep 09 16:34:24.655227 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:34:24.655197    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-49eb9be1-openshift-default-7987c44958-fhgxn"]
Sep 09 16:34:24.665950 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:34:24.665924    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-49eb9be1-openshift-default-7987c44958-fhgxn"]
Sep 09 16:34:26.240165 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:34:26.240131    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e31d87fd-97b0-4e08-b086-9db1ee5fedcc" path="/var/lib/kubelet/pods/e31d87fd-97b0-4e08-b086-9db1ee5fedcc/volumes"
Sep 09 16:34:33.718404 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:34:33.718319    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:34:37.422138 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:34:37.422099    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:34:45.817142 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:34:45.817106    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:34:46.415387 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:34:46.415334    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:34:46.931472 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:34:46.931445    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-20ed533b-nksxs"]
Sep 09 16:34:46.931869 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:34:46.931856    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e31d87fd-97b0-4e08-b086-9db1ee5fedcc" containerName="istio-proxy"
Sep 09 16:34:46.931912 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:34:46.931870    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="e31d87fd-97b0-4e08-b086-9db1ee5fedcc" containerName="istio-proxy"
Sep 09 16:34:46.931912 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:34:46.931882    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e31d87fd-97b0-4e08-b086-9db1ee5fedcc" containerName="istio-proxy"
Sep 09 16:34:46.931912 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:34:46.931888    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="e31d87fd-97b0-4e08-b086-9db1ee5fedcc" containerName="istio-proxy"
Sep 09 16:34:46.931912 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:34:46.931903    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e3683e0e-0289-4552-87e0-056eb2074fe5" containerName="revoke-keys"
Sep 09 16:34:46.931912 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:34:46.931909    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="e3683e0e-0289-4552-87e0-056eb2074fe5" containerName="revoke-keys"
Sep 09 16:34:46.932084 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:34:46.931965    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="e31d87fd-97b0-4e08-b086-9db1ee5fedcc" containerName="istio-proxy"
Sep 09 16:34:46.932084 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:34:46.931972    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="e3683e0e-0289-4552-87e0-056eb2074fe5" containerName="revoke-keys"
Sep 09 16:34:46.932084 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:34:46.932004    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="e31d87fd-97b0-4e08-b086-9db1ee5fedcc" containerName="istio-proxy"
Sep 09 16:34:46.934851 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:34:46.934833    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-20ed533b-nksxs"
Sep 09 16:34:46.937283 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:34:46.937264    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jz5ff\""
Sep 09 16:34:46.941521 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:34:46.941498    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-20ed533b-nksxs"]
Sep 09 16:34:46.991804 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:34:46.991781    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/06950869-4f63-4b65-a3be-b756b93b2f20-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-20ed533b-nksxs\" (UID: \"06950869-4f63-4b65-a3be-b756b93b2f20\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-20ed533b-nksxs"
Sep 09 16:34:47.093325 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:34:47.093291    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/06950869-4f63-4b65-a3be-b756b93b2f20-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-20ed533b-nksxs\" (UID: \"06950869-4f63-4b65-a3be-b756b93b2f20\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-20ed533b-nksxs"
Sep 09 16:34:47.094263 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:34:47.094210    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/06950869-4f63-4b65-a3be-b756b93b2f20-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-20ed533b-nksxs\" (UID: \"06950869-4f63-4b65-a3be-b756b93b2f20\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-20ed533b-nksxs"
Sep 09 16:34:47.246164 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:34:47.246090    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-20ed533b-nksxs"
Sep 09 16:34:47.337968 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:34:47.337932    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:34:47.523341 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:34:47.523320    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-20ed533b-nksxs"]
Sep 09 16:34:47.525926 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:34:47.525900    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06950869_4f63_4b65_a3be_b756b93b2f20.slice/crio-778ee30af51449d5287331aad2cea28113a74e60be9e206f4646f52fdb886c52 WatchSource:0}: Error finding container 778ee30af51449d5287331aad2cea28113a74e60be9e206f4646f52fdb886c52: Status 404 returned error can't find the container with id 778ee30af51449d5287331aad2cea28113a74e60be9e206f4646f52fdb886c52
Sep 09 16:34:47.757668 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:34:47.757640    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-20ed533b-nksxs" event={"ID":"06950869-4f63-4b65-a3be-b756b93b2f20","Type":"ContainerStarted","Data":"778ee30af51449d5287331aad2cea28113a74e60be9e206f4646f52fdb886c52"}
Sep 09 16:34:48.177709 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:34:48.177669    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:34:48.550480 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:34:48.550406    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:34:48.764066 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:34:48.764031    2583 generic.go:356] "Generic (PLEG): container finished" podID="06950869-4f63-4b65-a3be-b756b93b2f20" containerID="5e157d7b5b1fc26f8b5655e0ece3f65f31e5aafe763a180b046b9c499653c559" exitCode=0
Sep 09 16:34:48.764220 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:34:48.764117    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-20ed533b-nksxs" event={"ID":"06950869-4f63-4b65-a3be-b756b93b2f20","Type":"ContainerDied","Data":"5e157d7b5b1fc26f8b5655e0ece3f65f31e5aafe763a180b046b9c499653c559"}
Sep 09 16:34:49.144341 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:34:49.144304    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:34:49.881702 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:34:49.881653    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:34:49.903516 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:34:49.903496    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-20ed533b-nksxs"
Sep 09 16:34:49.918928 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:34:49.918896    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/06950869-4f63-4b65-a3be-b756b93b2f20-maas-api-service-ca\") pod \"06950869-4f63-4b65-a3be-b756b93b2f20\" (UID: \"06950869-4f63-4b65-a3be-b756b93b2f20\") "
Sep 09 16:34:49.919289 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:34:49.919267    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/06950869-4f63-4b65-a3be-b756b93b2f20-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "06950869-4f63-4b65-a3be-b756b93b2f20" (UID: "06950869-4f63-4b65-a3be-b756b93b2f20"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 16:34:50.019870 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:34:50.019834    2583 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/06950869-4f63-4b65-a3be-b756b93b2f20-maas-api-service-ca\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\""
Sep 09 16:34:50.471408 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:34:50.471382    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:34:50.776133 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:34:50.776108    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-20ed533b-nksxs"
Sep 09 16:34:50.776133 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:34:50.776118    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-20ed533b-nksxs" event={"ID":"06950869-4f63-4b65-a3be-b756b93b2f20","Type":"ContainerDied","Data":"778ee30af51449d5287331aad2cea28113a74e60be9e206f4646f52fdb886c52"}
Sep 09 16:34:50.776320 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:34:50.776160    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="778ee30af51449d5287331aad2cea28113a74e60be9e206f4646f52fdb886c52"
Sep 09 16:34:53.349116 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:34:53.349069    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:34:53.871141 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:34:53.871109    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:34:54.019453 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:34:54.019425    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:34:54.039763 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:34:54.039730    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-20ed533b-nksxs"]
Sep 09 16:34:54.041695 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:34:54.041675    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-20ed533b-nksxs"]
Sep 09 16:34:54.075911 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:34:54.075885    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:34:54.215970 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:34:54.215895    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:34:54.238933 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:34:54.238908    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="06950869-4f63-4b65-a3be-b756b93b2f20" path="/var/lib/kubelet/pods/06950869-4f63-4b65-a3be-b756b93b2f20/volumes"
Sep 09 16:34:54.470289 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:34:54.470217    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:34:54.927294 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:34:54.927264    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:34:55.030128 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:34:55.030096    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:34:55.126828 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:34:55.126793    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:34:55.226365 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:34:55.226308    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:34:56.068547 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:34:56.068517    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:34:56.571281 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:34:56.571254    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:34:56.738405 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:34:56.738381    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:34:58.524888 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:34:58.524858    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:35:00.492072 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:35:00.492041    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:35:00.592095 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:35:00.592061    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:35:02.300363 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:35:02.300332    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:35:02.400385 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:35:02.400362    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:35:02.746504 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:35:02.746476    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:35:02.846724 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:35:02.846703    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:35:02.999548 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:35:02.999494    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:35:11.255551 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:35:11.255516    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-05e496-8q9gs"]
Sep 09 16:35:11.256035 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:35:11.255941    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="06950869-4f63-4b65-a3be-b756b93b2f20" containerName="revoke-keys"
Sep 09 16:35:11.256035 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:35:11.255954    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="06950869-4f63-4b65-a3be-b756b93b2f20" containerName="revoke-keys"
Sep 09 16:35:11.256115 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:35:11.256062    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="06950869-4f63-4b65-a3be-b756b93b2f20" containerName="revoke-keys"
Sep 09 16:35:11.259307 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:35:11.259288    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-05e496-8q9gs"
Sep 09 16:35:11.261789 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:35:11.261758    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jz5ff\""
Sep 09 16:35:11.266048 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:35:11.266022    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-05e496-8q9gs"]
Sep 09 16:35:11.402327 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:35:11.402297    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bf9f0d66-08fd-461f-a477-8d9993f60a7e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-05e496-8q9gs\" (UID: \"bf9f0d66-08fd-461f-a477-8d9993f60a7e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-05e496-8q9gs"
Sep 09 16:35:11.503686 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:35:11.503648    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bf9f0d66-08fd-461f-a477-8d9993f60a7e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-05e496-8q9gs\" (UID: \"bf9f0d66-08fd-461f-a477-8d9993f60a7e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-05e496-8q9gs"
Sep 09 16:35:11.504265 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:35:11.504247    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bf9f0d66-08fd-461f-a477-8d9993f60a7e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-05e496-8q9gs\" (UID: \"bf9f0d66-08fd-461f-a477-8d9993f60a7e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-05e496-8q9gs"
Sep 09 16:35:11.571166 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:35:11.571105    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-05e496-8q9gs"
Sep 09 16:35:11.837784 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:35:11.837761    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-05e496-8q9gs"]
Sep 09 16:35:11.840272 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:35:11.840247    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf9f0d66_08fd_461f_a477_8d9993f60a7e.slice/crio-de2495145a499820013bfd7c8e79857aaeece4b8027cc7e81d83eabe02c78ddd WatchSource:0}: Error finding container de2495145a499820013bfd7c8e79857aaeece4b8027cc7e81d83eabe02c78ddd: Status 404 returned error can't find the container with id de2495145a499820013bfd7c8e79857aaeece4b8027cc7e81d83eabe02c78ddd
Sep 09 16:35:11.894257 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:35:11.894235    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-05e496-8q9gs" event={"ID":"bf9f0d66-08fd-461f-a477-8d9993f60a7e","Type":"ContainerStarted","Data":"de2495145a499820013bfd7c8e79857aaeece4b8027cc7e81d83eabe02c78ddd"}
Sep 09 16:35:12.900661 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:35:12.900626    2583 generic.go:356] "Generic (PLEG): container finished" podID="bf9f0d66-08fd-461f-a477-8d9993f60a7e" containerID="13ffb66b63c36b220e0b446cddd4bd3a8b3c273fc047af860507382ca6c92287" exitCode=0
Sep 09 16:35:12.900661 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:35:12.900660    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-05e496-8q9gs" event={"ID":"bf9f0d66-08fd-461f-a477-8d9993f60a7e","Type":"ContainerDied","Data":"13ffb66b63c36b220e0b446cddd4bd3a8b3c273fc047af860507382ca6c92287"}
Sep 09 16:35:14.044176 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:35:14.044153    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-05e496-8q9gs"
Sep 09 16:35:14.125151 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:35:14.125130    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bf9f0d66-08fd-461f-a477-8d9993f60a7e-maas-api-service-ca\") pod \"bf9f0d66-08fd-461f-a477-8d9993f60a7e\" (UID: \"bf9f0d66-08fd-461f-a477-8d9993f60a7e\") "
Sep 09 16:35:14.125453 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:35:14.125430    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bf9f0d66-08fd-461f-a477-8d9993f60a7e-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "bf9f0d66-08fd-461f-a477-8d9993f60a7e" (UID: "bf9f0d66-08fd-461f-a477-8d9993f60a7e"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 16:35:14.226951 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:35:14.226881    2583 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bf9f0d66-08fd-461f-a477-8d9993f60a7e-maas-api-service-ca\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\""
Sep 09 16:35:14.764896 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:35:14.764865    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:35:14.911530 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:35:14.911492    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:35:14.912676 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:35:14.912651    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-05e496-8q9gs" event={"ID":"bf9f0d66-08fd-461f-a477-8d9993f60a7e","Type":"ContainerDied","Data":"de2495145a499820013bfd7c8e79857aaeece4b8027cc7e81d83eabe02c78ddd"}
Sep 09 16:35:14.912758 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:35:14.912677    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-05e496-8q9gs"
Sep 09 16:35:14.912758 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:35:14.912720    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="de2495145a499820013bfd7c8e79857aaeece4b8027cc7e81d83eabe02c78ddd"
Sep 09 16:35:15.715024 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:35:15.714999    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:35:18.953384 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:35:18.953348    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:35:21.827230 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:35:21.827196    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:35:21.849445 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:35:21.849415    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-05e496-c677877f5-j7rtm"]
Sep 09 16:35:21.849659 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:35:21.849638    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-autores-05e496-c677877f5-j7rtm" podUID="585601a2-357d-41bd-8e51-b1553fe3dbf4" containerName="payload-processing" containerID="cri-o://13454406534b760589f4cacd45b40c57732cfb047263e20a2167023c137f01ad" gracePeriod=30
Sep 09 16:35:21.996204 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:35:21.996171    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-05e496-8q9gs"]
Sep 09 16:35:21.998117 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:35:21.998091    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-05e496-8q9gs"]
Sep 09 16:35:22.113516 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:35:22.113487    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:35:22.114319 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:35:22.114297    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-05e496-c677877f5-j7rtm"
Sep 09 16:35:22.163699 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:35:22.163676    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:35:22.195780 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:35:22.195756    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/585601a2-357d-41bd-8e51-b1553fe3dbf4-plugins-config-volume\") pod \"585601a2-357d-41bd-8e51-b1553fe3dbf4\" (UID: \"585601a2-357d-41bd-8e51-b1553fe3dbf4\") "
Sep 09 16:35:22.195888 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:35:22.195825    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5wzqx\" (UniqueName: \"kubernetes.io/projected/585601a2-357d-41bd-8e51-b1553fe3dbf4-kube-api-access-5wzqx\") pod \"585601a2-357d-41bd-8e51-b1553fe3dbf4\" (UID: \"585601a2-357d-41bd-8e51-b1553fe3dbf4\") "
Sep 09 16:35:22.196193 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:35:22.196170    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/585601a2-357d-41bd-8e51-b1553fe3dbf4-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "585601a2-357d-41bd-8e51-b1553fe3dbf4" (UID: "585601a2-357d-41bd-8e51-b1553fe3dbf4"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 16:35:22.197889 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:35:22.197852    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/585601a2-357d-41bd-8e51-b1553fe3dbf4-kube-api-access-5wzqx" (OuterVolumeSpecName: "kube-api-access-5wzqx") pod "585601a2-357d-41bd-8e51-b1553fe3dbf4" (UID: "585601a2-357d-41bd-8e51-b1553fe3dbf4"). InnerVolumeSpecName "kube-api-access-5wzqx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 16:35:22.238095 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:35:22.238072    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bf9f0d66-08fd-461f-a477-8d9993f60a7e" path="/var/lib/kubelet/pods/bf9f0d66-08fd-461f-a477-8d9993f60a7e/volumes"
Sep 09 16:35:22.296899 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:35:22.296872    2583 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/585601a2-357d-41bd-8e51-b1553fe3dbf4-plugins-config-volume\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\""
Sep 09 16:35:22.296899 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:35:22.296896    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5wzqx\" (UniqueName: \"kubernetes.io/projected/585601a2-357d-41bd-8e51-b1553fe3dbf4-kube-api-access-5wzqx\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\""
Sep 09 16:35:22.373721 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:35:22.373659    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:35:22.474860 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:35:22.474833    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:35:22.956553 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:35:22.956523    2583 generic.go:356] "Generic (PLEG): container finished" podID="585601a2-357d-41bd-8e51-b1553fe3dbf4" containerID="13454406534b760589f4cacd45b40c57732cfb047263e20a2167023c137f01ad" exitCode=0
Sep 09 16:35:22.956877 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:35:22.956563    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-05e496-c677877f5-j7rtm"
Sep 09 16:35:22.956877 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:35:22.956561    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-05e496-c677877f5-j7rtm" event={"ID":"585601a2-357d-41bd-8e51-b1553fe3dbf4","Type":"ContainerDied","Data":"13454406534b760589f4cacd45b40c57732cfb047263e20a2167023c137f01ad"}
Sep 09 16:35:22.956877 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:35:22.956689    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-05e496-c677877f5-j7rtm" event={"ID":"585601a2-357d-41bd-8e51-b1553fe3dbf4","Type":"ContainerDied","Data":"cdf5ec4fb4d352ee661a0956e9de3a95696a65eb90817725d679eb10f02770ef"}
Sep 09 16:35:22.956877 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:35:22.956719    2583 scope.go:117] "RemoveContainer" containerID="13454406534b760589f4cacd45b40c57732cfb047263e20a2167023c137f01ad"
Sep 09 16:35:22.965364 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:35:22.965348    2583 scope.go:117] "RemoveContainer" containerID="13454406534b760589f4cacd45b40c57732cfb047263e20a2167023c137f01ad"
Sep 09 16:35:22.965657 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:35:22.965634    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"13454406534b760589f4cacd45b40c57732cfb047263e20a2167023c137f01ad\": container with ID starting with 13454406534b760589f4cacd45b40c57732cfb047263e20a2167023c137f01ad not found: ID does not exist" containerID="13454406534b760589f4cacd45b40c57732cfb047263e20a2167023c137f01ad"
Sep 09 16:35:22.965746 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:35:22.965663    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"13454406534b760589f4cacd45b40c57732cfb047263e20a2167023c137f01ad"} err="failed to get container status \"13454406534b760589f4cacd45b40c57732cfb047263e20a2167023c137f01ad\": rpc error: code = NotFound desc = could not find container \"13454406534b760589f4cacd45b40c57732cfb047263e20a2167023c137f01ad\": container with ID starting with 13454406534b760589f4cacd45b40c57732cfb047263e20a2167023c137f01ad not found: ID does not exist"
Sep 09 16:35:22.972035 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:35:22.972008    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-05e496-c677877f5-j7rtm"]
Sep 09 16:35:22.974369 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:35:22.974346    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:35:22.977596 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:35:22.977578    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-05e496-c677877f5-j7rtm"]
Sep 09 16:35:23.036177 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:35:23.036139    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-autores-05e496-c677877f5-j7rtm" podUID="585601a2-357d-41bd-8e51-b1553fe3dbf4" containerName="payload-processing" probeResult="failure" output="dial tcp 10.132.0.43:9004: i/o timeout"
Sep 09 16:35:23.602484 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:35:23.602459    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:35:24.238540 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:35:24.238508    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="585601a2-357d-41bd-8e51-b1553fe3dbf4" path="/var/lib/kubelet/pods/585601a2-357d-41bd-8e51-b1553fe3dbf4/volumes"
Sep 09 16:35:27.473329 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:35:27.473296    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:35:29.011598 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:35:29.011556    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:35:34.575879 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:35:34.575840    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:35:34.679631 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:35:34.679602    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:35:34.775962 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:35:34.775925    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:35:37.839522 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:35:37.839488    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:35:39.304204 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:35:39.304176    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:35:47.524445 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:35:47.524414    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:35:50.628308 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:35:50.628259    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:35:56.725762 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:35:56.725724    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:35:56.826049 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:35:56.826019    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:36:04.228882 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:36:04.228809    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:36:05.222851 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:36:05.222818    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-explicit-26563f-openshift-default-58bfdcf77b-r4zlh"]
Sep 09 16:36:05.223505 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:36:05.223484    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bf9f0d66-08fd-461f-a477-8d9993f60a7e" containerName="revoke-keys"
Sep 09 16:36:05.223565 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:36:05.223510    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="bf9f0d66-08fd-461f-a477-8d9993f60a7e" containerName="revoke-keys"
Sep 09 16:36:05.223602 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:36:05.223567    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="585601a2-357d-41bd-8e51-b1553fe3dbf4" containerName="payload-processing"
Sep 09 16:36:05.223602 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:36:05.223577    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="585601a2-357d-41bd-8e51-b1553fe3dbf4" containerName="payload-processing"
Sep 09 16:36:05.223680 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:36:05.223667    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="bf9f0d66-08fd-461f-a477-8d9993f60a7e" containerName="revoke-keys"
Sep 09 16:36:05.223720 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:36:05.223690    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="585601a2-357d-41bd-8e51-b1553fe3dbf4" containerName="payload-processing"
Sep 09 16:36:05.228545 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:36:05.228521    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-26563f-openshift-default-58bfdcf77b-r4zlh"
Sep 09 16:36:05.231223 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:36:05.231200    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-explicit-26563f-openshift-default-dockercfg-62s7s\""
Sep 09 16:36:05.238257 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:36:05.238236    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-explicit-26563f-openshift-default-58bfdcf77b-r4zlh"]
Sep 09 16:36:05.354915 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:36:05.354885    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a60e44dd-dd86-4b5a-8d7b-7265bd997eb1-istio-data\") pod \"e2e-explicit-26563f-openshift-default-58bfdcf77b-r4zlh\" (UID: \"a60e44dd-dd86-4b5a-8d7b-7265bd997eb1\") " pod="openshift-ingress/e2e-explicit-26563f-openshift-default-58bfdcf77b-r4zlh"
Sep 09 16:36:05.355090 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:36:05.354947    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9nrfk\" (UniqueName: \"kubernetes.io/projected/a60e44dd-dd86-4b5a-8d7b-7265bd997eb1-kube-api-access-9nrfk\") pod \"e2e-explicit-26563f-openshift-default-58bfdcf77b-r4zlh\" (UID: \"a60e44dd-dd86-4b5a-8d7b-7265bd997eb1\") " pod="openshift-ingress/e2e-explicit-26563f-openshift-default-58bfdcf77b-r4zlh"
Sep 09 16:36:05.355090 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:36:05.354977    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a60e44dd-dd86-4b5a-8d7b-7265bd997eb1-istio-token\") pod \"e2e-explicit-26563f-openshift-default-58bfdcf77b-r4zlh\" (UID: \"a60e44dd-dd86-4b5a-8d7b-7265bd997eb1\") " pod="openshift-ingress/e2e-explicit-26563f-openshift-default-58bfdcf77b-r4zlh"
Sep 09 16:36:05.355090 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:36:05.355052    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a60e44dd-dd86-4b5a-8d7b-7265bd997eb1-istiod-ca-cert\") pod \"e2e-explicit-26563f-openshift-default-58bfdcf77b-r4zlh\" (UID: \"a60e44dd-dd86-4b5a-8d7b-7265bd997eb1\") " pod="openshift-ingress/e2e-explicit-26563f-openshift-default-58bfdcf77b-r4zlh"
Sep 09 16:36:05.355090 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:36:05.355071    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a60e44dd-dd86-4b5a-8d7b-7265bd997eb1-credential-socket\") pod \"e2e-explicit-26563f-openshift-default-58bfdcf77b-r4zlh\" (UID: \"a60e44dd-dd86-4b5a-8d7b-7265bd997eb1\") " pod="openshift-ingress/e2e-explicit-26563f-openshift-default-58bfdcf77b-r4zlh"
Sep 09 16:36:05.355224 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:36:05.355091    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a60e44dd-dd86-4b5a-8d7b-7265bd997eb1-istio-podinfo\") pod \"e2e-explicit-26563f-openshift-default-58bfdcf77b-r4zlh\" (UID: \"a60e44dd-dd86-4b5a-8d7b-7265bd997eb1\") " pod="openshift-ingress/e2e-explicit-26563f-openshift-default-58bfdcf77b-r4zlh"
Sep 09 16:36:05.355224 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:36:05.355132    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a60e44dd-dd86-4b5a-8d7b-7265bd997eb1-workload-certs\") pod \"e2e-explicit-26563f-openshift-default-58bfdcf77b-r4zlh\" (UID: \"a60e44dd-dd86-4b5a-8d7b-7265bd997eb1\") " pod="openshift-ingress/e2e-explicit-26563f-openshift-default-58bfdcf77b-r4zlh"
Sep 09 16:36:05.355224 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:36:05.355192    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a60e44dd-dd86-4b5a-8d7b-7265bd997eb1-workload-socket\") pod \"e2e-explicit-26563f-openshift-default-58bfdcf77b-r4zlh\" (UID: \"a60e44dd-dd86-4b5a-8d7b-7265bd997eb1\") " pod="openshift-ingress/e2e-explicit-26563f-openshift-default-58bfdcf77b-r4zlh"
Sep 09 16:36:05.355312 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:36:05.355250    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a60e44dd-dd86-4b5a-8d7b-7265bd997eb1-istio-envoy\") pod \"e2e-explicit-26563f-openshift-default-58bfdcf77b-r4zlh\" (UID: \"a60e44dd-dd86-4b5a-8d7b-7265bd997eb1\") " pod="openshift-ingress/e2e-explicit-26563f-openshift-default-58bfdcf77b-r4zlh"
Sep 09 16:36:05.456041 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:36:05.456015    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a60e44dd-dd86-4b5a-8d7b-7265bd997eb1-workload-certs\") pod \"e2e-explicit-26563f-openshift-default-58bfdcf77b-r4zlh\" (UID: \"a60e44dd-dd86-4b5a-8d7b-7265bd997eb1\") " pod="openshift-ingress/e2e-explicit-26563f-openshift-default-58bfdcf77b-r4zlh"
Sep 09 16:36:05.456157 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:36:05.456049    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a60e44dd-dd86-4b5a-8d7b-7265bd997eb1-workload-socket\") pod \"e2e-explicit-26563f-openshift-default-58bfdcf77b-r4zlh\" (UID: \"a60e44dd-dd86-4b5a-8d7b-7265bd997eb1\") " pod="openshift-ingress/e2e-explicit-26563f-openshift-default-58bfdcf77b-r4zlh"
Sep 09 16:36:05.456157 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:36:05.456080    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a60e44dd-dd86-4b5a-8d7b-7265bd997eb1-istio-envoy\") pod \"e2e-explicit-26563f-openshift-default-58bfdcf77b-r4zlh\" (UID: \"a60e44dd-dd86-4b5a-8d7b-7265bd997eb1\") " pod="openshift-ingress/e2e-explicit-26563f-openshift-default-58bfdcf77b-r4zlh"
Sep 09 16:36:05.456157 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:36:05.456107    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a60e44dd-dd86-4b5a-8d7b-7265bd997eb1-istio-data\") pod \"e2e-explicit-26563f-openshift-default-58bfdcf77b-r4zlh\" (UID: \"a60e44dd-dd86-4b5a-8d7b-7265bd997eb1\") " pod="openshift-ingress/e2e-explicit-26563f-openshift-default-58bfdcf77b-r4zlh"
Sep 09 16:36:05.456157 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:36:05.456146    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9nrfk\" (UniqueName: \"kubernetes.io/projected/a60e44dd-dd86-4b5a-8d7b-7265bd997eb1-kube-api-access-9nrfk\") pod \"e2e-explicit-26563f-openshift-default-58bfdcf77b-r4zlh\" (UID: \"a60e44dd-dd86-4b5a-8d7b-7265bd997eb1\") " pod="openshift-ingress/e2e-explicit-26563f-openshift-default-58bfdcf77b-r4zlh"
Sep 09 16:36:05.456342 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:36:05.456170    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a60e44dd-dd86-4b5a-8d7b-7265bd997eb1-istio-token\") pod \"e2e-explicit-26563f-openshift-default-58bfdcf77b-r4zlh\" (UID: \"a60e44dd-dd86-4b5a-8d7b-7265bd997eb1\") " pod="openshift-ingress/e2e-explicit-26563f-openshift-default-58bfdcf77b-r4zlh"
Sep 09 16:36:05.456342 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:36:05.456191    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a60e44dd-dd86-4b5a-8d7b-7265bd997eb1-istiod-ca-cert\") pod \"e2e-explicit-26563f-openshift-default-58bfdcf77b-r4zlh\" (UID: \"a60e44dd-dd86-4b5a-8d7b-7265bd997eb1\") " pod="openshift-ingress/e2e-explicit-26563f-openshift-default-58bfdcf77b-r4zlh"
Sep 09 16:36:05.456433 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:36:05.456381    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a60e44dd-dd86-4b5a-8d7b-7265bd997eb1-workload-certs\") pod \"e2e-explicit-26563f-openshift-default-58bfdcf77b-r4zlh\" (UID: \"a60e44dd-dd86-4b5a-8d7b-7265bd997eb1\") " pod="openshift-ingress/e2e-explicit-26563f-openshift-default-58bfdcf77b-r4zlh"
Sep 09 16:36:05.456433 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:36:05.456395    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a60e44dd-dd86-4b5a-8d7b-7265bd997eb1-credential-socket\") pod \"e2e-explicit-26563f-openshift-default-58bfdcf77b-r4zlh\" (UID: \"a60e44dd-dd86-4b5a-8d7b-7265bd997eb1\") " pod="openshift-ingress/e2e-explicit-26563f-openshift-default-58bfdcf77b-r4zlh"
Sep 09 16:36:05.456566 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:36:05.456430    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a60e44dd-dd86-4b5a-8d7b-7265bd997eb1-workload-socket\") pod \"e2e-explicit-26563f-openshift-default-58bfdcf77b-r4zlh\" (UID: \"a60e44dd-dd86-4b5a-8d7b-7265bd997eb1\") " pod="openshift-ingress/e2e-explicit-26563f-openshift-default-58bfdcf77b-r4zlh"
Sep 09 16:36:05.456566 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:36:05.456443    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a60e44dd-dd86-4b5a-8d7b-7265bd997eb1-istio-podinfo\") pod \"e2e-explicit-26563f-openshift-default-58bfdcf77b-r4zlh\" (UID: \"a60e44dd-dd86-4b5a-8d7b-7265bd997eb1\") " pod="openshift-ingress/e2e-explicit-26563f-openshift-default-58bfdcf77b-r4zlh"
Sep 09 16:36:05.456566 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:36:05.456518    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a60e44dd-dd86-4b5a-8d7b-7265bd997eb1-istio-data\") pod \"e2e-explicit-26563f-openshift-default-58bfdcf77b-r4zlh\" (UID: \"a60e44dd-dd86-4b5a-8d7b-7265bd997eb1\") " pod="openshift-ingress/e2e-explicit-26563f-openshift-default-58bfdcf77b-r4zlh"
Sep 09 16:36:05.456725 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:36:05.456675    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a60e44dd-dd86-4b5a-8d7b-7265bd997eb1-credential-socket\") pod \"e2e-explicit-26563f-openshift-default-58bfdcf77b-r4zlh\" (UID: \"a60e44dd-dd86-4b5a-8d7b-7265bd997eb1\") " pod="openshift-ingress/e2e-explicit-26563f-openshift-default-58bfdcf77b-r4zlh"
Sep 09 16:36:05.456895 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:36:05.456876    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a60e44dd-dd86-4b5a-8d7b-7265bd997eb1-istiod-ca-cert\") pod \"e2e-explicit-26563f-openshift-default-58bfdcf77b-r4zlh\" (UID: \"a60e44dd-dd86-4b5a-8d7b-7265bd997eb1\") " pod="openshift-ingress/e2e-explicit-26563f-openshift-default-58bfdcf77b-r4zlh"
Sep 09 16:36:05.458283 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:36:05.458261    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a60e44dd-dd86-4b5a-8d7b-7265bd997eb1-istio-envoy\") pod \"e2e-explicit-26563f-openshift-default-58bfdcf77b-r4zlh\" (UID: \"a60e44dd-dd86-4b5a-8d7b-7265bd997eb1\") " pod="openshift-ingress/e2e-explicit-26563f-openshift-default-58bfdcf77b-r4zlh"
Sep 09 16:36:05.458484 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:36:05.458468    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a60e44dd-dd86-4b5a-8d7b-7265bd997eb1-istio-podinfo\") pod \"e2e-explicit-26563f-openshift-default-58bfdcf77b-r4zlh\" (UID: \"a60e44dd-dd86-4b5a-8d7b-7265bd997eb1\") " pod="openshift-ingress/e2e-explicit-26563f-openshift-default-58bfdcf77b-r4zlh"
Sep 09 16:36:05.463268 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:36:05.463250    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a60e44dd-dd86-4b5a-8d7b-7265bd997eb1-istio-token\") pod \"e2e-explicit-26563f-openshift-default-58bfdcf77b-r4zlh\" (UID: \"a60e44dd-dd86-4b5a-8d7b-7265bd997eb1\") " pod="openshift-ingress/e2e-explicit-26563f-openshift-default-58bfdcf77b-r4zlh"
Sep 09 16:36:05.463654 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:36:05.463633    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9nrfk\" (UniqueName: \"kubernetes.io/projected/a60e44dd-dd86-4b5a-8d7b-7265bd997eb1-kube-api-access-9nrfk\") pod \"e2e-explicit-26563f-openshift-default-58bfdcf77b-r4zlh\" (UID: \"a60e44dd-dd86-4b5a-8d7b-7265bd997eb1\") " pod="openshift-ingress/e2e-explicit-26563f-openshift-default-58bfdcf77b-r4zlh"
Sep 09 16:36:05.541250 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:36:05.541192    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-26563f-openshift-default-58bfdcf77b-r4zlh"
Sep 09 16:36:05.814866 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:36:05.814835    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-explicit-26563f-openshift-default-58bfdcf77b-r4zlh"]
Sep 09 16:36:05.816200 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:36:05.816174    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda60e44dd_dd86_4b5a_8d7b_7265bd997eb1.slice/crio-0b0d38a22753cbf646294d134528043578461cb25517fa496d0d538489d65a79 WatchSource:0}: Error finding container 0b0d38a22753cbf646294d134528043578461cb25517fa496d0d538489d65a79: Status 404 returned error can't find the container with id 0b0d38a22753cbf646294d134528043578461cb25517fa496d0d538489d65a79
Sep 09 16:36:05.819037 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:36:05.819004    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 09 16:36:05.819130 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:36:05.819070    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 09 16:36:05.819130 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:36:05.819100    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 09 16:36:06.189609 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:36:06.189578    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-26563f-openshift-default-58bfdcf77b-r4zlh" event={"ID":"a60e44dd-dd86-4b5a-8d7b-7265bd997eb1","Type":"ContainerStarted","Data":"47aff536d30483b6fdd1cfb85e3b94689ba5941a21c7a5bd87f4755871f5e7b3"}
Sep 09 16:36:06.189807 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:36:06.189640    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-26563f-openshift-default-58bfdcf77b-r4zlh" event={"ID":"a60e44dd-dd86-4b5a-8d7b-7265bd997eb1","Type":"ContainerStarted","Data":"0b0d38a22753cbf646294d134528043578461cb25517fa496d0d538489d65a79"}
Sep 09 16:36:06.207719 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:36:06.207676    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-explicit-26563f-openshift-default-58bfdcf77b-r4zlh" podStartSLOduration=1.207661091 podStartE2EDuration="1.207661091s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 16:36:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:36:06.20688648 +0000 UTC m=+1348.560616304" watchObservedRunningTime="2026-09-09 16:36:06.207661091 +0000 UTC m=+1348.561390922"
Sep 09 16:36:06.542201 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:36:06.542132    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-explicit-26563f-openshift-default-58bfdcf77b-r4zlh"
Sep 09 16:36:06.547236 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:36:06.547216    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-explicit-26563f-openshift-default-58bfdcf77b-r4zlh"
Sep 09 16:36:07.196506 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:36:07.196473    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-explicit-26563f-openshift-default-58bfdcf77b-r4zlh"
Sep 09 16:36:07.197296 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:36:07.197275    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-explicit-26563f-openshift-default-58bfdcf77b-r4zlh"
Sep 09 16:36:07.548343 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:36:07.548268    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:36:07.648761 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:36:07.648695    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:36:07.887594 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:36:07.887560    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:36:11.008401 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:36:11.008363    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:36:11.076740 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:36:11.076700    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:36:13.681619 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:36:13.681588    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:36:13.793203 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:36:13.793180    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:36:13.889916 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:36:13.889867    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:36:13.990561 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:36:13.990475    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:36:14.673315 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:36:14.673288    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:36:14.769309 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:36:14.769255    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:36:15.007145 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:36:15.007076    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:36:16.460751 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:36:16.460706    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:36:22.101926 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:36:22.101887    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:36:22.202609 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:36:22.202582    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:36:22.809911 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:36:22.809882    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:36:27.301290 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:36:27.301204    2583 generic.go:356] "Generic (PLEG): container finished" podID="a60e44dd-dd86-4b5a-8d7b-7265bd997eb1" containerID="47aff536d30483b6fdd1cfb85e3b94689ba5941a21c7a5bd87f4755871f5e7b3" exitCode=0
Sep 09 16:36:27.301290 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:36:27.301273    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-26563f-openshift-default-58bfdcf77b-r4zlh" event={"ID":"a60e44dd-dd86-4b5a-8d7b-7265bd997eb1","Type":"ContainerDied","Data":"47aff536d30483b6fdd1cfb85e3b94689ba5941a21c7a5bd87f4755871f5e7b3"}
Sep 09 16:36:27.301721 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:36:27.301702    2583 scope.go:117] "RemoveContainer" containerID="47aff536d30483b6fdd1cfb85e3b94689ba5941a21c7a5bd87f4755871f5e7b3"
Sep 09 16:36:27.302755 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:36:27.302723    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 09 16:36:27.302870 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:36:27.302808    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 09 16:36:27.302935 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:36:27.302867    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 09 16:36:28.312128 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:36:28.312093    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-26563f-openshift-default-58bfdcf77b-r4zlh" event={"ID":"a60e44dd-dd86-4b5a-8d7b-7265bd997eb1","Type":"ContainerStarted","Data":"48acb2cda2c573250d3f275d49a38d9d630c42c25b554fe28349ddfbf30533ab"}
Sep 09 16:36:28.541643 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:36:28.541614    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-explicit-26563f-openshift-default-58bfdcf77b-r4zlh"
Sep 09 16:36:28.541804 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:36:28.541763    2583 patch_prober.go:28] interesting pod/e2e-explicit-26563f-openshift-default-58bfdcf77b-r4zlh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body=
Sep 09 16:36:28.541846 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:36:28.541805    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-26563f-openshift-default-58bfdcf77b-r4zlh" podUID="a60e44dd-dd86-4b5a-8d7b-7265bd997eb1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused"
Sep 09 16:36:28.546150 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:36:28.546124    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:36:28.672066 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:36:28.672027    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:36:28.784559 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:36:28.784525    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:36:29.070348 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:36:29.070272    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-77176368-openshift-default-776fbf68d4-kptn9"]
Sep 09 16:36:29.074064 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:36:29.074041    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-77176368-openshift-default-776fbf68d4-kptn9"
Sep 09 16:36:29.077122 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:36:29.077102    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-77176368-openshift-default-dockercfg-6cs2v\""
Sep 09 16:36:29.097011 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:36:29.088040    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-77176368-openshift-default-776fbf68d4-kptn9"]
Sep 09 16:36:29.105329 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:36:29.105304    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:36:29.176879 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:36:29.176847    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea9f8073-4763-4a3d-bff6-ca92616541d9-workload-socket\") pod \"e2e-mt-77176368-openshift-default-776fbf68d4-kptn9\" (UID: \"ea9f8073-4763-4a3d-bff6-ca92616541d9\") " pod="openshift-ingress/e2e-mt-77176368-openshift-default-776fbf68d4-kptn9"
Sep 09 16:36:29.176879 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:36:29.176889    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ea9f8073-4763-4a3d-bff6-ca92616541d9-istio-podinfo\") pod \"e2e-mt-77176368-openshift-default-776fbf68d4-kptn9\" (UID: \"ea9f8073-4763-4a3d-bff6-ca92616541d9\") " pod="openshift-ingress/e2e-mt-77176368-openshift-default-776fbf68d4-kptn9"
Sep 09 16:36:29.176879 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:36:29.176929    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ea9f8073-4763-4a3d-bff6-ca92616541d9-istio-envoy\") pod \"e2e-mt-77176368-openshift-default-776fbf68d4-kptn9\" (UID: \"ea9f8073-4763-4a3d-bff6-ca92616541d9\") " pod="openshift-ingress/e2e-mt-77176368-openshift-default-776fbf68d4-kptn9"
Sep 09 16:36:29.177259 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:36:29.176952    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ea9f8073-4763-4a3d-bff6-ca92616541d9-istiod-ca-cert\") pod \"e2e-mt-77176368-openshift-default-776fbf68d4-kptn9\" (UID: \"ea9f8073-4763-4a3d-bff6-ca92616541d9\") " pod="openshift-ingress/e2e-mt-77176368-openshift-default-776fbf68d4-kptn9"
Sep 09 16:36:29.177259 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:36:29.177020    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ea9f8073-4763-4a3d-bff6-ca92616541d9-istio-token\") pod \"e2e-mt-77176368-openshift-default-776fbf68d4-kptn9\" (UID: \"ea9f8073-4763-4a3d-bff6-ca92616541d9\") " pod="openshift-ingress/e2e-mt-77176368-openshift-default-776fbf68d4-kptn9"
Sep 09 16:36:29.177259 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:36:29.177055    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea9f8073-4763-4a3d-bff6-ca92616541d9-credential-socket\") pod \"e2e-mt-77176368-openshift-default-776fbf68d4-kptn9\" (UID: \"ea9f8073-4763-4a3d-bff6-ca92616541d9\") " pod="openshift-ingress/e2e-mt-77176368-openshift-default-776fbf68d4-kptn9"
Sep 09 16:36:29.177259 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:36:29.177102    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ea9f8073-4763-4a3d-bff6-ca92616541d9-workload-certs\") pod \"e2e-mt-77176368-openshift-default-776fbf68d4-kptn9\" (UID: \"ea9f8073-4763-4a3d-bff6-ca92616541d9\") " pod="openshift-ingress/e2e-mt-77176368-openshift-default-776fbf68d4-kptn9"
Sep 09 16:36:29.177259 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:36:29.177145    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-497ql\" (UniqueName: \"kubernetes.io/projected/ea9f8073-4763-4a3d-bff6-ca92616541d9-kube-api-access-497ql\") pod \"e2e-mt-77176368-openshift-default-776fbf68d4-kptn9\" (UID: \"ea9f8073-4763-4a3d-bff6-ca92616541d9\") " pod="openshift-ingress/e2e-mt-77176368-openshift-default-776fbf68d4-kptn9"
Sep 09 16:36:29.177259 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:36:29.177197    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ea9f8073-4763-4a3d-bff6-ca92616541d9-istio-data\") pod \"e2e-mt-77176368-openshift-default-776fbf68d4-kptn9\" (UID: \"ea9f8073-4763-4a3d-bff6-ca92616541d9\") " pod="openshift-ingress/e2e-mt-77176368-openshift-default-776fbf68d4-kptn9"
Sep 09 16:36:29.277853 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:36:29.277821    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ea9f8073-4763-4a3d-bff6-ca92616541d9-istio-envoy\") pod \"e2e-mt-77176368-openshift-default-776fbf68d4-kptn9\" (UID: \"ea9f8073-4763-4a3d-bff6-ca92616541d9\") " pod="openshift-ingress/e2e-mt-77176368-openshift-default-776fbf68d4-kptn9"
Sep 09 16:36:29.278003 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:36:29.277857    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ea9f8073-4763-4a3d-bff6-ca92616541d9-istiod-ca-cert\") pod \"e2e-mt-77176368-openshift-default-776fbf68d4-kptn9\" (UID: \"ea9f8073-4763-4a3d-bff6-ca92616541d9\") " pod="openshift-ingress/e2e-mt-77176368-openshift-default-776fbf68d4-kptn9"
Sep 09 16:36:29.278003 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:36:29.277891    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ea9f8073-4763-4a3d-bff6-ca92616541d9-istio-token\") pod \"e2e-mt-77176368-openshift-default-776fbf68d4-kptn9\" (UID: \"ea9f8073-4763-4a3d-bff6-ca92616541d9\") " pod="openshift-ingress/e2e-mt-77176368-openshift-default-776fbf68d4-kptn9"
Sep 09 16:36:29.278003 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:36:29.277914    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea9f8073-4763-4a3d-bff6-ca92616541d9-credential-socket\") pod \"e2e-mt-77176368-openshift-default-776fbf68d4-kptn9\" (UID: \"ea9f8073-4763-4a3d-bff6-ca92616541d9\") " pod="openshift-ingress/e2e-mt-77176368-openshift-default-776fbf68d4-kptn9"
Sep 09 16:36:29.278003 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:36:29.277953    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ea9f8073-4763-4a3d-bff6-ca92616541d9-workload-certs\") pod \"e2e-mt-77176368-openshift-default-776fbf68d4-kptn9\" (UID: \"ea9f8073-4763-4a3d-bff6-ca92616541d9\") " pod="openshift-ingress/e2e-mt-77176368-openshift-default-776fbf68d4-kptn9"
Sep 09 16:36:29.278003 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:36:29.277977    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-497ql\" (UniqueName: \"kubernetes.io/projected/ea9f8073-4763-4a3d-bff6-ca92616541d9-kube-api-access-497ql\") pod \"e2e-mt-77176368-openshift-default-776fbf68d4-kptn9\" (UID: \"ea9f8073-4763-4a3d-bff6-ca92616541d9\") " pod="openshift-ingress/e2e-mt-77176368-openshift-default-776fbf68d4-kptn9"
Sep 09 16:36:29.278235 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:36:29.278047    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ea9f8073-4763-4a3d-bff6-ca92616541d9-istio-data\") pod \"e2e-mt-77176368-openshift-default-776fbf68d4-kptn9\" (UID: \"ea9f8073-4763-4a3d-bff6-ca92616541d9\") " pod="openshift-ingress/e2e-mt-77176368-openshift-default-776fbf68d4-kptn9"
Sep 09 16:36:29.278235 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:36:29.278084    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea9f8073-4763-4a3d-bff6-ca92616541d9-workload-socket\") pod \"e2e-mt-77176368-openshift-default-776fbf68d4-kptn9\" (UID: \"ea9f8073-4763-4a3d-bff6-ca92616541d9\") " pod="openshift-ingress/e2e-mt-77176368-openshift-default-776fbf68d4-kptn9"
Sep 09 16:36:29.278386 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:36:29.278351    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ea9f8073-4763-4a3d-bff6-ca92616541d9-workload-certs\") pod \"e2e-mt-77176368-openshift-default-776fbf68d4-kptn9\" (UID: \"ea9f8073-4763-4a3d-bff6-ca92616541d9\") " pod="openshift-ingress/e2e-mt-77176368-openshift-default-776fbf68d4-kptn9"
Sep 09 16:36:29.278453 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:36:29.278403    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ea9f8073-4763-4a3d-bff6-ca92616541d9-istio-podinfo\") pod \"e2e-mt-77176368-openshift-default-776fbf68d4-kptn9\" (UID: \"ea9f8073-4763-4a3d-bff6-ca92616541d9\") " pod="openshift-ingress/e2e-mt-77176368-openshift-default-776fbf68d4-kptn9"
Sep 09 16:36:29.278453 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:36:29.278430    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea9f8073-4763-4a3d-bff6-ca92616541d9-workload-socket\") pod \"e2e-mt-77176368-openshift-default-776fbf68d4-kptn9\" (UID: \"ea9f8073-4763-4a3d-bff6-ca92616541d9\") " pod="openshift-ingress/e2e-mt-77176368-openshift-default-776fbf68d4-kptn9"
Sep 09 16:36:29.278542 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:36:29.278458    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ea9f8073-4763-4a3d-bff6-ca92616541d9-istio-data\") pod \"e2e-mt-77176368-openshift-default-776fbf68d4-kptn9\" (UID: \"ea9f8073-4763-4a3d-bff6-ca92616541d9\") " pod="openshift-ingress/e2e-mt-77176368-openshift-default-776fbf68d4-kptn9"
Sep 09 16:36:29.278542 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:36:29.278405    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea9f8073-4763-4a3d-bff6-ca92616541d9-credential-socket\") pod \"e2e-mt-77176368-openshift-default-776fbf68d4-kptn9\" (UID: \"ea9f8073-4763-4a3d-bff6-ca92616541d9\") " pod="openshift-ingress/e2e-mt-77176368-openshift-default-776fbf68d4-kptn9"
Sep 09 16:36:29.278636 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:36:29.278616    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ea9f8073-4763-4a3d-bff6-ca92616541d9-istiod-ca-cert\") pod \"e2e-mt-77176368-openshift-default-776fbf68d4-kptn9\" (UID: \"ea9f8073-4763-4a3d-bff6-ca92616541d9\") " pod="openshift-ingress/e2e-mt-77176368-openshift-default-776fbf68d4-kptn9"
Sep 09 16:36:29.280111 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:36:29.280090    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ea9f8073-4763-4a3d-bff6-ca92616541d9-istio-envoy\") pod \"e2e-mt-77176368-openshift-default-776fbf68d4-kptn9\" (UID: \"ea9f8073-4763-4a3d-bff6-ca92616541d9\") " pod="openshift-ingress/e2e-mt-77176368-openshift-default-776fbf68d4-kptn9"
Sep 09 16:36:29.280600 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:36:29.280579    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ea9f8073-4763-4a3d-bff6-ca92616541d9-istio-podinfo\") pod \"e2e-mt-77176368-openshift-default-776fbf68d4-kptn9\" (UID: \"ea9f8073-4763-4a3d-bff6-ca92616541d9\") " pod="openshift-ingress/e2e-mt-77176368-openshift-default-776fbf68d4-kptn9"
Sep 09 16:36:29.285226 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:36:29.285207    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ea9f8073-4763-4a3d-bff6-ca92616541d9-istio-token\") pod \"e2e-mt-77176368-openshift-default-776fbf68d4-kptn9\" (UID: \"ea9f8073-4763-4a3d-bff6-ca92616541d9\") " pod="openshift-ingress/e2e-mt-77176368-openshift-default-776fbf68d4-kptn9"
Sep 09 16:36:29.285909 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:36:29.285893    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-497ql\" (UniqueName: \"kubernetes.io/projected/ea9f8073-4763-4a3d-bff6-ca92616541d9-kube-api-access-497ql\") pod \"e2e-mt-77176368-openshift-default-776fbf68d4-kptn9\" (UID: \"ea9f8073-4763-4a3d-bff6-ca92616541d9\") " pod="openshift-ingress/e2e-mt-77176368-openshift-default-776fbf68d4-kptn9"
Sep 09 16:36:29.386713 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:36:29.386694    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-77176368-openshift-default-776fbf68d4-kptn9"
Sep 09 16:36:29.542125 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:36:29.542092    2583 patch_prober.go:28] interesting pod/e2e-explicit-26563f-openshift-default-58bfdcf77b-r4zlh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body=
Sep 09 16:36:29.542266 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:36:29.542152    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-26563f-openshift-default-58bfdcf77b-r4zlh" podUID="a60e44dd-dd86-4b5a-8d7b-7265bd997eb1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused"
Sep 09 16:36:29.646935 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:36:29.646818    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:36:29.682245 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:36:29.682217    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-77176368-openshift-default-776fbf68d4-kptn9"]
Sep 09 16:36:29.683851 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:36:29.683822    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea9f8073_4763_4a3d_bff6_ca92616541d9.slice/crio-ebcb52865a167c088bcf08d78cc24d23304101af57822a1045720bbb720cc11f WatchSource:0}: Error finding container ebcb52865a167c088bcf08d78cc24d23304101af57822a1045720bbb720cc11f: Status 404 returned error can't find the container with id ebcb52865a167c088bcf08d78cc24d23304101af57822a1045720bbb720cc11f
Sep 09 16:36:29.686455 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:36:29.686428    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 09 16:36:29.686537 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:36:29.686484    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 09 16:36:29.686537 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:36:29.686509    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 09 16:36:30.324302 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:36:30.324266    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-77176368-openshift-default-776fbf68d4-kptn9" event={"ID":"ea9f8073-4763-4a3d-bff6-ca92616541d9","Type":"ContainerStarted","Data":"b99c73bbc1e924446b9962741a96a990f6668afcc2d2640b656ffe921a806acb"}
Sep 09 16:36:30.324488 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:36:30.324326    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-77176368-openshift-default-776fbf68d4-kptn9" event={"ID":"ea9f8073-4763-4a3d-bff6-ca92616541d9","Type":"ContainerStarted","Data":"ebcb52865a167c088bcf08d78cc24d23304101af57822a1045720bbb720cc11f"}
Sep 09 16:36:30.344629 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:36:30.344583    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-77176368-openshift-default-776fbf68d4-kptn9" podStartSLOduration=1.344567643 podStartE2EDuration="1.344567643s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 16:36:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:36:30.342875991 +0000 UTC m=+1372.696605910" watchObservedRunningTime="2026-09-09 16:36:30.344567643 +0000 UTC m=+1372.698297532"
Sep 09 16:36:30.387411 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:36:30.387389    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-77176368-openshift-default-776fbf68d4-kptn9"
Sep 09 16:36:30.401713 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:36:30.401690    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-77176368-openshift-default-776fbf68d4-kptn9"
Sep 09 16:36:30.542390 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:36:30.542359    2583 patch_prober.go:28] interesting pod/e2e-explicit-26563f-openshift-default-58bfdcf77b-r4zlh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body=
Sep 09 16:36:30.542546 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:36:30.542419    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-26563f-openshift-default-58bfdcf77b-r4zlh" podUID="a60e44dd-dd86-4b5a-8d7b-7265bd997eb1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused"
Sep 09 16:36:31.329481 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:36:31.329454    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-77176368-openshift-default-776fbf68d4-kptn9"
Sep 09 16:36:31.330440 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:36:31.330417    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-77176368-openshift-default-776fbf68d4-kptn9"
Sep 09 16:36:31.541923 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:36:31.541888    2583 patch_prober.go:28] interesting pod/e2e-explicit-26563f-openshift-default-58bfdcf77b-r4zlh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body=
Sep 09 16:36:31.542297 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:36:31.541952    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-26563f-openshift-default-58bfdcf77b-r4zlh" podUID="a60e44dd-dd86-4b5a-8d7b-7265bd997eb1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused"
Sep 09 16:36:31.994731 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:36:31.994677    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:36:32.542278 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:36:32.542243    2583 patch_prober.go:28] interesting pod/e2e-explicit-26563f-openshift-default-58bfdcf77b-r4zlh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body=
Sep 09 16:36:32.542617 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:36:32.542302    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-26563f-openshift-default-58bfdcf77b-r4zlh" podUID="a60e44dd-dd86-4b5a-8d7b-7265bd997eb1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused"
Sep 09 16:36:33.545937 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:36:33.545815    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-explicit-26563f-openshift-default-58bfdcf77b-r4zlh"
Sep 09 16:36:33.546367 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:36:33.546223    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-explicit-26563f-openshift-default-58bfdcf77b-r4zlh"
Sep 09 16:36:33.546825 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:36:33.546805    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-explicit-26563f-openshift-default-58bfdcf77b-r4zlh"
Sep 09 16:36:34.918698 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:36:34.918661    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:36:34.981795 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:36:34.981766    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:36:35.034771 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:36:35.034742    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:36:35.554733 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:36:35.554696    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:36:35.629186 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:36:35.629151    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:36:38.855540 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:36:38.855503    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:36:48.560511 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:36:48.560473    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:36:52.718253 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:36:52.718227    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:36:52.825334 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:36:52.825298    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-26563f-r64k4"]
Sep 09 16:36:52.827747 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:36:52.827728    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-26563f-r64k4"
Sep 09 16:36:52.830165 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:36:52.830143    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jz5ff\""
Sep 09 16:36:52.834191 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:36:52.834167    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-26563f-r64k4"]
Sep 09 16:36:52.920230 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:36:52.920202    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/001e73f4-ff72-42fe-b2eb-b66d995015a9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-26563f-r64k4\" (UID: \"001e73f4-ff72-42fe-b2eb-b66d995015a9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-26563f-r64k4"
Sep 09 16:36:53.021127 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:36:53.021100    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/001e73f4-ff72-42fe-b2eb-b66d995015a9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-26563f-r64k4\" (UID: \"001e73f4-ff72-42fe-b2eb-b66d995015a9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-26563f-r64k4"
Sep 09 16:36:53.021707 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:36:53.021690    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/001e73f4-ff72-42fe-b2eb-b66d995015a9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-26563f-r64k4\" (UID: \"001e73f4-ff72-42fe-b2eb-b66d995015a9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-26563f-r64k4"
Sep 09 16:36:53.093844 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:36:53.093784    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:36:53.139420 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:36:53.139393    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-26563f-r64k4"
Sep 09 16:36:53.416352 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:36:53.416331    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-26563f-r64k4"]
Sep 09 16:36:53.418317 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:36:53.418289    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod001e73f4_ff72_42fe_b2eb_b66d995015a9.slice/crio-c22446fec6944163f849c9b2880c0c6dfdadb3129708dc46becd989af38f3212 WatchSource:0}: Error finding container c22446fec6944163f849c9b2880c0c6dfdadb3129708dc46becd989af38f3212: Status 404 returned error can't find the container with id c22446fec6944163f849c9b2880c0c6dfdadb3129708dc46becd989af38f3212
Sep 09 16:36:53.455281 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:36:53.455256    2583 generic.go:356] "Generic (PLEG): container finished" podID="ea9f8073-4763-4a3d-bff6-ca92616541d9" containerID="b99c73bbc1e924446b9962741a96a990f6668afcc2d2640b656ffe921a806acb" exitCode=0
Sep 09 16:36:53.455392 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:36:53.455320    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-77176368-openshift-default-776fbf68d4-kptn9" event={"ID":"ea9f8073-4763-4a3d-bff6-ca92616541d9","Type":"ContainerDied","Data":"b99c73bbc1e924446b9962741a96a990f6668afcc2d2640b656ffe921a806acb"}
Sep 09 16:36:53.455689 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:36:53.455672    2583 scope.go:117] "RemoveContainer" containerID="b99c73bbc1e924446b9962741a96a990f6668afcc2d2640b656ffe921a806acb"
Sep 09 16:36:53.456582 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:36:53.456562    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-26563f-r64k4" event={"ID":"001e73f4-ff72-42fe-b2eb-b66d995015a9","Type":"ContainerStarted","Data":"c22446fec6944163f849c9b2880c0c6dfdadb3129708dc46becd989af38f3212"}
Sep 09 16:36:53.456678 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:36:53.456656    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 09 16:36:53.456736 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:36:53.456719    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 09 16:36:53.456814 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:36:53.456748    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 09 16:36:54.463972 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:36:54.463933    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-77176368-openshift-default-776fbf68d4-kptn9" event={"ID":"ea9f8073-4763-4a3d-bff6-ca92616541d9","Type":"ContainerStarted","Data":"ee6cf8dabc43db681a28a7dc981930d3c200f3f7d831309c6dd84b733943c268"}
Sep 09 16:36:54.465824 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:36:54.465799    2583 generic.go:356] "Generic (PLEG): container finished" podID="001e73f4-ff72-42fe-b2eb-b66d995015a9" containerID="c6ad54a71600f77674fe04ddd6d1eef688862cc8c40f8a17e85f61667a602017" exitCode=0
Sep 09 16:36:54.465963 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:36:54.465879    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-26563f-r64k4" event={"ID":"001e73f4-ff72-42fe-b2eb-b66d995015a9","Type":"ContainerDied","Data":"c6ad54a71600f77674fe04ddd6d1eef688862cc8c40f8a17e85f61667a602017"}
Sep 09 16:36:55.387063 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:36:55.387024    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-77176368-openshift-default-776fbf68d4-kptn9"
Sep 09 16:36:55.387264 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:36:55.387242    2583 patch_prober.go:28] interesting pod/e2e-mt-77176368-openshift-default-776fbf68d4-kptn9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body=
Sep 09 16:36:55.387310 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:36:55.387289    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-77176368-openshift-default-776fbf68d4-kptn9" podUID="ea9f8073-4763-4a3d-bff6-ca92616541d9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused"
Sep 09 16:36:55.647001 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:36:55.646939    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-26563f-r64k4"
Sep 09 16:36:55.749925 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:36:55.749897    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/001e73f4-ff72-42fe-b2eb-b66d995015a9-maas-api-service-ca\") pod \"001e73f4-ff72-42fe-b2eb-b66d995015a9\" (UID: \"001e73f4-ff72-42fe-b2eb-b66d995015a9\") "
Sep 09 16:36:55.750293 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:36:55.750269    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/001e73f4-ff72-42fe-b2eb-b66d995015a9-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "001e73f4-ff72-42fe-b2eb-b66d995015a9" (UID: "001e73f4-ff72-42fe-b2eb-b66d995015a9"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 16:36:55.851232 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:36:55.851202    2583 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/001e73f4-ff72-42fe-b2eb-b66d995015a9-maas-api-service-ca\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\""
Sep 09 16:36:56.005477 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:36:56.005368    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:36:56.079415 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:36:56.079395    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:36:56.387468 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:36:56.387426    2583 patch_prober.go:28] interesting pod/e2e-mt-77176368-openshift-default-776fbf68d4-kptn9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body=
Sep 09 16:36:56.387661 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:36:56.387552    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-77176368-openshift-default-776fbf68d4-kptn9" podUID="ea9f8073-4763-4a3d-bff6-ca92616541d9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused"
Sep 09 16:36:56.477042 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:36:56.477017    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-26563f-r64k4"
Sep 09 16:36:56.477218 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:36:56.477054    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-26563f-r64k4" event={"ID":"001e73f4-ff72-42fe-b2eb-b66d995015a9","Type":"ContainerDied","Data":"c22446fec6944163f849c9b2880c0c6dfdadb3129708dc46becd989af38f3212"}
Sep 09 16:36:56.477218 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:36:56.477097    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c22446fec6944163f849c9b2880c0c6dfdadb3129708dc46becd989af38f3212"
Sep 09 16:36:56.574244 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:36:56.574214    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:36:57.314471 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:36:57.314433    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:36:57.387904 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:36:57.387876    2583 patch_prober.go:28] interesting pod/e2e-mt-77176368-openshift-default-776fbf68d4-kptn9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body=
Sep 09 16:36:57.388102 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:36:57.387930    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-77176368-openshift-default-776fbf68d4-kptn9" podUID="ea9f8073-4763-4a3d-bff6-ca92616541d9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused"
Sep 09 16:36:57.478219 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:36:57.478185    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:36:58.019963 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:36:58.019928    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:36:58.119311 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:36:58.119284    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:36:58.300127 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:36:58.300045    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:36:58.387904 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:36:58.387873    2583 patch_prober.go:28] interesting pod/e2e-mt-77176368-openshift-default-776fbf68d4-kptn9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body=
Sep 09 16:36:58.388355 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:36:58.387923    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-77176368-openshift-default-776fbf68d4-kptn9" podUID="ea9f8073-4763-4a3d-bff6-ca92616541d9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused"
Sep 09 16:36:58.536139 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:36:58.536110    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:36:59.387330 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:36:59.387300    2583 patch_prober.go:28] interesting pod/e2e-mt-77176368-openshift-default-776fbf68d4-kptn9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body=
Sep 09 16:36:59.387476 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:36:59.387351    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-77176368-openshift-default-776fbf68d4-kptn9" podUID="ea9f8073-4763-4a3d-bff6-ca92616541d9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused"
Sep 09 16:37:00.391421 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:00.391395    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-77176368-openshift-default-776fbf68d4-kptn9"
Sep 09 16:37:00.391824 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:00.391667    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-77176368-openshift-default-776fbf68d4-kptn9"
Sep 09 16:37:00.392329 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:00.392314    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-77176368-openshift-default-776fbf68d4-kptn9"
Sep 09 16:37:01.160098 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:01.160058    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:37:01.210837 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:01.210809    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:37:03.115539 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:03.115507    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:37:03.583309 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:03.583281    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:37:03.680177 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:03.680144    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:37:03.753618 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:03.753586    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-26563f-r64k4"]
Sep 09 16:37:03.756303 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:03.756272    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:37:03.757649 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:03.757627    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-26563f-r64k4"]
Sep 09 16:37:03.815835 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:03.815809    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:37:04.144786 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:04.144761    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:37:04.239961 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:04.239931    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="001e73f4-ff72-42fe-b2eb-b66d995015a9" path="/var/lib/kubelet/pods/001e73f4-ff72-42fe-b2eb-b66d995015a9/volumes"
Sep 09 16:37:04.244333 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:04.244311    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:37:04.687177 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:04.687151    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:37:04.788825 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:04.788799    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:37:04.887283 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:04.887250    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:37:05.647318 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:05.647288    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:37:06.229476 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:06.229440    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:37:06.970365 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:06.970334    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:37:07.490095 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:07.490065    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:37:07.514111 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:07.514081    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-630acf-746fb75d87-8lcbj"]
Sep 09 16:37:07.514318 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:07.514296    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-a-630acf-746fb75d87-8lcbj" podUID="f8aab71c-bd4c-4590-a7e2-a4eabe41f215" containerName="payload-processing" containerID="cri-o://9719f63ac11ccfcf8124ff302b1783fcf85378ebf42c38e967098093b8554bcb" gracePeriod=30
Sep 09 16:37:07.775870 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:07.775847    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-630acf-746fb75d87-8lcbj"
Sep 09 16:37:07.969557 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:07.969527    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f8aab71c-bd4c-4590-a7e2-a4eabe41f215-plugins-config-volume\") pod \"f8aab71c-bd4c-4590-a7e2-a4eabe41f215\" (UID: \"f8aab71c-bd4c-4590-a7e2-a4eabe41f215\") "
Sep 09 16:37:07.969732 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:07.969704    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sm5sx\" (UniqueName: \"kubernetes.io/projected/f8aab71c-bd4c-4590-a7e2-a4eabe41f215-kube-api-access-sm5sx\") pod \"f8aab71c-bd4c-4590-a7e2-a4eabe41f215\" (UID: \"f8aab71c-bd4c-4590-a7e2-a4eabe41f215\") "
Sep 09 16:37:07.969944 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:07.969921    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f8aab71c-bd4c-4590-a7e2-a4eabe41f215-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "f8aab71c-bd4c-4590-a7e2-a4eabe41f215" (UID: "f8aab71c-bd4c-4590-a7e2-a4eabe41f215"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 16:37:07.970075 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:07.970056    2583 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f8aab71c-bd4c-4590-a7e2-a4eabe41f215-plugins-config-volume\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\""
Sep 09 16:37:07.971725 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:07.971700    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f8aab71c-bd4c-4590-a7e2-a4eabe41f215-kube-api-access-sm5sx" (OuterVolumeSpecName: "kube-api-access-sm5sx") pod "f8aab71c-bd4c-4590-a7e2-a4eabe41f215" (UID: "f8aab71c-bd4c-4590-a7e2-a4eabe41f215"). InnerVolumeSpecName "kube-api-access-sm5sx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 16:37:08.069008 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:08.068921    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:37:08.071324 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:08.071301    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sm5sx\" (UniqueName: \"kubernetes.io/projected/f8aab71c-bd4c-4590-a7e2-a4eabe41f215-kube-api-access-sm5sx\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\""
Sep 09 16:37:08.294447 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:08.294415    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:37:08.551197 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:08.551165    2583 generic.go:356] "Generic (PLEG): container finished" podID="f8aab71c-bd4c-4590-a7e2-a4eabe41f215" containerID="9719f63ac11ccfcf8124ff302b1783fcf85378ebf42c38e967098093b8554bcb" exitCode=0
Sep 09 16:37:08.551348 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:08.551209    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-630acf-746fb75d87-8lcbj"
Sep 09 16:37:08.551348 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:08.551262    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-630acf-746fb75d87-8lcbj" event={"ID":"f8aab71c-bd4c-4590-a7e2-a4eabe41f215","Type":"ContainerDied","Data":"9719f63ac11ccfcf8124ff302b1783fcf85378ebf42c38e967098093b8554bcb"}
Sep 09 16:37:08.551348 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:08.551316    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-630acf-746fb75d87-8lcbj" event={"ID":"f8aab71c-bd4c-4590-a7e2-a4eabe41f215","Type":"ContainerDied","Data":"6ba3cb4790944ebfed2b1ede80ed37a32d4480fcf881eabbca15c0f6e238d654"}
Sep 09 16:37:08.551348 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:08.551345    2583 scope.go:117] "RemoveContainer" containerID="9719f63ac11ccfcf8124ff302b1783fcf85378ebf42c38e967098093b8554bcb"
Sep 09 16:37:08.563809 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:08.563783    2583 scope.go:117] "RemoveContainer" containerID="9719f63ac11ccfcf8124ff302b1783fcf85378ebf42c38e967098093b8554bcb"
Sep 09 16:37:08.564081 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:37:08.564064    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9719f63ac11ccfcf8124ff302b1783fcf85378ebf42c38e967098093b8554bcb\": container with ID starting with 9719f63ac11ccfcf8124ff302b1783fcf85378ebf42c38e967098093b8554bcb not found: ID does not exist" containerID="9719f63ac11ccfcf8124ff302b1783fcf85378ebf42c38e967098093b8554bcb"
Sep 09 16:37:08.564155 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:08.564088    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9719f63ac11ccfcf8124ff302b1783fcf85378ebf42c38e967098093b8554bcb"} err="failed to get container status \"9719f63ac11ccfcf8124ff302b1783fcf85378ebf42c38e967098093b8554bcb\": rpc error: code = NotFound desc = could not find container \"9719f63ac11ccfcf8124ff302b1783fcf85378ebf42c38e967098093b8554bcb\": container with ID starting with 9719f63ac11ccfcf8124ff302b1783fcf85378ebf42c38e967098093b8554bcb not found: ID does not exist"
Sep 09 16:37:08.569329 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:08.569312    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-630acf-746fb75d87-8lcbj"]
Sep 09 16:37:08.576114 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:08.576092    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-630acf-746fb75d87-8lcbj"]
Sep 09 16:37:08.705390 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:08.705360    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:37:09.273847 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:09.273821    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:37:10.238494 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:10.238462    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f8aab71c-bd4c-4590-a7e2-a4eabe41f215" path="/var/lib/kubelet/pods/f8aab71c-bd4c-4590-a7e2-a4eabe41f215/volumes"
Sep 09 16:37:10.571073 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:10.570997    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-explicit-26563f-openshift-default-58bfdcf77b-r4zlh"]
Sep 09 16:37:10.571463 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:10.571248    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-explicit-26563f-openshift-default-58bfdcf77b-r4zlh" podUID="a60e44dd-dd86-4b5a-8d7b-7265bd997eb1" containerName="istio-proxy" containerID="cri-o://48acb2cda2c573250d3f275d49a38d9d630c42c25b554fe28349ddfbf30533ab" gracePeriod=30
Sep 09 16:37:12.529361 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:12.529331    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:37:12.628235 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:12.628206    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:37:13.117339 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:13.117309    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:37:13.217177 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:13.217148    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:37:13.271108 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:13.271088    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:37:14.307734 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:14.307704    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:37:14.704822 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:14.704792    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:37:14.809167 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:14.809126    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:37:15.073161 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:15.073133    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:37:15.835175 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:15.835126    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-26563f-openshift-default-58bfdcf77b-r4zlh"
Sep 09 16:37:15.875537 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:15.875515    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:37:15.947131 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:15.947099    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a60e44dd-dd86-4b5a-8d7b-7265bd997eb1-workload-certs\") pod \"a60e44dd-dd86-4b5a-8d7b-7265bd997eb1\" (UID: \"a60e44dd-dd86-4b5a-8d7b-7265bd997eb1\") "
Sep 09 16:37:15.947262 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:15.947149    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a60e44dd-dd86-4b5a-8d7b-7265bd997eb1-istio-data\") pod \"a60e44dd-dd86-4b5a-8d7b-7265bd997eb1\" (UID: \"a60e44dd-dd86-4b5a-8d7b-7265bd997eb1\") "
Sep 09 16:37:15.947262 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:15.947219    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a60e44dd-dd86-4b5a-8d7b-7265bd997eb1-istio-token\") pod \"a60e44dd-dd86-4b5a-8d7b-7265bd997eb1\" (UID: \"a60e44dd-dd86-4b5a-8d7b-7265bd997eb1\") "
Sep 09 16:37:15.947363 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:15.947287    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a60e44dd-dd86-4b5a-8d7b-7265bd997eb1-credential-socket\") pod \"a60e44dd-dd86-4b5a-8d7b-7265bd997eb1\" (UID: \"a60e44dd-dd86-4b5a-8d7b-7265bd997eb1\") "
Sep 09 16:37:15.947363 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:15.947317    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a60e44dd-dd86-4b5a-8d7b-7265bd997eb1-istiod-ca-cert\") pod \"a60e44dd-dd86-4b5a-8d7b-7265bd997eb1\" (UID: \"a60e44dd-dd86-4b5a-8d7b-7265bd997eb1\") "
Sep 09 16:37:15.947488 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:15.947400    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a60e44dd-dd86-4b5a-8d7b-7265bd997eb1-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a60e44dd-dd86-4b5a-8d7b-7265bd997eb1" (UID: "a60e44dd-dd86-4b5a-8d7b-7265bd997eb1"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 16:37:15.947488 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:15.947408    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a60e44dd-dd86-4b5a-8d7b-7265bd997eb1-istio-podinfo\") pod \"a60e44dd-dd86-4b5a-8d7b-7265bd997eb1\" (UID: \"a60e44dd-dd86-4b5a-8d7b-7265bd997eb1\") "
Sep 09 16:37:15.947488 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:15.947460    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a60e44dd-dd86-4b5a-8d7b-7265bd997eb1-istio-envoy\") pod \"a60e44dd-dd86-4b5a-8d7b-7265bd997eb1\" (UID: \"a60e44dd-dd86-4b5a-8d7b-7265bd997eb1\") "
Sep 09 16:37:15.947604 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:15.947415    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a60e44dd-dd86-4b5a-8d7b-7265bd997eb1-istio-data" (OuterVolumeSpecName: "istio-data") pod "a60e44dd-dd86-4b5a-8d7b-7265bd997eb1" (UID: "a60e44dd-dd86-4b5a-8d7b-7265bd997eb1"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 16:37:15.947604 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:15.947541    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9nrfk\" (UniqueName: \"kubernetes.io/projected/a60e44dd-dd86-4b5a-8d7b-7265bd997eb1-kube-api-access-9nrfk\") pod \"a60e44dd-dd86-4b5a-8d7b-7265bd997eb1\" (UID: \"a60e44dd-dd86-4b5a-8d7b-7265bd997eb1\") "
Sep 09 16:37:15.947604 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:15.947538    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a60e44dd-dd86-4b5a-8d7b-7265bd997eb1-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a60e44dd-dd86-4b5a-8d7b-7265bd997eb1" (UID: "a60e44dd-dd86-4b5a-8d7b-7265bd997eb1"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 16:37:15.947604 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:15.947576    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a60e44dd-dd86-4b5a-8d7b-7265bd997eb1-workload-socket\") pod \"a60e44dd-dd86-4b5a-8d7b-7265bd997eb1\" (UID: \"a60e44dd-dd86-4b5a-8d7b-7265bd997eb1\") "
Sep 09 16:37:15.947802 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:15.947630    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a60e44dd-dd86-4b5a-8d7b-7265bd997eb1-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a60e44dd-dd86-4b5a-8d7b-7265bd997eb1" (UID: "a60e44dd-dd86-4b5a-8d7b-7265bd997eb1"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 16:37:15.947855 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:15.947822    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a60e44dd-dd86-4b5a-8d7b-7265bd997eb1-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a60e44dd-dd86-4b5a-8d7b-7265bd997eb1" (UID: "a60e44dd-dd86-4b5a-8d7b-7265bd997eb1"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 16:37:15.947973 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:15.947951    2583 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a60e44dd-dd86-4b5a-8d7b-7265bd997eb1-workload-socket\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\""
Sep 09 16:37:15.948045 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:15.947979    2583 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a60e44dd-dd86-4b5a-8d7b-7265bd997eb1-workload-certs\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\""
Sep 09 16:37:15.948045 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:15.948008    2583 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a60e44dd-dd86-4b5a-8d7b-7265bd997eb1-istio-data\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\""
Sep 09 16:37:15.948045 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:15.948022    2583 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a60e44dd-dd86-4b5a-8d7b-7265bd997eb1-credential-socket\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\""
Sep 09 16:37:15.948045 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:15.948034    2583 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a60e44dd-dd86-4b5a-8d7b-7265bd997eb1-istiod-ca-cert\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\""
Sep 09 16:37:15.949476 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:15.949455    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a60e44dd-dd86-4b5a-8d7b-7265bd997eb1-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a60e44dd-dd86-4b5a-8d7b-7265bd997eb1" (UID: "a60e44dd-dd86-4b5a-8d7b-7265bd997eb1"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 09 16:37:15.949573 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:15.949547    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a60e44dd-dd86-4b5a-8d7b-7265bd997eb1-istio-token" (OuterVolumeSpecName: "istio-token") pod "a60e44dd-dd86-4b5a-8d7b-7265bd997eb1" (UID: "a60e44dd-dd86-4b5a-8d7b-7265bd997eb1"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 16:37:15.949761 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:15.949744    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a60e44dd-dd86-4b5a-8d7b-7265bd997eb1-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a60e44dd-dd86-4b5a-8d7b-7265bd997eb1" (UID: "a60e44dd-dd86-4b5a-8d7b-7265bd997eb1"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 16:37:15.949809 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:15.949746    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a60e44dd-dd86-4b5a-8d7b-7265bd997eb1-kube-api-access-9nrfk" (OuterVolumeSpecName: "kube-api-access-9nrfk") pod "a60e44dd-dd86-4b5a-8d7b-7265bd997eb1" (UID: "a60e44dd-dd86-4b5a-8d7b-7265bd997eb1"). InnerVolumeSpecName "kube-api-access-9nrfk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 16:37:16.049218 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:16.049191    2583 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a60e44dd-dd86-4b5a-8d7b-7265bd997eb1-istio-podinfo\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\""
Sep 09 16:37:16.049218 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:16.049213    2583 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a60e44dd-dd86-4b5a-8d7b-7265bd997eb1-istio-envoy\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\""
Sep 09 16:37:16.049343 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:16.049226    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9nrfk\" (UniqueName: \"kubernetes.io/projected/a60e44dd-dd86-4b5a-8d7b-7265bd997eb1-kube-api-access-9nrfk\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\""
Sep 09 16:37:16.049343 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:16.049238    2583 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a60e44dd-dd86-4b5a-8d7b-7265bd997eb1-istio-token\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\""
Sep 09 16:37:16.391241 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:16.391189    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:37:16.449869 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:16.449837    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:37:16.550419 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:16.550305    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:37:16.598891 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:16.598858    2583 generic.go:356] "Generic (PLEG): container finished" podID="a60e44dd-dd86-4b5a-8d7b-7265bd997eb1" containerID="48acb2cda2c573250d3f275d49a38d9d630c42c25b554fe28349ddfbf30533ab" exitCode=0
Sep 09 16:37:16.599053 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:16.598930    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-26563f-openshift-default-58bfdcf77b-r4zlh"
Sep 09 16:37:16.599053 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:16.598942    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-26563f-openshift-default-58bfdcf77b-r4zlh" event={"ID":"a60e44dd-dd86-4b5a-8d7b-7265bd997eb1","Type":"ContainerDied","Data":"48acb2cda2c573250d3f275d49a38d9d630c42c25b554fe28349ddfbf30533ab"}
Sep 09 16:37:16.599053 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:16.599014    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-26563f-openshift-default-58bfdcf77b-r4zlh" event={"ID":"a60e44dd-dd86-4b5a-8d7b-7265bd997eb1","Type":"ContainerDied","Data":"0b0d38a22753cbf646294d134528043578461cb25517fa496d0d538489d65a79"}
Sep 09 16:37:16.599053 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:16.599045    2583 scope.go:117] "RemoveContainer" containerID="48acb2cda2c573250d3f275d49a38d9d630c42c25b554fe28349ddfbf30533ab"
Sep 09 16:37:16.608558 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:16.608541    2583 scope.go:117] "RemoveContainer" containerID="47aff536d30483b6fdd1cfb85e3b94689ba5941a21c7a5bd87f4755871f5e7b3"
Sep 09 16:37:16.616516 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:16.616492    2583 scope.go:117] "RemoveContainer" containerID="48acb2cda2c573250d3f275d49a38d9d630c42c25b554fe28349ddfbf30533ab"
Sep 09 16:37:16.616978 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:37:16.616953    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"48acb2cda2c573250d3f275d49a38d9d630c42c25b554fe28349ddfbf30533ab\": container with ID starting with 48acb2cda2c573250d3f275d49a38d9d630c42c25b554fe28349ddfbf30533ab not found: ID does not exist" containerID="48acb2cda2c573250d3f275d49a38d9d630c42c25b554fe28349ddfbf30533ab"
Sep 09 16:37:16.617143 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:16.617118    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"48acb2cda2c573250d3f275d49a38d9d630c42c25b554fe28349ddfbf30533ab"} err="failed to get container status \"48acb2cda2c573250d3f275d49a38d9d630c42c25b554fe28349ddfbf30533ab\": rpc error: code = NotFound desc = could not find container \"48acb2cda2c573250d3f275d49a38d9d630c42c25b554fe28349ddfbf30533ab\": container with ID starting with 48acb2cda2c573250d3f275d49a38d9d630c42c25b554fe28349ddfbf30533ab not found: ID does not exist"
Sep 09 16:37:16.617252 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:16.617240    2583 scope.go:117] "RemoveContainer" containerID="47aff536d30483b6fdd1cfb85e3b94689ba5941a21c7a5bd87f4755871f5e7b3"
Sep 09 16:37:16.617648 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:37:16.617623    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"47aff536d30483b6fdd1cfb85e3b94689ba5941a21c7a5bd87f4755871f5e7b3\": container with ID starting with 47aff536d30483b6fdd1cfb85e3b94689ba5941a21c7a5bd87f4755871f5e7b3 not found: ID does not exist" containerID="47aff536d30483b6fdd1cfb85e3b94689ba5941a21c7a5bd87f4755871f5e7b3"
Sep 09 16:37:16.617648 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:16.617655    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"47aff536d30483b6fdd1cfb85e3b94689ba5941a21c7a5bd87f4755871f5e7b3"} err="failed to get container status \"47aff536d30483b6fdd1cfb85e3b94689ba5941a21c7a5bd87f4755871f5e7b3\": rpc error: code = NotFound desc = could not find container \"47aff536d30483b6fdd1cfb85e3b94689ba5941a21c7a5bd87f4755871f5e7b3\": container with ID starting with 47aff536d30483b6fdd1cfb85e3b94689ba5941a21c7a5bd87f4755871f5e7b3 not found: ID does not exist"
Sep 09 16:37:16.619524 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:16.619504    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-explicit-26563f-openshift-default-58bfdcf77b-r4zlh"]
Sep 09 16:37:16.624369 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:16.624344    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:37:16.624518 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:16.624496    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-explicit-26563f-openshift-default-58bfdcf77b-r4zlh"]
Sep 09 16:37:16.836499 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:16.836470    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:37:17.003411 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:17.003384    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:37:17.468067 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:17.468041    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:37:18.244012 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:18.243967    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a60e44dd-dd86-4b5a-8d7b-7265bd997eb1" path="/var/lib/kubelet/pods/a60e44dd-dd86-4b5a-8d7b-7265bd997eb1/volumes"
Sep 09 16:37:18.660131 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:18.660100    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:37:22.992919 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:22.992883    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:37:23.036974 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:23.036945    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-77176368-openshift-default-776fbf68d4-kptn9"]
Sep 09 16:37:23.037249 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:23.037223    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-77176368-openshift-default-776fbf68d4-kptn9" podUID="ea9f8073-4763-4a3d-bff6-ca92616541d9" containerName="istio-proxy" containerID="cri-o://ee6cf8dabc43db681a28a7dc981930d3c200f3f7d831309c6dd84b733943c268" gracePeriod=30
Sep 09 16:37:23.059084 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:23.059054    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:37:23.417556 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:23.417489    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:37:23.514432 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:23.514397    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:37:23.654343 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:23.654316    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:37:25.311284 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:25.311245    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:37:26.480049 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:26.480013    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:37:26.533882 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:26.533858    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:37:28.286502 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:28.286480    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-77176368-openshift-default-776fbf68d4-kptn9"
Sep 09 16:37:28.353593 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:28.353563    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ea9f8073-4763-4a3d-bff6-ca92616541d9-istio-podinfo\") pod \"ea9f8073-4763-4a3d-bff6-ca92616541d9\" (UID: \"ea9f8073-4763-4a3d-bff6-ca92616541d9\") "
Sep 09 16:37:28.353701 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:28.353617    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ea9f8073-4763-4a3d-bff6-ca92616541d9-istio-token\") pod \"ea9f8073-4763-4a3d-bff6-ca92616541d9\" (UID: \"ea9f8073-4763-4a3d-bff6-ca92616541d9\") "
Sep 09 16:37:28.353745 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:28.353714    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ea9f8073-4763-4a3d-bff6-ca92616541d9-istio-envoy\") pod \"ea9f8073-4763-4a3d-bff6-ca92616541d9\" (UID: \"ea9f8073-4763-4a3d-bff6-ca92616541d9\") "
Sep 09 16:37:28.353779 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:28.353743    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ea9f8073-4763-4a3d-bff6-ca92616541d9-istio-data\") pod \"ea9f8073-4763-4a3d-bff6-ca92616541d9\" (UID: \"ea9f8073-4763-4a3d-bff6-ca92616541d9\") "
Sep 09 16:37:28.353811 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:28.353784    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-497ql\" (UniqueName: \"kubernetes.io/projected/ea9f8073-4763-4a3d-bff6-ca92616541d9-kube-api-access-497ql\") pod \"ea9f8073-4763-4a3d-bff6-ca92616541d9\" (UID: \"ea9f8073-4763-4a3d-bff6-ca92616541d9\") "
Sep 09 16:37:28.353844 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:28.353810    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ea9f8073-4763-4a3d-bff6-ca92616541d9-istiod-ca-cert\") pod \"ea9f8073-4763-4a3d-bff6-ca92616541d9\" (UID: \"ea9f8073-4763-4a3d-bff6-ca92616541d9\") "
Sep 09 16:37:28.353888 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:28.353852    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea9f8073-4763-4a3d-bff6-ca92616541d9-credential-socket\") pod \"ea9f8073-4763-4a3d-bff6-ca92616541d9\" (UID: \"ea9f8073-4763-4a3d-bff6-ca92616541d9\") "
Sep 09 16:37:28.353888 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:28.353879    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea9f8073-4763-4a3d-bff6-ca92616541d9-workload-socket\") pod \"ea9f8073-4763-4a3d-bff6-ca92616541d9\" (UID: \"ea9f8073-4763-4a3d-bff6-ca92616541d9\") "
Sep 09 16:37:28.354009 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:28.353942    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ea9f8073-4763-4a3d-bff6-ca92616541d9-workload-certs\") pod \"ea9f8073-4763-4a3d-bff6-ca92616541d9\" (UID: \"ea9f8073-4763-4a3d-bff6-ca92616541d9\") "
Sep 09 16:37:28.354069 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:28.354029    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ea9f8073-4763-4a3d-bff6-ca92616541d9-istio-data" (OuterVolumeSpecName: "istio-data") pod "ea9f8073-4763-4a3d-bff6-ca92616541d9" (UID: "ea9f8073-4763-4a3d-bff6-ca92616541d9"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 16:37:28.354252 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:28.354168    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ea9f8073-4763-4a3d-bff6-ca92616541d9-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ea9f8073-4763-4a3d-bff6-ca92616541d9" (UID: "ea9f8073-4763-4a3d-bff6-ca92616541d9"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 16:37:28.354347 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:28.354262    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ea9f8073-4763-4a3d-bff6-ca92616541d9-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ea9f8073-4763-4a3d-bff6-ca92616541d9" (UID: "ea9f8073-4763-4a3d-bff6-ca92616541d9"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 16:37:28.354347 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:28.354283    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ea9f8073-4763-4a3d-bff6-ca92616541d9-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ea9f8073-4763-4a3d-bff6-ca92616541d9" (UID: "ea9f8073-4763-4a3d-bff6-ca92616541d9"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 16:37:28.354432 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:28.354383    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ea9f8073-4763-4a3d-bff6-ca92616541d9-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ea9f8073-4763-4a3d-bff6-ca92616541d9" (UID: "ea9f8073-4763-4a3d-bff6-ca92616541d9"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 16:37:28.354469 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:28.354455    2583 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ea9f8073-4763-4a3d-bff6-ca92616541d9-istio-data\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\""
Sep 09 16:37:28.354502 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:28.354477    2583 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ea9f8073-4763-4a3d-bff6-ca92616541d9-istiod-ca-cert\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\""
Sep 09 16:37:28.354502 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:28.354491    2583 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea9f8073-4763-4a3d-bff6-ca92616541d9-credential-socket\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\""
Sep 09 16:37:28.354567 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:28.354506    2583 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea9f8073-4763-4a3d-bff6-ca92616541d9-workload-socket\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\""
Sep 09 16:37:28.355760 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:28.355737    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ea9f8073-4763-4a3d-bff6-ca92616541d9-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ea9f8073-4763-4a3d-bff6-ca92616541d9" (UID: "ea9f8073-4763-4a3d-bff6-ca92616541d9"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 09 16:37:28.355760 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:28.355737    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ea9f8073-4763-4a3d-bff6-ca92616541d9-istio-token" (OuterVolumeSpecName: "istio-token") pod "ea9f8073-4763-4a3d-bff6-ca92616541d9" (UID: "ea9f8073-4763-4a3d-bff6-ca92616541d9"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 16:37:28.355893 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:28.355766    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ea9f8073-4763-4a3d-bff6-ca92616541d9-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ea9f8073-4763-4a3d-bff6-ca92616541d9" (UID: "ea9f8073-4763-4a3d-bff6-ca92616541d9"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 16:37:28.356270 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:28.356252    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ea9f8073-4763-4a3d-bff6-ca92616541d9-kube-api-access-497ql" (OuterVolumeSpecName: "kube-api-access-497ql") pod "ea9f8073-4763-4a3d-bff6-ca92616541d9" (UID: "ea9f8073-4763-4a3d-bff6-ca92616541d9"). InnerVolumeSpecName "kube-api-access-497ql". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 16:37:28.454968 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:28.454947    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-497ql\" (UniqueName: \"kubernetes.io/projected/ea9f8073-4763-4a3d-bff6-ca92616541d9-kube-api-access-497ql\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\""
Sep 09 16:37:28.454968 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:28.454972    2583 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ea9f8073-4763-4a3d-bff6-ca92616541d9-workload-certs\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\""
Sep 09 16:37:28.455121 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:28.454997    2583 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ea9f8073-4763-4a3d-bff6-ca92616541d9-istio-podinfo\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\""
Sep 09 16:37:28.455121 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:28.455010    2583 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ea9f8073-4763-4a3d-bff6-ca92616541d9-istio-token\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\""
Sep 09 16:37:28.455121 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:28.455021    2583 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ea9f8073-4763-4a3d-bff6-ca92616541d9-istio-envoy\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\""
Sep 09 16:37:28.665053 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:28.664995    2583 generic.go:356] "Generic (PLEG): container finished" podID="ea9f8073-4763-4a3d-bff6-ca92616541d9" containerID="ee6cf8dabc43db681a28a7dc981930d3c200f3f7d831309c6dd84b733943c268" exitCode=0
Sep 09 16:37:28.665053 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:28.665027    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-77176368-openshift-default-776fbf68d4-kptn9" event={"ID":"ea9f8073-4763-4a3d-bff6-ca92616541d9","Type":"ContainerDied","Data":"ee6cf8dabc43db681a28a7dc981930d3c200f3f7d831309c6dd84b733943c268"}
Sep 09 16:37:28.665053 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:28.665050    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-77176368-openshift-default-776fbf68d4-kptn9"
Sep 09 16:37:28.665222 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:28.665081    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-77176368-openshift-default-776fbf68d4-kptn9" event={"ID":"ea9f8073-4763-4a3d-bff6-ca92616541d9","Type":"ContainerDied","Data":"ebcb52865a167c088bcf08d78cc24d23304101af57822a1045720bbb720cc11f"}
Sep 09 16:37:28.665222 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:28.665103    2583 scope.go:117] "RemoveContainer" containerID="ee6cf8dabc43db681a28a7dc981930d3c200f3f7d831309c6dd84b733943c268"
Sep 09 16:37:28.674634 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:28.674620    2583 scope.go:117] "RemoveContainer" containerID="b99c73bbc1e924446b9962741a96a990f6668afcc2d2640b656ffe921a806acb"
Sep 09 16:37:28.684259 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:28.684243    2583 scope.go:117] "RemoveContainer" containerID="ee6cf8dabc43db681a28a7dc981930d3c200f3f7d831309c6dd84b733943c268"
Sep 09 16:37:28.684648 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:37:28.684628    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ee6cf8dabc43db681a28a7dc981930d3c200f3f7d831309c6dd84b733943c268\": container with ID starting with ee6cf8dabc43db681a28a7dc981930d3c200f3f7d831309c6dd84b733943c268 not found: ID does not exist" containerID="ee6cf8dabc43db681a28a7dc981930d3c200f3f7d831309c6dd84b733943c268"
Sep 09 16:37:28.684719 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:28.684656    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee6cf8dabc43db681a28a7dc981930d3c200f3f7d831309c6dd84b733943c268"} err="failed to get container status \"ee6cf8dabc43db681a28a7dc981930d3c200f3f7d831309c6dd84b733943c268\": rpc error: code = NotFound desc = could not find container \"ee6cf8dabc43db681a28a7dc981930d3c200f3f7d831309c6dd84b733943c268\": container with ID starting with ee6cf8dabc43db681a28a7dc981930d3c200f3f7d831309c6dd84b733943c268 not found: ID does not exist"
Sep 09 16:37:28.684719 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:28.684673    2583 scope.go:117] "RemoveContainer" containerID="b99c73bbc1e924446b9962741a96a990f6668afcc2d2640b656ffe921a806acb"
Sep 09 16:37:28.684967 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:37:28.684950    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b99c73bbc1e924446b9962741a96a990f6668afcc2d2640b656ffe921a806acb\": container with ID starting with b99c73bbc1e924446b9962741a96a990f6668afcc2d2640b656ffe921a806acb not found: ID does not exist" containerID="b99c73bbc1e924446b9962741a96a990f6668afcc2d2640b656ffe921a806acb"
Sep 09 16:37:28.685111 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:28.684971    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b99c73bbc1e924446b9962741a96a990f6668afcc2d2640b656ffe921a806acb"} err="failed to get container status \"b99c73bbc1e924446b9962741a96a990f6668afcc2d2640b656ffe921a806acb\": rpc error: code = NotFound desc = could not find container \"b99c73bbc1e924446b9962741a96a990f6668afcc2d2640b656ffe921a806acb\": container with ID starting with b99c73bbc1e924446b9962741a96a990f6668afcc2d2640b656ffe921a806acb not found: ID does not exist"
Sep 09 16:37:28.688239 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:28.688219    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-77176368-openshift-default-776fbf68d4-kptn9"]
Sep 09 16:37:28.691380 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:28.691361    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-77176368-openshift-default-776fbf68d4-kptn9"]
Sep 09 16:37:29.237449 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:29.237430    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:37:29.338792 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:29.338765    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:37:29.437525 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:29.437500    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:37:29.589460 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:29.589436    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:37:30.239118 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:30.239086    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ea9f8073-4763-4a3d-bff6-ca92616541d9" path="/var/lib/kubelet/pods/ea9f8073-4763-4a3d-bff6-ca92616541d9/volumes"
Sep 09 16:37:31.537653 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:31.537568    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:37:31.636748 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:31.636714    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:37:31.695050 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:31.695018    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-34141f-openshift-default-75c8656694-8p8mp"]
Sep 09 16:37:31.695281 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:31.695254    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-34141f-openshift-default-75c8656694-8p8mp" podUID="28222823-dc46-49c7-b949-b76951d639dc" containerName="istio-proxy" containerID="cri-o://3c26c170f68d3d86f116f74e732bdcede794b958423e15f45ba10f40c4e3019b" gracePeriod=30
Sep 09 16:37:31.726631 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:31.726611    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:37:32.309029 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:32.308976    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:37:32.696629 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:32.696602    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:37:32.745206 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:32.745184    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:37:36.962543 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:36.962483    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-34141f-openshift-default-75c8656694-8p8mp"
Sep 09 16:37:37.028531 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:37.028505    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/28222823-dc46-49c7-b949-b76951d639dc-istio-token\") pod \"28222823-dc46-49c7-b949-b76951d639dc\" (UID: \"28222823-dc46-49c7-b949-b76951d639dc\") "
Sep 09 16:37:37.028659 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:37.028553    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/28222823-dc46-49c7-b949-b76951d639dc-istio-podinfo\") pod \"28222823-dc46-49c7-b949-b76951d639dc\" (UID: \"28222823-dc46-49c7-b949-b76951d639dc\") "
Sep 09 16:37:37.028659 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:37.028573    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/28222823-dc46-49c7-b949-b76951d639dc-istiod-ca-cert\") pod \"28222823-dc46-49c7-b949-b76951d639dc\" (UID: \"28222823-dc46-49c7-b949-b76951d639dc\") "
Sep 09 16:37:37.028659 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:37.028614    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/28222823-dc46-49c7-b949-b76951d639dc-istio-data\") pod \"28222823-dc46-49c7-b949-b76951d639dc\" (UID: \"28222823-dc46-49c7-b949-b76951d639dc\") "
Sep 09 16:37:37.028659 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:37.028656    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/28222823-dc46-49c7-b949-b76951d639dc-istio-envoy\") pod \"28222823-dc46-49c7-b949-b76951d639dc\" (UID: \"28222823-dc46-49c7-b949-b76951d639dc\") "
Sep 09 16:37:37.028831 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:37.028692    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/28222823-dc46-49c7-b949-b76951d639dc-workload-socket\") pod \"28222823-dc46-49c7-b949-b76951d639dc\" (UID: \"28222823-dc46-49c7-b949-b76951d639dc\") "
Sep 09 16:37:37.028831 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:37.028720    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/28222823-dc46-49c7-b949-b76951d639dc-credential-socket\") pod \"28222823-dc46-49c7-b949-b76951d639dc\" (UID: \"28222823-dc46-49c7-b949-b76951d639dc\") "
Sep 09 16:37:37.028831 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:37.028756    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hmjq5\" (UniqueName: \"kubernetes.io/projected/28222823-dc46-49c7-b949-b76951d639dc-kube-api-access-hmjq5\") pod \"28222823-dc46-49c7-b949-b76951d639dc\" (UID: \"28222823-dc46-49c7-b949-b76951d639dc\") "
Sep 09 16:37:37.028831 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:37.028785    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/28222823-dc46-49c7-b949-b76951d639dc-workload-certs\") pod \"28222823-dc46-49c7-b949-b76951d639dc\" (UID: \"28222823-dc46-49c7-b949-b76951d639dc\") "
Sep 09 16:37:37.029061 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:37.028895    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/28222823-dc46-49c7-b949-b76951d639dc-istio-data" (OuterVolumeSpecName: "istio-data") pod "28222823-dc46-49c7-b949-b76951d639dc" (UID: "28222823-dc46-49c7-b949-b76951d639dc"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 16:37:37.029061 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:37.028979    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/28222823-dc46-49c7-b949-b76951d639dc-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "28222823-dc46-49c7-b949-b76951d639dc" (UID: "28222823-dc46-49c7-b949-b76951d639dc"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 16:37:37.029061 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:37.029027    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/28222823-dc46-49c7-b949-b76951d639dc-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "28222823-dc46-49c7-b949-b76951d639dc" (UID: "28222823-dc46-49c7-b949-b76951d639dc"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 16:37:37.029226 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:37.029143    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/28222823-dc46-49c7-b949-b76951d639dc-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "28222823-dc46-49c7-b949-b76951d639dc" (UID: "28222823-dc46-49c7-b949-b76951d639dc"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 16:37:37.029226 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:37.029209    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/28222823-dc46-49c7-b949-b76951d639dc-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "28222823-dc46-49c7-b949-b76951d639dc" (UID: "28222823-dc46-49c7-b949-b76951d639dc"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 16:37:37.029334 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:37.029291    2583 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/28222823-dc46-49c7-b949-b76951d639dc-workload-socket\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\""
Sep 09 16:37:37.029334 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:37.029308    2583 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/28222823-dc46-49c7-b949-b76951d639dc-credential-socket\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\""
Sep 09 16:37:37.029334 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:37.029322    2583 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/28222823-dc46-49c7-b949-b76951d639dc-workload-certs\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\""
Sep 09 16:37:37.029482 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:37.029334    2583 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/28222823-dc46-49c7-b949-b76951d639dc-istiod-ca-cert\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\""
Sep 09 16:37:37.029482 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:37.029349    2583 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/28222823-dc46-49c7-b949-b76951d639dc-istio-data\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\""
Sep 09 16:37:37.030665 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:37.030642    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/28222823-dc46-49c7-b949-b76951d639dc-istio-token" (OuterVolumeSpecName: "istio-token") pod "28222823-dc46-49c7-b949-b76951d639dc" (UID: "28222823-dc46-49c7-b949-b76951d639dc"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 16:37:37.030767 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:37.030690    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/28222823-dc46-49c7-b949-b76951d639dc-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "28222823-dc46-49c7-b949-b76951d639dc" (UID: "28222823-dc46-49c7-b949-b76951d639dc"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 09 16:37:37.030809 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:37.030776    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/28222823-dc46-49c7-b949-b76951d639dc-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "28222823-dc46-49c7-b949-b76951d639dc" (UID: "28222823-dc46-49c7-b949-b76951d639dc"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 16:37:37.030910 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:37.030895    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/28222823-dc46-49c7-b949-b76951d639dc-kube-api-access-hmjq5" (OuterVolumeSpecName: "kube-api-access-hmjq5") pod "28222823-dc46-49c7-b949-b76951d639dc" (UID: "28222823-dc46-49c7-b949-b76951d639dc"). InnerVolumeSpecName "kube-api-access-hmjq5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 16:37:37.129978 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:37.129955    2583 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/28222823-dc46-49c7-b949-b76951d639dc-istio-podinfo\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\""
Sep 09 16:37:37.129978 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:37.129977    2583 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/28222823-dc46-49c7-b949-b76951d639dc-istio-envoy\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\""
Sep 09 16:37:37.130126 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:37.130009    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hmjq5\" (UniqueName: \"kubernetes.io/projected/28222823-dc46-49c7-b949-b76951d639dc-kube-api-access-hmjq5\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\""
Sep 09 16:37:37.130126 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:37.130018    2583 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/28222823-dc46-49c7-b949-b76951d639dc-istio-token\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\""
Sep 09 16:37:37.621023 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:37.620965    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:37:37.717600 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:37.717563    2583 generic.go:356] "Generic (PLEG): container finished" podID="28222823-dc46-49c7-b949-b76951d639dc" containerID="3c26c170f68d3d86f116f74e732bdcede794b958423e15f45ba10f40c4e3019b" exitCode=0
Sep 09 16:37:37.717770 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:37.717616    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-34141f-openshift-default-75c8656694-8p8mp"
Sep 09 16:37:37.717770 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:37.717619    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-34141f-openshift-default-75c8656694-8p8mp" event={"ID":"28222823-dc46-49c7-b949-b76951d639dc","Type":"ContainerDied","Data":"3c26c170f68d3d86f116f74e732bdcede794b958423e15f45ba10f40c4e3019b"}
Sep 09 16:37:37.717770 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:37.717674    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-34141f-openshift-default-75c8656694-8p8mp" event={"ID":"28222823-dc46-49c7-b949-b76951d639dc","Type":"ContainerDied","Data":"3a45e95e9e668f80fafc3f583c6517cf29fb34494a2dea21518685ff84ad0fef"}
Sep 09 16:37:37.717770 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:37.717704    2583 scope.go:117] "RemoveContainer" containerID="3c26c170f68d3d86f116f74e732bdcede794b958423e15f45ba10f40c4e3019b"
Sep 09 16:37:37.720679 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:37.720651    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:37:37.727525 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:37.727511    2583 scope.go:117] "RemoveContainer" containerID="52b9c91504e148be2476c06fb8f3c708e55a768e928bd3f67015963c13bda1ce"
Sep 09 16:37:37.735045 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:37.735030    2583 scope.go:117] "RemoveContainer" containerID="3c26c170f68d3d86f116f74e732bdcede794b958423e15f45ba10f40c4e3019b"
Sep 09 16:37:37.735276 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:37:37.735254    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3c26c170f68d3d86f116f74e732bdcede794b958423e15f45ba10f40c4e3019b\": container with ID starting with 3c26c170f68d3d86f116f74e732bdcede794b958423e15f45ba10f40c4e3019b not found: ID does not exist" containerID="3c26c170f68d3d86f116f74e732bdcede794b958423e15f45ba10f40c4e3019b"
Sep 09 16:37:37.735325 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:37.735289    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3c26c170f68d3d86f116f74e732bdcede794b958423e15f45ba10f40c4e3019b"} err="failed to get container status \"3c26c170f68d3d86f116f74e732bdcede794b958423e15f45ba10f40c4e3019b\": rpc error: code = NotFound desc = could not find container \"3c26c170f68d3d86f116f74e732bdcede794b958423e15f45ba10f40c4e3019b\": container with ID starting with 3c26c170f68d3d86f116f74e732bdcede794b958423e15f45ba10f40c4e3019b not found: ID does not exist"
Sep 09 16:37:37.735325 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:37.735307    2583 scope.go:117] "RemoveContainer" containerID="52b9c91504e148be2476c06fb8f3c708e55a768e928bd3f67015963c13bda1ce"
Sep 09 16:37:37.735567 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:37:37.735551    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"52b9c91504e148be2476c06fb8f3c708e55a768e928bd3f67015963c13bda1ce\": container with ID starting with 52b9c91504e148be2476c06fb8f3c708e55a768e928bd3f67015963c13bda1ce not found: ID does not exist" containerID="52b9c91504e148be2476c06fb8f3c708e55a768e928bd3f67015963c13bda1ce"
Sep 09 16:37:37.735612 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:37.735573    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"52b9c91504e148be2476c06fb8f3c708e55a768e928bd3f67015963c13bda1ce"} err="failed to get container status \"52b9c91504e148be2476c06fb8f3c708e55a768e928bd3f67015963c13bda1ce\": rpc error: code = NotFound desc = could not find container \"52b9c91504e148be2476c06fb8f3c708e55a768e928bd3f67015963c13bda1ce\": container with ID starting with 52b9c91504e148be2476c06fb8f3c708e55a768e928bd3f67015963c13bda1ce not found: ID does not exist"
Sep 09 16:37:37.740243 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:37.740220    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-34141f-openshift-default-75c8656694-8p8mp"]
Sep 09 16:37:37.743463 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:37.743445    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-34141f-openshift-default-75c8656694-8p8mp"]
Sep 09 16:37:38.238736 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:38.238708    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="28222823-dc46-49c7-b949-b76951d639dc" path="/var/lib/kubelet/pods/28222823-dc46-49c7-b949-b76951d639dc/volumes"
Sep 09 16:37:39.167010 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:39.166961    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:37:39.860855 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:39.860808    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:37:39.949167 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:39.949114    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:37:40.653897 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:40.653867    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:37:41.267605 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:41.267576    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:37:41.369837 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:41.369806    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:37:41.493785 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:41.493759    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:37:41.703420 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:41.703391    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:37:41.790620 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:41.790591    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:37:42.178420 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:42.178382    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:37:42.786873 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:42.786818    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:37:49.100122 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:49.100090    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:37:58.647586 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:58.647547    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:37:58.857408 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:58.857382    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:37:59.618130 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:37:59.618097    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:38:00.238570 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:00.238541    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:38:00.818352 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:00.818323    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:38:00.917967 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:00.917939    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:38:01.233915 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:01.233893    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:38:01.418668 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:01.418605    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w3-50fcbc-openshift-default-7cccc7648d-7j88r"]
Sep 09 16:38:01.419155 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:01.419135    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="001e73f4-ff72-42fe-b2eb-b66d995015a9" containerName="revoke-keys"
Sep 09 16:38:01.419155 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:01.419154    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="001e73f4-ff72-42fe-b2eb-b66d995015a9" containerName="revoke-keys"
Sep 09 16:38:01.419286 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:01.419169    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="28222823-dc46-49c7-b949-b76951d639dc" containerName="istio-proxy"
Sep 09 16:38:01.419286 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:01.419176    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="28222823-dc46-49c7-b949-b76951d639dc" containerName="istio-proxy"
Sep 09 16:38:01.419286 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:01.419183    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="28222823-dc46-49c7-b949-b76951d639dc" containerName="istio-proxy"
Sep 09 16:38:01.419286 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:01.419189    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="28222823-dc46-49c7-b949-b76951d639dc" containerName="istio-proxy"
Sep 09 16:38:01.419286 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:01.419206    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f8aab71c-bd4c-4590-a7e2-a4eabe41f215" containerName="payload-processing"
Sep 09 16:38:01.419286 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:01.419213    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="f8aab71c-bd4c-4590-a7e2-a4eabe41f215" containerName="payload-processing"
Sep 09 16:38:01.419286 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:01.419222    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a60e44dd-dd86-4b5a-8d7b-7265bd997eb1" containerName="istio-proxy"
Sep 09 16:38:01.419286 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:01.419227    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="a60e44dd-dd86-4b5a-8d7b-7265bd997eb1" containerName="istio-proxy"
Sep 09 16:38:01.419286 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:01.419233    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ea9f8073-4763-4a3d-bff6-ca92616541d9" containerName="istio-proxy"
Sep 09 16:38:01.419286 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:01.419238    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="ea9f8073-4763-4a3d-bff6-ca92616541d9" containerName="istio-proxy"
Sep 09 16:38:01.419286 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:01.419247    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ea9f8073-4763-4a3d-bff6-ca92616541d9" containerName="istio-proxy"
Sep 09 16:38:01.419286 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:01.419253    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="ea9f8073-4763-4a3d-bff6-ca92616541d9" containerName="istio-proxy"
Sep 09 16:38:01.419286 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:01.419259    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a60e44dd-dd86-4b5a-8d7b-7265bd997eb1" containerName="istio-proxy"
Sep 09 16:38:01.419286 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:01.419263    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="a60e44dd-dd86-4b5a-8d7b-7265bd997eb1" containerName="istio-proxy"
Sep 09 16:38:01.419958 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:01.419321    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="a60e44dd-dd86-4b5a-8d7b-7265bd997eb1" containerName="istio-proxy"
Sep 09 16:38:01.419958 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:01.419329    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="f8aab71c-bd4c-4590-a7e2-a4eabe41f215" containerName="payload-processing"
Sep 09 16:38:01.419958 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:01.419337    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="001e73f4-ff72-42fe-b2eb-b66d995015a9" containerName="revoke-keys"
Sep 09 16:38:01.419958 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:01.419343    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="a60e44dd-dd86-4b5a-8d7b-7265bd997eb1" containerName="istio-proxy"
Sep 09 16:38:01.419958 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:01.419351    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="ea9f8073-4763-4a3d-bff6-ca92616541d9" containerName="istio-proxy"
Sep 09 16:38:01.419958 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:01.419358    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="28222823-dc46-49c7-b949-b76951d639dc" containerName="istio-proxy"
Sep 09 16:38:01.419958 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:01.419365    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="28222823-dc46-49c7-b949-b76951d639dc" containerName="istio-proxy"
Sep 09 16:38:01.423100 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:01.423075    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-50fcbc-openshift-default-7cccc7648d-7j88r"
Sep 09 16:38:01.425957 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:01.425931    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-w3-50fcbc-openshift-default-dockercfg-6pkgd\""
Sep 09 16:38:01.433389 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:01.433364    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-50fcbc-openshift-default-7cccc7648d-7j88r"]
Sep 09 16:38:01.446101 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:01.446081    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k8wmd\" (UniqueName: \"kubernetes.io/projected/9eba3116-8b88-4185-bce0-e9fa72554058-kube-api-access-k8wmd\") pod \"e2e-shared-b-w3-50fcbc-openshift-default-7cccc7648d-7j88r\" (UID: \"9eba3116-8b88-4185-bce0-e9fa72554058\") " pod="openshift-ingress/e2e-shared-b-w3-50fcbc-openshift-default-7cccc7648d-7j88r"
Sep 09 16:38:01.446191 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:01.446111    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9eba3116-8b88-4185-bce0-e9fa72554058-workload-socket\") pod \"e2e-shared-b-w3-50fcbc-openshift-default-7cccc7648d-7j88r\" (UID: \"9eba3116-8b88-4185-bce0-e9fa72554058\") " pod="openshift-ingress/e2e-shared-b-w3-50fcbc-openshift-default-7cccc7648d-7j88r"
Sep 09 16:38:01.446191 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:01.446146    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9eba3116-8b88-4185-bce0-e9fa72554058-workload-certs\") pod \"e2e-shared-b-w3-50fcbc-openshift-default-7cccc7648d-7j88r\" (UID: \"9eba3116-8b88-4185-bce0-e9fa72554058\") " pod="openshift-ingress/e2e-shared-b-w3-50fcbc-openshift-default-7cccc7648d-7j88r"
Sep 09 16:38:01.446273 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:01.446258    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9eba3116-8b88-4185-bce0-e9fa72554058-istiod-ca-cert\") pod \"e2e-shared-b-w3-50fcbc-openshift-default-7cccc7648d-7j88r\" (UID: \"9eba3116-8b88-4185-bce0-e9fa72554058\") " pod="openshift-ingress/e2e-shared-b-w3-50fcbc-openshift-default-7cccc7648d-7j88r"
Sep 09 16:38:01.446315 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:01.446289    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9eba3116-8b88-4185-bce0-e9fa72554058-credential-socket\") pod \"e2e-shared-b-w3-50fcbc-openshift-default-7cccc7648d-7j88r\" (UID: \"9eba3116-8b88-4185-bce0-e9fa72554058\") " pod="openshift-ingress/e2e-shared-b-w3-50fcbc-openshift-default-7cccc7648d-7j88r"
Sep 09 16:38:01.446354 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:01.446315    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9eba3116-8b88-4185-bce0-e9fa72554058-istio-data\") pod \"e2e-shared-b-w3-50fcbc-openshift-default-7cccc7648d-7j88r\" (UID: \"9eba3116-8b88-4185-bce0-e9fa72554058\") " pod="openshift-ingress/e2e-shared-b-w3-50fcbc-openshift-default-7cccc7648d-7j88r"
Sep 09 16:38:01.446354 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:01.446333    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9eba3116-8b88-4185-bce0-e9fa72554058-istio-envoy\") pod \"e2e-shared-b-w3-50fcbc-openshift-default-7cccc7648d-7j88r\" (UID: \"9eba3116-8b88-4185-bce0-e9fa72554058\") " pod="openshift-ingress/e2e-shared-b-w3-50fcbc-openshift-default-7cccc7648d-7j88r"
Sep 09 16:38:01.446455 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:01.446429    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9eba3116-8b88-4185-bce0-e9fa72554058-istio-token\") pod \"e2e-shared-b-w3-50fcbc-openshift-default-7cccc7648d-7j88r\" (UID: \"9eba3116-8b88-4185-bce0-e9fa72554058\") " pod="openshift-ingress/e2e-shared-b-w3-50fcbc-openshift-default-7cccc7648d-7j88r"
Sep 09 16:38:01.446509 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:01.446494    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9eba3116-8b88-4185-bce0-e9fa72554058-istio-podinfo\") pod \"e2e-shared-b-w3-50fcbc-openshift-default-7cccc7648d-7j88r\" (UID: \"9eba3116-8b88-4185-bce0-e9fa72554058\") " pod="openshift-ingress/e2e-shared-b-w3-50fcbc-openshift-default-7cccc7648d-7j88r"
Sep 09 16:38:01.451448 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:01.451425    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:38:01.547206 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:01.547130    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9eba3116-8b88-4185-bce0-e9fa72554058-workload-certs\") pod \"e2e-shared-b-w3-50fcbc-openshift-default-7cccc7648d-7j88r\" (UID: \"9eba3116-8b88-4185-bce0-e9fa72554058\") " pod="openshift-ingress/e2e-shared-b-w3-50fcbc-openshift-default-7cccc7648d-7j88r"
Sep 09 16:38:01.547206 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:01.547184    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9eba3116-8b88-4185-bce0-e9fa72554058-istiod-ca-cert\") pod \"e2e-shared-b-w3-50fcbc-openshift-default-7cccc7648d-7j88r\" (UID: \"9eba3116-8b88-4185-bce0-e9fa72554058\") " pod="openshift-ingress/e2e-shared-b-w3-50fcbc-openshift-default-7cccc7648d-7j88r"
Sep 09 16:38:01.547399 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:01.547289    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9eba3116-8b88-4185-bce0-e9fa72554058-credential-socket\") pod \"e2e-shared-b-w3-50fcbc-openshift-default-7cccc7648d-7j88r\" (UID: \"9eba3116-8b88-4185-bce0-e9fa72554058\") " pod="openshift-ingress/e2e-shared-b-w3-50fcbc-openshift-default-7cccc7648d-7j88r"
Sep 09 16:38:01.547399 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:01.547318    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9eba3116-8b88-4185-bce0-e9fa72554058-istio-data\") pod \"e2e-shared-b-w3-50fcbc-openshift-default-7cccc7648d-7j88r\" (UID: \"9eba3116-8b88-4185-bce0-e9fa72554058\") " pod="openshift-ingress/e2e-shared-b-w3-50fcbc-openshift-default-7cccc7648d-7j88r"
Sep 09 16:38:01.547399 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:01.547346    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9eba3116-8b88-4185-bce0-e9fa72554058-istio-envoy\") pod \"e2e-shared-b-w3-50fcbc-openshift-default-7cccc7648d-7j88r\" (UID: \"9eba3116-8b88-4185-bce0-e9fa72554058\") " pod="openshift-ingress/e2e-shared-b-w3-50fcbc-openshift-default-7cccc7648d-7j88r"
Sep 09 16:38:01.547550 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:01.547399    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9eba3116-8b88-4185-bce0-e9fa72554058-istio-token\") pod \"e2e-shared-b-w3-50fcbc-openshift-default-7cccc7648d-7j88r\" (UID: \"9eba3116-8b88-4185-bce0-e9fa72554058\") " pod="openshift-ingress/e2e-shared-b-w3-50fcbc-openshift-default-7cccc7648d-7j88r"
Sep 09 16:38:01.547550 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:01.547445    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9eba3116-8b88-4185-bce0-e9fa72554058-istio-podinfo\") pod \"e2e-shared-b-w3-50fcbc-openshift-default-7cccc7648d-7j88r\" (UID: \"9eba3116-8b88-4185-bce0-e9fa72554058\") " pod="openshift-ingress/e2e-shared-b-w3-50fcbc-openshift-default-7cccc7648d-7j88r"
Sep 09 16:38:01.547550 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:01.547503    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k8wmd\" (UniqueName: \"kubernetes.io/projected/9eba3116-8b88-4185-bce0-e9fa72554058-kube-api-access-k8wmd\") pod \"e2e-shared-b-w3-50fcbc-openshift-default-7cccc7648d-7j88r\" (UID: \"9eba3116-8b88-4185-bce0-e9fa72554058\") " pod="openshift-ingress/e2e-shared-b-w3-50fcbc-openshift-default-7cccc7648d-7j88r"
Sep 09 16:38:01.547550 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:01.547542    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9eba3116-8b88-4185-bce0-e9fa72554058-workload-socket\") pod \"e2e-shared-b-w3-50fcbc-openshift-default-7cccc7648d-7j88r\" (UID: \"9eba3116-8b88-4185-bce0-e9fa72554058\") " pod="openshift-ingress/e2e-shared-b-w3-50fcbc-openshift-default-7cccc7648d-7j88r"
Sep 09 16:38:01.547747 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:01.547557    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9eba3116-8b88-4185-bce0-e9fa72554058-workload-certs\") pod \"e2e-shared-b-w3-50fcbc-openshift-default-7cccc7648d-7j88r\" (UID: \"9eba3116-8b88-4185-bce0-e9fa72554058\") " pod="openshift-ingress/e2e-shared-b-w3-50fcbc-openshift-default-7cccc7648d-7j88r"
Sep 09 16:38:01.547747 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:01.547673    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9eba3116-8b88-4185-bce0-e9fa72554058-credential-socket\") pod \"e2e-shared-b-w3-50fcbc-openshift-default-7cccc7648d-7j88r\" (UID: \"9eba3116-8b88-4185-bce0-e9fa72554058\") " pod="openshift-ingress/e2e-shared-b-w3-50fcbc-openshift-default-7cccc7648d-7j88r"
Sep 09 16:38:01.547858 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:01.547742    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9eba3116-8b88-4185-bce0-e9fa72554058-istio-data\") pod \"e2e-shared-b-w3-50fcbc-openshift-default-7cccc7648d-7j88r\" (UID: \"9eba3116-8b88-4185-bce0-e9fa72554058\") " pod="openshift-ingress/e2e-shared-b-w3-50fcbc-openshift-default-7cccc7648d-7j88r"
Sep 09 16:38:01.547913 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:01.547887    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9eba3116-8b88-4185-bce0-e9fa72554058-workload-socket\") pod \"e2e-shared-b-w3-50fcbc-openshift-default-7cccc7648d-7j88r\" (UID: \"9eba3116-8b88-4185-bce0-e9fa72554058\") " pod="openshift-ingress/e2e-shared-b-w3-50fcbc-openshift-default-7cccc7648d-7j88r"
Sep 09 16:38:01.547913 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:01.547897    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9eba3116-8b88-4185-bce0-e9fa72554058-istiod-ca-cert\") pod \"e2e-shared-b-w3-50fcbc-openshift-default-7cccc7648d-7j88r\" (UID: \"9eba3116-8b88-4185-bce0-e9fa72554058\") " pod="openshift-ingress/e2e-shared-b-w3-50fcbc-openshift-default-7cccc7648d-7j88r"
Sep 09 16:38:01.549662 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:01.549644    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9eba3116-8b88-4185-bce0-e9fa72554058-istio-envoy\") pod \"e2e-shared-b-w3-50fcbc-openshift-default-7cccc7648d-7j88r\" (UID: \"9eba3116-8b88-4185-bce0-e9fa72554058\") " pod="openshift-ingress/e2e-shared-b-w3-50fcbc-openshift-default-7cccc7648d-7j88r"
Sep 09 16:38:01.549777 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:01.549760    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9eba3116-8b88-4185-bce0-e9fa72554058-istio-podinfo\") pod \"e2e-shared-b-w3-50fcbc-openshift-default-7cccc7648d-7j88r\" (UID: \"9eba3116-8b88-4185-bce0-e9fa72554058\") " pod="openshift-ingress/e2e-shared-b-w3-50fcbc-openshift-default-7cccc7648d-7j88r"
Sep 09 16:38:01.554972 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:01.554953    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9eba3116-8b88-4185-bce0-e9fa72554058-istio-token\") pod \"e2e-shared-b-w3-50fcbc-openshift-default-7cccc7648d-7j88r\" (UID: \"9eba3116-8b88-4185-bce0-e9fa72554058\") " pod="openshift-ingress/e2e-shared-b-w3-50fcbc-openshift-default-7cccc7648d-7j88r"
Sep 09 16:38:01.555723 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:01.555695    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k8wmd\" (UniqueName: \"kubernetes.io/projected/9eba3116-8b88-4185-bce0-e9fa72554058-kube-api-access-k8wmd\") pod \"e2e-shared-b-w3-50fcbc-openshift-default-7cccc7648d-7j88r\" (UID: \"9eba3116-8b88-4185-bce0-e9fa72554058\") " pod="openshift-ingress/e2e-shared-b-w3-50fcbc-openshift-default-7cccc7648d-7j88r"
Sep 09 16:38:01.736324 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:01.736286    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-50fcbc-openshift-default-7cccc7648d-7j88r"
Sep 09 16:38:02.007452 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:02.007431    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-50fcbc-openshift-default-7cccc7648d-7j88r"]
Sep 09 16:38:02.008903 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:38:02.008876    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9eba3116_8b88_4185_bce0_e9fa72554058.slice/crio-741f59c3227ece601db0fcddc273ab3cdf10c3305c4d7e122f4999dae213a9a0 WatchSource:0}: Error finding container 741f59c3227ece601db0fcddc273ab3cdf10c3305c4d7e122f4999dae213a9a0: Status 404 returned error can't find the container with id 741f59c3227ece601db0fcddc273ab3cdf10c3305c4d7e122f4999dae213a9a0
Sep 09 16:38:02.011064 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:02.011030    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 09 16:38:02.011151 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:02.011101    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 09 16:38:02.011151 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:02.011130    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 09 16:38:02.471516 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:02.471488    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:38:02.572485 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:02.572458    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:38:02.856565 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:02.856532    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-50fcbc-openshift-default-7cccc7648d-7j88r" event={"ID":"9eba3116-8b88-4185-bce0-e9fa72554058","Type":"ContainerStarted","Data":"64e4e443e167ce00ef597e1e6e258ab40bfd192fb706048b0bd1c959410c9c29"}
Sep 09 16:38:02.856712 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:02.856582    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-50fcbc-openshift-default-7cccc7648d-7j88r" event={"ID":"9eba3116-8b88-4185-bce0-e9fa72554058","Type":"ContainerStarted","Data":"741f59c3227ece601db0fcddc273ab3cdf10c3305c4d7e122f4999dae213a9a0"}
Sep 09 16:38:02.876027 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:02.875971    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w3-50fcbc-openshift-default-7cccc7648d-7j88r" podStartSLOduration=1.875957851 podStartE2EDuration="1.875957851s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 16:38:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:38:02.874201864 +0000 UTC m=+1465.227931715" watchObservedRunningTime="2026-09-09 16:38:02.875957851 +0000 UTC m=+1465.229687682"
Sep 09 16:38:02.953798 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:02.953772    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:38:03.736592 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:03.736560    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w3-50fcbc-openshift-default-7cccc7648d-7j88r"
Sep 09 16:38:03.741978 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:03.741956    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w3-50fcbc-openshift-default-7cccc7648d-7j88r"
Sep 09 16:38:03.861317 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:03.861291    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w3-50fcbc-openshift-default-7cccc7648d-7j88r"
Sep 09 16:38:03.862114 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:03.862096    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w3-50fcbc-openshift-default-7cccc7648d-7j88r"
Sep 09 16:38:04.412265 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:04.412233    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:38:04.810543 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:04.810469    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:38:05.401498 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:05.401471    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:38:05.459073 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:05.459044    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w2-1d59dd-openshift-default-57db7596bb-mtq8j"]
Sep 09 16:38:05.459742 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:05.459723    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="ea9f8073-4763-4a3d-bff6-ca92616541d9" containerName="istio-proxy"
Sep 09 16:38:05.463174 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:05.463155    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-1d59dd-openshift-default-57db7596bb-mtq8j"
Sep 09 16:38:05.465736 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:05.465710    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-w2-1d59dd-openshift-default-dockercfg-4sp9d\""
Sep 09 16:38:05.473184 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:05.473157    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-1d59dd-openshift-default-57db7596bb-mtq8j"]
Sep 09 16:38:05.583477 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:05.583446    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7c87f10c-d9c9-4d1d-b108-97ef7b62b9f4-workload-certs\") pod \"e2e-shared-b-w2-1d59dd-openshift-default-57db7596bb-mtq8j\" (UID: \"7c87f10c-d9c9-4d1d-b108-97ef7b62b9f4\") " pod="openshift-ingress/e2e-shared-b-w2-1d59dd-openshift-default-57db7596bb-mtq8j"
Sep 09 16:38:05.583624 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:05.583484    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7c87f10c-d9c9-4d1d-b108-97ef7b62b9f4-istio-token\") pod \"e2e-shared-b-w2-1d59dd-openshift-default-57db7596bb-mtq8j\" (UID: \"7c87f10c-d9c9-4d1d-b108-97ef7b62b9f4\") " pod="openshift-ingress/e2e-shared-b-w2-1d59dd-openshift-default-57db7596bb-mtq8j"
Sep 09 16:38:05.583624 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:05.583503    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7c87f10c-d9c9-4d1d-b108-97ef7b62b9f4-istiod-ca-cert\") pod \"e2e-shared-b-w2-1d59dd-openshift-default-57db7596bb-mtq8j\" (UID: \"7c87f10c-d9c9-4d1d-b108-97ef7b62b9f4\") " pod="openshift-ingress/e2e-shared-b-w2-1d59dd-openshift-default-57db7596bb-mtq8j"
Sep 09 16:38:05.583624 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:05.583610    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7c87f10c-d9c9-4d1d-b108-97ef7b62b9f4-istio-data\") pod \"e2e-shared-b-w2-1d59dd-openshift-default-57db7596bb-mtq8j\" (UID: \"7c87f10c-d9c9-4d1d-b108-97ef7b62b9f4\") " pod="openshift-ingress/e2e-shared-b-w2-1d59dd-openshift-default-57db7596bb-mtq8j"
Sep 09 16:38:05.583726 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:05.583635    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7c87f10c-d9c9-4d1d-b108-97ef7b62b9f4-istio-envoy\") pod \"e2e-shared-b-w2-1d59dd-openshift-default-57db7596bb-mtq8j\" (UID: \"7c87f10c-d9c9-4d1d-b108-97ef7b62b9f4\") " pod="openshift-ingress/e2e-shared-b-w2-1d59dd-openshift-default-57db7596bb-mtq8j"
Sep 09 16:38:05.583726 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:05.583698    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7c87f10c-d9c9-4d1d-b108-97ef7b62b9f4-istio-podinfo\") pod \"e2e-shared-b-w2-1d59dd-openshift-default-57db7596bb-mtq8j\" (UID: \"7c87f10c-d9c9-4d1d-b108-97ef7b62b9f4\") " pod="openshift-ingress/e2e-shared-b-w2-1d59dd-openshift-default-57db7596bb-mtq8j"
Sep 09 16:38:05.583726 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:05.583716    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7c87f10c-d9c9-4d1d-b108-97ef7b62b9f4-workload-socket\") pod \"e2e-shared-b-w2-1d59dd-openshift-default-57db7596bb-mtq8j\" (UID: \"7c87f10c-d9c9-4d1d-b108-97ef7b62b9f4\") " pod="openshift-ingress/e2e-shared-b-w2-1d59dd-openshift-default-57db7596bb-mtq8j"
Sep 09 16:38:05.583817 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:05.583735    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7c87f10c-d9c9-4d1d-b108-97ef7b62b9f4-credential-socket\") pod \"e2e-shared-b-w2-1d59dd-openshift-default-57db7596bb-mtq8j\" (UID: \"7c87f10c-d9c9-4d1d-b108-97ef7b62b9f4\") " pod="openshift-ingress/e2e-shared-b-w2-1d59dd-openshift-default-57db7596bb-mtq8j"
Sep 09 16:38:05.583817 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:05.583789    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-57l8x\" (UniqueName: \"kubernetes.io/projected/7c87f10c-d9c9-4d1d-b108-97ef7b62b9f4-kube-api-access-57l8x\") pod \"e2e-shared-b-w2-1d59dd-openshift-default-57db7596bb-mtq8j\" (UID: \"7c87f10c-d9c9-4d1d-b108-97ef7b62b9f4\") " pod="openshift-ingress/e2e-shared-b-w2-1d59dd-openshift-default-57db7596bb-mtq8j"
Sep 09 16:38:05.684570 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:05.684503    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-57l8x\" (UniqueName: \"kubernetes.io/projected/7c87f10c-d9c9-4d1d-b108-97ef7b62b9f4-kube-api-access-57l8x\") pod \"e2e-shared-b-w2-1d59dd-openshift-default-57db7596bb-mtq8j\" (UID: \"7c87f10c-d9c9-4d1d-b108-97ef7b62b9f4\") " pod="openshift-ingress/e2e-shared-b-w2-1d59dd-openshift-default-57db7596bb-mtq8j"
Sep 09 16:38:05.684570 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:05.684551    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7c87f10c-d9c9-4d1d-b108-97ef7b62b9f4-workload-certs\") pod \"e2e-shared-b-w2-1d59dd-openshift-default-57db7596bb-mtq8j\" (UID: \"7c87f10c-d9c9-4d1d-b108-97ef7b62b9f4\") " pod="openshift-ingress/e2e-shared-b-w2-1d59dd-openshift-default-57db7596bb-mtq8j"
Sep 09 16:38:05.684754 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:05.684573    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7c87f10c-d9c9-4d1d-b108-97ef7b62b9f4-istio-token\") pod \"e2e-shared-b-w2-1d59dd-openshift-default-57db7596bb-mtq8j\" (UID: \"7c87f10c-d9c9-4d1d-b108-97ef7b62b9f4\") " pod="openshift-ingress/e2e-shared-b-w2-1d59dd-openshift-default-57db7596bb-mtq8j"
Sep 09 16:38:05.684754 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:05.684589    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7c87f10c-d9c9-4d1d-b108-97ef7b62b9f4-istiod-ca-cert\") pod \"e2e-shared-b-w2-1d59dd-openshift-default-57db7596bb-mtq8j\" (UID: \"7c87f10c-d9c9-4d1d-b108-97ef7b62b9f4\") " pod="openshift-ingress/e2e-shared-b-w2-1d59dd-openshift-default-57db7596bb-mtq8j"
Sep 09 16:38:05.684754 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:05.684635    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7c87f10c-d9c9-4d1d-b108-97ef7b62b9f4-istio-data\") pod \"e2e-shared-b-w2-1d59dd-openshift-default-57db7596bb-mtq8j\" (UID: \"7c87f10c-d9c9-4d1d-b108-97ef7b62b9f4\") " pod="openshift-ingress/e2e-shared-b-w2-1d59dd-openshift-default-57db7596bb-mtq8j"
Sep 09 16:38:05.684754 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:05.684652    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7c87f10c-d9c9-4d1d-b108-97ef7b62b9f4-istio-envoy\") pod \"e2e-shared-b-w2-1d59dd-openshift-default-57db7596bb-mtq8j\" (UID: \"7c87f10c-d9c9-4d1d-b108-97ef7b62b9f4\") " pod="openshift-ingress/e2e-shared-b-w2-1d59dd-openshift-default-57db7596bb-mtq8j"
Sep 09 16:38:05.684754 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:05.684736    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7c87f10c-d9c9-4d1d-b108-97ef7b62b9f4-istio-podinfo\") pod \"e2e-shared-b-w2-1d59dd-openshift-default-57db7596bb-mtq8j\" (UID: \"7c87f10c-d9c9-4d1d-b108-97ef7b62b9f4\") " pod="openshift-ingress/e2e-shared-b-w2-1d59dd-openshift-default-57db7596bb-mtq8j"
Sep 09 16:38:05.685014 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:05.684762    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7c87f10c-d9c9-4d1d-b108-97ef7b62b9f4-workload-socket\") pod \"e2e-shared-b-w2-1d59dd-openshift-default-57db7596bb-mtq8j\" (UID: \"7c87f10c-d9c9-4d1d-b108-97ef7b62b9f4\") " pod="openshift-ingress/e2e-shared-b-w2-1d59dd-openshift-default-57db7596bb-mtq8j"
Sep 09 16:38:05.685014 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:05.684783    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7c87f10c-d9c9-4d1d-b108-97ef7b62b9f4-credential-socket\") pod \"e2e-shared-b-w2-1d59dd-openshift-default-57db7596bb-mtq8j\" (UID: \"7c87f10c-d9c9-4d1d-b108-97ef7b62b9f4\") " pod="openshift-ingress/e2e-shared-b-w2-1d59dd-openshift-default-57db7596bb-mtq8j"
Sep 09 16:38:05.685126 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:05.685040    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7c87f10c-d9c9-4d1d-b108-97ef7b62b9f4-istio-data\") pod \"e2e-shared-b-w2-1d59dd-openshift-default-57db7596bb-mtq8j\" (UID: \"7c87f10c-d9c9-4d1d-b108-97ef7b62b9f4\") " pod="openshift-ingress/e2e-shared-b-w2-1d59dd-openshift-default-57db7596bb-mtq8j"
Sep 09 16:38:05.685179 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:05.685137    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7c87f10c-d9c9-4d1d-b108-97ef7b62b9f4-workload-socket\") pod \"e2e-shared-b-w2-1d59dd-openshift-default-57db7596bb-mtq8j\" (UID: \"7c87f10c-d9c9-4d1d-b108-97ef7b62b9f4\") " pod="openshift-ingress/e2e-shared-b-w2-1d59dd-openshift-default-57db7596bb-mtq8j"
Sep 09 16:38:05.685328 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:05.685309    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7c87f10c-d9c9-4d1d-b108-97ef7b62b9f4-workload-certs\") pod \"e2e-shared-b-w2-1d59dd-openshift-default-57db7596bb-mtq8j\" (UID: \"7c87f10c-d9c9-4d1d-b108-97ef7b62b9f4\") " pod="openshift-ingress/e2e-shared-b-w2-1d59dd-openshift-default-57db7596bb-mtq8j"
Sep 09 16:38:05.685405 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:05.685349    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7c87f10c-d9c9-4d1d-b108-97ef7b62b9f4-credential-socket\") pod \"e2e-shared-b-w2-1d59dd-openshift-default-57db7596bb-mtq8j\" (UID: \"7c87f10c-d9c9-4d1d-b108-97ef7b62b9f4\") " pod="openshift-ingress/e2e-shared-b-w2-1d59dd-openshift-default-57db7596bb-mtq8j"
Sep 09 16:38:05.685405 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:05.685347    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7c87f10c-d9c9-4d1d-b108-97ef7b62b9f4-istiod-ca-cert\") pod \"e2e-shared-b-w2-1d59dd-openshift-default-57db7596bb-mtq8j\" (UID: \"7c87f10c-d9c9-4d1d-b108-97ef7b62b9f4\") " pod="openshift-ingress/e2e-shared-b-w2-1d59dd-openshift-default-57db7596bb-mtq8j"
Sep 09 16:38:05.687185 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:05.687164    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7c87f10c-d9c9-4d1d-b108-97ef7b62b9f4-istio-podinfo\") pod \"e2e-shared-b-w2-1d59dd-openshift-default-57db7596bb-mtq8j\" (UID: \"7c87f10c-d9c9-4d1d-b108-97ef7b62b9f4\") " pod="openshift-ingress/e2e-shared-b-w2-1d59dd-openshift-default-57db7596bb-mtq8j"
Sep 09 16:38:05.687268 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:05.687189    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7c87f10c-d9c9-4d1d-b108-97ef7b62b9f4-istio-envoy\") pod \"e2e-shared-b-w2-1d59dd-openshift-default-57db7596bb-mtq8j\" (UID: \"7c87f10c-d9c9-4d1d-b108-97ef7b62b9f4\") " pod="openshift-ingress/e2e-shared-b-w2-1d59dd-openshift-default-57db7596bb-mtq8j"
Sep 09 16:38:05.691760 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:05.691741    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7c87f10c-d9c9-4d1d-b108-97ef7b62b9f4-istio-token\") pod \"e2e-shared-b-w2-1d59dd-openshift-default-57db7596bb-mtq8j\" (UID: \"7c87f10c-d9c9-4d1d-b108-97ef7b62b9f4\") " pod="openshift-ingress/e2e-shared-b-w2-1d59dd-openshift-default-57db7596bb-mtq8j"
Sep 09 16:38:05.691944 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:05.691927    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-57l8x\" (UniqueName: \"kubernetes.io/projected/7c87f10c-d9c9-4d1d-b108-97ef7b62b9f4-kube-api-access-57l8x\") pod \"e2e-shared-b-w2-1d59dd-openshift-default-57db7596bb-mtq8j\" (UID: \"7c87f10c-d9c9-4d1d-b108-97ef7b62b9f4\") " pod="openshift-ingress/e2e-shared-b-w2-1d59dd-openshift-default-57db7596bb-mtq8j"
Sep 09 16:38:05.774899 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:05.774875    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-1d59dd-openshift-default-57db7596bb-mtq8j"
Sep 09 16:38:05.776055 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:05.776035    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:38:05.894814 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:05.894787    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:38:06.006461 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:06.006363    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:38:06.060715 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:06.060690    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-1d59dd-openshift-default-57db7596bb-mtq8j"]
Sep 09 16:38:06.062720 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:38:06.062689    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c87f10c_d9c9_4d1d_b108_97ef7b62b9f4.slice/crio-d90037fdaed78bbd4a6586320914875fe04ed71e84100f1025d396dbd16138ed WatchSource:0}: Error finding container d90037fdaed78bbd4a6586320914875fe04ed71e84100f1025d396dbd16138ed: Status 404 returned error can't find the container with id d90037fdaed78bbd4a6586320914875fe04ed71e84100f1025d396dbd16138ed
Sep 09 16:38:06.064581 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:06.064557    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:38:06.065151 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:06.065112    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 09 16:38:06.065226 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:06.065206    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 09 16:38:06.065263 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:06.065251    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 09 16:38:06.792189 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:06.792154    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:38:06.877664 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:06.877632    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-1d59dd-openshift-default-57db7596bb-mtq8j" event={"ID":"7c87f10c-d9c9-4d1d-b108-97ef7b62b9f4","Type":"ContainerStarted","Data":"1c2c39e9287b47969108d0f7b3a88a05243d1469a86ee819482cca7d499c6a77"}
Sep 09 16:38:06.877810 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:06.877693    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-1d59dd-openshift-default-57db7596bb-mtq8j" event={"ID":"7c87f10c-d9c9-4d1d-b108-97ef7b62b9f4","Type":"ContainerStarted","Data":"d90037fdaed78bbd4a6586320914875fe04ed71e84100f1025d396dbd16138ed"}
Sep 09 16:38:06.897836 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:06.897787    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w2-1d59dd-openshift-default-57db7596bb-mtq8j" podStartSLOduration=1.897773542 podStartE2EDuration="1.897773542s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 16:38:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:38:06.896112739 +0000 UTC m=+1469.249842620" watchObservedRunningTime="2026-09-09 16:38:06.897773542 +0000 UTC m=+1469.251503373"
Sep 09 16:38:07.196818 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:07.196795    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:38:07.775412 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:07.775379    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w2-1d59dd-openshift-default-57db7596bb-mtq8j"
Sep 09 16:38:07.780119 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:07.780094    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w2-1d59dd-openshift-default-57db7596bb-mtq8j"
Sep 09 16:38:07.884090 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:07.884056    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w2-1d59dd-openshift-default-57db7596bb-mtq8j"
Sep 09 16:38:07.884936 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:07.884918    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w2-1d59dd-openshift-default-57db7596bb-mtq8j"
Sep 09 16:38:08.387703 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:08.387671    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:38:08.774810 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:08.774720    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:38:08.879004 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:08.878957    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:38:08.976126 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:08.976099    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:38:09.569248 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:09.569218    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:38:10.461880 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:10.461828    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:38:11.114868 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:11.114817    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:38:11.233548 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:11.233513    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:38:11.510924 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:11.510814    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:38:11.623326 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:11.623297    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:38:11.723934 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:11.723908    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:38:19.079022 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:19.078968    2583 patch_prober.go:28] interesting pod/e2e-shared-b-w3-50fcbc-openshift-default-7cccc7648d-7j88r container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": read tcp 10.132.0.2:53058->10.132.0.53:15021: read: connection reset by peer" start-of-body=
Sep 09 16:38:19.079429 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:19.079074    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-w3-50fcbc-openshift-default-7cccc7648d-7j88r" podUID="9eba3116-8b88-4185-bce0-e9fa72554058" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": read tcp 10.132.0.2:53058->10.132.0.53:15021: read: connection reset by peer"
Sep 09 16:38:19.954946 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:19.954915    2583 generic.go:356] "Generic (PLEG): container finished" podID="9eba3116-8b88-4185-bce0-e9fa72554058" containerID="64e4e443e167ce00ef597e1e6e258ab40bfd192fb706048b0bd1c959410c9c29" exitCode=0
Sep 09 16:38:19.955174 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:19.955010    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-50fcbc-openshift-default-7cccc7648d-7j88r" event={"ID":"9eba3116-8b88-4185-bce0-e9fa72554058","Type":"ContainerDied","Data":"64e4e443e167ce00ef597e1e6e258ab40bfd192fb706048b0bd1c959410c9c29"}
Sep 09 16:38:19.955415 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:19.955398    2583 scope.go:117] "RemoveContainer" containerID="64e4e443e167ce00ef597e1e6e258ab40bfd192fb706048b0bd1c959410c9c29"
Sep 09 16:38:19.956556 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:19.956522    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 09 16:38:19.956660 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:19.956589    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 09 16:38:19.956660 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:19.956622    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 09 16:38:20.961997 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:20.961953    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-50fcbc-openshift-default-7cccc7648d-7j88r" event={"ID":"9eba3116-8b88-4185-bce0-e9fa72554058","Type":"ContainerStarted","Data":"2fe37c66d85d290d77bc36e8e6efcb5cc5808c2591358f3d0c8383cfd300c00e"}
Sep 09 16:38:21.736692 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:21.736646    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w3-50fcbc-openshift-default-7cccc7648d-7j88r"
Sep 09 16:38:21.736897 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:21.736775    2583 patch_prober.go:28] interesting pod/e2e-shared-b-w3-50fcbc-openshift-default-7cccc7648d-7j88r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body=
Sep 09 16:38:21.736897 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:21.736834    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-50fcbc-openshift-default-7cccc7648d-7j88r" podUID="9eba3116-8b88-4185-bce0-e9fa72554058" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused"
Sep 09 16:38:22.737437 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:22.737399    2583 patch_prober.go:28] interesting pod/e2e-shared-b-w3-50fcbc-openshift-default-7cccc7648d-7j88r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body=
Sep 09 16:38:22.738020 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:22.737966    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-50fcbc-openshift-default-7cccc7648d-7j88r" podUID="9eba3116-8b88-4185-bce0-e9fa72554058" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused"
Sep 09 16:38:23.740009 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:23.739253    2583 patch_prober.go:28] interesting pod/e2e-shared-b-w3-50fcbc-openshift-default-7cccc7648d-7j88r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body=
Sep 09 16:38:23.740009 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:23.739338    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-50fcbc-openshift-default-7cccc7648d-7j88r" podUID="9eba3116-8b88-4185-bce0-e9fa72554058" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused"
Sep 09 16:38:24.737186 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:24.737150    2583 patch_prober.go:28] interesting pod/e2e-shared-b-w3-50fcbc-openshift-default-7cccc7648d-7j88r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body=
Sep 09 16:38:24.737353 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:24.737206    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-50fcbc-openshift-default-7cccc7648d-7j88r" podUID="9eba3116-8b88-4185-bce0-e9fa72554058" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused"
Sep 09 16:38:25.736922 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:25.736877    2583 patch_prober.go:28] interesting pod/e2e-shared-b-w3-50fcbc-openshift-default-7cccc7648d-7j88r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body=
Sep 09 16:38:25.737417 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:25.736962    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-50fcbc-openshift-default-7cccc7648d-7j88r" podUID="9eba3116-8b88-4185-bce0-e9fa72554058" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused"
Sep 09 16:38:25.765185 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:25.765155    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:38:25.865886 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:25.865844    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:38:26.741337 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:26.741306    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w3-50fcbc-openshift-default-7cccc7648d-7j88r"
Sep 09 16:38:26.741769 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:26.741593    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w3-50fcbc-openshift-default-7cccc7648d-7j88r"
Sep 09 16:38:26.742384 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:26.742361    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w3-50fcbc-openshift-default-7cccc7648d-7j88r"
Sep 09 16:38:26.832760 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:26.832731    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:38:28.003297 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:28.003267    2583 generic.go:356] "Generic (PLEG): container finished" podID="7c87f10c-d9c9-4d1d-b108-97ef7b62b9f4" containerID="1c2c39e9287b47969108d0f7b3a88a05243d1469a86ee819482cca7d499c6a77" exitCode=0
Sep 09 16:38:28.003658 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:28.003349    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-1d59dd-openshift-default-57db7596bb-mtq8j" event={"ID":"7c87f10c-d9c9-4d1d-b108-97ef7b62b9f4","Type":"ContainerDied","Data":"1c2c39e9287b47969108d0f7b3a88a05243d1469a86ee819482cca7d499c6a77"}
Sep 09 16:38:28.003858 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:28.003842    2583 scope.go:117] "RemoveContainer" containerID="1c2c39e9287b47969108d0f7b3a88a05243d1469a86ee819482cca7d499c6a77"
Sep 09 16:38:28.004858 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:28.004832    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 09 16:38:28.004932 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:28.004917    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 09 16:38:28.004964 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:28.004956    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 09 16:38:28.018546 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:28.018528    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:38:28.803044 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:28.803012    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:38:29.015434 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:29.015405    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-1d59dd-openshift-default-57db7596bb-mtq8j" event={"ID":"7c87f10c-d9c9-4d1d-b108-97ef7b62b9f4","Type":"ContainerStarted","Data":"58f267d1c3e955ce7ef200312e36d642f76287e1e081845926507da560154538"}
Sep 09 16:38:29.566468 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:29.566372    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:38:29.776021 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:29.775969    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w2-1d59dd-openshift-default-57db7596bb-mtq8j"
Sep 09 16:38:29.776253 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:29.776163    2583 patch_prober.go:28] interesting pod/e2e-shared-b-w2-1d59dd-openshift-default-57db7596bb-mtq8j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Sep 09 16:38:29.776253 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:29.776209    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-1d59dd-openshift-default-57db7596bb-mtq8j" podUID="7c87f10c-d9c9-4d1d-b108-97ef7b62b9f4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Sep 09 16:38:29.936154 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:29.936124    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:38:30.754199 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:30.754164    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:38:30.775409 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:30.775377    2583 patch_prober.go:28] interesting pod/e2e-shared-b-w2-1d59dd-openshift-default-57db7596bb-mtq8j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Sep 09 16:38:30.775548 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:30.775427    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-1d59dd-openshift-default-57db7596bb-mtq8j" podUID="7c87f10c-d9c9-4d1d-b108-97ef7b62b9f4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Sep 09 16:38:30.907459 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:30.907428    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:38:31.276279 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:31.276244    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:38:31.775751 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:31.775708    2583 patch_prober.go:28] interesting pod/e2e-shared-b-w2-1d59dd-openshift-default-57db7596bb-mtq8j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Sep 09 16:38:31.776180 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:31.775784    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-1d59dd-openshift-default-57db7596bb-mtq8j" podUID="7c87f10c-d9c9-4d1d-b108-97ef7b62b9f4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Sep 09 16:38:31.959424 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:31.959394    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:38:32.615647 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:32.615600    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:38:32.775756 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:32.775724    2583 patch_prober.go:28] interesting pod/e2e-shared-b-w2-1d59dd-openshift-default-57db7596bb-mtq8j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Sep 09 16:38:32.776142 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:32.775801    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-1d59dd-openshift-default-57db7596bb-mtq8j" podUID="7c87f10c-d9c9-4d1d-b108-97ef7b62b9f4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Sep 09 16:38:33.775970 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:33.775930    2583 patch_prober.go:28] interesting pod/e2e-shared-b-w2-1d59dd-openshift-default-57db7596bb-mtq8j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Sep 09 16:38:33.776360 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:33.776003    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-1d59dd-openshift-default-57db7596bb-mtq8j" podUID="7c87f10c-d9c9-4d1d-b108-97ef7b62b9f4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Sep 09 16:38:34.779143 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:34.779116    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w2-1d59dd-openshift-default-57db7596bb-mtq8j"
Sep 09 16:38:34.779568 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:34.779365    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w2-1d59dd-openshift-default-57db7596bb-mtq8j"
Sep 09 16:38:34.780028 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:34.780011    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w2-1d59dd-openshift-default-57db7596bb-mtq8j"
Sep 09 16:38:35.233919 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:35.233891    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:38:35.294768 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:35.294743    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:38:36.817076 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:36.817015    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:38:37.629546 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:37.629509    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-6954-140011489899696"]
Sep 09 16:38:37.633558 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:37.633539    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-6954-140011489899696"
Sep 09 16:38:37.636703 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:37.636676    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-npvh9\""
Sep 09 16:38:37.639275 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:37.639250    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-6954-140011489899696"]
Sep 09 16:38:37.795354 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:37.795329    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9749p\" (UniqueName: \"kubernetes.io/projected/218b493b-84f1-4aa2-a142-d140bec7e6d2-kube-api-access-9749p\") pod \"test-curl-6954-140011489899696\" (UID: \"218b493b-84f1-4aa2-a142-d140bec7e6d2\") " pod="opendatahub/test-curl-6954-140011489899696"
Sep 09 16:38:37.896170 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:37.896110    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9749p\" (UniqueName: \"kubernetes.io/projected/218b493b-84f1-4aa2-a142-d140bec7e6d2-kube-api-access-9749p\") pod \"test-curl-6954-140011489899696\" (UID: \"218b493b-84f1-4aa2-a142-d140bec7e6d2\") " pod="opendatahub/test-curl-6954-140011489899696"
Sep 09 16:38:37.903354 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:37.903333    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9749p\" (UniqueName: \"kubernetes.io/projected/218b493b-84f1-4aa2-a142-d140bec7e6d2-kube-api-access-9749p\") pod \"test-curl-6954-140011489899696\" (UID: \"218b493b-84f1-4aa2-a142-d140bec7e6d2\") " pod="opendatahub/test-curl-6954-140011489899696"
Sep 09 16:38:37.951475 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:37.951452    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-6954-140011489899696"
Sep 09 16:38:38.218096 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:38.218074    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-6954-140011489899696"]
Sep 09 16:38:38.219355 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:38:38.219324    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod218b493b_84f1_4aa2_a142_d140bec7e6d2.slice/crio-c54a0966a7b5e2891baeb0384fe100db13060fe91dae0bc0007d774377fbfddd WatchSource:0}: Error finding container c54a0966a7b5e2891baeb0384fe100db13060fe91dae0bc0007d774377fbfddd: Status 404 returned error can't find the container with id c54a0966a7b5e2891baeb0384fe100db13060fe91dae0bc0007d774377fbfddd
Sep 09 16:38:38.220776 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:38.220758    2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 09 16:38:39.082665 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:39.082627    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-6954-140011489899696" event={"ID":"218b493b-84f1-4aa2-a142-d140bec7e6d2","Type":"ContainerStarted","Data":"c54a0966a7b5e2891baeb0384fe100db13060fe91dae0bc0007d774377fbfddd"}
Sep 09 16:38:39.430583 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:39.430548    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:38:39.784126 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:39.784045    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:38:40.089402 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:40.089368    2583 generic.go:356] "Generic (PLEG): container finished" podID="218b493b-84f1-4aa2-a142-d140bec7e6d2" containerID="9a194bc6d75793736ae86cfa74e1c78b30d42ad470631ac5b24cb1796a987a4c" exitCode=0
Sep 09 16:38:40.089725 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:40.089449    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-6954-140011489899696" event={"ID":"218b493b-84f1-4aa2-a142-d140bec7e6d2","Type":"ContainerDied","Data":"9a194bc6d75793736ae86cfa74e1c78b30d42ad470631ac5b24cb1796a987a4c"}
Sep 09 16:38:41.235923 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:41.235897    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-6954-140011489899696"
Sep 09 16:38:41.254537 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:41.254512    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-6954-140011489899696_218b493b-84f1-4aa2-a142-d140bec7e6d2/test-curl-6954-140011489899696/0.log"
Sep 09 16:38:41.276647 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:41.276620    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-6954-140011489899696"]
Sep 09 16:38:41.278400 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:41.278381    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-6954-140011489899696"]
Sep 09 16:38:41.322764 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:41.322740    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9749p\" (UniqueName: \"kubernetes.io/projected/218b493b-84f1-4aa2-a142-d140bec7e6d2-kube-api-access-9749p\") pod \"218b493b-84f1-4aa2-a142-d140bec7e6d2\" (UID: \"218b493b-84f1-4aa2-a142-d140bec7e6d2\") "
Sep 09 16:38:41.324732 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:41.324706    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/218b493b-84f1-4aa2-a142-d140bec7e6d2-kube-api-access-9749p" (OuterVolumeSpecName: "kube-api-access-9749p") pod "218b493b-84f1-4aa2-a142-d140bec7e6d2" (UID: "218b493b-84f1-4aa2-a142-d140bec7e6d2"). InnerVolumeSpecName "kube-api-access-9749p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 16:38:41.409861 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:41.409799    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-6954-140011489900272"]
Sep 09 16:38:41.410220 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:41.410207    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="218b493b-84f1-4aa2-a142-d140bec7e6d2" containerName="test-curl-6954-140011489899696"
Sep 09 16:38:41.410272 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:41.410221    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="218b493b-84f1-4aa2-a142-d140bec7e6d2" containerName="test-curl-6954-140011489899696"
Sep 09 16:38:41.410311 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:41.410302    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="218b493b-84f1-4aa2-a142-d140bec7e6d2" containerName="test-curl-6954-140011489899696"
Sep 09 16:38:41.413339 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:41.413324    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-6954-140011489900272"
Sep 09 16:38:41.418915 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:41.418893    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-6954-140011489900272"]
Sep 09 16:38:41.424021 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:41.424002    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9749p\" (UniqueName: \"kubernetes.io/projected/218b493b-84f1-4aa2-a142-d140bec7e6d2-kube-api-access-9749p\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\""
Sep 09 16:38:41.524833 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:41.524809    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7frrj\" (UniqueName: \"kubernetes.io/projected/7c19dbdf-4e9d-4450-8af3-0b21e3854c75-kube-api-access-7frrj\") pod \"test-curl-6954-140011489900272\" (UID: \"7c19dbdf-4e9d-4450-8af3-0b21e3854c75\") " pod="opendatahub/test-curl-6954-140011489900272"
Sep 09 16:38:41.625552 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:41.625525    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7frrj\" (UniqueName: \"kubernetes.io/projected/7c19dbdf-4e9d-4450-8af3-0b21e3854c75-kube-api-access-7frrj\") pod \"test-curl-6954-140011489900272\" (UID: \"7c19dbdf-4e9d-4450-8af3-0b21e3854c75\") " pod="opendatahub/test-curl-6954-140011489900272"
Sep 09 16:38:41.637299 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:41.637278    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7frrj\" (UniqueName: \"kubernetes.io/projected/7c19dbdf-4e9d-4450-8af3-0b21e3854c75-kube-api-access-7frrj\") pod \"test-curl-6954-140011489900272\" (UID: \"7c19dbdf-4e9d-4450-8af3-0b21e3854c75\") " pod="opendatahub/test-curl-6954-140011489900272"
Sep 09 16:38:41.724910 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:41.724861    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-6954-140011489900272"
Sep 09 16:38:41.992483 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:41.992459    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-6954-140011489900272"]
Sep 09 16:38:41.994422 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:38:41.994389    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7c19dbdf_4e9d_4450_8af3_0b21e3854c75.slice/crio-e15c795ca1b050738ca348cb612d71b1c3c7a12cf63f7dddc092ad4463fdd671 WatchSource:0}: Error finding container e15c795ca1b050738ca348cb612d71b1c3c7a12cf63f7dddc092ad4463fdd671: Status 404 returned error can't find the container with id e15c795ca1b050738ca348cb612d71b1c3c7a12cf63f7dddc092ad4463fdd671
Sep 09 16:38:42.101071 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:42.101046    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c54a0966a7b5e2891baeb0384fe100db13060fe91dae0bc0007d774377fbfddd"
Sep 09 16:38:42.101071 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:42.101050    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-6954-140011489899696"
Sep 09 16:38:42.102175 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:42.102152    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-6954-140011489900272" event={"ID":"7c19dbdf-4e9d-4450-8af3-0b21e3854c75","Type":"ContainerStarted","Data":"e15c795ca1b050738ca348cb612d71b1c3c7a12cf63f7dddc092ad4463fdd671"}
Sep 09 16:38:42.111150 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:38:42.111125    2583 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-6954-140011489899696\" is forbidden: User \"system:node:ip-10-0-131-48.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-131-48.ec2.internal' and this object" podUID="218b493b-84f1-4aa2-a142-d140bec7e6d2" pod="opendatahub/test-curl-6954-140011489899696"
Sep 09 16:38:42.237870 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:42.237849    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="218b493b-84f1-4aa2-a142-d140bec7e6d2" path="/var/lib/kubelet/pods/218b493b-84f1-4aa2-a142-d140bec7e6d2/volumes"
Sep 09 16:38:42.493608 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:42.493574    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:38:43.109574 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:43.109542    2583 generic.go:356] "Generic (PLEG): container finished" podID="7c19dbdf-4e9d-4450-8af3-0b21e3854c75" containerID="7f9e1f8a76c3a71ed2a5fc2e7df26e3b2bece79a79049fd06fa663502c766623" exitCode=0
Sep 09 16:38:43.109723 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:43.109625    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-6954-140011489900272" event={"ID":"7c19dbdf-4e9d-4450-8af3-0b21e3854c75","Type":"ContainerDied","Data":"7f9e1f8a76c3a71ed2a5fc2e7df26e3b2bece79a79049fd06fa663502c766623"}
Sep 09 16:38:44.251009 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:44.250973    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-6954-140011489900272"
Sep 09 16:38:44.267598 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:44.267574    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-6954-140011489900272_7c19dbdf-4e9d-4450-8af3-0b21e3854c75/test-curl-6954-140011489900272/0.log"
Sep 09 16:38:44.286404 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:44.286379    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-6954-140011489900272"]
Sep 09 16:38:44.289663 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:44.289644    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-6954-140011489900272"]
Sep 09 16:38:44.348378 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:44.348356    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7frrj\" (UniqueName: \"kubernetes.io/projected/7c19dbdf-4e9d-4450-8af3-0b21e3854c75-kube-api-access-7frrj\") pod \"7c19dbdf-4e9d-4450-8af3-0b21e3854c75\" (UID: \"7c19dbdf-4e9d-4450-8af3-0b21e3854c75\") "
Sep 09 16:38:44.350326 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:44.350305    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7c19dbdf-4e9d-4450-8af3-0b21e3854c75-kube-api-access-7frrj" (OuterVolumeSpecName: "kube-api-access-7frrj") pod "7c19dbdf-4e9d-4450-8af3-0b21e3854c75" (UID: "7c19dbdf-4e9d-4450-8af3-0b21e3854c75"). InnerVolumeSpecName "kube-api-access-7frrj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 16:38:44.449420 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:44.449361    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7frrj\" (UniqueName: \"kubernetes.io/projected/7c19dbdf-4e9d-4450-8af3-0b21e3854c75-kube-api-access-7frrj\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\""
Sep 09 16:38:45.121906 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:45.121879    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e15c795ca1b050738ca348cb612d71b1c3c7a12cf63f7dddc092ad4463fdd671"
Sep 09 16:38:45.121906 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:45.121889    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-6954-140011489900272"
Sep 09 16:38:45.137399 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:38:45.137370    2583 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-6954-140011489900272\" is forbidden: User \"system:node:ip-10-0-131-48.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-131-48.ec2.internal' and this object" podUID="7c19dbdf-4e9d-4450-8af3-0b21e3854c75" pod="opendatahub/test-curl-6954-140011489900272"
Sep 09 16:38:46.238319 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:46.238284    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7c19dbdf-4e9d-4450-8af3-0b21e3854c75" path="/var/lib/kubelet/pods/7c19dbdf-4e9d-4450-8af3-0b21e3854c75/volumes"
Sep 09 16:38:48.202123 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:48.202093    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:38:48.498759 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:48.498670    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-22795bd0-openshift-default-74fb886c6-2s4m6"]
Sep 09 16:38:48.499265 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:48.499240    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7c19dbdf-4e9d-4450-8af3-0b21e3854c75" containerName="test-curl-6954-140011489900272"
Sep 09 16:38:48.499265 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:48.499263    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c19dbdf-4e9d-4450-8af3-0b21e3854c75" containerName="test-curl-6954-140011489900272"
Sep 09 16:38:48.499433 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:48.499398    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="7c19dbdf-4e9d-4450-8af3-0b21e3854c75" containerName="test-curl-6954-140011489900272"
Sep 09 16:38:48.502916 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:48.502899    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-22795bd0-openshift-default-74fb886c6-2s4m6"
Sep 09 16:38:48.505635 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:48.505620    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-22795bd0-openshift-default-dockercfg-jcwwj\""
Sep 09 16:38:48.513643 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:48.513622    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-22795bd0-openshift-default-74fb886c6-2s4m6"]
Sep 09 16:38:48.520955 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:48.520937    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:38:48.586927 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:48.586898    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s9mqp\" (UniqueName: \"kubernetes.io/projected/94ca5874-b99a-4a2a-bcae-294df985ea07-kube-api-access-s9mqp\") pod \"e2e-mt-22795bd0-openshift-default-74fb886c6-2s4m6\" (UID: \"94ca5874-b99a-4a2a-bcae-294df985ea07\") " pod="openshift-ingress/e2e-mt-22795bd0-openshift-default-74fb886c6-2s4m6"
Sep 09 16:38:48.587199 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:48.587176    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/94ca5874-b99a-4a2a-bcae-294df985ea07-workload-socket\") pod \"e2e-mt-22795bd0-openshift-default-74fb886c6-2s4m6\" (UID: \"94ca5874-b99a-4a2a-bcae-294df985ea07\") " pod="openshift-ingress/e2e-mt-22795bd0-openshift-default-74fb886c6-2s4m6"
Sep 09 16:38:48.587382 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:48.587364    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/94ca5874-b99a-4a2a-bcae-294df985ea07-workload-certs\") pod \"e2e-mt-22795bd0-openshift-default-74fb886c6-2s4m6\" (UID: \"94ca5874-b99a-4a2a-bcae-294df985ea07\") " pod="openshift-ingress/e2e-mt-22795bd0-openshift-default-74fb886c6-2s4m6"
Sep 09 16:38:48.587530 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:48.587516    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/94ca5874-b99a-4a2a-bcae-294df985ea07-istio-data\") pod \"e2e-mt-22795bd0-openshift-default-74fb886c6-2s4m6\" (UID: \"94ca5874-b99a-4a2a-bcae-294df985ea07\") " pod="openshift-ingress/e2e-mt-22795bd0-openshift-default-74fb886c6-2s4m6"
Sep 09 16:38:48.587691 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:48.587676    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/94ca5874-b99a-4a2a-bcae-294df985ea07-credential-socket\") pod \"e2e-mt-22795bd0-openshift-default-74fb886c6-2s4m6\" (UID: \"94ca5874-b99a-4a2a-bcae-294df985ea07\") " pod="openshift-ingress/e2e-mt-22795bd0-openshift-default-74fb886c6-2s4m6"
Sep 09 16:38:48.587841 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:48.587827    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/94ca5874-b99a-4a2a-bcae-294df985ea07-istio-envoy\") pod \"e2e-mt-22795bd0-openshift-default-74fb886c6-2s4m6\" (UID: \"94ca5874-b99a-4a2a-bcae-294df985ea07\") " pod="openshift-ingress/e2e-mt-22795bd0-openshift-default-74fb886c6-2s4m6"
Sep 09 16:38:48.587975 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:48.587960    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/94ca5874-b99a-4a2a-bcae-294df985ea07-istio-token\") pod \"e2e-mt-22795bd0-openshift-default-74fb886c6-2s4m6\" (UID: \"94ca5874-b99a-4a2a-bcae-294df985ea07\") " pod="openshift-ingress/e2e-mt-22795bd0-openshift-default-74fb886c6-2s4m6"
Sep 09 16:38:48.588264 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:48.588238    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/94ca5874-b99a-4a2a-bcae-294df985ea07-istiod-ca-cert\") pod \"e2e-mt-22795bd0-openshift-default-74fb886c6-2s4m6\" (UID: \"94ca5874-b99a-4a2a-bcae-294df985ea07\") " pod="openshift-ingress/e2e-mt-22795bd0-openshift-default-74fb886c6-2s4m6"
Sep 09 16:38:48.588426 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:48.588409    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/94ca5874-b99a-4a2a-bcae-294df985ea07-istio-podinfo\") pod \"e2e-mt-22795bd0-openshift-default-74fb886c6-2s4m6\" (UID: \"94ca5874-b99a-4a2a-bcae-294df985ea07\") " pod="openshift-ingress/e2e-mt-22795bd0-openshift-default-74fb886c6-2s4m6"
Sep 09 16:38:48.689713 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:48.689681    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/94ca5874-b99a-4a2a-bcae-294df985ea07-credential-socket\") pod \"e2e-mt-22795bd0-openshift-default-74fb886c6-2s4m6\" (UID: \"94ca5874-b99a-4a2a-bcae-294df985ea07\") " pod="openshift-ingress/e2e-mt-22795bd0-openshift-default-74fb886c6-2s4m6"
Sep 09 16:38:48.689884 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:48.689724    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/94ca5874-b99a-4a2a-bcae-294df985ea07-istio-envoy\") pod \"e2e-mt-22795bd0-openshift-default-74fb886c6-2s4m6\" (UID: \"94ca5874-b99a-4a2a-bcae-294df985ea07\") " pod="openshift-ingress/e2e-mt-22795bd0-openshift-default-74fb886c6-2s4m6"
Sep 09 16:38:48.689884 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:48.689753    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/94ca5874-b99a-4a2a-bcae-294df985ea07-istio-token\") pod \"e2e-mt-22795bd0-openshift-default-74fb886c6-2s4m6\" (UID: \"94ca5874-b99a-4a2a-bcae-294df985ea07\") " pod="openshift-ingress/e2e-mt-22795bd0-openshift-default-74fb886c6-2s4m6"
Sep 09 16:38:48.689884 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:48.689771    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/94ca5874-b99a-4a2a-bcae-294df985ea07-istiod-ca-cert\") pod \"e2e-mt-22795bd0-openshift-default-74fb886c6-2s4m6\" (UID: \"94ca5874-b99a-4a2a-bcae-294df985ea07\") " pod="openshift-ingress/e2e-mt-22795bd0-openshift-default-74fb886c6-2s4m6"
Sep 09 16:38:48.689884 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:48.689789    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/94ca5874-b99a-4a2a-bcae-294df985ea07-istio-podinfo\") pod \"e2e-mt-22795bd0-openshift-default-74fb886c6-2s4m6\" (UID: \"94ca5874-b99a-4a2a-bcae-294df985ea07\") " pod="openshift-ingress/e2e-mt-22795bd0-openshift-default-74fb886c6-2s4m6"
Sep 09 16:38:48.689884 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:48.689838    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s9mqp\" (UniqueName: \"kubernetes.io/projected/94ca5874-b99a-4a2a-bcae-294df985ea07-kube-api-access-s9mqp\") pod \"e2e-mt-22795bd0-openshift-default-74fb886c6-2s4m6\" (UID: \"94ca5874-b99a-4a2a-bcae-294df985ea07\") " pod="openshift-ingress/e2e-mt-22795bd0-openshift-default-74fb886c6-2s4m6"
Sep 09 16:38:48.689884 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:48.689857    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/94ca5874-b99a-4a2a-bcae-294df985ea07-workload-socket\") pod \"e2e-mt-22795bd0-openshift-default-74fb886c6-2s4m6\" (UID: \"94ca5874-b99a-4a2a-bcae-294df985ea07\") " pod="openshift-ingress/e2e-mt-22795bd0-openshift-default-74fb886c6-2s4m6"
Sep 09 16:38:48.689884 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:48.689880    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/94ca5874-b99a-4a2a-bcae-294df985ea07-workload-certs\") pod \"e2e-mt-22795bd0-openshift-default-74fb886c6-2s4m6\" (UID: \"94ca5874-b99a-4a2a-bcae-294df985ea07\") " pod="openshift-ingress/e2e-mt-22795bd0-openshift-default-74fb886c6-2s4m6"
Sep 09 16:38:48.690262 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:48.689908    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/94ca5874-b99a-4a2a-bcae-294df985ea07-istio-data\") pod \"e2e-mt-22795bd0-openshift-default-74fb886c6-2s4m6\" (UID: \"94ca5874-b99a-4a2a-bcae-294df985ea07\") " pod="openshift-ingress/e2e-mt-22795bd0-openshift-default-74fb886c6-2s4m6"
Sep 09 16:38:48.690321 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:48.690261    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/94ca5874-b99a-4a2a-bcae-294df985ea07-credential-socket\") pod \"e2e-mt-22795bd0-openshift-default-74fb886c6-2s4m6\" (UID: \"94ca5874-b99a-4a2a-bcae-294df985ea07\") " pod="openshift-ingress/e2e-mt-22795bd0-openshift-default-74fb886c6-2s4m6"
Sep 09 16:38:48.690370 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:48.690312    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/94ca5874-b99a-4a2a-bcae-294df985ea07-workload-socket\") pod \"e2e-mt-22795bd0-openshift-default-74fb886c6-2s4m6\" (UID: \"94ca5874-b99a-4a2a-bcae-294df985ea07\") " pod="openshift-ingress/e2e-mt-22795bd0-openshift-default-74fb886c6-2s4m6"
Sep 09 16:38:48.690499 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:48.690481    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/94ca5874-b99a-4a2a-bcae-294df985ea07-istio-data\") pod \"e2e-mt-22795bd0-openshift-default-74fb886c6-2s4m6\" (UID: \"94ca5874-b99a-4a2a-bcae-294df985ea07\") " pod="openshift-ingress/e2e-mt-22795bd0-openshift-default-74fb886c6-2s4m6"
Sep 09 16:38:48.690538 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:48.690496    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/94ca5874-b99a-4a2a-bcae-294df985ea07-workload-certs\") pod \"e2e-mt-22795bd0-openshift-default-74fb886c6-2s4m6\" (UID: \"94ca5874-b99a-4a2a-bcae-294df985ea07\") " pod="openshift-ingress/e2e-mt-22795bd0-openshift-default-74fb886c6-2s4m6"
Sep 09 16:38:48.690714 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:48.690696    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/94ca5874-b99a-4a2a-bcae-294df985ea07-istiod-ca-cert\") pod \"e2e-mt-22795bd0-openshift-default-74fb886c6-2s4m6\" (UID: \"94ca5874-b99a-4a2a-bcae-294df985ea07\") " pod="openshift-ingress/e2e-mt-22795bd0-openshift-default-74fb886c6-2s4m6"
Sep 09 16:38:48.692493 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:48.692476    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/94ca5874-b99a-4a2a-bcae-294df985ea07-istio-envoy\") pod \"e2e-mt-22795bd0-openshift-default-74fb886c6-2s4m6\" (UID: \"94ca5874-b99a-4a2a-bcae-294df985ea07\") " pod="openshift-ingress/e2e-mt-22795bd0-openshift-default-74fb886c6-2s4m6"
Sep 09 16:38:48.692794 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:48.692776    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/94ca5874-b99a-4a2a-bcae-294df985ea07-istio-podinfo\") pod \"e2e-mt-22795bd0-openshift-default-74fb886c6-2s4m6\" (UID: \"94ca5874-b99a-4a2a-bcae-294df985ea07\") " pod="openshift-ingress/e2e-mt-22795bd0-openshift-default-74fb886c6-2s4m6"
Sep 09 16:38:48.697438 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:48.697414    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s9mqp\" (UniqueName: \"kubernetes.io/projected/94ca5874-b99a-4a2a-bcae-294df985ea07-kube-api-access-s9mqp\") pod \"e2e-mt-22795bd0-openshift-default-74fb886c6-2s4m6\" (UID: \"94ca5874-b99a-4a2a-bcae-294df985ea07\") " pod="openshift-ingress/e2e-mt-22795bd0-openshift-default-74fb886c6-2s4m6"
Sep 09 16:38:48.697834 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:48.697816    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/94ca5874-b99a-4a2a-bcae-294df985ea07-istio-token\") pod \"e2e-mt-22795bd0-openshift-default-74fb886c6-2s4m6\" (UID: \"94ca5874-b99a-4a2a-bcae-294df985ea07\") " pod="openshift-ingress/e2e-mt-22795bd0-openshift-default-74fb886c6-2s4m6"
Sep 09 16:38:48.814078 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:48.814024    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-22795bd0-openshift-default-74fb886c6-2s4m6"
Sep 09 16:38:49.088556 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:49.088527    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-22795bd0-openshift-default-74fb886c6-2s4m6"]
Sep 09 16:38:49.090024 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:38:49.089972    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94ca5874_b99a_4a2a_bcae_294df985ea07.slice/crio-6616de6debba6179d5e3ab89f3246c4a5833fed2aa351be0d3a071c89755100c WatchSource:0}: Error finding container 6616de6debba6179d5e3ab89f3246c4a5833fed2aa351be0d3a071c89755100c: Status 404 returned error can't find the container with id 6616de6debba6179d5e3ab89f3246c4a5833fed2aa351be0d3a071c89755100c
Sep 09 16:38:49.092204 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:49.092170    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 09 16:38:49.092288 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:49.092236    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 09 16:38:49.092288 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:49.092264    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 09 16:38:49.145325 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:49.145293    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-22795bd0-openshift-default-74fb886c6-2s4m6" event={"ID":"94ca5874-b99a-4a2a-bcae-294df985ea07","Type":"ContainerStarted","Data":"6616de6debba6179d5e3ab89f3246c4a5833fed2aa351be0d3a071c89755100c"}
Sep 09 16:38:49.323534 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:49.323506    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:38:50.153312 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:50.153276    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-22795bd0-openshift-default-74fb886c6-2s4m6" event={"ID":"94ca5874-b99a-4a2a-bcae-294df985ea07","Type":"ContainerStarted","Data":"5ac710810eee9c74a2648306c72b7703afad42e007e5bb8edcb92b763d99b366"}
Sep 09 16:38:50.171888 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:50.171832    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-22795bd0-openshift-default-74fb886c6-2s4m6" podStartSLOduration=2.171815622 podStartE2EDuration="2.171815622s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 16:38:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:38:50.170585464 +0000 UTC m=+1512.524315319" watchObservedRunningTime="2026-09-09 16:38:50.171815622 +0000 UTC m=+1512.525545453"
Sep 09 16:38:50.815126 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:50.815091    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-22795bd0-openshift-default-74fb886c6-2s4m6"
Sep 09 16:38:50.820971 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:50.820948    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-22795bd0-openshift-default-74fb886c6-2s4m6"
Sep 09 16:38:51.159635 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:51.159609    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-22795bd0-openshift-default-74fb886c6-2s4m6"
Sep 09 16:38:51.160482 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:51.160462    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-22795bd0-openshift-default-74fb886c6-2s4m6"
Sep 09 16:38:51.373702 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:51.373669    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:38:51.978107 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:51.978077    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:38:52.079068 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:52.079042    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:38:52.201944 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:52.201903    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:38:52.705901 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:52.705875    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:38:53.541160 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:53.541121    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:38:54.140778 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:54.140749    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:38:54.769632 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:54.769602    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:38:55.029102 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:55.029027    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:38:55.089729 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:55.089706    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:38:55.290202 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:55.290131    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:38:55.387999 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:55.387950    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:38:58.260278 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:58.260244    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:38:58.317792 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:58.317763    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:38:58.405793 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:38:58.405773    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:39:07.384522 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:39:07.384447    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:39:12.285897 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:39:12.285858    2583 generic.go:356] "Generic (PLEG): container finished" podID="94ca5874-b99a-4a2a-bcae-294df985ea07" containerID="5ac710810eee9c74a2648306c72b7703afad42e007e5bb8edcb92b763d99b366" exitCode=0
Sep 09 16:39:12.286316 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:39:12.285922    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-22795bd0-openshift-default-74fb886c6-2s4m6" event={"ID":"94ca5874-b99a-4a2a-bcae-294df985ea07","Type":"ContainerDied","Data":"5ac710810eee9c74a2648306c72b7703afad42e007e5bb8edcb92b763d99b366"}
Sep 09 16:39:12.286383 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:39:12.286361    2583 scope.go:117] "RemoveContainer" containerID="5ac710810eee9c74a2648306c72b7703afad42e007e5bb8edcb92b763d99b366"
Sep 09 16:39:12.287572 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:39:12.287541    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 09 16:39:12.287638 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:39:12.287623    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 09 16:39:12.287674 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:39:12.287663    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 09 16:39:13.296704 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:39:13.296656    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-22795bd0-openshift-default-74fb886c6-2s4m6" event={"ID":"94ca5874-b99a-4a2a-bcae-294df985ea07","Type":"ContainerStarted","Data":"934695f1e007fa0ce581d5343ba2569995af3842f439ad16a682aaa9977b4a97"}
Sep 09 16:39:13.814672 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:39:13.814635    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-22795bd0-openshift-default-74fb886c6-2s4m6"
Sep 09 16:39:13.814903 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:39:13.814876    2583 patch_prober.go:28] interesting pod/e2e-mt-22795bd0-openshift-default-74fb886c6-2s4m6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body=
Sep 09 16:39:13.814955 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:39:13.814932    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-22795bd0-openshift-default-74fb886c6-2s4m6" podUID="94ca5874-b99a-4a2a-bcae-294df985ea07" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused"
Sep 09 16:39:14.815118 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:39:14.815081    2583 patch_prober.go:28] interesting pod/e2e-mt-22795bd0-openshift-default-74fb886c6-2s4m6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body=
Sep 09 16:39:14.815481 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:39:14.815137    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-22795bd0-openshift-default-74fb886c6-2s4m6" podUID="94ca5874-b99a-4a2a-bcae-294df985ea07" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused"
Sep 09 16:39:15.815062 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:39:15.814610    2583 patch_prober.go:28] interesting pod/e2e-mt-22795bd0-openshift-default-74fb886c6-2s4m6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body=
Sep 09 16:39:15.815062 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:39:15.814669    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-22795bd0-openshift-default-74fb886c6-2s4m6" podUID="94ca5874-b99a-4a2a-bcae-294df985ea07" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused"
Sep 09 16:39:16.580408 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:39:16.580333    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:39:16.815031 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:39:16.814966    2583 patch_prober.go:28] interesting pod/e2e-mt-22795bd0-openshift-default-74fb886c6-2s4m6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body=
Sep 09 16:39:16.815201 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:39:16.815057    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-22795bd0-openshift-default-74fb886c6-2s4m6" podUID="94ca5874-b99a-4a2a-bcae-294df985ea07" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused"
Sep 09 16:39:17.815277 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:39:17.815240    2583 patch_prober.go:28] interesting pod/e2e-mt-22795bd0-openshift-default-74fb886c6-2s4m6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body=
Sep 09 16:39:17.815646 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:39:17.815299    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-22795bd0-openshift-default-74fb886c6-2s4m6" podUID="94ca5874-b99a-4a2a-bcae-294df985ea07" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused"
Sep 09 16:39:18.819120 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:39:18.819090    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-22795bd0-openshift-default-74fb886c6-2s4m6"
Sep 09 16:39:18.819487 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:39:18.819467    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-22795bd0-openshift-default-74fb886c6-2s4m6"
Sep 09 16:39:18.820238 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:39:18.820221    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-22795bd0-openshift-default-74fb886c6-2s4m6"
Sep 09 16:39:21.334100 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:39:21.334052    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:39:34.951297 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:39:34.951254    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:39:37.489078 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:39:37.489046    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:39:38.002615 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:39:38.002581    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:39:38.259931 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:39:38.259863    2583 scope.go:117] "RemoveContainer" containerID="4b3a2fa28e24aca3b82ef8ed75c0b173f624d6e02366ac9dc31b57bcf27a0ce4"
Sep 09 16:39:59.746490 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:39:59.746454    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:40:06.828596 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:40:06.828554    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-22795bd0-zn7bd"]
Sep 09 16:40:06.832344 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:40:06.832325    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-22795bd0-zn7bd"
Sep 09 16:40:06.835323 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:40:06.835293    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jz5ff\""
Sep 09 16:40:06.838191 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:40:06.838165    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-22795bd0-zn7bd"]
Sep 09 16:40:06.971401 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:40:06.971370    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c0ace95e-e780-4cc0-95a6-ceb89eb0d5a5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-22795bd0-zn7bd\" (UID: \"c0ace95e-e780-4cc0-95a6-ceb89eb0d5a5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-22795bd0-zn7bd"
Sep 09 16:40:07.072262 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:40:07.072234    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c0ace95e-e780-4cc0-95a6-ceb89eb0d5a5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-22795bd0-zn7bd\" (UID: \"c0ace95e-e780-4cc0-95a6-ceb89eb0d5a5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-22795bd0-zn7bd"
Sep 09 16:40:07.072823 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:40:07.072802    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c0ace95e-e780-4cc0-95a6-ceb89eb0d5a5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-22795bd0-zn7bd\" (UID: \"c0ace95e-e780-4cc0-95a6-ceb89eb0d5a5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-22795bd0-zn7bd"
Sep 09 16:40:07.145075 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:40:07.145010    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-22795bd0-zn7bd"
Sep 09 16:40:07.417564 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:40:07.417534    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-22795bd0-zn7bd"]
Sep 09 16:40:07.417838 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:40:07.417810    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0ace95e_e780_4cc0_95a6_ceb89eb0d5a5.slice/crio-ef824ca1b67235d5b484cd866a3280772fbd74ab8376ec71886734663bfa5694 WatchSource:0}: Error finding container ef824ca1b67235d5b484cd866a3280772fbd74ab8376ec71886734663bfa5694: Status 404 returned error can't find the container with id ef824ca1b67235d5b484cd866a3280772fbd74ab8376ec71886734663bfa5694
Sep 09 16:40:07.556965 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:40:07.556931    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:40:07.596644 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:40:07.596618    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-22795bd0-zn7bd" event={"ID":"c0ace95e-e780-4cc0-95a6-ceb89eb0d5a5","Type":"ContainerStarted","Data":"ef824ca1b67235d5b484cd866a3280772fbd74ab8376ec71886734663bfa5694"}
Sep 09 16:40:08.122031 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:40:08.121969    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:40:08.134901 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:40:08.134854    2583 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0ace95e_e780_4cc0_95a6_ceb89eb0d5a5.slice/crio-conmon-a6f34fb85da0d38a72a8b96d892a775002efe05ef1d33979bbabd1a865ff7c25.scope\": RecentStats: unable to find data in memory cache]"
Sep 09 16:40:08.611092 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:40:08.611062    2583 generic.go:356] "Generic (PLEG): container finished" podID="c0ace95e-e780-4cc0-95a6-ceb89eb0d5a5" containerID="a6f34fb85da0d38a72a8b96d892a775002efe05ef1d33979bbabd1a865ff7c25" exitCode=0
Sep 09 16:40:08.611246 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:40:08.611148    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-22795bd0-zn7bd" event={"ID":"c0ace95e-e780-4cc0-95a6-ceb89eb0d5a5","Type":"ContainerDied","Data":"a6f34fb85da0d38a72a8b96d892a775002efe05ef1d33979bbabd1a865ff7c25"}
Sep 09 16:40:08.731679 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:40:08.731652    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:40:09.568494 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:40:09.568458    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:40:09.764730 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:40:09.764707    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-22795bd0-zn7bd"
Sep 09 16:40:09.898400 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:40:09.898375    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c0ace95e-e780-4cc0-95a6-ceb89eb0d5a5-maas-api-service-ca\") pod \"c0ace95e-e780-4cc0-95a6-ceb89eb0d5a5\" (UID: \"c0ace95e-e780-4cc0-95a6-ceb89eb0d5a5\") "
Sep 09 16:40:09.898631 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:40:09.898610    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c0ace95e-e780-4cc0-95a6-ceb89eb0d5a5-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "c0ace95e-e780-4cc0-95a6-ceb89eb0d5a5" (UID: "c0ace95e-e780-4cc0-95a6-ceb89eb0d5a5"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 16:40:09.999862 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:40:09.999843    2583 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c0ace95e-e780-4cc0-95a6-ceb89eb0d5a5-maas-api-service-ca\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\""
Sep 09 16:40:10.176240 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:40:10.176177    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:40:10.622930 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:40:10.622905    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-22795bd0-zn7bd"
Sep 09 16:40:10.623261 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:40:10.622943    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-22795bd0-zn7bd" event={"ID":"c0ace95e-e780-4cc0-95a6-ceb89eb0d5a5","Type":"ContainerDied","Data":"ef824ca1b67235d5b484cd866a3280772fbd74ab8376ec71886734663bfa5694"}
Sep 09 16:40:10.623261 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:40:10.622999    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ef824ca1b67235d5b484cd866a3280772fbd74ab8376ec71886734663bfa5694"
Sep 09 16:40:10.782359 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:40:10.782332    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:40:22.362119 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:40:22.362085    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:40:22.446798 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:40:22.446769    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:40:22.540236 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:40:22.540202    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-22795bd0-zn7bd"]
Sep 09 16:40:22.541978 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:40:22.541942    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:40:22.542285 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:40:22.542268    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-22795bd0-zn7bd"]
Sep 09 16:40:22.593773 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:40:22.593753    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:40:22.954952 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:40:22.954926    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:40:24.238202 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:40:24.238173    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c0ace95e-e780-4cc0-95a6-ceb89eb0d5a5" path="/var/lib/kubelet/pods/c0ace95e-e780-4cc0-95a6-ceb89eb0d5a5/volumes"
Sep 09 16:40:24.263781 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:40:24.263756    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:40:24.412560 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:40:24.412529    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:40:24.805871 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:40:24.805835    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:40:25.499426 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:40:25.499398    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:40:25.881086 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:40:25.881056    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:40:31.120484 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:40:31.120443    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:40:38.279697 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:40:38.279671    2583 scope.go:117] "RemoveContainer" containerID="006e83faf4bf7f7e1b12e2efe7da165dfc71a15b36c20e93c9d35421eb954c0c"
Sep 09 16:41:04.913677 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:41:04.913645    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:41:05.798364 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:41:05.798328    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:41:07.067149 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:41:07.067114    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:41:08.049253 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:41:08.049220    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:41:13.212022 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:41:13.211978    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:41:13.487110 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:41:13.487044    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:41:18.967676 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:41:18.967637    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:41:19.017049 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:41:19.017024    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:41:19.208733 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:41:19.208701    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-22795bd0-openshift-default-74fb886c6-2s4m6"]
Sep 09 16:41:19.209000 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:41:19.208955    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-22795bd0-openshift-default-74fb886c6-2s4m6" podUID="94ca5874-b99a-4a2a-bcae-294df985ea07" containerName="istio-proxy" containerID="cri-o://934695f1e007fa0ce581d5343ba2569995af3842f439ad16a682aaa9977b4a97" gracePeriod=30
Sep 09 16:41:19.221835 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:41:19.221779    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:41:20.497395 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:41:20.497358    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:41:20.596591 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:41:20.596566    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:41:20.697426 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:41:20.697396    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:41:21.354970 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:41:21.354938    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:41:21.454907 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:41:21.454878    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:41:21.555516 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:41:21.555490    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:41:22.794245 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:41:22.794213    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:41:24.465043 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:41:24.465019    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-22795bd0-openshift-default-74fb886c6-2s4m6"
Sep 09 16:41:24.637802 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:41:24.637776    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/94ca5874-b99a-4a2a-bcae-294df985ea07-istio-data\") pod \"94ca5874-b99a-4a2a-bcae-294df985ea07\" (UID: \"94ca5874-b99a-4a2a-bcae-294df985ea07\") "
Sep 09 16:41:24.637933 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:41:24.637835    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/94ca5874-b99a-4a2a-bcae-294df985ea07-istio-podinfo\") pod \"94ca5874-b99a-4a2a-bcae-294df985ea07\" (UID: \"94ca5874-b99a-4a2a-bcae-294df985ea07\") "
Sep 09 16:41:24.637933 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:41:24.637857    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s9mqp\" (UniqueName: \"kubernetes.io/projected/94ca5874-b99a-4a2a-bcae-294df985ea07-kube-api-access-s9mqp\") pod \"94ca5874-b99a-4a2a-bcae-294df985ea07\" (UID: \"94ca5874-b99a-4a2a-bcae-294df985ea07\") "
Sep 09 16:41:24.637933 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:41:24.637892    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/94ca5874-b99a-4a2a-bcae-294df985ea07-workload-socket\") pod \"94ca5874-b99a-4a2a-bcae-294df985ea07\" (UID: \"94ca5874-b99a-4a2a-bcae-294df985ea07\") "
Sep 09 16:41:24.637933 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:41:24.637914    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/94ca5874-b99a-4a2a-bcae-294df985ea07-workload-certs\") pod \"94ca5874-b99a-4a2a-bcae-294df985ea07\" (UID: \"94ca5874-b99a-4a2a-bcae-294df985ea07\") "
Sep 09 16:41:24.637933 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:41:24.637931    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/94ca5874-b99a-4a2a-bcae-294df985ea07-istiod-ca-cert\") pod \"94ca5874-b99a-4a2a-bcae-294df985ea07\" (UID: \"94ca5874-b99a-4a2a-bcae-294df985ea07\") "
Sep 09 16:41:24.638204 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:41:24.637975    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/94ca5874-b99a-4a2a-bcae-294df985ea07-istio-token\") pod \"94ca5874-b99a-4a2a-bcae-294df985ea07\" (UID: \"94ca5874-b99a-4a2a-bcae-294df985ea07\") "
Sep 09 16:41:24.638204 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:41:24.638052    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/94ca5874-b99a-4a2a-bcae-294df985ea07-credential-socket\") pod \"94ca5874-b99a-4a2a-bcae-294df985ea07\" (UID: \"94ca5874-b99a-4a2a-bcae-294df985ea07\") "
Sep 09 16:41:24.638204 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:41:24.638062    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/94ca5874-b99a-4a2a-bcae-294df985ea07-istio-data" (OuterVolumeSpecName: "istio-data") pod "94ca5874-b99a-4a2a-bcae-294df985ea07" (UID: "94ca5874-b99a-4a2a-bcae-294df985ea07"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 16:41:24.638204 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:41:24.638093    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/94ca5874-b99a-4a2a-bcae-294df985ea07-istio-envoy\") pod \"94ca5874-b99a-4a2a-bcae-294df985ea07\" (UID: \"94ca5874-b99a-4a2a-bcae-294df985ea07\") "
Sep 09 16:41:24.638397 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:41:24.638299    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/94ca5874-b99a-4a2a-bcae-294df985ea07-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "94ca5874-b99a-4a2a-bcae-294df985ea07" (UID: "94ca5874-b99a-4a2a-bcae-294df985ea07"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 16:41:24.638397 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:41:24.638306    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/94ca5874-b99a-4a2a-bcae-294df985ea07-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "94ca5874-b99a-4a2a-bcae-294df985ea07" (UID: "94ca5874-b99a-4a2a-bcae-294df985ea07"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 16:41:24.638495 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:41:24.638414    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/94ca5874-b99a-4a2a-bcae-294df985ea07-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "94ca5874-b99a-4a2a-bcae-294df985ea07" (UID: "94ca5874-b99a-4a2a-bcae-294df985ea07"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 16:41:24.638495 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:41:24.638483    2583 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/94ca5874-b99a-4a2a-bcae-294df985ea07-istio-data\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\""
Sep 09 16:41:24.638578 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:41:24.638502    2583 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/94ca5874-b99a-4a2a-bcae-294df985ea07-workload-socket\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\""
Sep 09 16:41:24.638578 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:41:24.638517    2583 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/94ca5874-b99a-4a2a-bcae-294df985ea07-workload-certs\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\""
Sep 09 16:41:24.638875 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:41:24.638652    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/94ca5874-b99a-4a2a-bcae-294df985ea07-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "94ca5874-b99a-4a2a-bcae-294df985ea07" (UID: "94ca5874-b99a-4a2a-bcae-294df985ea07"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 16:41:24.640172 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:41:24.640144    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/94ca5874-b99a-4a2a-bcae-294df985ea07-kube-api-access-s9mqp" (OuterVolumeSpecName: "kube-api-access-s9mqp") pod "94ca5874-b99a-4a2a-bcae-294df985ea07" (UID: "94ca5874-b99a-4a2a-bcae-294df985ea07"). InnerVolumeSpecName "kube-api-access-s9mqp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 16:41:24.640273 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:41:24.640230    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/94ca5874-b99a-4a2a-bcae-294df985ea07-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "94ca5874-b99a-4a2a-bcae-294df985ea07" (UID: "94ca5874-b99a-4a2a-bcae-294df985ea07"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 09 16:41:24.640519 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:41:24.640494    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/94ca5874-b99a-4a2a-bcae-294df985ea07-istio-token" (OuterVolumeSpecName: "istio-token") pod "94ca5874-b99a-4a2a-bcae-294df985ea07" (UID: "94ca5874-b99a-4a2a-bcae-294df985ea07"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 16:41:24.640519 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:41:24.640494    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/94ca5874-b99a-4a2a-bcae-294df985ea07-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "94ca5874-b99a-4a2a-bcae-294df985ea07" (UID: "94ca5874-b99a-4a2a-bcae-294df985ea07"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 16:41:24.739530 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:41:24.739501    2583 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/94ca5874-b99a-4a2a-bcae-294df985ea07-istio-envoy\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\""
Sep 09 16:41:24.739530 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:41:24.739520    2583 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/94ca5874-b99a-4a2a-bcae-294df985ea07-istio-podinfo\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\""
Sep 09 16:41:24.739530 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:41:24.739529    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s9mqp\" (UniqueName: \"kubernetes.io/projected/94ca5874-b99a-4a2a-bcae-294df985ea07-kube-api-access-s9mqp\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\""
Sep 09 16:41:24.739678 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:41:24.739538    2583 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/94ca5874-b99a-4a2a-bcae-294df985ea07-istiod-ca-cert\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\""
Sep 09 16:41:24.739678 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:41:24.739546    2583 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/94ca5874-b99a-4a2a-bcae-294df985ea07-istio-token\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\""
Sep 09 16:41:24.739678 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:41:24.739554    2583 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/94ca5874-b99a-4a2a-bcae-294df985ea07-credential-socket\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\""
Sep 09 16:41:25.040809 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:41:25.040749    2583 generic.go:356] "Generic (PLEG): container finished" podID="94ca5874-b99a-4a2a-bcae-294df985ea07" containerID="934695f1e007fa0ce581d5343ba2569995af3842f439ad16a682aaa9977b4a97" exitCode=0
Sep 09 16:41:25.040809 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:41:25.040802    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-22795bd0-openshift-default-74fb886c6-2s4m6"
Sep 09 16:41:25.040929 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:41:25.040829    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-22795bd0-openshift-default-74fb886c6-2s4m6" event={"ID":"94ca5874-b99a-4a2a-bcae-294df985ea07","Type":"ContainerDied","Data":"934695f1e007fa0ce581d5343ba2569995af3842f439ad16a682aaa9977b4a97"}
Sep 09 16:41:25.040929 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:41:25.040877    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-22795bd0-openshift-default-74fb886c6-2s4m6" event={"ID":"94ca5874-b99a-4a2a-bcae-294df985ea07","Type":"ContainerDied","Data":"6616de6debba6179d5e3ab89f3246c4a5833fed2aa351be0d3a071c89755100c"}
Sep 09 16:41:25.040929 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:41:25.040898    2583 scope.go:117] "RemoveContainer" containerID="934695f1e007fa0ce581d5343ba2569995af3842f439ad16a682aaa9977b4a97"
Sep 09 16:41:25.050217 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:41:25.050204    2583 scope.go:117] "RemoveContainer" containerID="5ac710810eee9c74a2648306c72b7703afad42e007e5bb8edcb92b763d99b366"
Sep 09 16:41:25.058253 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:41:25.058233    2583 scope.go:117] "RemoveContainer" containerID="934695f1e007fa0ce581d5343ba2569995af3842f439ad16a682aaa9977b4a97"
Sep 09 16:41:25.058555 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:41:25.058533    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"934695f1e007fa0ce581d5343ba2569995af3842f439ad16a682aaa9977b4a97\": container with ID starting with 934695f1e007fa0ce581d5343ba2569995af3842f439ad16a682aaa9977b4a97 not found: ID does not exist" containerID="934695f1e007fa0ce581d5343ba2569995af3842f439ad16a682aaa9977b4a97"
Sep 09 16:41:25.058644 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:41:25.058559    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"934695f1e007fa0ce581d5343ba2569995af3842f439ad16a682aaa9977b4a97"} err="failed to get container status \"934695f1e007fa0ce581d5343ba2569995af3842f439ad16a682aaa9977b4a97\": rpc error: code = NotFound desc = could not find container \"934695f1e007fa0ce581d5343ba2569995af3842f439ad16a682aaa9977b4a97\": container with ID starting with 934695f1e007fa0ce581d5343ba2569995af3842f439ad16a682aaa9977b4a97 not found: ID does not exist"
Sep 09 16:41:25.058644 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:41:25.058575    2583 scope.go:117] "RemoveContainer" containerID="5ac710810eee9c74a2648306c72b7703afad42e007e5bb8edcb92b763d99b366"
Sep 09 16:41:25.058836 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:41:25.058816    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5ac710810eee9c74a2648306c72b7703afad42e007e5bb8edcb92b763d99b366\": container with ID starting with 5ac710810eee9c74a2648306c72b7703afad42e007e5bb8edcb92b763d99b366 not found: ID does not exist" containerID="5ac710810eee9c74a2648306c72b7703afad42e007e5bb8edcb92b763d99b366"
Sep 09 16:41:25.058895 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:41:25.058848    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5ac710810eee9c74a2648306c72b7703afad42e007e5bb8edcb92b763d99b366"} err="failed to get container status \"5ac710810eee9c74a2648306c72b7703afad42e007e5bb8edcb92b763d99b366\": rpc error: code = NotFound desc = could not find container \"5ac710810eee9c74a2648306c72b7703afad42e007e5bb8edcb92b763d99b366\": container with ID starting with 5ac710810eee9c74a2648306c72b7703afad42e007e5bb8edcb92b763d99b366 not found: ID does not exist"
Sep 09 16:41:25.062169 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:41:25.062147    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-22795bd0-openshift-default-74fb886c6-2s4m6"]
Sep 09 16:41:25.066209 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:41:25.066182    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-22795bd0-openshift-default-74fb886c6-2s4m6"]
Sep 09 16:41:26.238533 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:41:26.238502    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="94ca5874-b99a-4a2a-bcae-294df985ea07" path="/var/lib/kubelet/pods/94ca5874-b99a-4a2a-bcae-294df985ea07/volumes"
Sep 09 16:41:28.454076 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:41:28.454033    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:41:28.555406 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:41:28.555382    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:41:29.153519 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:41:29.153491    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:41:34.860795 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:41:34.860754    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:41:34.965180 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:41:34.965154    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:41:37.083605 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:41:37.083567    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:41:38.299655 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:41:38.299626    2583 scope.go:117] "RemoveContainer" containerID="5e157d7b5b1fc26f8b5655e0ece3f65f31e5aafe763a180b046b9c499653c559"
Sep 09 16:41:38.307723 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:41:38.307700    2583 scope.go:117] "RemoveContainer" containerID="13ffb66b63c36b220e0b446cddd4bd3a8b3c273fc047af860507382ca6c92287"
Sep 09 16:41:45.580332 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:41:45.580292    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:41:45.825008 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:41:45.824960    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:41:46.529370 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:41:46.529339    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:42:06.774475 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:42:06.774393    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:42:12.329039 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:42:12.329005    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:42:12.391549 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:42:12.391526    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:42:12.671613 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:42:12.671528    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:42:12.956870 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:42:12.956793    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-14e637-openshift-default-59c6558bfb-6trn7"]
Sep 09 16:42:12.957840 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:42:12.957813    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c0ace95e-e780-4cc0-95a6-ceb89eb0d5a5" containerName="revoke-keys"
Sep 09 16:42:12.957840 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:42:12.957839    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="c0ace95e-e780-4cc0-95a6-ceb89eb0d5a5" containerName="revoke-keys"
Sep 09 16:42:12.958044 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:42:12.957900    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="94ca5874-b99a-4a2a-bcae-294df985ea07" containerName="istio-proxy"
Sep 09 16:42:12.958044 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:42:12.957910    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="94ca5874-b99a-4a2a-bcae-294df985ea07" containerName="istio-proxy"
Sep 09 16:42:12.958044 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:42:12.957930    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="94ca5874-b99a-4a2a-bcae-294df985ea07" containerName="istio-proxy"
Sep 09 16:42:12.958044 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:42:12.957939    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="94ca5874-b99a-4a2a-bcae-294df985ea07" containerName="istio-proxy"
Sep 09 16:42:12.958232 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:42:12.958141    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="94ca5874-b99a-4a2a-bcae-294df985ea07" containerName="istio-proxy"
Sep 09 16:42:12.958232 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:42:12.958158    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="94ca5874-b99a-4a2a-bcae-294df985ea07" containerName="istio-proxy"
Sep 09 16:42:12.958232 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:42:12.958167    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="c0ace95e-e780-4cc0-95a6-ceb89eb0d5a5" containerName="revoke-keys"
Sep 09 16:42:12.965723 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:42:12.965702    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-14e637-openshift-default-59c6558bfb-6trn7"
Sep 09 16:42:12.968278 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:42:12.968252    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-14e637-openshift-default-dockercfg-688m7\""
Sep 09 16:42:12.969655 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:42:12.969631    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-14e637-openshift-default-59c6558bfb-6trn7"]
Sep 09 16:42:12.983184 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:42:12.983161    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:42:13.127131 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:42:13.127091    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/21b7f659-cd20-40ef-826c-642e630c3ad7-workload-socket\") pod \"e2e-api-a-14e637-openshift-default-59c6558bfb-6trn7\" (UID: \"21b7f659-cd20-40ef-826c-642e630c3ad7\") " pod="openshift-ingress/e2e-api-a-14e637-openshift-default-59c6558bfb-6trn7"
Sep 09 16:42:13.127309 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:42:13.127174    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/21b7f659-cd20-40ef-826c-642e630c3ad7-workload-certs\") pod \"e2e-api-a-14e637-openshift-default-59c6558bfb-6trn7\" (UID: \"21b7f659-cd20-40ef-826c-642e630c3ad7\") " pod="openshift-ingress/e2e-api-a-14e637-openshift-default-59c6558bfb-6trn7"
Sep 09 16:42:13.127309 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:42:13.127231    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gnsc2\" (UniqueName: \"kubernetes.io/projected/21b7f659-cd20-40ef-826c-642e630c3ad7-kube-api-access-gnsc2\") pod \"e2e-api-a-14e637-openshift-default-59c6558bfb-6trn7\" (UID: \"21b7f659-cd20-40ef-826c-642e630c3ad7\") " pod="openshift-ingress/e2e-api-a-14e637-openshift-default-59c6558bfb-6trn7"
Sep 09 16:42:13.127309 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:42:13.127268    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/21b7f659-cd20-40ef-826c-642e630c3ad7-istio-token\") pod \"e2e-api-a-14e637-openshift-default-59c6558bfb-6trn7\" (UID: \"21b7f659-cd20-40ef-826c-642e630c3ad7\") " pod="openshift-ingress/e2e-api-a-14e637-openshift-default-59c6558bfb-6trn7"
Sep 09 16:42:13.127309 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:42:13.127291    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/21b7f659-cd20-40ef-826c-642e630c3ad7-credential-socket\") pod \"e2e-api-a-14e637-openshift-default-59c6558bfb-6trn7\" (UID: \"21b7f659-cd20-40ef-826c-642e630c3ad7\") " pod="openshift-ingress/e2e-api-a-14e637-openshift-default-59c6558bfb-6trn7"
Sep 09 16:42:13.127520 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:42:13.127354    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/21b7f659-cd20-40ef-826c-642e630c3ad7-istio-podinfo\") pod \"e2e-api-a-14e637-openshift-default-59c6558bfb-6trn7\" (UID: \"21b7f659-cd20-40ef-826c-642e630c3ad7\") " pod="openshift-ingress/e2e-api-a-14e637-openshift-default-59c6558bfb-6trn7"
Sep 09 16:42:13.127520 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:42:13.127419    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/21b7f659-cd20-40ef-826c-642e630c3ad7-istio-data\") pod \"e2e-api-a-14e637-openshift-default-59c6558bfb-6trn7\" (UID: \"21b7f659-cd20-40ef-826c-642e630c3ad7\") " pod="openshift-ingress/e2e-api-a-14e637-openshift-default-59c6558bfb-6trn7"
Sep 09 16:42:13.127520 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:42:13.127456    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/21b7f659-cd20-40ef-826c-642e630c3ad7-istiod-ca-cert\") pod \"e2e-api-a-14e637-openshift-default-59c6558bfb-6trn7\" (UID: \"21b7f659-cd20-40ef-826c-642e630c3ad7\") " pod="openshift-ingress/e2e-api-a-14e637-openshift-default-59c6558bfb-6trn7"
Sep 09 16:42:13.127520 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:42:13.127488    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/21b7f659-cd20-40ef-826c-642e630c3ad7-istio-envoy\") pod \"e2e-api-a-14e637-openshift-default-59c6558bfb-6trn7\" (UID: \"21b7f659-cd20-40ef-826c-642e630c3ad7\") " pod="openshift-ingress/e2e-api-a-14e637-openshift-default-59c6558bfb-6trn7"
Sep 09 16:42:13.228901 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:42:13.228834    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/21b7f659-cd20-40ef-826c-642e630c3ad7-istio-data\") pod \"e2e-api-a-14e637-openshift-default-59c6558bfb-6trn7\" (UID: \"21b7f659-cd20-40ef-826c-642e630c3ad7\") " pod="openshift-ingress/e2e-api-a-14e637-openshift-default-59c6558bfb-6trn7"
Sep 09 16:42:13.228901 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:42:13.228868    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/21b7f659-cd20-40ef-826c-642e630c3ad7-istiod-ca-cert\") pod \"e2e-api-a-14e637-openshift-default-59c6558bfb-6trn7\" (UID: \"21b7f659-cd20-40ef-826c-642e630c3ad7\") " pod="openshift-ingress/e2e-api-a-14e637-openshift-default-59c6558bfb-6trn7"
Sep 09 16:42:13.229101 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:42:13.228903    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/21b7f659-cd20-40ef-826c-642e630c3ad7-istio-envoy\") pod \"e2e-api-a-14e637-openshift-default-59c6558bfb-6trn7\" (UID: \"21b7f659-cd20-40ef-826c-642e630c3ad7\") " pod="openshift-ingress/e2e-api-a-14e637-openshift-default-59c6558bfb-6trn7"
Sep 09 16:42:13.229101 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:42:13.228928    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/21b7f659-cd20-40ef-826c-642e630c3ad7-workload-socket\") pod \"e2e-api-a-14e637-openshift-default-59c6558bfb-6trn7\" (UID: \"21b7f659-cd20-40ef-826c-642e630c3ad7\") " pod="openshift-ingress/e2e-api-a-14e637-openshift-default-59c6558bfb-6trn7"
Sep 09 16:42:13.229101 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:42:13.228979    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/21b7f659-cd20-40ef-826c-642e630c3ad7-workload-certs\") pod \"e2e-api-a-14e637-openshift-default-59c6558bfb-6trn7\" (UID: \"21b7f659-cd20-40ef-826c-642e630c3ad7\") " pod="openshift-ingress/e2e-api-a-14e637-openshift-default-59c6558bfb-6trn7"
Sep 09 16:42:13.229101 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:42:13.229063    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gnsc2\" (UniqueName: \"kubernetes.io/projected/21b7f659-cd20-40ef-826c-642e630c3ad7-kube-api-access-gnsc2\") pod \"e2e-api-a-14e637-openshift-default-59c6558bfb-6trn7\" (UID: \"21b7f659-cd20-40ef-826c-642e630c3ad7\") " pod="openshift-ingress/e2e-api-a-14e637-openshift-default-59c6558bfb-6trn7"
Sep 09 16:42:13.229302 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:42:13.229103    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/21b7f659-cd20-40ef-826c-642e630c3ad7-istio-token\") pod \"e2e-api-a-14e637-openshift-default-59c6558bfb-6trn7\" (UID: \"21b7f659-cd20-40ef-826c-642e630c3ad7\") " pod="openshift-ingress/e2e-api-a-14e637-openshift-default-59c6558bfb-6trn7"
Sep 09 16:42:13.229302 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:42:13.229132    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/21b7f659-cd20-40ef-826c-642e630c3ad7-credential-socket\") pod \"e2e-api-a-14e637-openshift-default-59c6558bfb-6trn7\" (UID: \"21b7f659-cd20-40ef-826c-642e630c3ad7\") " pod="openshift-ingress/e2e-api-a-14e637-openshift-default-59c6558bfb-6trn7"
Sep 09 16:42:13.229302 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:42:13.229162    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/21b7f659-cd20-40ef-826c-642e630c3ad7-istio-podinfo\") pod \"e2e-api-a-14e637-openshift-default-59c6558bfb-6trn7\" (UID: \"21b7f659-cd20-40ef-826c-642e630c3ad7\") " pod="openshift-ingress/e2e-api-a-14e637-openshift-default-59c6558bfb-6trn7"
Sep 09 16:42:13.229526 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:42:13.229479    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/21b7f659-cd20-40ef-826c-642e630c3ad7-workload-certs\") pod \"e2e-api-a-14e637-openshift-default-59c6558bfb-6trn7\" (UID: \"21b7f659-cd20-40ef-826c-642e630c3ad7\") " pod="openshift-ingress/e2e-api-a-14e637-openshift-default-59c6558bfb-6trn7"
Sep 09 16:42:13.229702 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:42:13.229645    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/21b7f659-cd20-40ef-826c-642e630c3ad7-istiod-ca-cert\") pod \"e2e-api-a-14e637-openshift-default-59c6558bfb-6trn7\" (UID: \"21b7f659-cd20-40ef-826c-642e630c3ad7\") " pod="openshift-ingress/e2e-api-a-14e637-openshift-default-59c6558bfb-6trn7"
Sep 09 16:42:13.229702 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:42:13.229645    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/21b7f659-cd20-40ef-826c-642e630c3ad7-workload-socket\") pod \"e2e-api-a-14e637-openshift-default-59c6558bfb-6trn7\" (UID: \"21b7f659-cd20-40ef-826c-642e630c3ad7\") " pod="openshift-ingress/e2e-api-a-14e637-openshift-default-59c6558bfb-6trn7"
Sep 09 16:42:13.229864 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:42:13.229752    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/21b7f659-cd20-40ef-826c-642e630c3ad7-credential-socket\") pod \"e2e-api-a-14e637-openshift-default-59c6558bfb-6trn7\" (UID: \"21b7f659-cd20-40ef-826c-642e630c3ad7\") " pod="openshift-ingress/e2e-api-a-14e637-openshift-default-59c6558bfb-6trn7"
Sep 09 16:42:13.229923 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:42:13.229890    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/21b7f659-cd20-40ef-826c-642e630c3ad7-istio-data\") pod \"e2e-api-a-14e637-openshift-default-59c6558bfb-6trn7\" (UID: \"21b7f659-cd20-40ef-826c-642e630c3ad7\") " pod="openshift-ingress/e2e-api-a-14e637-openshift-default-59c6558bfb-6trn7"
Sep 09 16:42:13.231489 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:42:13.231467    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/21b7f659-cd20-40ef-826c-642e630c3ad7-istio-envoy\") pod \"e2e-api-a-14e637-openshift-default-59c6558bfb-6trn7\" (UID: \"21b7f659-cd20-40ef-826c-642e630c3ad7\") " pod="openshift-ingress/e2e-api-a-14e637-openshift-default-59c6558bfb-6trn7"
Sep 09 16:42:13.231709 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:42:13.231692    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/21b7f659-cd20-40ef-826c-642e630c3ad7-istio-podinfo\") pod \"e2e-api-a-14e637-openshift-default-59c6558bfb-6trn7\" (UID: \"21b7f659-cd20-40ef-826c-642e630c3ad7\") " pod="openshift-ingress/e2e-api-a-14e637-openshift-default-59c6558bfb-6trn7"
Sep 09 16:42:13.238271 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:42:13.238252    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/21b7f659-cd20-40ef-826c-642e630c3ad7-istio-token\") pod \"e2e-api-a-14e637-openshift-default-59c6558bfb-6trn7\" (UID: \"21b7f659-cd20-40ef-826c-642e630c3ad7\") " pod="openshift-ingress/e2e-api-a-14e637-openshift-default-59c6558bfb-6trn7"
Sep 09 16:42:13.238452 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:42:13.238432    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gnsc2\" (UniqueName: \"kubernetes.io/projected/21b7f659-cd20-40ef-826c-642e630c3ad7-kube-api-access-gnsc2\") pod \"e2e-api-a-14e637-openshift-default-59c6558bfb-6trn7\" (UID: \"21b7f659-cd20-40ef-826c-642e630c3ad7\") " pod="openshift-ingress/e2e-api-a-14e637-openshift-default-59c6558bfb-6trn7"
Sep 09 16:42:13.278729 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:42:13.278713    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-14e637-openshift-default-59c6558bfb-6trn7"
Sep 09 16:42:13.384794 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:42:13.384767    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:42:13.554627 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:42:13.554602    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-14e637-openshift-default-59c6558bfb-6trn7"]
Sep 09 16:42:13.556064 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:42:13.556039    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21b7f659_cd20_40ef_826c_642e630c3ad7.slice/crio-2fdc954107d6d2436fa7b88ae2741f0dac86b82e6ebe4bb193fe0c2f9f915cda WatchSource:0}: Error finding container 2fdc954107d6d2436fa7b88ae2741f0dac86b82e6ebe4bb193fe0c2f9f915cda: Status 404 returned error can't find the container with id 2fdc954107d6d2436fa7b88ae2741f0dac86b82e6ebe4bb193fe0c2f9f915cda
Sep 09 16:42:13.558407 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:42:13.558370    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 09 16:42:13.558475 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:42:13.558457    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 09 16:42:13.558521 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:42:13.558506    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 09 16:42:14.304225 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:42:14.304191    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-14e637-openshift-default-59c6558bfb-6trn7" event={"ID":"21b7f659-cd20-40ef-826c-642e630c3ad7","Type":"ContainerStarted","Data":"afb17f8bfb71eee5d7767adf525b0643ce91903d74cea40eb269556035d61874"}
Sep 09 16:42:14.304414 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:42:14.304239    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-14e637-openshift-default-59c6558bfb-6trn7" event={"ID":"21b7f659-cd20-40ef-826c-642e630c3ad7","Type":"ContainerStarted","Data":"2fdc954107d6d2436fa7b88ae2741f0dac86b82e6ebe4bb193fe0c2f9f915cda"}
Sep 09 16:42:14.322403 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:42:14.322357    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-14e637-openshift-default-59c6558bfb-6trn7" podStartSLOduration=2.322342663 podStartE2EDuration="2.322342663s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 16:42:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:42:14.32211424 +0000 UTC m=+1716.675844101" watchObservedRunningTime="2026-09-09 16:42:14.322342663 +0000 UTC m=+1716.676072494"
Sep 09 16:42:15.279687 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:42:15.279651    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-14e637-openshift-default-59c6558bfb-6trn7"
Sep 09 16:42:15.284622 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:42:15.284599    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-14e637-openshift-default-59c6558bfb-6trn7"
Sep 09 16:42:15.310888 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:42:15.310865    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-14e637-openshift-default-59c6558bfb-6trn7"
Sep 09 16:42:15.311861 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:42:15.311840    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-14e637-openshift-default-59c6558bfb-6trn7"
Sep 09 16:42:15.575021 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:42:15.574943    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:42:16.168081 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:42:16.168045    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:42:16.269072 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:42:16.269037    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:42:16.382403 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:42:16.382370    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:42:16.896551 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:42:16.896522    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:42:17.626893 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:42:17.626866    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:42:19.125223 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:42:19.125185    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:42:19.260846 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:42:19.260820    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:42:19.311897 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:42:19.311862    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:42:19.704653 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:42:19.704627    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:42:19.795999 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:42:19.795957    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:42:34.416500 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:42:34.416468    2583 generic.go:356] "Generic (PLEG): container finished" podID="21b7f659-cd20-40ef-826c-642e630c3ad7" containerID="afb17f8bfb71eee5d7767adf525b0643ce91903d74cea40eb269556035d61874" exitCode=0
Sep 09 16:42:34.416877 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:42:34.416510    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-14e637-openshift-default-59c6558bfb-6trn7" event={"ID":"21b7f659-cd20-40ef-826c-642e630c3ad7","Type":"ContainerDied","Data":"afb17f8bfb71eee5d7767adf525b0643ce91903d74cea40eb269556035d61874"}
Sep 09 16:42:34.416877 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:42:34.416826    2583 scope.go:117] "RemoveContainer" containerID="afb17f8bfb71eee5d7767adf525b0643ce91903d74cea40eb269556035d61874"
Sep 09 16:42:34.417999 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:42:34.417953    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 09 16:42:34.418116 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:42:34.418063    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 09 16:42:34.418177 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:42:34.418115    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 09 16:42:35.423470 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:42:35.423432    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-14e637-openshift-default-59c6558bfb-6trn7" event={"ID":"21b7f659-cd20-40ef-826c-642e630c3ad7","Type":"ContainerStarted","Data":"fb625abcd9a522e90393ed50e1a5bc14c54b08d87822961aa77702648d5185a6"}
Sep 09 16:42:36.279596 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:42:36.279568    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-14e637-openshift-default-59c6558bfb-6trn7"
Sep 09 16:42:36.279759 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:42:36.279719    2583 patch_prober.go:28] interesting pod/e2e-api-a-14e637-openshift-default-59c6558bfb-6trn7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Sep 09 16:42:36.279802 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:42:36.279769    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-14e637-openshift-default-59c6558bfb-6trn7" podUID="21b7f659-cd20-40ef-826c-642e630c3ad7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Sep 09 16:42:37.279514 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:42:37.279479    2583 patch_prober.go:28] interesting pod/e2e-api-a-14e637-openshift-default-59c6558bfb-6trn7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Sep 09 16:42:37.279882 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:42:37.279538    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-14e637-openshift-default-59c6558bfb-6trn7" podUID="21b7f659-cd20-40ef-826c-642e630c3ad7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Sep 09 16:42:38.279750 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:42:38.279717    2583 patch_prober.go:28] interesting pod/e2e-api-a-14e637-openshift-default-59c6558bfb-6trn7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Sep 09 16:42:38.280184 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:42:38.279780    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-14e637-openshift-default-59c6558bfb-6trn7" podUID="21b7f659-cd20-40ef-826c-642e630c3ad7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Sep 09 16:42:39.279857 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:42:39.279828    2583 patch_prober.go:28] interesting pod/e2e-api-a-14e637-openshift-default-59c6558bfb-6trn7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Sep 09 16:42:39.280244 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:42:39.279905    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-14e637-openshift-default-59c6558bfb-6trn7" podUID="21b7f659-cd20-40ef-826c-642e630c3ad7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Sep 09 16:42:40.282459 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:42:40.282429    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-14e637-openshift-default-59c6558bfb-6trn7"
Sep 09 16:42:40.282920 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:42:40.282901    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-14e637-openshift-default-59c6558bfb-6trn7"
Sep 09 16:42:40.283593 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:42:40.283575    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-14e637-openshift-default-59c6558bfb-6trn7"
Sep 09 16:42:41.845419 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:42:41.845358    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:42:42.463962 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:42:42.463928    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:42:43.101951 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:42:43.101916    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:42:43.367672 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:42:43.367588    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:42:43.707161 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:42:43.707083    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:42:44.313968 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:42:44.313939    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:42:44.484633 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:42:44.484602    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:42:45.082706 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:42:45.082677    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:42:46.455969 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:42:46.455935    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:42:46.994555 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:42:46.994525    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:42:47.275291 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:42:47.275217    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-8cb67b-openshift-default-664d664b98-6w2dh"]
Sep 09 16:42:47.278553 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:42:47.278534    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-8cb67b-openshift-default-664d664b98-6w2dh"
Sep 09 16:42:47.281465 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:42:47.281443    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-8cb67b-openshift-default-dockercfg-5jjl7\""
Sep 09 16:42:47.287859 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:42:47.287836    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-8cb67b-openshift-default-664d664b98-6w2dh"]
Sep 09 16:42:47.299126 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:42:47.299105    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:42:47.345421 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:42:47.345391    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/97a2267d-2373-475c-8575-acbdb85e1492-istio-token\") pod \"e2e-api-b-8cb67b-openshift-default-664d664b98-6w2dh\" (UID: \"97a2267d-2373-475c-8575-acbdb85e1492\") " pod="openshift-ingress/e2e-api-b-8cb67b-openshift-default-664d664b98-6w2dh"
Sep 09 16:42:47.345562 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:42:47.345432    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/97a2267d-2373-475c-8575-acbdb85e1492-istio-envoy\") pod \"e2e-api-b-8cb67b-openshift-default-664d664b98-6w2dh\" (UID: \"97a2267d-2373-475c-8575-acbdb85e1492\") " pod="openshift-ingress/e2e-api-b-8cb67b-openshift-default-664d664b98-6w2dh"
Sep 09 16:42:47.345562 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:42:47.345460    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/97a2267d-2373-475c-8575-acbdb85e1492-istio-podinfo\") pod \"e2e-api-b-8cb67b-openshift-default-664d664b98-6w2dh\" (UID: \"97a2267d-2373-475c-8575-acbdb85e1492\") " pod="openshift-ingress/e2e-api-b-8cb67b-openshift-default-664d664b98-6w2dh"
Sep 09 16:42:47.345562 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:42:47.345527    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/97a2267d-2373-475c-8575-acbdb85e1492-workload-socket\") pod \"e2e-api-b-8cb67b-openshift-default-664d664b98-6w2dh\" (UID: \"97a2267d-2373-475c-8575-acbdb85e1492\") " pod="openshift-ingress/e2e-api-b-8cb67b-openshift-default-664d664b98-6w2dh"
Sep 09 16:42:47.345719 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:42:47.345601    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/97a2267d-2373-475c-8575-acbdb85e1492-istio-data\") pod \"e2e-api-b-8cb67b-openshift-default-664d664b98-6w2dh\" (UID: \"97a2267d-2373-475c-8575-acbdb85e1492\") " pod="openshift-ingress/e2e-api-b-8cb67b-openshift-default-664d664b98-6w2dh"
Sep 09 16:42:47.345719 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:42:47.345657    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/97a2267d-2373-475c-8575-acbdb85e1492-workload-certs\") pod \"e2e-api-b-8cb67b-openshift-default-664d664b98-6w2dh\" (UID: \"97a2267d-2373-475c-8575-acbdb85e1492\") " pod="openshift-ingress/e2e-api-b-8cb67b-openshift-default-664d664b98-6w2dh"
Sep 09 16:42:47.345719 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:42:47.345708    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/97a2267d-2373-475c-8575-acbdb85e1492-credential-socket\") pod \"e2e-api-b-8cb67b-openshift-default-664d664b98-6w2dh\" (UID: \"97a2267d-2373-475c-8575-acbdb85e1492\") " pod="openshift-ingress/e2e-api-b-8cb67b-openshift-default-664d664b98-6w2dh"
Sep 09 16:42:47.345863 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:42:47.345752    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/97a2267d-2373-475c-8575-acbdb85e1492-istiod-ca-cert\") pod \"e2e-api-b-8cb67b-openshift-default-664d664b98-6w2dh\" (UID: \"97a2267d-2373-475c-8575-acbdb85e1492\") " pod="openshift-ingress/e2e-api-b-8cb67b-openshift-default-664d664b98-6w2dh"
Sep 09 16:42:47.345863 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:42:47.345776    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mc5lr\" (UniqueName: \"kubernetes.io/projected/97a2267d-2373-475c-8575-acbdb85e1492-kube-api-access-mc5lr\") pod \"e2e-api-b-8cb67b-openshift-default-664d664b98-6w2dh\" (UID: \"97a2267d-2373-475c-8575-acbdb85e1492\") " pod="openshift-ingress/e2e-api-b-8cb67b-openshift-default-664d664b98-6w2dh"
Sep 09 16:42:47.447371 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:42:47.447334    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/97a2267d-2373-475c-8575-acbdb85e1492-istiod-ca-cert\") pod \"e2e-api-b-8cb67b-openshift-default-664d664b98-6w2dh\" (UID: \"97a2267d-2373-475c-8575-acbdb85e1492\") " pod="openshift-ingress/e2e-api-b-8cb67b-openshift-default-664d664b98-6w2dh"
Sep 09 16:42:47.447371 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:42:47.447380    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mc5lr\" (UniqueName: \"kubernetes.io/projected/97a2267d-2373-475c-8575-acbdb85e1492-kube-api-access-mc5lr\") pod \"e2e-api-b-8cb67b-openshift-default-664d664b98-6w2dh\" (UID: \"97a2267d-2373-475c-8575-acbdb85e1492\") " pod="openshift-ingress/e2e-api-b-8cb67b-openshift-default-664d664b98-6w2dh"
Sep 09 16:42:47.447609 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:42:47.447461    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/97a2267d-2373-475c-8575-acbdb85e1492-istio-token\") pod \"e2e-api-b-8cb67b-openshift-default-664d664b98-6w2dh\" (UID: \"97a2267d-2373-475c-8575-acbdb85e1492\") " pod="openshift-ingress/e2e-api-b-8cb67b-openshift-default-664d664b98-6w2dh"
Sep 09 16:42:47.447609 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:42:47.447486    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/97a2267d-2373-475c-8575-acbdb85e1492-istio-envoy\") pod \"e2e-api-b-8cb67b-openshift-default-664d664b98-6w2dh\" (UID: \"97a2267d-2373-475c-8575-acbdb85e1492\") " pod="openshift-ingress/e2e-api-b-8cb67b-openshift-default-664d664b98-6w2dh"
Sep 09 16:42:47.447609 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:42:47.447511    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/97a2267d-2373-475c-8575-acbdb85e1492-istio-podinfo\") pod \"e2e-api-b-8cb67b-openshift-default-664d664b98-6w2dh\" (UID: \"97a2267d-2373-475c-8575-acbdb85e1492\") " pod="openshift-ingress/e2e-api-b-8cb67b-openshift-default-664d664b98-6w2dh"
Sep 09 16:42:47.447609 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:42:47.447547    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/97a2267d-2373-475c-8575-acbdb85e1492-workload-socket\") pod \"e2e-api-b-8cb67b-openshift-default-664d664b98-6w2dh\" (UID: \"97a2267d-2373-475c-8575-acbdb85e1492\") " pod="openshift-ingress/e2e-api-b-8cb67b-openshift-default-664d664b98-6w2dh"
Sep 09 16:42:47.447609 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:42:47.447602    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/97a2267d-2373-475c-8575-acbdb85e1492-istio-data\") pod \"e2e-api-b-8cb67b-openshift-default-664d664b98-6w2dh\" (UID: \"97a2267d-2373-475c-8575-acbdb85e1492\") " pod="openshift-ingress/e2e-api-b-8cb67b-openshift-default-664d664b98-6w2dh"
Sep 09 16:42:47.447847 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:42:47.447662    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/97a2267d-2373-475c-8575-acbdb85e1492-workload-certs\") pod \"e2e-api-b-8cb67b-openshift-default-664d664b98-6w2dh\" (UID: \"97a2267d-2373-475c-8575-acbdb85e1492\") " pod="openshift-ingress/e2e-api-b-8cb67b-openshift-default-664d664b98-6w2dh"
Sep 09 16:42:47.447847 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:42:47.447702    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/97a2267d-2373-475c-8575-acbdb85e1492-credential-socket\") pod \"e2e-api-b-8cb67b-openshift-default-664d664b98-6w2dh\" (UID: \"97a2267d-2373-475c-8575-acbdb85e1492\") " pod="openshift-ingress/e2e-api-b-8cb67b-openshift-default-664d664b98-6w2dh"
Sep 09 16:42:47.448125 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:42:47.448103    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/97a2267d-2373-475c-8575-acbdb85e1492-istiod-ca-cert\") pod \"e2e-api-b-8cb67b-openshift-default-664d664b98-6w2dh\" (UID: \"97a2267d-2373-475c-8575-acbdb85e1492\") " pod="openshift-ingress/e2e-api-b-8cb67b-openshift-default-664d664b98-6w2dh"
Sep 09 16:42:47.448193 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:42:47.448105    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/97a2267d-2373-475c-8575-acbdb85e1492-credential-socket\") pod \"e2e-api-b-8cb67b-openshift-default-664d664b98-6w2dh\" (UID: \"97a2267d-2373-475c-8575-acbdb85e1492\") " pod="openshift-ingress/e2e-api-b-8cb67b-openshift-default-664d664b98-6w2dh"
Sep 09 16:42:47.448724 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:42:47.448615    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/97a2267d-2373-475c-8575-acbdb85e1492-workload-socket\") pod \"e2e-api-b-8cb67b-openshift-default-664d664b98-6w2dh\" (UID: \"97a2267d-2373-475c-8575-acbdb85e1492\") " pod="openshift-ingress/e2e-api-b-8cb67b-openshift-default-664d664b98-6w2dh"
Sep 09 16:42:47.448879 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:42:47.448855    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/97a2267d-2373-475c-8575-acbdb85e1492-istio-data\") pod \"e2e-api-b-8cb67b-openshift-default-664d664b98-6w2dh\" (UID: \"97a2267d-2373-475c-8575-acbdb85e1492\") " pod="openshift-ingress/e2e-api-b-8cb67b-openshift-default-664d664b98-6w2dh"
Sep 09 16:42:47.449180 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:42:47.449157    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/97a2267d-2373-475c-8575-acbdb85e1492-workload-certs\") pod \"e2e-api-b-8cb67b-openshift-default-664d664b98-6w2dh\" (UID: \"97a2267d-2373-475c-8575-acbdb85e1492\") " pod="openshift-ingress/e2e-api-b-8cb67b-openshift-default-664d664b98-6w2dh"
Sep 09 16:42:47.451292 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:42:47.451262    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/97a2267d-2373-475c-8575-acbdb85e1492-istio-envoy\") pod \"e2e-api-b-8cb67b-openshift-default-664d664b98-6w2dh\" (UID: \"97a2267d-2373-475c-8575-acbdb85e1492\") " pod="openshift-ingress/e2e-api-b-8cb67b-openshift-default-664d664b98-6w2dh"
Sep 09 16:42:47.451430 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:42:47.451408    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/97a2267d-2373-475c-8575-acbdb85e1492-istio-podinfo\") pod \"e2e-api-b-8cb67b-openshift-default-664d664b98-6w2dh\" (UID: \"97a2267d-2373-475c-8575-acbdb85e1492\") " pod="openshift-ingress/e2e-api-b-8cb67b-openshift-default-664d664b98-6w2dh"
Sep 09 16:42:47.456342 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:42:47.456298    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mc5lr\" (UniqueName: \"kubernetes.io/projected/97a2267d-2373-475c-8575-acbdb85e1492-kube-api-access-mc5lr\") pod \"e2e-api-b-8cb67b-openshift-default-664d664b98-6w2dh\" (UID: \"97a2267d-2373-475c-8575-acbdb85e1492\") " pod="openshift-ingress/e2e-api-b-8cb67b-openshift-default-664d664b98-6w2dh"
Sep 09 16:42:47.456658 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:42:47.456557    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/97a2267d-2373-475c-8575-acbdb85e1492-istio-token\") pod \"e2e-api-b-8cb67b-openshift-default-664d664b98-6w2dh\" (UID: \"97a2267d-2373-475c-8575-acbdb85e1492\") " pod="openshift-ingress/e2e-api-b-8cb67b-openshift-default-664d664b98-6w2dh"
Sep 09 16:42:47.538742 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:42:47.538665    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:42:47.590681 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:42:47.590470    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-8cb67b-openshift-default-664d664b98-6w2dh"
Sep 09 16:42:47.866860 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:42:47.866829    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-8cb67b-openshift-default-664d664b98-6w2dh"]
Sep 09 16:42:47.868310 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:42:47.868284    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97a2267d_2373_475c_8575_acbdb85e1492.slice/crio-ff132d59b03a587ba4fd44acb4053143e240eb7a3c01828e7698373b29206e62 WatchSource:0}: Error finding container ff132d59b03a587ba4fd44acb4053143e240eb7a3c01828e7698373b29206e62: Status 404 returned error can't find the container with id ff132d59b03a587ba4fd44acb4053143e240eb7a3c01828e7698373b29206e62
Sep 09 16:42:47.873020 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:42:47.871379    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 09 16:42:47.873020 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:42:47.871531    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 09 16:42:47.873020 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:42:47.871616    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 09 16:42:48.497153 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:42:48.497112    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-8cb67b-openshift-default-664d664b98-6w2dh" event={"ID":"97a2267d-2373-475c-8575-acbdb85e1492","Type":"ContainerStarted","Data":"ba9828ce607c8ca5ff6e32f1acce66ec54629a9a9da37ac23e3ee288f82c634a"}
Sep 09 16:42:48.497570 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:42:48.497167    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-8cb67b-openshift-default-664d664b98-6w2dh" event={"ID":"97a2267d-2373-475c-8575-acbdb85e1492","Type":"ContainerStarted","Data":"ff132d59b03a587ba4fd44acb4053143e240eb7a3c01828e7698373b29206e62"}
Sep 09 16:42:48.518369 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:42:48.518313    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-8cb67b-openshift-default-664d664b98-6w2dh" podStartSLOduration=1.5182931320000002 podStartE2EDuration="1.518293132s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 16:42:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:42:48.515412097 +0000 UTC m=+1750.869141949" watchObservedRunningTime="2026-09-09 16:42:48.518293132 +0000 UTC m=+1750.872022965"
Sep 09 16:42:48.591200 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:42:48.591172    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-8cb67b-openshift-default-664d664b98-6w2dh"
Sep 09 16:42:48.592742 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:42:48.592718    2583 patch_prober.go:28] interesting pod/e2e-api-b-8cb67b-openshift-default-664d664b98-6w2dh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Sep 09 16:42:48.592867 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:42:48.592784    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-8cb67b-openshift-default-664d664b98-6w2dh" podUID="97a2267d-2373-475c-8575-acbdb85e1492" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Sep 09 16:42:49.595233 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:42:49.595201    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-8cb67b-openshift-default-664d664b98-6w2dh"
Sep 09 16:42:49.783215 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:42:49.783189    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:42:50.398149 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:42:50.398124    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:42:50.507485 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:42:50.507454    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-8cb67b-openshift-default-664d664b98-6w2dh"
Sep 09 16:42:50.508439 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:42:50.508418    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-8cb67b-openshift-default-664d664b98-6w2dh"
Sep 09 16:42:50.514515 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:42:50.514491    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:42:52.724374 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:42:52.724345    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:42:52.824162 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:42:52.824137    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:42:53.152515 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:42:53.152488    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:42:53.935284 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:42:53.935253    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:42:54.034266 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:42:54.034230    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:42:54.150438 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:42:54.150410    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:42:54.350177 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:42:54.350126    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:42:54.892127 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:42:54.892088    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:42:58.340090 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:42:58.340037    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:42:59.683662 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:42:59.683619    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:43:03.527495 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:43:03.527439    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:43:14.692876 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:43:14.692828    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:43:16.072781 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:43:16.072725    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:43:17.599535 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:43:17.599462    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:43:17.699424 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:43:17.699380    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:43:18.063572 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:43:18.063478    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:43:18.683266 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:43:18.683226    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:43:19.481228 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:43:19.481197    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:43:20.222579 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:43:20.222500    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:43:22.173351 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:43:22.173314    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:43:23.621812 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:43:23.621784    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-14e637-r9krt"]
Sep 09 16:43:23.625678 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:43:23.625659    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-14e637-r9krt"
Sep 09 16:43:23.629350 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:43:23.629324    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jz5ff\""
Sep 09 16:43:23.631216 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:43:23.631190    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-14e637-r9krt"]
Sep 09 16:43:23.687486 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:43:23.687463    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/85833961-4cc3-4bc9-9392-782f33b0d1bc-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-14e637-r9krt\" (UID: \"85833961-4cc3-4bc9-9392-782f33b0d1bc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-14e637-r9krt"
Sep 09 16:43:23.703605 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:43:23.703582    2583 generic.go:356] "Generic (PLEG): container finished" podID="97a2267d-2373-475c-8575-acbdb85e1492" containerID="ba9828ce607c8ca5ff6e32f1acce66ec54629a9a9da37ac23e3ee288f82c634a" exitCode=0
Sep 09 16:43:23.703714 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:43:23.703654    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-8cb67b-openshift-default-664d664b98-6w2dh" event={"ID":"97a2267d-2373-475c-8575-acbdb85e1492","Type":"ContainerDied","Data":"ba9828ce607c8ca5ff6e32f1acce66ec54629a9a9da37ac23e3ee288f82c634a"}
Sep 09 16:43:23.704087 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:43:23.704070    2583 scope.go:117] "RemoveContainer" containerID="ba9828ce607c8ca5ff6e32f1acce66ec54629a9a9da37ac23e3ee288f82c634a"
Sep 09 16:43:23.705400 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:43:23.705369    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 09 16:43:23.705519 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:43:23.705433    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 09 16:43:23.705519 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:43:23.705466    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 09 16:43:23.788931 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:43:23.788898    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/85833961-4cc3-4bc9-9392-782f33b0d1bc-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-14e637-r9krt\" (UID: \"85833961-4cc3-4bc9-9392-782f33b0d1bc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-14e637-r9krt"
Sep 09 16:43:23.789821 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:43:23.789784    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/85833961-4cc3-4bc9-9392-782f33b0d1bc-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-14e637-r9krt\" (UID: \"85833961-4cc3-4bc9-9392-782f33b0d1bc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-14e637-r9krt"
Sep 09 16:43:23.940569 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:43:23.940481    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-14e637-r9krt"
Sep 09 16:43:24.224096 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:43:24.224070    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-14e637-r9krt"]
Sep 09 16:43:24.225884 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:43:24.225853    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85833961_4cc3_4bc9_9392_782f33b0d1bc.slice/crio-6ea2da09e50680541999c6487e463526ee152a59ee98aa496df981eeb61fb6a5 WatchSource:0}: Error finding container 6ea2da09e50680541999c6487e463526ee152a59ee98aa496df981eeb61fb6a5: Status 404 returned error can't find the container with id 6ea2da09e50680541999c6487e463526ee152a59ee98aa496df981eeb61fb6a5
Sep 09 16:43:24.435171 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:43:24.435141    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:43:24.535411 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:43:24.535383    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:43:24.661703 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:43:24.661670    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:43:24.716289 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:43:24.716244    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-8cb67b-openshift-default-664d664b98-6w2dh" event={"ID":"97a2267d-2373-475c-8575-acbdb85e1492","Type":"ContainerStarted","Data":"26d59ba1813b4131a153dab9d5ac9acea1193c2d1f9df10efd199196e6bfe799"}
Sep 09 16:43:24.718382 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:43:24.718346    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-14e637-r9krt" event={"ID":"85833961-4cc3-4bc9-9392-782f33b0d1bc","Type":"ContainerStarted","Data":"6637e290e4b0d5383a6da3a5242290fbe6ad288c981dd51e3c5f81fdbec9d41a"}
Sep 09 16:43:24.718524 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:43:24.718406    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-14e637-r9krt" event={"ID":"85833961-4cc3-4bc9-9392-782f33b0d1bc","Type":"ContainerStarted","Data":"6ea2da09e50680541999c6487e463526ee152a59ee98aa496df981eeb61fb6a5"}
Sep 09 16:43:24.751401 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:43:24.751350    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-14e637-r9krt" podStartSLOduration=1.7513341850000002 podStartE2EDuration="1.751334185s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 16:43:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:43:24.750098227 +0000 UTC m=+1787.103828074" watchObservedRunningTime="2026-09-09 16:43:24.751334185 +0000 UTC m=+1787.105064017"
Sep 09 16:43:25.457595 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:43:25.457467    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:43:25.591480 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:43:25.591034    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-8cb67b-openshift-default-664d664b98-6w2dh"
Sep 09 16:43:25.591480 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:43:25.591056    2583 patch_prober.go:28] interesting pod/e2e-api-b-8cb67b-openshift-default-664d664b98-6w2dh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Sep 09 16:43:25.591480 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:43:25.591108    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-8cb67b-openshift-default-664d664b98-6w2dh" podUID="97a2267d-2373-475c-8575-acbdb85e1492" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Sep 09 16:43:25.725728 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:43:25.725639    2583 generic.go:356] "Generic (PLEG): container finished" podID="85833961-4cc3-4bc9-9392-782f33b0d1bc" containerID="6637e290e4b0d5383a6da3a5242290fbe6ad288c981dd51e3c5f81fdbec9d41a" exitCode=0
Sep 09 16:43:25.726122 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:43:25.725729    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-14e637-r9krt" event={"ID":"85833961-4cc3-4bc9-9392-782f33b0d1bc","Type":"ContainerDied","Data":"6637e290e4b0d5383a6da3a5242290fbe6ad288c981dd51e3c5f81fdbec9d41a"}
Sep 09 16:43:26.591265 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:43:26.591223    2583 patch_prober.go:28] interesting pod/e2e-api-b-8cb67b-openshift-default-664d664b98-6w2dh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Sep 09 16:43:26.591439 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:43:26.591309    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-8cb67b-openshift-default-664d664b98-6w2dh" podUID="97a2267d-2373-475c-8575-acbdb85e1492" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Sep 09 16:43:26.913171 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:43:26.913143    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-14e637-r9krt"
Sep 09 16:43:27.032306 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:43:27.032276    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/85833961-4cc3-4bc9-9392-782f33b0d1bc-maas-api-service-ca\") pod \"85833961-4cc3-4bc9-9392-782f33b0d1bc\" (UID: \"85833961-4cc3-4bc9-9392-782f33b0d1bc\") "
Sep 09 16:43:27.032672 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:43:27.032640    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/85833961-4cc3-4bc9-9392-782f33b0d1bc-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "85833961-4cc3-4bc9-9392-782f33b0d1bc" (UID: "85833961-4cc3-4bc9-9392-782f33b0d1bc"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 16:43:27.133656 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:43:27.133570    2583 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/85833961-4cc3-4bc9-9392-782f33b0d1bc-maas-api-service-ca\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\""
Sep 09 16:43:27.330504 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:43:27.330470    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:43:27.430421 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:43:27.430333    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:43:27.591639 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:43:27.591598    2583 patch_prober.go:28] interesting pod/e2e-api-b-8cb67b-openshift-default-664d664b98-6w2dh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Sep 09 16:43:27.591842 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:43:27.591669    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-8cb67b-openshift-default-664d664b98-6w2dh" podUID="97a2267d-2373-475c-8575-acbdb85e1492" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Sep 09 16:43:27.739795 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:43:27.739715    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-14e637-r9krt"
Sep 09 16:43:27.739795 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:43:27.739754    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-14e637-r9krt" event={"ID":"85833961-4cc3-4bc9-9392-782f33b0d1bc","Type":"ContainerDied","Data":"6ea2da09e50680541999c6487e463526ee152a59ee98aa496df981eeb61fb6a5"}
Sep 09 16:43:27.739978 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:43:27.739796    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6ea2da09e50680541999c6487e463526ee152a59ee98aa496df981eeb61fb6a5"
Sep 09 16:43:27.794070 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:43:27.794044    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:43:28.543522 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:43:28.543487    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:43:28.592007 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:43:28.591553    2583 patch_prober.go:28] interesting pod/e2e-api-b-8cb67b-openshift-default-664d664b98-6w2dh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Sep 09 16:43:28.592007 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:43:28.591612    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-8cb67b-openshift-default-664d664b98-6w2dh" podUID="97a2267d-2373-475c-8575-acbdb85e1492" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Sep 09 16:43:29.189855 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:43:29.189815    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:43:29.594339 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:43:29.594311    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-8cb67b-openshift-default-664d664b98-6w2dh"
Sep 09 16:43:29.594810 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:43:29.594738    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-8cb67b-openshift-default-664d664b98-6w2dh"
Sep 09 16:43:29.595430 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:43:29.595405    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-8cb67b-openshift-default-664d664b98-6w2dh"
Sep 09 16:43:29.873211 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:43:29.873101    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:43:33.988569 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:43:33.988478    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:43:34.093667 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:43:34.093640    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:43:38.344239 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:43:38.344209    2583 scope.go:117] "RemoveContainer" containerID="c6ad54a71600f77674fe04ddd6d1eef688862cc8c40f8a17e85f61667a602017"
Sep 09 16:43:39.392051 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:43:39.392020    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:43:39.492310 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:43:39.492278    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:43:39.560879 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:43:39.560837    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-14e637-r9krt"]
Sep 09 16:43:39.562547 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:43:39.562524    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:43:39.563309 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:43:39.563291    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-14e637-r9krt"]
Sep 09 16:43:39.619222 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:43:39.619196    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:43:39.939659 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:43:39.939627    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:43:40.045535 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:43:40.045499    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:43:40.239369 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:43:40.239273    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="85833961-4cc3-4bc9-9392-782f33b0d1bc" path="/var/lib/kubelet/pods/85833961-4cc3-4bc9-9392-782f33b0d1bc/volumes"
Sep 09 16:43:40.692298 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:43:40.692259    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:43:41.568185 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:43:41.568145    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:43:42.280667 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:43:42.280628    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:43:42.847039 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:43:42.846970    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:43:43.475611 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:43:43.475578    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:43:44.061552 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:43:44.061524    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:43:45.749190 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:43:45.749160    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:43:45.802337 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:43:45.802300    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:43:45.865159 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:43:45.865127    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-14e637-openshift-default-59c6558bfb-6trn7"]
Sep 09 16:43:45.865379 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:43:45.865353    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-14e637-openshift-default-59c6558bfb-6trn7" podUID="21b7f659-cd20-40ef-826c-642e630c3ad7" containerName="istio-proxy" containerID="cri-o://fb625abcd9a522e90393ed50e1a5bc14c54b08d87822961aa77702648d5185a6" gracePeriod=30
Sep 09 16:43:45.879970 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:43:45.879946    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:43:46.248260 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:43:46.248234    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-8cb67b-v7xlr"]
Sep 09 16:43:46.248614 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:43:46.248603    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="85833961-4cc3-4bc9-9392-782f33b0d1bc" containerName="revoke-keys"
Sep 09 16:43:46.248668 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:43:46.248616    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="85833961-4cc3-4bc9-9392-782f33b0d1bc" containerName="revoke-keys"
Sep 09 16:43:46.248705 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:43:46.248694    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="85833961-4cc3-4bc9-9392-782f33b0d1bc" containerName="revoke-keys"
Sep 09 16:43:46.251899 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:43:46.251876    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-8cb67b-v7xlr"]
Sep 09 16:43:46.252055 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:43:46.251952    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-8cb67b-v7xlr"
Sep 09 16:43:46.254636 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:43:46.254614    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jz5ff\""
Sep 09 16:43:46.320710 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:43:46.320672    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2ff13a0c-27a1-43ec-aac3-8437b304c777-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-8cb67b-v7xlr\" (UID: \"2ff13a0c-27a1-43ec-aac3-8437b304c777\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-8cb67b-v7xlr"
Sep 09 16:43:46.383890 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:43:46.383857    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:43:46.421372 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:43:46.421339    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2ff13a0c-27a1-43ec-aac3-8437b304c777-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-8cb67b-v7xlr\" (UID: \"2ff13a0c-27a1-43ec-aac3-8437b304c777\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-8cb67b-v7xlr"
Sep 09 16:43:46.422030 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:43:46.422009    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2ff13a0c-27a1-43ec-aac3-8437b304c777-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-8cb67b-v7xlr\" (UID: \"2ff13a0c-27a1-43ec-aac3-8437b304c777\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-8cb67b-v7xlr"
Sep 09 16:43:46.562879 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:43:46.562852    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-8cb67b-v7xlr"
Sep 09 16:43:46.833040 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:43:46.833013    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-8cb67b-v7xlr"]
Sep 09 16:43:46.834681 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:43:46.834648    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ff13a0c_27a1_43ec_aac3_8437b304c777.slice/crio-65b04d21cc192a83a8b0e6f98983ae43262c46fcfd072c0d3c1f610994add8d4 WatchSource:0}: Error finding container 65b04d21cc192a83a8b0e6f98983ae43262c46fcfd072c0d3c1f610994add8d4: Status 404 returned error can't find the container with id 65b04d21cc192a83a8b0e6f98983ae43262c46fcfd072c0d3c1f610994add8d4
Sep 09 16:43:46.844466 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:43:46.844441    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-8cb67b-v7xlr" event={"ID":"2ff13a0c-27a1-43ec-aac3-8437b304c777","Type":"ContainerStarted","Data":"65b04d21cc192a83a8b0e6f98983ae43262c46fcfd072c0d3c1f610994add8d4"}
Sep 09 16:43:47.088509 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:43:47.088414    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:43:47.716882 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:43:47.716852    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:43:47.831895 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:43:47.831866    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:43:47.852744 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:43:47.852679    2583 generic.go:356] "Generic (PLEG): container finished" podID="2ff13a0c-27a1-43ec-aac3-8437b304c777" containerID="2682ba3e55aed30e08c6b6c0dc8b5853d2643300ce90cd32df10fc78debfe8d2" exitCode=0
Sep 09 16:43:47.853080 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:43:47.852762    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-8cb67b-v7xlr" event={"ID":"2ff13a0c-27a1-43ec-aac3-8437b304c777","Type":"ContainerDied","Data":"2682ba3e55aed30e08c6b6c0dc8b5853d2643300ce90cd32df10fc78debfe8d2"}
Sep 09 16:43:48.490496 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:43:48.490468    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:43:49.022411 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:43:49.022386    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-8cb67b-v7xlr"
Sep 09 16:43:49.048664 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:43:49.048628    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2ff13a0c-27a1-43ec-aac3-8437b304c777-maas-api-service-ca\") pod \"2ff13a0c-27a1-43ec-aac3-8437b304c777\" (UID: \"2ff13a0c-27a1-43ec-aac3-8437b304c777\") "
Sep 09 16:43:49.049015 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:43:49.048969    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2ff13a0c-27a1-43ec-aac3-8437b304c777-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "2ff13a0c-27a1-43ec-aac3-8437b304c777" (UID: "2ff13a0c-27a1-43ec-aac3-8437b304c777"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 16:43:49.150499 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:43:49.150418    2583 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2ff13a0c-27a1-43ec-aac3-8437b304c777-maas-api-service-ca\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\""
Sep 09 16:43:49.176949 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:43:49.176921    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:43:49.793599 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:43:49.793547    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:43:49.865333 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:43:49.865291    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-8cb67b-v7xlr"
Sep 09 16:43:49.865333 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:43:49.865315    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-8cb67b-v7xlr" event={"ID":"2ff13a0c-27a1-43ec-aac3-8437b304c777","Type":"ContainerDied","Data":"65b04d21cc192a83a8b0e6f98983ae43262c46fcfd072c0d3c1f610994add8d4"}
Sep 09 16:43:49.865548 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:43:49.865366    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="65b04d21cc192a83a8b0e6f98983ae43262c46fcfd072c0d3c1f610994add8d4"
Sep 09 16:43:50.565715 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:43:50.565683    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:43:51.123935 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:43:51.123908    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-14e637-openshift-default-59c6558bfb-6trn7"
Sep 09 16:43:51.174365 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:43:51.174277    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/21b7f659-cd20-40ef-826c-642e630c3ad7-istio-data\") pod \"21b7f659-cd20-40ef-826c-642e630c3ad7\" (UID: \"21b7f659-cd20-40ef-826c-642e630c3ad7\") "
Sep 09 16:43:51.174514 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:43:51.174386    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/21b7f659-cd20-40ef-826c-642e630c3ad7-workload-certs\") pod \"21b7f659-cd20-40ef-826c-642e630c3ad7\" (UID: \"21b7f659-cd20-40ef-826c-642e630c3ad7\") "
Sep 09 16:43:51.174514 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:43:51.174425    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/21b7f659-cd20-40ef-826c-642e630c3ad7-credential-socket\") pod \"21b7f659-cd20-40ef-826c-642e630c3ad7\" (UID: \"21b7f659-cd20-40ef-826c-642e630c3ad7\") "
Sep 09 16:43:51.174640 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:43:51.174579    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/21b7f659-cd20-40ef-826c-642e630c3ad7-workload-socket\") pod \"21b7f659-cd20-40ef-826c-642e630c3ad7\" (UID: \"21b7f659-cd20-40ef-826c-642e630c3ad7\") "
Sep 09 16:43:51.174640 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:43:51.174615    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/21b7f659-cd20-40ef-826c-642e630c3ad7-istio-data" (OuterVolumeSpecName: "istio-data") pod "21b7f659-cd20-40ef-826c-642e630c3ad7" (UID: "21b7f659-cd20-40ef-826c-642e630c3ad7"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 16:43:51.174753 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:43:51.174623    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/21b7f659-cd20-40ef-826c-642e630c3ad7-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "21b7f659-cd20-40ef-826c-642e630c3ad7" (UID: "21b7f659-cd20-40ef-826c-642e630c3ad7"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 16:43:51.174753 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:43:51.174626    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gnsc2\" (UniqueName: \"kubernetes.io/projected/21b7f659-cd20-40ef-826c-642e630c3ad7-kube-api-access-gnsc2\") pod \"21b7f659-cd20-40ef-826c-642e630c3ad7\" (UID: \"21b7f659-cd20-40ef-826c-642e630c3ad7\") "
Sep 09 16:43:51.174753 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:43:51.174699    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/21b7f659-cd20-40ef-826c-642e630c3ad7-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "21b7f659-cd20-40ef-826c-642e630c3ad7" (UID: "21b7f659-cd20-40ef-826c-642e630c3ad7"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 16:43:51.174753 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:43:51.174739    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/21b7f659-cd20-40ef-826c-642e630c3ad7-istio-podinfo\") pod \"21b7f659-cd20-40ef-826c-642e630c3ad7\" (UID: \"21b7f659-cd20-40ef-826c-642e630c3ad7\") "
Sep 09 16:43:51.174974 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:43:51.174777    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/21b7f659-cd20-40ef-826c-642e630c3ad7-istio-envoy\") pod \"21b7f659-cd20-40ef-826c-642e630c3ad7\" (UID: \"21b7f659-cd20-40ef-826c-642e630c3ad7\") "
Sep 09 16:43:51.174974 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:43:51.174818    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/21b7f659-cd20-40ef-826c-642e630c3ad7-istio-token\") pod \"21b7f659-cd20-40ef-826c-642e630c3ad7\" (UID: \"21b7f659-cd20-40ef-826c-642e630c3ad7\") "
Sep 09 16:43:51.174974 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:43:51.174845    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/21b7f659-cd20-40ef-826c-642e630c3ad7-istiod-ca-cert\") pod \"21b7f659-cd20-40ef-826c-642e630c3ad7\" (UID: \"21b7f659-cd20-40ef-826c-642e630c3ad7\") "
Sep 09 16:43:51.174974 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:43:51.174890    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/21b7f659-cd20-40ef-826c-642e630c3ad7-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "21b7f659-cd20-40ef-826c-642e630c3ad7" (UID: "21b7f659-cd20-40ef-826c-642e630c3ad7"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 16:43:51.175267 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:43:51.175243    2583 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/21b7f659-cd20-40ef-826c-642e630c3ad7-workload-certs\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\""
Sep 09 16:43:51.175442 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:43:51.175422    2583 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/21b7f659-cd20-40ef-826c-642e630c3ad7-credential-socket\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\""
Sep 09 16:43:51.175519 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:43:51.175444    2583 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/21b7f659-cd20-40ef-826c-642e630c3ad7-workload-socket\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\""
Sep 09 16:43:51.175519 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:43:51.175459    2583 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/21b7f659-cd20-40ef-826c-642e630c3ad7-istio-data\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\""
Sep 09 16:43:51.175519 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:43:51.175296    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/21b7f659-cd20-40ef-826c-642e630c3ad7-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "21b7f659-cd20-40ef-826c-642e630c3ad7" (UID: "21b7f659-cd20-40ef-826c-642e630c3ad7"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 16:43:51.176928 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:43:51.176901    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/21b7f659-cd20-40ef-826c-642e630c3ad7-kube-api-access-gnsc2" (OuterVolumeSpecName: "kube-api-access-gnsc2") pod "21b7f659-cd20-40ef-826c-642e630c3ad7" (UID: "21b7f659-cd20-40ef-826c-642e630c3ad7"). InnerVolumeSpecName "kube-api-access-gnsc2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 16:43:51.177151 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:43:51.177130    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/21b7f659-cd20-40ef-826c-642e630c3ad7-istio-token" (OuterVolumeSpecName: "istio-token") pod "21b7f659-cd20-40ef-826c-642e630c3ad7" (UID: "21b7f659-cd20-40ef-826c-642e630c3ad7"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 16:43:51.177280 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:43:51.177260    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/21b7f659-cd20-40ef-826c-642e630c3ad7-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "21b7f659-cd20-40ef-826c-642e630c3ad7" (UID: "21b7f659-cd20-40ef-826c-642e630c3ad7"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 09 16:43:51.177351 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:43:51.177262    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/21b7f659-cd20-40ef-826c-642e630c3ad7-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "21b7f659-cd20-40ef-826c-642e630c3ad7" (UID: "21b7f659-cd20-40ef-826c-642e630c3ad7"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 16:43:51.276333 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:43:51.276290    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gnsc2\" (UniqueName: \"kubernetes.io/projected/21b7f659-cd20-40ef-826c-642e630c3ad7-kube-api-access-gnsc2\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\""
Sep 09 16:43:51.276333 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:43:51.276325    2583 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/21b7f659-cd20-40ef-826c-642e630c3ad7-istio-podinfo\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\""
Sep 09 16:43:51.276333 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:43:51.276337    2583 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/21b7f659-cd20-40ef-826c-642e630c3ad7-istio-envoy\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\""
Sep 09 16:43:51.276570 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:43:51.276347    2583 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/21b7f659-cd20-40ef-826c-642e630c3ad7-istio-token\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\""
Sep 09 16:43:51.276570 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:43:51.276358    2583 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/21b7f659-cd20-40ef-826c-642e630c3ad7-istiod-ca-cert\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\""
Sep 09 16:43:51.879178 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:43:51.879146    2583 generic.go:356] "Generic (PLEG): container finished" podID="21b7f659-cd20-40ef-826c-642e630c3ad7" containerID="fb625abcd9a522e90393ed50e1a5bc14c54b08d87822961aa77702648d5185a6" exitCode=0
Sep 09 16:43:51.879602 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:43:51.879210    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-14e637-openshift-default-59c6558bfb-6trn7"
Sep 09 16:43:51.879602 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:43:51.879232    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-14e637-openshift-default-59c6558bfb-6trn7" event={"ID":"21b7f659-cd20-40ef-826c-642e630c3ad7","Type":"ContainerDied","Data":"fb625abcd9a522e90393ed50e1a5bc14c54b08d87822961aa77702648d5185a6"}
Sep 09 16:43:51.879602 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:43:51.879292    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-14e637-openshift-default-59c6558bfb-6trn7" event={"ID":"21b7f659-cd20-40ef-826c-642e630c3ad7","Type":"ContainerDied","Data":"2fdc954107d6d2436fa7b88ae2741f0dac86b82e6ebe4bb193fe0c2f9f915cda"}
Sep 09 16:43:51.879602 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:43:51.879319    2583 scope.go:117] "RemoveContainer" containerID="fb625abcd9a522e90393ed50e1a5bc14c54b08d87822961aa77702648d5185a6"
Sep 09 16:43:51.889505 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:43:51.889487    2583 scope.go:117] "RemoveContainer" containerID="afb17f8bfb71eee5d7767adf525b0643ce91903d74cea40eb269556035d61874"
Sep 09 16:43:51.899033 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:43:51.899009    2583 scope.go:117] "RemoveContainer" containerID="fb625abcd9a522e90393ed50e1a5bc14c54b08d87822961aa77702648d5185a6"
Sep 09 16:43:51.899337 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:43:51.899318    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fb625abcd9a522e90393ed50e1a5bc14c54b08d87822961aa77702648d5185a6\": container with ID starting with fb625abcd9a522e90393ed50e1a5bc14c54b08d87822961aa77702648d5185a6 not found: ID does not exist" containerID="fb625abcd9a522e90393ed50e1a5bc14c54b08d87822961aa77702648d5185a6"
Sep 09 16:43:51.899417 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:43:51.899346    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fb625abcd9a522e90393ed50e1a5bc14c54b08d87822961aa77702648d5185a6"} err="failed to get container status \"fb625abcd9a522e90393ed50e1a5bc14c54b08d87822961aa77702648d5185a6\": rpc error: code = NotFound desc = could not find container \"fb625abcd9a522e90393ed50e1a5bc14c54b08d87822961aa77702648d5185a6\": container with ID starting with fb625abcd9a522e90393ed50e1a5bc14c54b08d87822961aa77702648d5185a6 not found: ID does not exist"
Sep 09 16:43:51.899417 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:43:51.899365    2583 scope.go:117] "RemoveContainer" containerID="afb17f8bfb71eee5d7767adf525b0643ce91903d74cea40eb269556035d61874"
Sep 09 16:43:51.899602 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:43:51.899587    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"afb17f8bfb71eee5d7767adf525b0643ce91903d74cea40eb269556035d61874\": container with ID starting with afb17f8bfb71eee5d7767adf525b0643ce91903d74cea40eb269556035d61874 not found: ID does not exist" containerID="afb17f8bfb71eee5d7767adf525b0643ce91903d74cea40eb269556035d61874"
Sep 09 16:43:51.899659 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:43:51.899605    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"afb17f8bfb71eee5d7767adf525b0643ce91903d74cea40eb269556035d61874"} err="failed to get container status \"afb17f8bfb71eee5d7767adf525b0643ce91903d74cea40eb269556035d61874\": rpc error: code = NotFound desc = could not find container \"afb17f8bfb71eee5d7767adf525b0643ce91903d74cea40eb269556035d61874\": container with ID starting with afb17f8bfb71eee5d7767adf525b0643ce91903d74cea40eb269556035d61874 not found: ID does not exist"
Sep 09 16:43:51.900716 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:43:51.900588    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-14e637-openshift-default-59c6558bfb-6trn7"]
Sep 09 16:43:51.903237 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:43:51.903209    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-14e637-openshift-default-59c6558bfb-6trn7"]
Sep 09 16:43:52.238908 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:43:52.238820    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="21b7f659-cd20-40ef-826c-642e630c3ad7" path="/var/lib/kubelet/pods/21b7f659-cd20-40ef-826c-642e630c3ad7/volumes"
Sep 09 16:44:01.656743 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:01.656707    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:44:01.725210 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:01.725181    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:44:01.821734 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:01.821699    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-8cb67b-v7xlr"]
Sep 09 16:44:01.824283 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:01.824259    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:44:01.826274 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:01.826251    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-8cb67b-v7xlr"]
Sep 09 16:44:02.035802 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:02.035709    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:44:02.239215 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:02.239173    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2ff13a0c-27a1-43ec-aac3-8437b304c777" path="/var/lib/kubelet/pods/2ff13a0c-27a1-43ec-aac3-8437b304c777/volumes"
Sep 09 16:44:02.309122 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:02.309024    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:44:02.364453 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:02.364419    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:44:02.875787 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:02.875747    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:44:03.747606 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:03.747573    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:44:04.268827 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:04.268793    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:44:04.958940 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:04.958912    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:44:08.439950 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:08.439914    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:44:08.498699 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:08.498660    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:44:08.687596 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:08.687554    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-8cb67b-openshift-default-664d664b98-6w2dh"]
Sep 09 16:44:08.687850 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:08.687822    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-8cb67b-openshift-default-664d664b98-6w2dh" podUID="97a2267d-2373-475c-8575-acbdb85e1492" containerName="istio-proxy" containerID="cri-o://26d59ba1813b4131a153dab9d5ac9acea1193c2d1f9df10efd199196e6bfe799" gracePeriod=30
Sep 09 16:44:08.779075 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:08.778922    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:44:09.064718 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:09.064631    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-2bdf45-bg456"]
Sep 09 16:44:09.065149 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:09.065132    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="21b7f659-cd20-40ef-826c-642e630c3ad7" containerName="istio-proxy"
Sep 09 16:44:09.065198 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:09.065151    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="21b7f659-cd20-40ef-826c-642e630c3ad7" containerName="istio-proxy"
Sep 09 16:44:09.065198 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:09.065172    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2ff13a0c-27a1-43ec-aac3-8437b304c777" containerName="revoke-keys"
Sep 09 16:44:09.065198 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:09.065178    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="2ff13a0c-27a1-43ec-aac3-8437b304c777" containerName="revoke-keys"
Sep 09 16:44:09.065294 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:09.065250    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="21b7f659-cd20-40ef-826c-642e630c3ad7" containerName="istio-proxy"
Sep 09 16:44:09.065294 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:09.065260    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="2ff13a0c-27a1-43ec-aac3-8437b304c777" containerName="revoke-keys"
Sep 09 16:44:09.072289 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:09.072251    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-2bdf45-bg456"
Sep 09 16:44:09.077052 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:09.077020    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jz5ff\""
Sep 09 16:44:09.080124 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:09.080097    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-2bdf45-bg456"]
Sep 09 16:44:09.155233 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:09.155191    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0c27e14a-a0ce-4ec3-97ca-8e5d8e297b46-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w2-2bdf45-bg456\" (UID: \"0c27e14a-a0ce-4ec3-97ca-8e5d8e297b46\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-2bdf45-bg456"
Sep 09 16:44:09.256849 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:09.256815    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0c27e14a-a0ce-4ec3-97ca-8e5d8e297b46-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w2-2bdf45-bg456\" (UID: \"0c27e14a-a0ce-4ec3-97ca-8e5d8e297b46\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-2bdf45-bg456"
Sep 09 16:44:09.257445 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:09.257423    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0c27e14a-a0ce-4ec3-97ca-8e5d8e297b46-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w2-2bdf45-bg456\" (UID: \"0c27e14a-a0ce-4ec3-97ca-8e5d8e297b46\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-2bdf45-bg456"
Sep 09 16:44:09.386803 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:09.386761    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-2bdf45-bg456"
Sep 09 16:44:09.658557 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:09.658529    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-2bdf45-bg456"]
Sep 09 16:44:09.660344 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:44:09.660323    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c27e14a_a0ce_4ec3_97ca_8e5d8e297b46.slice/crio-264776449b4166a966965bb2117ffefa6158f5d84ed4820d3448a152fb0ce572 WatchSource:0}: Error finding container 264776449b4166a966965bb2117ffefa6158f5d84ed4820d3448a152fb0ce572: Status 404 returned error can't find the container with id 264776449b4166a966965bb2117ffefa6158f5d84ed4820d3448a152fb0ce572
Sep 09 16:44:09.901449 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:09.901420    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:44:09.990055 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:09.989962    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-2bdf45-bg456" event={"ID":"0c27e14a-a0ce-4ec3-97ca-8e5d8e297b46","Type":"ContainerStarted","Data":"264776449b4166a966965bb2117ffefa6158f5d84ed4820d3448a152fb0ce572"}
Sep 09 16:44:10.483287 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:10.483256    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:44:10.997584 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:10.997550    2583 generic.go:356] "Generic (PLEG): container finished" podID="0c27e14a-a0ce-4ec3-97ca-8e5d8e297b46" containerID="a42214cc49f4ae80a528008377be16a0c6cd642417001b5a382fe7daf3e9a83d" exitCode=0
Sep 09 16:44:10.997961 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:10.997610    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-2bdf45-bg456" event={"ID":"0c27e14a-a0ce-4ec3-97ca-8e5d8e297b46","Type":"ContainerDied","Data":"a42214cc49f4ae80a528008377be16a0c6cd642417001b5a382fe7daf3e9a83d"}
Sep 09 16:44:11.147249 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:11.147221    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:44:11.765422 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:11.765387    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:44:12.149696 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:12.149673    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-2bdf45-bg456"
Sep 09 16:44:12.291010 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:12.290965    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0c27e14a-a0ce-4ec3-97ca-8e5d8e297b46-maas-api-service-ca\") pod \"0c27e14a-a0ce-4ec3-97ca-8e5d8e297b46\" (UID: \"0c27e14a-a0ce-4ec3-97ca-8e5d8e297b46\") "
Sep 09 16:44:12.291421 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:12.291385    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0c27e14a-a0ce-4ec3-97ca-8e5d8e297b46-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "0c27e14a-a0ce-4ec3-97ca-8e5d8e297b46" (UID: "0c27e14a-a0ce-4ec3-97ca-8e5d8e297b46"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 16:44:12.392912 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:12.392875    2583 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0c27e14a-a0ce-4ec3-97ca-8e5d8e297b46-maas-api-service-ca\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\""
Sep 09 16:44:12.469964 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:12.469924    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:44:13.009483 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:13.009449    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-2bdf45-bg456" event={"ID":"0c27e14a-a0ce-4ec3-97ca-8e5d8e297b46","Type":"ContainerDied","Data":"264776449b4166a966965bb2117ffefa6158f5d84ed4820d3448a152fb0ce572"}
Sep 09 16:44:13.009670 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:13.009498    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="264776449b4166a966965bb2117ffefa6158f5d84ed4820d3448a152fb0ce572"
Sep 09 16:44:13.009670 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:13.009460    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-2bdf45-bg456"
Sep 09 16:44:13.958084 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:13.958030    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-8cb67b-openshift-default-664d664b98-6w2dh"
Sep 09 16:44:14.016045 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:14.016004    2583 generic.go:356] "Generic (PLEG): container finished" podID="97a2267d-2373-475c-8575-acbdb85e1492" containerID="26d59ba1813b4131a153dab9d5ac9acea1193c2d1f9df10efd199196e6bfe799" exitCode=0
Sep 09 16:44:14.016182 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:14.016054    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-8cb67b-openshift-default-664d664b98-6w2dh"
Sep 09 16:44:14.016182 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:14.016109    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-8cb67b-openshift-default-664d664b98-6w2dh" event={"ID":"97a2267d-2373-475c-8575-acbdb85e1492","Type":"ContainerDied","Data":"26d59ba1813b4131a153dab9d5ac9acea1193c2d1f9df10efd199196e6bfe799"}
Sep 09 16:44:14.016182 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:14.016155    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-8cb67b-openshift-default-664d664b98-6w2dh" event={"ID":"97a2267d-2373-475c-8575-acbdb85e1492","Type":"ContainerDied","Data":"ff132d59b03a587ba4fd44acb4053143e240eb7a3c01828e7698373b29206e62"}
Sep 09 16:44:14.016305 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:14.016185    2583 scope.go:117] "RemoveContainer" containerID="26d59ba1813b4131a153dab9d5ac9acea1193c2d1f9df10efd199196e6bfe799"
Sep 09 16:44:14.024936 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:14.024918    2583 scope.go:117] "RemoveContainer" containerID="ba9828ce607c8ca5ff6e32f1acce66ec54629a9a9da37ac23e3ee288f82c634a"
Sep 09 16:44:14.032842 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:14.032823    2583 scope.go:117] "RemoveContainer" containerID="26d59ba1813b4131a153dab9d5ac9acea1193c2d1f9df10efd199196e6bfe799"
Sep 09 16:44:14.033203 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:44:14.033184    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"26d59ba1813b4131a153dab9d5ac9acea1193c2d1f9df10efd199196e6bfe799\": container with ID starting with 26d59ba1813b4131a153dab9d5ac9acea1193c2d1f9df10efd199196e6bfe799 not found: ID does not exist" containerID="26d59ba1813b4131a153dab9d5ac9acea1193c2d1f9df10efd199196e6bfe799"
Sep 09 16:44:14.033276 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:14.033221    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"26d59ba1813b4131a153dab9d5ac9acea1193c2d1f9df10efd199196e6bfe799"} err="failed to get container status \"26d59ba1813b4131a153dab9d5ac9acea1193c2d1f9df10efd199196e6bfe799\": rpc error: code = NotFound desc = could not find container \"26d59ba1813b4131a153dab9d5ac9acea1193c2d1f9df10efd199196e6bfe799\": container with ID starting with 26d59ba1813b4131a153dab9d5ac9acea1193c2d1f9df10efd199196e6bfe799 not found: ID does not exist"
Sep 09 16:44:14.033276 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:14.033239    2583 scope.go:117] "RemoveContainer" containerID="ba9828ce607c8ca5ff6e32f1acce66ec54629a9a9da37ac23e3ee288f82c634a"
Sep 09 16:44:14.033488 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:44:14.033467    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ba9828ce607c8ca5ff6e32f1acce66ec54629a9a9da37ac23e3ee288f82c634a\": container with ID starting with ba9828ce607c8ca5ff6e32f1acce66ec54629a9a9da37ac23e3ee288f82c634a not found: ID does not exist" containerID="ba9828ce607c8ca5ff6e32f1acce66ec54629a9a9da37ac23e3ee288f82c634a"
Sep 09 16:44:14.033544 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:14.033498    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba9828ce607c8ca5ff6e32f1acce66ec54629a9a9da37ac23e3ee288f82c634a"} err="failed to get container status \"ba9828ce607c8ca5ff6e32f1acce66ec54629a9a9da37ac23e3ee288f82c634a\": rpc error: code = NotFound desc = could not find container \"ba9828ce607c8ca5ff6e32f1acce66ec54629a9a9da37ac23e3ee288f82c634a\": container with ID starting with ba9828ce607c8ca5ff6e32f1acce66ec54629a9a9da37ac23e3ee288f82c634a not found: ID does not exist"
Sep 09 16:44:14.109642 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:14.109613    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/97a2267d-2373-475c-8575-acbdb85e1492-istio-podinfo\") pod \"97a2267d-2373-475c-8575-acbdb85e1492\" (UID: \"97a2267d-2373-475c-8575-acbdb85e1492\") "
Sep 09 16:44:14.109642 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:14.109649    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/97a2267d-2373-475c-8575-acbdb85e1492-istio-envoy\") pod \"97a2267d-2373-475c-8575-acbdb85e1492\" (UID: \"97a2267d-2373-475c-8575-acbdb85e1492\") "
Sep 09 16:44:14.109831 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:14.109694    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/97a2267d-2373-475c-8575-acbdb85e1492-istio-data\") pod \"97a2267d-2373-475c-8575-acbdb85e1492\" (UID: \"97a2267d-2373-475c-8575-acbdb85e1492\") "
Sep 09 16:44:14.109831 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:14.109709    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/97a2267d-2373-475c-8575-acbdb85e1492-istiod-ca-cert\") pod \"97a2267d-2373-475c-8575-acbdb85e1492\" (UID: \"97a2267d-2373-475c-8575-acbdb85e1492\") "
Sep 09 16:44:14.109831 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:14.109743    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/97a2267d-2373-475c-8575-acbdb85e1492-istio-token\") pod \"97a2267d-2373-475c-8575-acbdb85e1492\" (UID: \"97a2267d-2373-475c-8575-acbdb85e1492\") "
Sep 09 16:44:14.109831 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:14.109757    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/97a2267d-2373-475c-8575-acbdb85e1492-workload-certs\") pod \"97a2267d-2373-475c-8575-acbdb85e1492\" (UID: \"97a2267d-2373-475c-8575-acbdb85e1492\") "
Sep 09 16:44:14.109831 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:14.109794    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/97a2267d-2373-475c-8575-acbdb85e1492-credential-socket\") pod \"97a2267d-2373-475c-8575-acbdb85e1492\" (UID: \"97a2267d-2373-475c-8575-acbdb85e1492\") "
Sep 09 16:44:14.109831 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:14.109820    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mc5lr\" (UniqueName: \"kubernetes.io/projected/97a2267d-2373-475c-8575-acbdb85e1492-kube-api-access-mc5lr\") pod \"97a2267d-2373-475c-8575-acbdb85e1492\" (UID: \"97a2267d-2373-475c-8575-acbdb85e1492\") "
Sep 09 16:44:14.110139 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:14.109859    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/97a2267d-2373-475c-8575-acbdb85e1492-workload-socket\") pod \"97a2267d-2373-475c-8575-acbdb85e1492\" (UID: \"97a2267d-2373-475c-8575-acbdb85e1492\") "
Sep 09 16:44:14.110297 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:14.110268    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/97a2267d-2373-475c-8575-acbdb85e1492-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "97a2267d-2373-475c-8575-acbdb85e1492" (UID: "97a2267d-2373-475c-8575-acbdb85e1492"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 16:44:14.110397 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:14.110287    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/97a2267d-2373-475c-8575-acbdb85e1492-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "97a2267d-2373-475c-8575-acbdb85e1492" (UID: "97a2267d-2373-475c-8575-acbdb85e1492"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 16:44:14.110397 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:14.110309    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/97a2267d-2373-475c-8575-acbdb85e1492-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "97a2267d-2373-475c-8575-acbdb85e1492" (UID: "97a2267d-2373-475c-8575-acbdb85e1492"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 16:44:14.110397 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:14.110369    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/97a2267d-2373-475c-8575-acbdb85e1492-istio-data" (OuterVolumeSpecName: "istio-data") pod "97a2267d-2373-475c-8575-acbdb85e1492" (UID: "97a2267d-2373-475c-8575-acbdb85e1492"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 16:44:14.110566 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:14.110407    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/97a2267d-2373-475c-8575-acbdb85e1492-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "97a2267d-2373-475c-8575-acbdb85e1492" (UID: "97a2267d-2373-475c-8575-acbdb85e1492"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 16:44:14.111874 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:14.111839    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/97a2267d-2373-475c-8575-acbdb85e1492-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "97a2267d-2373-475c-8575-acbdb85e1492" (UID: "97a2267d-2373-475c-8575-acbdb85e1492"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 16:44:14.112252 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:14.112229    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/97a2267d-2373-475c-8575-acbdb85e1492-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "97a2267d-2373-475c-8575-acbdb85e1492" (UID: "97a2267d-2373-475c-8575-acbdb85e1492"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 09 16:44:14.112346 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:14.112227    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/97a2267d-2373-475c-8575-acbdb85e1492-kube-api-access-mc5lr" (OuterVolumeSpecName: "kube-api-access-mc5lr") pod "97a2267d-2373-475c-8575-acbdb85e1492" (UID: "97a2267d-2373-475c-8575-acbdb85e1492"). InnerVolumeSpecName "kube-api-access-mc5lr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 16:44:14.112346 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:14.112272    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/97a2267d-2373-475c-8575-acbdb85e1492-istio-token" (OuterVolumeSpecName: "istio-token") pod "97a2267d-2373-475c-8575-acbdb85e1492" (UID: "97a2267d-2373-475c-8575-acbdb85e1492"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 16:44:14.210938 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:14.210869    2583 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/97a2267d-2373-475c-8575-acbdb85e1492-istio-podinfo\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\""
Sep 09 16:44:14.210938 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:14.210895    2583 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/97a2267d-2373-475c-8575-acbdb85e1492-istio-envoy\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\""
Sep 09 16:44:14.210938 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:14.210904    2583 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/97a2267d-2373-475c-8575-acbdb85e1492-istio-data\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\""
Sep 09 16:44:14.210938 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:14.210911    2583 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/97a2267d-2373-475c-8575-acbdb85e1492-istiod-ca-cert\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\""
Sep 09 16:44:14.210938 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:14.210919    2583 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/97a2267d-2373-475c-8575-acbdb85e1492-istio-token\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\""
Sep 09 16:44:14.210938 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:14.210926    2583 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/97a2267d-2373-475c-8575-acbdb85e1492-workload-certs\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\""
Sep 09 16:44:14.210938 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:14.210934    2583 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/97a2267d-2373-475c-8575-acbdb85e1492-credential-socket\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\""
Sep 09 16:44:14.210938 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:14.210943    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mc5lr\" (UniqueName: \"kubernetes.io/projected/97a2267d-2373-475c-8575-acbdb85e1492-kube-api-access-mc5lr\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\""
Sep 09 16:44:14.211304 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:14.210951    2583 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/97a2267d-2373-475c-8575-acbdb85e1492-workload-socket\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\""
Sep 09 16:44:14.331353 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:14.331325    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-8cb67b-openshift-default-664d664b98-6w2dh"]
Sep 09 16:44:14.335072 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:14.335047    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-8cb67b-openshift-default-664d664b98-6w2dh"]
Sep 09 16:44:16.242413 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:16.242367    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="97a2267d-2373-475c-8575-acbdb85e1492" path="/var/lib/kubelet/pods/97a2267d-2373-475c-8575-acbdb85e1492/volumes"
Sep 09 16:44:19.514979 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:19.514948    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:44:19.583557 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:19.583521    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:44:19.685726 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:19.685689    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:44:19.710812 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:19.710772    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-2bdf45-bg456"]
Sep 09 16:44:19.718016 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:19.717974    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-2bdf45-bg456"]
Sep 09 16:44:19.815689 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:19.815607    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:44:20.073592 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:20.073556    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:44:20.239087 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:20.239054    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0c27e14a-a0ce-4ec3-97ca-8e5d8e297b46" path="/var/lib/kubelet/pods/0c27e14a-a0ce-4ec3-97ca-8e5d8e297b46/volumes"
Sep 09 16:44:21.924326 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:21.924289    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:44:26.399234 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:26.399197    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-1d59dd-4f4dv"]
Sep 09 16:44:26.399632 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:26.399618    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="97a2267d-2373-475c-8575-acbdb85e1492" containerName="istio-proxy"
Sep 09 16:44:26.399675 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:26.399633    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="97a2267d-2373-475c-8575-acbdb85e1492" containerName="istio-proxy"
Sep 09 16:44:26.399675 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:26.399642    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c27e14a-a0ce-4ec3-97ca-8e5d8e297b46" containerName="revoke-keys"
Sep 09 16:44:26.399675 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:26.399648    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c27e14a-a0ce-4ec3-97ca-8e5d8e297b46" containerName="revoke-keys"
Sep 09 16:44:26.399675 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:26.399659    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="21b7f659-cd20-40ef-826c-642e630c3ad7" containerName="istio-proxy"
Sep 09 16:44:26.399675 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:26.399664    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="21b7f659-cd20-40ef-826c-642e630c3ad7" containerName="istio-proxy"
Sep 09 16:44:26.399675 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:26.399672    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="97a2267d-2373-475c-8575-acbdb85e1492" containerName="istio-proxy"
Sep 09 16:44:26.399857 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:26.399678    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="97a2267d-2373-475c-8575-acbdb85e1492" containerName="istio-proxy"
Sep 09 16:44:26.399857 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:26.399749    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="97a2267d-2373-475c-8575-acbdb85e1492" containerName="istio-proxy"
Sep 09 16:44:26.399857 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:26.399758    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="97a2267d-2373-475c-8575-acbdb85e1492" containerName="istio-proxy"
Sep 09 16:44:26.399857 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:26.399764    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="21b7f659-cd20-40ef-826c-642e630c3ad7" containerName="istio-proxy"
Sep 09 16:44:26.399857 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:26.399771    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="0c27e14a-a0ce-4ec3-97ca-8e5d8e297b46" containerName="revoke-keys"
Sep 09 16:44:26.403217 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:26.403196    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-1d59dd-4f4dv"
Sep 09 16:44:26.405677 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:26.405655    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jz5ff\""
Sep 09 16:44:26.410022 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:26.409996    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-1d59dd-4f4dv"]
Sep 09 16:44:26.530550 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:26.530509    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e9a73966-0511-4036-aeda-38c8a87eadb5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-1d59dd-4f4dv\" (UID: \"e9a73966-0511-4036-aeda-38c8a87eadb5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-1d59dd-4f4dv"
Sep 09 16:44:26.631710 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:26.631657    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e9a73966-0511-4036-aeda-38c8a87eadb5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-1d59dd-4f4dv\" (UID: \"e9a73966-0511-4036-aeda-38c8a87eadb5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-1d59dd-4f4dv"
Sep 09 16:44:26.632332 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:26.632311    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e9a73966-0511-4036-aeda-38c8a87eadb5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-1d59dd-4f4dv\" (UID: \"e9a73966-0511-4036-aeda-38c8a87eadb5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-1d59dd-4f4dv"
Sep 09 16:44:26.714673 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:26.714587    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-1d59dd-4f4dv"
Sep 09 16:44:26.988703 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:26.988572    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-1d59dd-4f4dv"]
Sep 09 16:44:26.991130 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:44:26.991102    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9a73966_0511_4036_aeda_38c8a87eadb5.slice/crio-d64806146734bf32a93b800290a08424acca6428ea300fea4800747a15a33b26 WatchSource:0}: Error finding container d64806146734bf32a93b800290a08424acca6428ea300fea4800747a15a33b26: Status 404 returned error can't find the container with id d64806146734bf32a93b800290a08424acca6428ea300fea4800747a15a33b26
Sep 09 16:44:27.090751 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:27.090715    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-1d59dd-4f4dv" event={"ID":"e9a73966-0511-4036-aeda-38c8a87eadb5","Type":"ContainerStarted","Data":"d64806146734bf32a93b800290a08424acca6428ea300fea4800747a15a33b26"}
Sep 09 16:44:27.265875 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:27.265787    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:44:27.468262 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:27.468229    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:44:28.098689 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:28.098647    2583 generic.go:356] "Generic (PLEG): container finished" podID="e9a73966-0511-4036-aeda-38c8a87eadb5" containerID="06c9bef15813646c13867f285d1e06ee07149269dc0579ab0984a70b490020f8" exitCode=0
Sep 09 16:44:28.099146 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:28.098708    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-1d59dd-4f4dv" event={"ID":"e9a73966-0511-4036-aeda-38c8a87eadb5","Type":"ContainerDied","Data":"06c9bef15813646c13867f285d1e06ee07149269dc0579ab0984a70b490020f8"}
Sep 09 16:44:28.167670 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:28.167621    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:44:28.861441 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:28.861401    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:44:29.247880 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:29.247855    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-1d59dd-4f4dv"
Sep 09 16:44:29.359506 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:29.359472    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e9a73966-0511-4036-aeda-38c8a87eadb5-maas-api-service-ca\") pod \"e9a73966-0511-4036-aeda-38c8a87eadb5\" (UID: \"e9a73966-0511-4036-aeda-38c8a87eadb5\") "
Sep 09 16:44:29.359904 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:29.359878    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e9a73966-0511-4036-aeda-38c8a87eadb5-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "e9a73966-0511-4036-aeda-38c8a87eadb5" (UID: "e9a73966-0511-4036-aeda-38c8a87eadb5"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 16:44:29.460641 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:29.460545    2583 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e9a73966-0511-4036-aeda-38c8a87eadb5-maas-api-service-ca\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\""
Sep 09 16:44:29.461532 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:29.461505    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:44:30.111210 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:30.111181    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-1d59dd-4f4dv"
Sep 09 16:44:30.111584 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:30.111181    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-1d59dd-4f4dv" event={"ID":"e9a73966-0511-4036-aeda-38c8a87eadb5","Type":"ContainerDied","Data":"d64806146734bf32a93b800290a08424acca6428ea300fea4800747a15a33b26"}
Sep 09 16:44:30.111584 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:30.111303    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d64806146734bf32a93b800290a08424acca6428ea300fea4800747a15a33b26"
Sep 09 16:44:33.754138 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:33.754103    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:44:34.794972 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:34.794937    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:44:35.251133 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:35.251085    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:44:35.547005 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:35.546894    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-a-61f0f9-openshift-default-5f457d8ff8-9kgt8"]
Sep 09 16:44:35.547591 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:35.547567    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e9a73966-0511-4036-aeda-38c8a87eadb5" containerName="revoke-keys"
Sep 09 16:44:35.547591 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:35.547589    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="e9a73966-0511-4036-aeda-38c8a87eadb5" containerName="revoke-keys"
Sep 09 16:44:35.547784 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:35.547708    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="e9a73966-0511-4036-aeda-38c8a87eadb5" containerName="revoke-keys"
Sep 09 16:44:35.551263 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:35.551245    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-61f0f9-openshift-default-5f457d8ff8-9kgt8"
Sep 09 16:44:35.553850 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:35.553825    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-a-61f0f9-openshift-default-dockercfg-x665z\""
Sep 09 16:44:35.563863 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:35.563836    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-61f0f9-openshift-default-5f457d8ff8-9kgt8"]
Sep 09 16:44:35.568707 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:35.568684    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:44:35.620946 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:35.620900    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b4e002dd-530b-4cf1-bd4c-7705b3ca33ad-istiod-ca-cert\") pod \"e2e-ipp-a-61f0f9-openshift-default-5f457d8ff8-9kgt8\" (UID: \"b4e002dd-530b-4cf1-bd4c-7705b3ca33ad\") " pod="openshift-ingress/e2e-ipp-a-61f0f9-openshift-default-5f457d8ff8-9kgt8"
Sep 09 16:44:35.621148 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:35.621022    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b4e002dd-530b-4cf1-bd4c-7705b3ca33ad-istio-podinfo\") pod \"e2e-ipp-a-61f0f9-openshift-default-5f457d8ff8-9kgt8\" (UID: \"b4e002dd-530b-4cf1-bd4c-7705b3ca33ad\") " pod="openshift-ingress/e2e-ipp-a-61f0f9-openshift-default-5f457d8ff8-9kgt8"
Sep 09 16:44:35.621148 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:35.621095    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b4e002dd-530b-4cf1-bd4c-7705b3ca33ad-istio-token\") pod \"e2e-ipp-a-61f0f9-openshift-default-5f457d8ff8-9kgt8\" (UID: \"b4e002dd-530b-4cf1-bd4c-7705b3ca33ad\") " pod="openshift-ingress/e2e-ipp-a-61f0f9-openshift-default-5f457d8ff8-9kgt8"
Sep 09 16:44:35.621275 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:35.621180    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b4e002dd-530b-4cf1-bd4c-7705b3ca33ad-istio-data\") pod \"e2e-ipp-a-61f0f9-openshift-default-5f457d8ff8-9kgt8\" (UID: \"b4e002dd-530b-4cf1-bd4c-7705b3ca33ad\") " pod="openshift-ingress/e2e-ipp-a-61f0f9-openshift-default-5f457d8ff8-9kgt8"
Sep 09 16:44:35.621275 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:35.621254    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b4e002dd-530b-4cf1-bd4c-7705b3ca33ad-workload-certs\") pod \"e2e-ipp-a-61f0f9-openshift-default-5f457d8ff8-9kgt8\" (UID: \"b4e002dd-530b-4cf1-bd4c-7705b3ca33ad\") " pod="openshift-ingress/e2e-ipp-a-61f0f9-openshift-default-5f457d8ff8-9kgt8"
Sep 09 16:44:35.621379 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:35.621278    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hzqlp\" (UniqueName: \"kubernetes.io/projected/b4e002dd-530b-4cf1-bd4c-7705b3ca33ad-kube-api-access-hzqlp\") pod \"e2e-ipp-a-61f0f9-openshift-default-5f457d8ff8-9kgt8\" (UID: \"b4e002dd-530b-4cf1-bd4c-7705b3ca33ad\") " pod="openshift-ingress/e2e-ipp-a-61f0f9-openshift-default-5f457d8ff8-9kgt8"
Sep 09 16:44:35.621379 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:35.621297    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b4e002dd-530b-4cf1-bd4c-7705b3ca33ad-workload-socket\") pod \"e2e-ipp-a-61f0f9-openshift-default-5f457d8ff8-9kgt8\" (UID: \"b4e002dd-530b-4cf1-bd4c-7705b3ca33ad\") " pod="openshift-ingress/e2e-ipp-a-61f0f9-openshift-default-5f457d8ff8-9kgt8"
Sep 09 16:44:35.621502 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:35.621390    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b4e002dd-530b-4cf1-bd4c-7705b3ca33ad-credential-socket\") pod \"e2e-ipp-a-61f0f9-openshift-default-5f457d8ff8-9kgt8\" (UID: \"b4e002dd-530b-4cf1-bd4c-7705b3ca33ad\") " pod="openshift-ingress/e2e-ipp-a-61f0f9-openshift-default-5f457d8ff8-9kgt8"
Sep 09 16:44:35.621502 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:35.621458    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b4e002dd-530b-4cf1-bd4c-7705b3ca33ad-istio-envoy\") pod \"e2e-ipp-a-61f0f9-openshift-default-5f457d8ff8-9kgt8\" (UID: \"b4e002dd-530b-4cf1-bd4c-7705b3ca33ad\") " pod="openshift-ingress/e2e-ipp-a-61f0f9-openshift-default-5f457d8ff8-9kgt8"
Sep 09 16:44:35.723002 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:35.722945    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b4e002dd-530b-4cf1-bd4c-7705b3ca33ad-credential-socket\") pod \"e2e-ipp-a-61f0f9-openshift-default-5f457d8ff8-9kgt8\" (UID: \"b4e002dd-530b-4cf1-bd4c-7705b3ca33ad\") " pod="openshift-ingress/e2e-ipp-a-61f0f9-openshift-default-5f457d8ff8-9kgt8"
Sep 09 16:44:35.723233 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:35.723100    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b4e002dd-530b-4cf1-bd4c-7705b3ca33ad-istio-envoy\") pod \"e2e-ipp-a-61f0f9-openshift-default-5f457d8ff8-9kgt8\" (UID: \"b4e002dd-530b-4cf1-bd4c-7705b3ca33ad\") " pod="openshift-ingress/e2e-ipp-a-61f0f9-openshift-default-5f457d8ff8-9kgt8"
Sep 09 16:44:35.723233 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:35.723120    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b4e002dd-530b-4cf1-bd4c-7705b3ca33ad-istiod-ca-cert\") pod \"e2e-ipp-a-61f0f9-openshift-default-5f457d8ff8-9kgt8\" (UID: \"b4e002dd-530b-4cf1-bd4c-7705b3ca33ad\") " pod="openshift-ingress/e2e-ipp-a-61f0f9-openshift-default-5f457d8ff8-9kgt8"
Sep 09 16:44:35.723233 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:35.723151    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b4e002dd-530b-4cf1-bd4c-7705b3ca33ad-istio-podinfo\") pod \"e2e-ipp-a-61f0f9-openshift-default-5f457d8ff8-9kgt8\" (UID: \"b4e002dd-530b-4cf1-bd4c-7705b3ca33ad\") " pod="openshift-ingress/e2e-ipp-a-61f0f9-openshift-default-5f457d8ff8-9kgt8"
Sep 09 16:44:35.723233 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:35.723191    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b4e002dd-530b-4cf1-bd4c-7705b3ca33ad-istio-token\") pod \"e2e-ipp-a-61f0f9-openshift-default-5f457d8ff8-9kgt8\" (UID: \"b4e002dd-530b-4cf1-bd4c-7705b3ca33ad\") " pod="openshift-ingress/e2e-ipp-a-61f0f9-openshift-default-5f457d8ff8-9kgt8"
Sep 09 16:44:35.723455 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:35.723258    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b4e002dd-530b-4cf1-bd4c-7705b3ca33ad-istio-data\") pod \"e2e-ipp-a-61f0f9-openshift-default-5f457d8ff8-9kgt8\" (UID: \"b4e002dd-530b-4cf1-bd4c-7705b3ca33ad\") " pod="openshift-ingress/e2e-ipp-a-61f0f9-openshift-default-5f457d8ff8-9kgt8"
Sep 09 16:44:35.723455 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:35.723410    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b4e002dd-530b-4cf1-bd4c-7705b3ca33ad-credential-socket\") pod \"e2e-ipp-a-61f0f9-openshift-default-5f457d8ff8-9kgt8\" (UID: \"b4e002dd-530b-4cf1-bd4c-7705b3ca33ad\") " pod="openshift-ingress/e2e-ipp-a-61f0f9-openshift-default-5f457d8ff8-9kgt8"
Sep 09 16:44:35.723566 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:35.723463    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b4e002dd-530b-4cf1-bd4c-7705b3ca33ad-workload-certs\") pod \"e2e-ipp-a-61f0f9-openshift-default-5f457d8ff8-9kgt8\" (UID: \"b4e002dd-530b-4cf1-bd4c-7705b3ca33ad\") " pod="openshift-ingress/e2e-ipp-a-61f0f9-openshift-default-5f457d8ff8-9kgt8"
Sep 09 16:44:35.723566 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:35.723490    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hzqlp\" (UniqueName: \"kubernetes.io/projected/b4e002dd-530b-4cf1-bd4c-7705b3ca33ad-kube-api-access-hzqlp\") pod \"e2e-ipp-a-61f0f9-openshift-default-5f457d8ff8-9kgt8\" (UID: \"b4e002dd-530b-4cf1-bd4c-7705b3ca33ad\") " pod="openshift-ingress/e2e-ipp-a-61f0f9-openshift-default-5f457d8ff8-9kgt8"
Sep 09 16:44:35.723566 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:35.723521    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b4e002dd-530b-4cf1-bd4c-7705b3ca33ad-workload-socket\") pod \"e2e-ipp-a-61f0f9-openshift-default-5f457d8ff8-9kgt8\" (UID: \"b4e002dd-530b-4cf1-bd4c-7705b3ca33ad\") " pod="openshift-ingress/e2e-ipp-a-61f0f9-openshift-default-5f457d8ff8-9kgt8"
Sep 09 16:44:35.723566 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:35.723551    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b4e002dd-530b-4cf1-bd4c-7705b3ca33ad-istio-data\") pod \"e2e-ipp-a-61f0f9-openshift-default-5f457d8ff8-9kgt8\" (UID: \"b4e002dd-530b-4cf1-bd4c-7705b3ca33ad\") " pod="openshift-ingress/e2e-ipp-a-61f0f9-openshift-default-5f457d8ff8-9kgt8"
Sep 09 16:44:35.724095 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:35.723867    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b4e002dd-530b-4cf1-bd4c-7705b3ca33ad-workload-certs\") pod \"e2e-ipp-a-61f0f9-openshift-default-5f457d8ff8-9kgt8\" (UID: \"b4e002dd-530b-4cf1-bd4c-7705b3ca33ad\") " pod="openshift-ingress/e2e-ipp-a-61f0f9-openshift-default-5f457d8ff8-9kgt8"
Sep 09 16:44:35.724095 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:35.723908    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b4e002dd-530b-4cf1-bd4c-7705b3ca33ad-workload-socket\") pod \"e2e-ipp-a-61f0f9-openshift-default-5f457d8ff8-9kgt8\" (UID: \"b4e002dd-530b-4cf1-bd4c-7705b3ca33ad\") " pod="openshift-ingress/e2e-ipp-a-61f0f9-openshift-default-5f457d8ff8-9kgt8"
Sep 09 16:44:35.724095 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:35.723910    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b4e002dd-530b-4cf1-bd4c-7705b3ca33ad-istiod-ca-cert\") pod \"e2e-ipp-a-61f0f9-openshift-default-5f457d8ff8-9kgt8\" (UID: \"b4e002dd-530b-4cf1-bd4c-7705b3ca33ad\") " pod="openshift-ingress/e2e-ipp-a-61f0f9-openshift-default-5f457d8ff8-9kgt8"
Sep 09 16:44:35.725534 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:35.725504    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b4e002dd-530b-4cf1-bd4c-7705b3ca33ad-istio-envoy\") pod \"e2e-ipp-a-61f0f9-openshift-default-5f457d8ff8-9kgt8\" (UID: \"b4e002dd-530b-4cf1-bd4c-7705b3ca33ad\") " pod="openshift-ingress/e2e-ipp-a-61f0f9-openshift-default-5f457d8ff8-9kgt8"
Sep 09 16:44:35.726166 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:35.726147    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b4e002dd-530b-4cf1-bd4c-7705b3ca33ad-istio-podinfo\") pod \"e2e-ipp-a-61f0f9-openshift-default-5f457d8ff8-9kgt8\" (UID: \"b4e002dd-530b-4cf1-bd4c-7705b3ca33ad\") " pod="openshift-ingress/e2e-ipp-a-61f0f9-openshift-default-5f457d8ff8-9kgt8"
Sep 09 16:44:35.731237 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:35.731215    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b4e002dd-530b-4cf1-bd4c-7705b3ca33ad-istio-token\") pod \"e2e-ipp-a-61f0f9-openshift-default-5f457d8ff8-9kgt8\" (UID: \"b4e002dd-530b-4cf1-bd4c-7705b3ca33ad\") " pod="openshift-ingress/e2e-ipp-a-61f0f9-openshift-default-5f457d8ff8-9kgt8"
Sep 09 16:44:35.731450 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:35.731431    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hzqlp\" (UniqueName: \"kubernetes.io/projected/b4e002dd-530b-4cf1-bd4c-7705b3ca33ad-kube-api-access-hzqlp\") pod \"e2e-ipp-a-61f0f9-openshift-default-5f457d8ff8-9kgt8\" (UID: \"b4e002dd-530b-4cf1-bd4c-7705b3ca33ad\") " pod="openshift-ingress/e2e-ipp-a-61f0f9-openshift-default-5f457d8ff8-9kgt8"
Sep 09 16:44:35.864189 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:35.864152    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-61f0f9-openshift-default-5f457d8ff8-9kgt8"
Sep 09 16:44:36.016136 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:36.016099    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:44:36.145405 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:36.145378    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-61f0f9-openshift-default-5f457d8ff8-9kgt8"]
Sep 09 16:44:36.147797 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:44:36.147764    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4e002dd_530b_4cf1_bd4c_7705b3ca33ad.slice/crio-e7f0aedcc5b3365ffc46f8bf51bfb4b68c7b57616800c5204fb9a38e9e8612fc WatchSource:0}: Error finding container e7f0aedcc5b3365ffc46f8bf51bfb4b68c7b57616800c5204fb9a38e9e8612fc: Status 404 returned error can't find the container with id e7f0aedcc5b3365ffc46f8bf51bfb4b68c7b57616800c5204fb9a38e9e8612fc
Sep 09 16:44:36.150092 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:36.150054    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 09 16:44:36.150185 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:36.150145    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 09 16:44:36.150254 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:36.150189    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 09 16:44:36.832540 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:36.832504    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:44:36.932970 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:36.932936    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:44:37.002526 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:37.002490    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-1d59dd-4f4dv"]
Sep 09 16:44:37.006039 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:37.006016    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-1d59dd-4f4dv"]
Sep 09 16:44:37.153507 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:37.153423    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-61f0f9-openshift-default-5f457d8ff8-9kgt8" event={"ID":"b4e002dd-530b-4cf1-bd4c-7705b3ca33ad","Type":"ContainerStarted","Data":"4c30f3df922ffc4e100603c87e0ca99e4b6b8e02c7b39d140ba0a2c28a3b559f"}
Sep 09 16:44:37.153507 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:37.153480    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-61f0f9-openshift-default-5f457d8ff8-9kgt8" event={"ID":"b4e002dd-530b-4cf1-bd4c-7705b3ca33ad","Type":"ContainerStarted","Data":"e7f0aedcc5b3365ffc46f8bf51bfb4b68c7b57616800c5204fb9a38e9e8612fc"}
Sep 09 16:44:37.172536 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:37.172480    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-a-61f0f9-openshift-default-5f457d8ff8-9kgt8" podStartSLOduration=2.172461978 podStartE2EDuration="2.172461978s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 16:44:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:44:37.171019907 +0000 UTC m=+1859.524749760" watchObservedRunningTime="2026-09-09 16:44:37.172461978 +0000 UTC m=+1859.526191808"
Sep 09 16:44:37.864524 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:37.864487    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-61f0f9-openshift-default-5f457d8ff8-9kgt8"
Sep 09 16:44:37.869959 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:37.869928    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-61f0f9-openshift-default-5f457d8ff8-9kgt8"
Sep 09 16:44:38.161020 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:38.160913    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-61f0f9-openshift-default-5f457d8ff8-9kgt8"
Sep 09 16:44:38.161934 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:38.161911    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-61f0f9-openshift-default-5f457d8ff8-9kgt8"
Sep 09 16:44:38.242413 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:38.242380    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e9a73966-0511-4036-aeda-38c8a87eadb5" path="/var/lib/kubelet/pods/e9a73966-0511-4036-aeda-38c8a87eadb5/volumes"
Sep 09 16:44:39.228272 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:39.228243    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:44:39.345580 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:39.345548    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:44:39.447072 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:39.447039    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:44:39.880238 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:39.880205    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:44:40.503218 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:40.503181    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:44:41.169966 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:41.169924    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:44:41.271236 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:41.271206    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:44:41.609334 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:41.609305    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:44:41.708160 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:41.708113    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:44:41.908096 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:41.907981    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:44:43.202917 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:43.202888    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:44:43.303754 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:43.303708    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:44:43.441169 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:43.441138    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-1d59dd-openshift-default-57db7596bb-mtq8j"]
Sep 09 16:44:43.441367 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:43.441343    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w2-1d59dd-openshift-default-57db7596bb-mtq8j" podUID="7c87f10c-d9c9-4d1d-b108-97ef7b62b9f4" containerName="istio-proxy" containerID="cri-o://58f267d1c3e955ce7ef200312e36d642f76287e1e081845926507da560154538" gracePeriod=30
Sep 09 16:44:43.460394 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:43.460307    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:44:48.740926 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:48.740900    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-1d59dd-openshift-default-57db7596bb-mtq8j"
Sep 09 16:44:48.857370 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:48.857338    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-57l8x\" (UniqueName: \"kubernetes.io/projected/7c87f10c-d9c9-4d1d-b108-97ef7b62b9f4-kube-api-access-57l8x\") pod \"7c87f10c-d9c9-4d1d-b108-97ef7b62b9f4\" (UID: \"7c87f10c-d9c9-4d1d-b108-97ef7b62b9f4\") "
Sep 09 16:44:48.857545 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:48.857378    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7c87f10c-d9c9-4d1d-b108-97ef7b62b9f4-istiod-ca-cert\") pod \"7c87f10c-d9c9-4d1d-b108-97ef7b62b9f4\" (UID: \"7c87f10c-d9c9-4d1d-b108-97ef7b62b9f4\") "
Sep 09 16:44:48.857545 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:48.857402    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7c87f10c-d9c9-4d1d-b108-97ef7b62b9f4-credential-socket\") pod \"7c87f10c-d9c9-4d1d-b108-97ef7b62b9f4\" (UID: \"7c87f10c-d9c9-4d1d-b108-97ef7b62b9f4\") "
Sep 09 16:44:48.857545 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:48.857422    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7c87f10c-d9c9-4d1d-b108-97ef7b62b9f4-workload-socket\") pod \"7c87f10c-d9c9-4d1d-b108-97ef7b62b9f4\" (UID: \"7c87f10c-d9c9-4d1d-b108-97ef7b62b9f4\") "
Sep 09 16:44:48.857712 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:48.857554    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7c87f10c-d9c9-4d1d-b108-97ef7b62b9f4-istio-token\") pod \"7c87f10c-d9c9-4d1d-b108-97ef7b62b9f4\" (UID: \"7c87f10c-d9c9-4d1d-b108-97ef7b62b9f4\") "
Sep 09 16:44:48.857712 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:48.857632    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7c87f10c-d9c9-4d1d-b108-97ef7b62b9f4-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "7c87f10c-d9c9-4d1d-b108-97ef7b62b9f4" (UID: "7c87f10c-d9c9-4d1d-b108-97ef7b62b9f4"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 16:44:48.857712 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:48.857637    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7c87f10c-d9c9-4d1d-b108-97ef7b62b9f4-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "7c87f10c-d9c9-4d1d-b108-97ef7b62b9f4" (UID: "7c87f10c-d9c9-4d1d-b108-97ef7b62b9f4"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 16:44:48.857712 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:48.857665    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7c87f10c-d9c9-4d1d-b108-97ef7b62b9f4-workload-certs\") pod \"7c87f10c-d9c9-4d1d-b108-97ef7b62b9f4\" (UID: \"7c87f10c-d9c9-4d1d-b108-97ef7b62b9f4\") "
Sep 09 16:44:48.857902 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:48.857719    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7c87f10c-d9c9-4d1d-b108-97ef7b62b9f4-istio-podinfo\") pod \"7c87f10c-d9c9-4d1d-b108-97ef7b62b9f4\" (UID: \"7c87f10c-d9c9-4d1d-b108-97ef7b62b9f4\") "
Sep 09 16:44:48.857902 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:48.857783    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7c87f10c-d9c9-4d1d-b108-97ef7b62b9f4-istio-envoy\") pod \"7c87f10c-d9c9-4d1d-b108-97ef7b62b9f4\" (UID: \"7c87f10c-d9c9-4d1d-b108-97ef7b62b9f4\") "
Sep 09 16:44:48.857902 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:48.857804    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7c87f10c-d9c9-4d1d-b108-97ef7b62b9f4-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "7c87f10c-d9c9-4d1d-b108-97ef7b62b9f4" (UID: "7c87f10c-d9c9-4d1d-b108-97ef7b62b9f4"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 16:44:48.857902 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:48.857819    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7c87f10c-d9c9-4d1d-b108-97ef7b62b9f4-istio-data\") pod \"7c87f10c-d9c9-4d1d-b108-97ef7b62b9f4\" (UID: \"7c87f10c-d9c9-4d1d-b108-97ef7b62b9f4\") "
Sep 09 16:44:48.857902 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:48.857859    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7c87f10c-d9c9-4d1d-b108-97ef7b62b9f4-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "7c87f10c-d9c9-4d1d-b108-97ef7b62b9f4" (UID: "7c87f10c-d9c9-4d1d-b108-97ef7b62b9f4"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 16:44:48.858208 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:48.858187    2583 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7c87f10c-d9c9-4d1d-b108-97ef7b62b9f4-istiod-ca-cert\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\""
Sep 09 16:44:48.858266 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:48.858208    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7c87f10c-d9c9-4d1d-b108-97ef7b62b9f4-istio-data" (OuterVolumeSpecName: "istio-data") pod "7c87f10c-d9c9-4d1d-b108-97ef7b62b9f4" (UID: "7c87f10c-d9c9-4d1d-b108-97ef7b62b9f4"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 16:44:48.858266 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:48.858215    2583 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7c87f10c-d9c9-4d1d-b108-97ef7b62b9f4-credential-socket\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\""
Sep 09 16:44:48.858266 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:48.858246    2583 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7c87f10c-d9c9-4d1d-b108-97ef7b62b9f4-workload-socket\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\""
Sep 09 16:44:48.858266 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:48.858259    2583 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7c87f10c-d9c9-4d1d-b108-97ef7b62b9f4-workload-certs\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\""
Sep 09 16:44:48.859838 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:48.859819    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7c87f10c-d9c9-4d1d-b108-97ef7b62b9f4-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "7c87f10c-d9c9-4d1d-b108-97ef7b62b9f4" (UID: "7c87f10c-d9c9-4d1d-b108-97ef7b62b9f4"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 16:44:48.859916 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:48.859848    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7c87f10c-d9c9-4d1d-b108-97ef7b62b9f4-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "7c87f10c-d9c9-4d1d-b108-97ef7b62b9f4" (UID: "7c87f10c-d9c9-4d1d-b108-97ef7b62b9f4"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 09 16:44:48.860055 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:48.860035    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7c87f10c-d9c9-4d1d-b108-97ef7b62b9f4-kube-api-access-57l8x" (OuterVolumeSpecName: "kube-api-access-57l8x") pod "7c87f10c-d9c9-4d1d-b108-97ef7b62b9f4" (UID: "7c87f10c-d9c9-4d1d-b108-97ef7b62b9f4"). InnerVolumeSpecName "kube-api-access-57l8x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 16:44:48.860113 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:48.860064    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7c87f10c-d9c9-4d1d-b108-97ef7b62b9f4-istio-token" (OuterVolumeSpecName: "istio-token") pod "7c87f10c-d9c9-4d1d-b108-97ef7b62b9f4" (UID: "7c87f10c-d9c9-4d1d-b108-97ef7b62b9f4"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 16:44:48.958863 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:48.958827    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-57l8x\" (UniqueName: \"kubernetes.io/projected/7c87f10c-d9c9-4d1d-b108-97ef7b62b9f4-kube-api-access-57l8x\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\""
Sep 09 16:44:48.958863 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:48.958857    2583 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7c87f10c-d9c9-4d1d-b108-97ef7b62b9f4-istio-token\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\""
Sep 09 16:44:48.958863 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:48.958866    2583 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7c87f10c-d9c9-4d1d-b108-97ef7b62b9f4-istio-podinfo\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\""
Sep 09 16:44:48.958863 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:48.958875    2583 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7c87f10c-d9c9-4d1d-b108-97ef7b62b9f4-istio-envoy\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\""
Sep 09 16:44:48.959152 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:48.958882    2583 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7c87f10c-d9c9-4d1d-b108-97ef7b62b9f4-istio-data\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\""
Sep 09 16:44:49.225159 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:49.225126    2583 generic.go:356] "Generic (PLEG): container finished" podID="7c87f10c-d9c9-4d1d-b108-97ef7b62b9f4" containerID="58f267d1c3e955ce7ef200312e36d642f76287e1e081845926507da560154538" exitCode=0
Sep 09 16:44:49.225330 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:49.225170    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-1d59dd-openshift-default-57db7596bb-mtq8j"
Sep 09 16:44:49.225330 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:49.225204    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-1d59dd-openshift-default-57db7596bb-mtq8j" event={"ID":"7c87f10c-d9c9-4d1d-b108-97ef7b62b9f4","Type":"ContainerDied","Data":"58f267d1c3e955ce7ef200312e36d642f76287e1e081845926507da560154538"}
Sep 09 16:44:49.225330 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:49.225257    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-1d59dd-openshift-default-57db7596bb-mtq8j" event={"ID":"7c87f10c-d9c9-4d1d-b108-97ef7b62b9f4","Type":"ContainerDied","Data":"d90037fdaed78bbd4a6586320914875fe04ed71e84100f1025d396dbd16138ed"}
Sep 09 16:44:49.225330 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:49.225280    2583 scope.go:117] "RemoveContainer" containerID="58f267d1c3e955ce7ef200312e36d642f76287e1e081845926507da560154538"
Sep 09 16:44:49.234650 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:49.234629    2583 scope.go:117] "RemoveContainer" containerID="1c2c39e9287b47969108d0f7b3a88a05243d1469a86ee819482cca7d499c6a77"
Sep 09 16:44:49.242709 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:49.242690    2583 scope.go:117] "RemoveContainer" containerID="58f267d1c3e955ce7ef200312e36d642f76287e1e081845926507da560154538"
Sep 09 16:44:49.242972 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:44:49.242952    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"58f267d1c3e955ce7ef200312e36d642f76287e1e081845926507da560154538\": container with ID starting with 58f267d1c3e955ce7ef200312e36d642f76287e1e081845926507da560154538 not found: ID does not exist" containerID="58f267d1c3e955ce7ef200312e36d642f76287e1e081845926507da560154538"
Sep 09 16:44:49.243070 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:49.242977    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"58f267d1c3e955ce7ef200312e36d642f76287e1e081845926507da560154538"} err="failed to get container status \"58f267d1c3e955ce7ef200312e36d642f76287e1e081845926507da560154538\": rpc error: code = NotFound desc = could not find container \"58f267d1c3e955ce7ef200312e36d642f76287e1e081845926507da560154538\": container with ID starting with 58f267d1c3e955ce7ef200312e36d642f76287e1e081845926507da560154538 not found: ID does not exist"
Sep 09 16:44:49.243070 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:49.243058    2583 scope.go:117] "RemoveContainer" containerID="1c2c39e9287b47969108d0f7b3a88a05243d1469a86ee819482cca7d499c6a77"
Sep 09 16:44:49.243307 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:44:49.243290    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1c2c39e9287b47969108d0f7b3a88a05243d1469a86ee819482cca7d499c6a77\": container with ID starting with 1c2c39e9287b47969108d0f7b3a88a05243d1469a86ee819482cca7d499c6a77 not found: ID does not exist" containerID="1c2c39e9287b47969108d0f7b3a88a05243d1469a86ee819482cca7d499c6a77"
Sep 09 16:44:49.243359 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:49.243312    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c2c39e9287b47969108d0f7b3a88a05243d1469a86ee819482cca7d499c6a77"} err="failed to get container status \"1c2c39e9287b47969108d0f7b3a88a05243d1469a86ee819482cca7d499c6a77\": rpc error: code = NotFound desc = could not find container \"1c2c39e9287b47969108d0f7b3a88a05243d1469a86ee819482cca7d499c6a77\": container with ID starting with 1c2c39e9287b47969108d0f7b3a88a05243d1469a86ee819482cca7d499c6a77 not found: ID does not exist"
Sep 09 16:44:49.246451 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:49.246431    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-1d59dd-openshift-default-57db7596bb-mtq8j"]
Sep 09 16:44:49.250472 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:49.250452    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-1d59dd-openshift-default-57db7596bb-mtq8j"]
Sep 09 16:44:50.238084 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:50.238047    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7c87f10c-d9c9-4d1d-b108-97ef7b62b9f4" path="/var/lib/kubelet/pods/7c87f10c-d9c9-4d1d-b108-97ef7b62b9f4/volumes"
Sep 09 16:44:54.671458 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:54.671424    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:44:54.772222 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:54.772187    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:44:57.018264 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:57.018230    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:44:57.270113 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:57.270029    2583 generic.go:356] "Generic (PLEG): container finished" podID="b4e002dd-530b-4cf1-bd4c-7705b3ca33ad" containerID="4c30f3df922ffc4e100603c87e0ca99e4b6b8e02c7b39d140ba0a2c28a3b559f" exitCode=0
Sep 09 16:44:57.270113 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:57.270100    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-61f0f9-openshift-default-5f457d8ff8-9kgt8" event={"ID":"b4e002dd-530b-4cf1-bd4c-7705b3ca33ad","Type":"ContainerDied","Data":"4c30f3df922ffc4e100603c87e0ca99e4b6b8e02c7b39d140ba0a2c28a3b559f"}
Sep 09 16:44:57.270534 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:57.270520    2583 scope.go:117] "RemoveContainer" containerID="4c30f3df922ffc4e100603c87e0ca99e4b6b8e02c7b39d140ba0a2c28a3b559f"
Sep 09 16:44:57.271661 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:57.271634    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 09 16:44:57.271714 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:57.271702    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 09 16:44:57.271751 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:57.271741    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 09 16:44:58.277082 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:58.277050    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-61f0f9-openshift-default-5f457d8ff8-9kgt8" event={"ID":"b4e002dd-530b-4cf1-bd4c-7705b3ca33ad","Type":"ContainerStarted","Data":"8057da97218c1a98d18a1f20845aa757316a03a238b231caaeb310ec072c8b9e"}
Sep 09 16:44:58.864617 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:58.864582    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-61f0f9-openshift-default-5f457d8ff8-9kgt8"
Sep 09 16:44:58.864803 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:58.864764    2583 patch_prober.go:28] interesting pod/e2e-ipp-a-61f0f9-openshift-default-5f457d8ff8-9kgt8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body=
Sep 09 16:44:58.864849 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:58.864820    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-61f0f9-openshift-default-5f457d8ff8-9kgt8" podUID="b4e002dd-530b-4cf1-bd4c-7705b3ca33ad" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused"
Sep 09 16:44:59.865224 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:59.865183    2583 patch_prober.go:28] interesting pod/e2e-ipp-a-61f0f9-openshift-default-5f457d8ff8-9kgt8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body=
Sep 09 16:44:59.865623 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:44:59.865243    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-61f0f9-openshift-default-5f457d8ff8-9kgt8" podUID="b4e002dd-530b-4cf1-bd4c-7705b3ca33ad" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused"
Sep 09 16:45:00.138888 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:45:00.138781    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-61f0f9-29816205-4tfdt"]
Sep 09 16:45:00.139355 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:45:00.139334    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7c87f10c-d9c9-4d1d-b108-97ef7b62b9f4" containerName="istio-proxy"
Sep 09 16:45:00.139455 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:45:00.139365    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c87f10c-d9c9-4d1d-b108-97ef7b62b9f4" containerName="istio-proxy"
Sep 09 16:45:00.139518 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:45:00.139495    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="7c87f10c-d9c9-4d1d-b108-97ef7b62b9f4" containerName="istio-proxy"
Sep 09 16:45:00.142681 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:45:00.142657    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-331bf8-29816205-jpr52"]
Sep 09 16:45:00.142837 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:45:00.142815    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-61f0f9-29816205-4tfdt"
Sep 09 16:45:00.143201 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:45:00.143177    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7c87f10c-d9c9-4d1d-b108-97ef7b62b9f4" containerName="istio-proxy"
Sep 09 16:45:00.143201 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:45:00.143198    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c87f10c-d9c9-4d1d-b108-97ef7b62b9f4" containerName="istio-proxy"
Sep 09 16:45:00.143337 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:45:00.143263    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="7c87f10c-d9c9-4d1d-b108-97ef7b62b9f4" containerName="istio-proxy"
Sep 09 16:45:00.145020 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:45:00.145002    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29816205-wh9ns"]
Sep 09 16:45:00.145121 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:45:00.145100    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-331bf8-29816205-jpr52"
Sep 09 16:45:00.145319 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:45:00.145302    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jz5ff\""
Sep 09 16:45:00.147309 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:45:00.147293    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29816205-wh9ns"
Sep 09 16:45:00.151194 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:45:00.151171    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-61f0f9-29816205-4tfdt"]
Sep 09 16:45:00.153797 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:45:00.153776    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-331bf8-29816205-jpr52"]
Sep 09 16:45:00.156052 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:45:00.155896    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-61f0f9-29816205-4tfdt"
Sep 09 16:45:00.157753 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:45:00.157630    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29816205-wh9ns"]
Sep 09 16:45:00.167154 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:45:00.167130    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-331bf8-29816205-jpr52"
Sep 09 16:45:00.175228 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:45:00.175203    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29816205-wh9ns"
Sep 09 16:45:00.474147 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:45:00.473943    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-61f0f9-29816205-4tfdt"]
Sep 09 16:45:00.476307 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:45:00.476260    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-331bf8-29816205-jpr52"]
Sep 09 16:45:00.476403 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:45:00.476378    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod809e51ea_bb3c_4367_bc62_e121ee4450e5.slice/crio-1a7d84a1b6ce8b2d8957ac4ea255ba019e645b948ba4d7847a8b48e0ba93201d WatchSource:0}: Error finding container 1a7d84a1b6ce8b2d8957ac4ea255ba019e645b948ba4d7847a8b48e0ba93201d: Status 404 returned error can't find the container with id 1a7d84a1b6ce8b2d8957ac4ea255ba019e645b948ba4d7847a8b48e0ba93201d
Sep 09 16:45:00.478977 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:45:00.478907    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod464b4cfd_8b8c_4096_a371_dfce187f98d9.slice/crio-02db89452bc8366ec6ae595b30aab2c1e6132a83890bf660ef344245a3192576 WatchSource:0}: Error finding container 02db89452bc8366ec6ae595b30aab2c1e6132a83890bf660ef344245a3192576: Status 404 returned error can't find the container with id 02db89452bc8366ec6ae595b30aab2c1e6132a83890bf660ef344245a3192576
Sep 09 16:45:00.512844 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:45:00.512769    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29816205-wh9ns"]
Sep 09 16:45:00.865502 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:45:00.865469    2583 patch_prober.go:28] interesting pod/e2e-ipp-a-61f0f9-openshift-default-5f457d8ff8-9kgt8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body=
Sep 09 16:45:00.865853 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:45:00.865522    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-61f0f9-openshift-default-5f457d8ff8-9kgt8" podUID="b4e002dd-530b-4cf1-bd4c-7705b3ca33ad" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused"
Sep 09 16:45:01.318015 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:45:01.317906    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29816205-wh9ns" event={"ID":"864c724f-3e27-410a-aa42-ae258ecd73da","Type":"ContainerStarted","Data":"3528d497110eb84492bc76d921d4c2840768dfbcb936e2ab6c2b17f7fc719e41"}
Sep 09 16:45:01.318015 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:45:01.317967    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29816205-wh9ns" event={"ID":"864c724f-3e27-410a-aa42-ae258ecd73da","Type":"ContainerStarted","Data":"2a5f0e07d9f644a98d0aac6afdb00be1377b00bfbb6b545e51c1bb77b52f8348"}
Sep 09 16:45:01.319551 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:45:01.319524    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-61f0f9-29816205-4tfdt" event={"ID":"809e51ea-bb3c-4367-bc62-e121ee4450e5","Type":"ContainerStarted","Data":"cd0172b367f83a3f0bd02d5ac26c11c83a4fe7d858c097276cbe6e957a54a141"}
Sep 09 16:45:01.319692 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:45:01.319564    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-61f0f9-29816205-4tfdt" event={"ID":"809e51ea-bb3c-4367-bc62-e121ee4450e5","Type":"ContainerStarted","Data":"1a7d84a1b6ce8b2d8957ac4ea255ba019e645b948ba4d7847a8b48e0ba93201d"}
Sep 09 16:45:01.320958 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:45:01.320936    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-331bf8-29816205-jpr52" event={"ID":"464b4cfd-8b8c-4096-a371-dfce187f98d9","Type":"ContainerStarted","Data":"9418444b207c618a465ba55faafc59bf28a300aa205d6751e57c99a819ef662e"}
Sep 09 16:45:01.321101 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:45:01.320969    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-331bf8-29816205-jpr52" event={"ID":"464b4cfd-8b8c-4096-a371-dfce187f98d9","Type":"ContainerStarted","Data":"02db89452bc8366ec6ae595b30aab2c1e6132a83890bf660ef344245a3192576"}
Sep 09 16:45:01.332413 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:45:01.332373    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29816205-wh9ns" podStartSLOduration=1.332358575 podStartE2EDuration="1.332358575s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 16:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:45:01.330891645 +0000 UTC m=+1883.684621502" watchObservedRunningTime="2026-09-09 16:45:01.332358575 +0000 UTC m=+1883.686088406"
Sep 09 16:45:01.346056 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:45:01.346015    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-61f0f9-29816205-4tfdt" podStartSLOduration=1.346003419 podStartE2EDuration="1.346003419s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 16:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:45:01.34442254 +0000 UTC m=+1883.698152391" watchObservedRunningTime="2026-09-09 16:45:01.346003419 +0000 UTC m=+1883.699733244"
Sep 09 16:45:01.357670 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:45:01.357631    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-331bf8-29816205-jpr52" podStartSLOduration=1.3576137959999999 podStartE2EDuration="1.357613796s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 16:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:45:01.357346318 +0000 UTC m=+1883.711076174" watchObservedRunningTime="2026-09-09 16:45:01.357613796 +0000 UTC m=+1883.711343647"
Sep 09 16:45:01.864652 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:45:01.864627    2583 patch_prober.go:28] interesting pod/e2e-ipp-a-61f0f9-openshift-default-5f457d8ff8-9kgt8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body=
Sep 09 16:45:01.864745 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:45:01.864689    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-61f0f9-openshift-default-5f457d8ff8-9kgt8" podUID="b4e002dd-530b-4cf1-bd4c-7705b3ca33ad" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused"
Sep 09 16:45:02.328023 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:45:02.327973    2583 generic.go:356] "Generic (PLEG): container finished" podID="864c724f-3e27-410a-aa42-ae258ecd73da" containerID="3528d497110eb84492bc76d921d4c2840768dfbcb936e2ab6c2b17f7fc719e41" exitCode=0
Sep 09 16:45:02.328456 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:45:02.328064    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29816205-wh9ns" event={"ID":"864c724f-3e27-410a-aa42-ae258ecd73da","Type":"ContainerDied","Data":"3528d497110eb84492bc76d921d4c2840768dfbcb936e2ab6c2b17f7fc719e41"}
Sep 09 16:45:02.329691 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:45:02.329663    2583 generic.go:356] "Generic (PLEG): container finished" podID="809e51ea-bb3c-4367-bc62-e121ee4450e5" containerID="cd0172b367f83a3f0bd02d5ac26c11c83a4fe7d858c097276cbe6e957a54a141" exitCode=0
Sep 09 16:45:02.329823 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:45:02.329724    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-61f0f9-29816205-4tfdt" event={"ID":"809e51ea-bb3c-4367-bc62-e121ee4450e5","Type":"ContainerDied","Data":"cd0172b367f83a3f0bd02d5ac26c11c83a4fe7d858c097276cbe6e957a54a141"}
Sep 09 16:45:02.331271 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:45:02.331246    2583 generic.go:356] "Generic (PLEG): container finished" podID="464b4cfd-8b8c-4096-a371-dfce187f98d9" containerID="9418444b207c618a465ba55faafc59bf28a300aa205d6751e57c99a819ef662e" exitCode=0
Sep 09 16:45:02.331385 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:45:02.331302    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-331bf8-29816205-jpr52" event={"ID":"464b4cfd-8b8c-4096-a371-dfce187f98d9","Type":"ContainerDied","Data":"9418444b207c618a465ba55faafc59bf28a300aa205d6751e57c99a819ef662e"}
Sep 09 16:45:02.864612 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:45:02.864574    2583 patch_prober.go:28] interesting pod/e2e-ipp-a-61f0f9-openshift-default-5f457d8ff8-9kgt8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body=
Sep 09 16:45:02.864795 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:45:02.864657    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-61f0f9-openshift-default-5f457d8ff8-9kgt8" podUID="b4e002dd-530b-4cf1-bd4c-7705b3ca33ad" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused"
Sep 09 16:45:03.110651 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:45:03.110617    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:45:03.511455 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:45:03.511237    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-61f0f9-29816205-4tfdt"
Sep 09 16:45:03.556536 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:45:03.556515    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29816205-wh9ns"
Sep 09 16:45:03.559475 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:45:03.559454    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-331bf8-29816205-jpr52"
Sep 09 16:45:03.750305 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:45:03.750209    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:45:03.868326 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:45:03.868297    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-61f0f9-openshift-default-5f457d8ff8-9kgt8"
Sep 09 16:45:03.868606 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:45:03.868588    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-61f0f9-openshift-default-5f457d8ff8-9kgt8"
Sep 09 16:45:03.869205 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:45:03.869186    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-61f0f9-openshift-default-5f457d8ff8-9kgt8"
Sep 09 16:45:04.344640 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:45:04.344612    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29816205-wh9ns"
Sep 09 16:45:04.344817 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:45:04.344611    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29816205-wh9ns" event={"ID":"864c724f-3e27-410a-aa42-ae258ecd73da","Type":"ContainerDied","Data":"2a5f0e07d9f644a98d0aac6afdb00be1377b00bfbb6b545e51c1bb77b52f8348"}
Sep 09 16:45:04.344817 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:45:04.344738    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2a5f0e07d9f644a98d0aac6afdb00be1377b00bfbb6b545e51c1bb77b52f8348"
Sep 09 16:45:04.346094 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:45:04.346077    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-61f0f9-29816205-4tfdt"
Sep 09 16:45:04.346203 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:45:04.346111    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-61f0f9-29816205-4tfdt" event={"ID":"809e51ea-bb3c-4367-bc62-e121ee4450e5","Type":"ContainerDied","Data":"1a7d84a1b6ce8b2d8957ac4ea255ba019e645b948ba4d7847a8b48e0ba93201d"}
Sep 09 16:45:04.346203 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:45:04.346154    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1a7d84a1b6ce8b2d8957ac4ea255ba019e645b948ba4d7847a8b48e0ba93201d"
Sep 09 16:45:04.347581 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:45:04.347565    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-331bf8-29816205-jpr52"
Sep 09 16:45:04.347690 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:45:04.347602    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-331bf8-29816205-jpr52" event={"ID":"464b4cfd-8b8c-4096-a371-dfce187f98d9","Type":"ContainerDied","Data":"02db89452bc8366ec6ae595b30aab2c1e6132a83890bf660ef344245a3192576"}
Sep 09 16:45:04.347690 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:45:04.347645    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="02db89452bc8366ec6ae595b30aab2c1e6132a83890bf660ef344245a3192576"
Sep 09 16:45:05.164697 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:45:05.164665    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:45:05.215753 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:45:05.215722    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-b-cd0c91-openshift-default-57d8886756-xwmpv"]
Sep 09 16:45:05.216338 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:45:05.216320    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="464b4cfd-8b8c-4096-a371-dfce187f98d9" containerName="cleanup"
Sep 09 16:45:05.216398 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:45:05.216341    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="464b4cfd-8b8c-4096-a371-dfce187f98d9" containerName="cleanup"
Sep 09 16:45:05.216398 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:45:05.216367    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="809e51ea-bb3c-4367-bc62-e121ee4450e5" containerName="cleanup"
Sep 09 16:45:05.216398 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:45:05.216375    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="809e51ea-bb3c-4367-bc62-e121ee4450e5" containerName="cleanup"
Sep 09 16:45:05.216398 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:45:05.216389    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="864c724f-3e27-410a-aa42-ae258ecd73da" containerName="cleanup"
Sep 09 16:45:05.216398 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:45:05.216399    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="864c724f-3e27-410a-aa42-ae258ecd73da" containerName="cleanup"
Sep 09 16:45:05.216544 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:45:05.216503    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="809e51ea-bb3c-4367-bc62-e121ee4450e5" containerName="cleanup"
Sep 09 16:45:05.216544 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:45:05.216513    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="864c724f-3e27-410a-aa42-ae258ecd73da" containerName="cleanup"
Sep 09 16:45:05.216544 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:45:05.216522    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="464b4cfd-8b8c-4096-a371-dfce187f98d9" containerName="cleanup"
Sep 09 16:45:05.219214 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:45:05.219193    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-cd0c91-openshift-default-57d8886756-xwmpv"
Sep 09 16:45:05.222159 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:45:05.221953    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-b-cd0c91-openshift-default-dockercfg-kmccz\""
Sep 09 16:45:05.231493 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:45:05.231465    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-cd0c91-openshift-default-57d8886756-xwmpv"]
Sep 09 16:45:05.249857 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:45:05.249813    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:45:05.330773 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:45:05.330732    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2dc3d0d9-3c75-475f-836d-0a544e1907cc-workload-certs\") pod \"e2e-ipp-b-cd0c91-openshift-default-57d8886756-xwmpv\" (UID: \"2dc3d0d9-3c75-475f-836d-0a544e1907cc\") " pod="openshift-ingress/e2e-ipp-b-cd0c91-openshift-default-57d8886756-xwmpv"
Sep 09 16:45:05.331072 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:45:05.331043    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-84s9j\" (UniqueName: \"kubernetes.io/projected/2dc3d0d9-3c75-475f-836d-0a544e1907cc-kube-api-access-84s9j\") pod \"e2e-ipp-b-cd0c91-openshift-default-57d8886756-xwmpv\" (UID: \"2dc3d0d9-3c75-475f-836d-0a544e1907cc\") " pod="openshift-ingress/e2e-ipp-b-cd0c91-openshift-default-57d8886756-xwmpv"
Sep 09 16:45:05.331285 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:45:05.331264    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2dc3d0d9-3c75-475f-836d-0a544e1907cc-istio-data\") pod \"e2e-ipp-b-cd0c91-openshift-default-57d8886756-xwmpv\" (UID: \"2dc3d0d9-3c75-475f-836d-0a544e1907cc\") " pod="openshift-ingress/e2e-ipp-b-cd0c91-openshift-default-57d8886756-xwmpv"
Sep 09 16:45:05.331403 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:45:05.331383    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2dc3d0d9-3c75-475f-836d-0a544e1907cc-istiod-ca-cert\") pod \"e2e-ipp-b-cd0c91-openshift-default-57d8886756-xwmpv\" (UID: \"2dc3d0d9-3c75-475f-836d-0a544e1907cc\") " pod="openshift-ingress/e2e-ipp-b-cd0c91-openshift-default-57d8886756-xwmpv"
Sep 09 16:45:05.331515 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:45:05.331491    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2dc3d0d9-3c75-475f-836d-0a544e1907cc-istio-envoy\") pod \"e2e-ipp-b-cd0c91-openshift-default-57d8886756-xwmpv\" (UID: \"2dc3d0d9-3c75-475f-836d-0a544e1907cc\") " pod="openshift-ingress/e2e-ipp-b-cd0c91-openshift-default-57d8886756-xwmpv"
Sep 09 16:45:05.331644 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:45:05.331523    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2dc3d0d9-3c75-475f-836d-0a544e1907cc-istio-podinfo\") pod \"e2e-ipp-b-cd0c91-openshift-default-57d8886756-xwmpv\" (UID: \"2dc3d0d9-3c75-475f-836d-0a544e1907cc\") " pod="openshift-ingress/e2e-ipp-b-cd0c91-openshift-default-57d8886756-xwmpv"
Sep 09 16:45:05.331644 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:45:05.331576    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2dc3d0d9-3c75-475f-836d-0a544e1907cc-istio-token\") pod \"e2e-ipp-b-cd0c91-openshift-default-57d8886756-xwmpv\" (UID: \"2dc3d0d9-3c75-475f-836d-0a544e1907cc\") " pod="openshift-ingress/e2e-ipp-b-cd0c91-openshift-default-57d8886756-xwmpv"
Sep 09 16:45:05.331644 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:45:05.331598    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2dc3d0d9-3c75-475f-836d-0a544e1907cc-credential-socket\") pod \"e2e-ipp-b-cd0c91-openshift-default-57d8886756-xwmpv\" (UID: \"2dc3d0d9-3c75-475f-836d-0a544e1907cc\") " pod="openshift-ingress/e2e-ipp-b-cd0c91-openshift-default-57d8886756-xwmpv"
Sep 09 16:45:05.331644 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:45:05.331615    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2dc3d0d9-3c75-475f-836d-0a544e1907cc-workload-socket\") pod \"e2e-ipp-b-cd0c91-openshift-default-57d8886756-xwmpv\" (UID: \"2dc3d0d9-3c75-475f-836d-0a544e1907cc\") " pod="openshift-ingress/e2e-ipp-b-cd0c91-openshift-default-57d8886756-xwmpv"
Sep 09 16:45:05.344993 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:45:05.344954    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:45:05.432664 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:45:05.432581    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2dc3d0d9-3c75-475f-836d-0a544e1907cc-workload-certs\") pod \"e2e-ipp-b-cd0c91-openshift-default-57d8886756-xwmpv\" (UID: \"2dc3d0d9-3c75-475f-836d-0a544e1907cc\") " pod="openshift-ingress/e2e-ipp-b-cd0c91-openshift-default-57d8886756-xwmpv"
Sep 09 16:45:05.432664 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:45:05.432615    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-84s9j\" (UniqueName: \"kubernetes.io/projected/2dc3d0d9-3c75-475f-836d-0a544e1907cc-kube-api-access-84s9j\") pod \"e2e-ipp-b-cd0c91-openshift-default-57d8886756-xwmpv\" (UID: \"2dc3d0d9-3c75-475f-836d-0a544e1907cc\") " pod="openshift-ingress/e2e-ipp-b-cd0c91-openshift-default-57d8886756-xwmpv"
Sep 09 16:45:05.432884 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:45:05.432674    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2dc3d0d9-3c75-475f-836d-0a544e1907cc-istio-data\") pod \"e2e-ipp-b-cd0c91-openshift-default-57d8886756-xwmpv\" (UID: \"2dc3d0d9-3c75-475f-836d-0a544e1907cc\") " pod="openshift-ingress/e2e-ipp-b-cd0c91-openshift-default-57d8886756-xwmpv"
Sep 09 16:45:05.432884 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:45:05.432742    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2dc3d0d9-3c75-475f-836d-0a544e1907cc-istiod-ca-cert\") pod \"e2e-ipp-b-cd0c91-openshift-default-57d8886756-xwmpv\" (UID: \"2dc3d0d9-3c75-475f-836d-0a544e1907cc\") " pod="openshift-ingress/e2e-ipp-b-cd0c91-openshift-default-57d8886756-xwmpv"
Sep 09 16:45:05.432884 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:45:05.432776    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2dc3d0d9-3c75-475f-836d-0a544e1907cc-istio-envoy\") pod \"e2e-ipp-b-cd0c91-openshift-default-57d8886756-xwmpv\" (UID: \"2dc3d0d9-3c75-475f-836d-0a544e1907cc\") " pod="openshift-ingress/e2e-ipp-b-cd0c91-openshift-default-57d8886756-xwmpv"
Sep 09 16:45:05.432884 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:45:05.432799    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2dc3d0d9-3c75-475f-836d-0a544e1907cc-istio-podinfo\") pod \"e2e-ipp-b-cd0c91-openshift-default-57d8886756-xwmpv\" (UID: \"2dc3d0d9-3c75-475f-836d-0a544e1907cc\") " pod="openshift-ingress/e2e-ipp-b-cd0c91-openshift-default-57d8886756-xwmpv"
Sep 09 16:45:05.432884 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:45:05.432855    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2dc3d0d9-3c75-475f-836d-0a544e1907cc-istio-token\") pod \"e2e-ipp-b-cd0c91-openshift-default-57d8886756-xwmpv\" (UID: \"2dc3d0d9-3c75-475f-836d-0a544e1907cc\") " pod="openshift-ingress/e2e-ipp-b-cd0c91-openshift-default-57d8886756-xwmpv"
Sep 09 16:45:05.433178 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:45:05.432906    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2dc3d0d9-3c75-475f-836d-0a544e1907cc-credential-socket\") pod \"e2e-ipp-b-cd0c91-openshift-default-57d8886756-xwmpv\" (UID: \"2dc3d0d9-3c75-475f-836d-0a544e1907cc\") " pod="openshift-ingress/e2e-ipp-b-cd0c91-openshift-default-57d8886756-xwmpv"
Sep 09 16:45:05.433178 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:45:05.432939    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2dc3d0d9-3c75-475f-836d-0a544e1907cc-workload-socket\") pod \"e2e-ipp-b-cd0c91-openshift-default-57d8886756-xwmpv\" (UID: \"2dc3d0d9-3c75-475f-836d-0a544e1907cc\") " pod="openshift-ingress/e2e-ipp-b-cd0c91-openshift-default-57d8886756-xwmpv"
Sep 09 16:45:05.433178 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:45:05.433095    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2dc3d0d9-3c75-475f-836d-0a544e1907cc-istio-data\") pod \"e2e-ipp-b-cd0c91-openshift-default-57d8886756-xwmpv\" (UID: \"2dc3d0d9-3c75-475f-836d-0a544e1907cc\") " pod="openshift-ingress/e2e-ipp-b-cd0c91-openshift-default-57d8886756-xwmpv"
Sep 09 16:45:05.433326 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:45:05.433305    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2dc3d0d9-3c75-475f-836d-0a544e1907cc-credential-socket\") pod \"e2e-ipp-b-cd0c91-openshift-default-57d8886756-xwmpv\" (UID: \"2dc3d0d9-3c75-475f-836d-0a544e1907cc\") " pod="openshift-ingress/e2e-ipp-b-cd0c91-openshift-default-57d8886756-xwmpv"
Sep 09 16:45:05.433410 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:45:05.433387    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2dc3d0d9-3c75-475f-836d-0a544e1907cc-workload-socket\") pod \"e2e-ipp-b-cd0c91-openshift-default-57d8886756-xwmpv\" (UID: \"2dc3d0d9-3c75-475f-836d-0a544e1907cc\") " pod="openshift-ingress/e2e-ipp-b-cd0c91-openshift-default-57d8886756-xwmpv"
Sep 09 16:45:05.433579 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:45:05.433551    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2dc3d0d9-3c75-475f-836d-0a544e1907cc-istiod-ca-cert\") pod \"e2e-ipp-b-cd0c91-openshift-default-57d8886756-xwmpv\" (UID: \"2dc3d0d9-3c75-475f-836d-0a544e1907cc\") " pod="openshift-ingress/e2e-ipp-b-cd0c91-openshift-default-57d8886756-xwmpv"
Sep 09 16:45:05.433683 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:45:05.433514    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2dc3d0d9-3c75-475f-836d-0a544e1907cc-workload-certs\") pod \"e2e-ipp-b-cd0c91-openshift-default-57d8886756-xwmpv\" (UID: \"2dc3d0d9-3c75-475f-836d-0a544e1907cc\") " pod="openshift-ingress/e2e-ipp-b-cd0c91-openshift-default-57d8886756-xwmpv"
Sep 09 16:45:05.435127 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:45:05.435096    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2dc3d0d9-3c75-475f-836d-0a544e1907cc-istio-envoy\") pod \"e2e-ipp-b-cd0c91-openshift-default-57d8886756-xwmpv\" (UID: \"2dc3d0d9-3c75-475f-836d-0a544e1907cc\") " pod="openshift-ingress/e2e-ipp-b-cd0c91-openshift-default-57d8886756-xwmpv"
Sep 09 16:45:05.435419 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:45:05.435404    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2dc3d0d9-3c75-475f-836d-0a544e1907cc-istio-podinfo\") pod \"e2e-ipp-b-cd0c91-openshift-default-57d8886756-xwmpv\" (UID: \"2dc3d0d9-3c75-475f-836d-0a544e1907cc\") " pod="openshift-ingress/e2e-ipp-b-cd0c91-openshift-default-57d8886756-xwmpv"
Sep 09 16:45:05.450865 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:45:05.450831    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-84s9j\" (UniqueName: \"kubernetes.io/projected/2dc3d0d9-3c75-475f-836d-0a544e1907cc-kube-api-access-84s9j\") pod \"e2e-ipp-b-cd0c91-openshift-default-57d8886756-xwmpv\" (UID: \"2dc3d0d9-3c75-475f-836d-0a544e1907cc\") " pod="openshift-ingress/e2e-ipp-b-cd0c91-openshift-default-57d8886756-xwmpv"
Sep 09 16:45:05.450997 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:45:05.450947    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2dc3d0d9-3c75-475f-836d-0a544e1907cc-istio-token\") pod \"e2e-ipp-b-cd0c91-openshift-default-57d8886756-xwmpv\" (UID: \"2dc3d0d9-3c75-475f-836d-0a544e1907cc\") " pod="openshift-ingress/e2e-ipp-b-cd0c91-openshift-default-57d8886756-xwmpv"
Sep 09 16:45:05.464325 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:45:05.464301    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:45:05.533812 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:45:05.533779    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-cd0c91-openshift-default-57d8886756-xwmpv"
Sep 09 16:45:05.814853 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:45:05.814822    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-cd0c91-openshift-default-57d8886756-xwmpv"]
Sep 09 16:45:05.817120 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:45:05.817093    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2dc3d0d9_3c75_475f_836d_0a544e1907cc.slice/crio-97af8bb01a5d273c007f3deace2ef6e18a5b57b268ee135e74464944e2d2ebd3 WatchSource:0}: Error finding container 97af8bb01a5d273c007f3deace2ef6e18a5b57b268ee135e74464944e2d2ebd3: Status 404 returned error can't find the container with id 97af8bb01a5d273c007f3deace2ef6e18a5b57b268ee135e74464944e2d2ebd3
Sep 09 16:45:05.819276 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:45:05.819246    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 09 16:45:05.819359 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:45:05.819317    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 09 16:45:05.819359 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:45:05.819347    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 09 16:45:06.362234 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:45:06.362189    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-cd0c91-openshift-default-57d8886756-xwmpv" event={"ID":"2dc3d0d9-3c75-475f-836d-0a544e1907cc","Type":"ContainerStarted","Data":"5ba257c9e88c88c15dd2db5664f1a29c7645fc913904560d1d9c74a98a41617b"}
Sep 09 16:45:06.362690 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:45:06.362302    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-cd0c91-openshift-default-57d8886756-xwmpv" event={"ID":"2dc3d0d9-3c75-475f-836d-0a544e1907cc","Type":"ContainerStarted","Data":"97af8bb01a5d273c007f3deace2ef6e18a5b57b268ee135e74464944e2d2ebd3"}
Sep 09 16:45:06.383782 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:45:06.383725    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-b-cd0c91-openshift-default-57d8886756-xwmpv" podStartSLOduration=1.3837073979999999 podStartE2EDuration="1.383707398s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 16:45:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:45:06.3813869 +0000 UTC m=+1888.735116766" watchObservedRunningTime="2026-09-09 16:45:06.383707398 +0000 UTC m=+1888.737437291"
Sep 09 16:45:06.534314 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:45:06.534276    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-cd0c91-openshift-default-57d8886756-xwmpv"
Sep 09 16:45:06.539520 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:45:06.539494    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-cd0c91-openshift-default-57d8886756-xwmpv"
Sep 09 16:45:07.368805 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:45:07.368773    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-cd0c91-openshift-default-57d8886756-xwmpv"
Sep 09 16:45:07.369712 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:45:07.369692    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-cd0c91-openshift-default-57d8886756-xwmpv"
Sep 09 16:45:08.485819 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:45:08.485781    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:45:08.585529 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:45:08.585488    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:45:09.064458 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:45:09.064429    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:45:09.775513 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:45:09.775480    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:45:10.399602 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:45:10.399560    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:45:10.453714 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:45:10.453682    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:45:10.556095 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:45:10.556049    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:45:10.839044 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:45:10.839015    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:45:11.656362 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:45:11.656330    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:45:19.817052 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:45:19.817006    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:45:20.229149 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:45:20.229114    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:45:23.411108 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:45:23.411076    2583 patch_prober.go:28] interesting pod/e2e-ipp-b-cd0c91-openshift-default-57d8886756-xwmpv container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 09 16:45:23.411543 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:45:23.411134    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-b-cd0c91-openshift-default-57d8886756-xwmpv" podUID="2dc3d0d9-3c75-475f-836d-0a544e1907cc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 09 16:45:25.483098 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:45:25.483061    2583 generic.go:356] "Generic (PLEG): container finished" podID="2dc3d0d9-3c75-475f-836d-0a544e1907cc" containerID="5ba257c9e88c88c15dd2db5664f1a29c7645fc913904560d1d9c74a98a41617b" exitCode=0
Sep 09 16:45:25.483508 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:45:25.483131    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-cd0c91-openshift-default-57d8886756-xwmpv" event={"ID":"2dc3d0d9-3c75-475f-836d-0a544e1907cc","Type":"ContainerDied","Data":"5ba257c9e88c88c15dd2db5664f1a29c7645fc913904560d1d9c74a98a41617b"}
Sep 09 16:45:25.483584 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:45:25.483570    2583 scope.go:117] "RemoveContainer" containerID="5ba257c9e88c88c15dd2db5664f1a29c7645fc913904560d1d9c74a98a41617b"
Sep 09 16:45:25.484737 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:45:25.484710    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 09 16:45:25.484789 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:45:25.484775    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 09 16:45:25.484823 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:45:25.484808    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 09 16:45:26.493566 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:45:26.493521    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-cd0c91-openshift-default-57d8886756-xwmpv" event={"ID":"2dc3d0d9-3c75-475f-836d-0a544e1907cc","Type":"ContainerStarted","Data":"53a67ffe927db868a3c84b5a026f6eec66769c02737a404df592c5bbcfe7f1f0"}
Sep 09 16:45:26.534573 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:45:26.534536    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-cd0c91-openshift-default-57d8886756-xwmpv"
Sep 09 16:45:26.534774 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:45:26.534749    2583 patch_prober.go:28] interesting pod/e2e-ipp-b-cd0c91-openshift-default-57d8886756-xwmpv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body=
Sep 09 16:45:26.534833 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:45:26.534813    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-cd0c91-openshift-default-57d8886756-xwmpv" podUID="2dc3d0d9-3c75-475f-836d-0a544e1907cc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused"
Sep 09 16:45:27.534889 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:45:27.534856    2583 patch_prober.go:28] interesting pod/e2e-ipp-b-cd0c91-openshift-default-57d8886756-xwmpv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body=
Sep 09 16:45:27.535290 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:45:27.534909    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-cd0c91-openshift-default-57d8886756-xwmpv" podUID="2dc3d0d9-3c75-475f-836d-0a544e1907cc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused"
Sep 09 16:45:28.534837 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:45:28.534790    2583 patch_prober.go:28] interesting pod/e2e-ipp-b-cd0c91-openshift-default-57d8886756-xwmpv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body=
Sep 09 16:45:28.535056 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:45:28.534853    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-cd0c91-openshift-default-57d8886756-xwmpv" podUID="2dc3d0d9-3c75-475f-836d-0a544e1907cc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused"
Sep 09 16:45:29.534788 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:45:29.534706    2583 patch_prober.go:28] interesting pod/e2e-ipp-b-cd0c91-openshift-default-57d8886756-xwmpv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body=
Sep 09 16:45:29.534788 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:45:29.534758    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-cd0c91-openshift-default-57d8886756-xwmpv" podUID="2dc3d0d9-3c75-475f-836d-0a544e1907cc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused"
Sep 09 16:45:30.534220 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:45:30.534186    2583 patch_prober.go:28] interesting pod/e2e-ipp-b-cd0c91-openshift-default-57d8886756-xwmpv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body=
Sep 09 16:45:30.534598 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:45:30.534236    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-cd0c91-openshift-default-57d8886756-xwmpv" podUID="2dc3d0d9-3c75-475f-836d-0a544e1907cc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused"
Sep 09 16:45:31.631461 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:45:31.631428    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-cd0c91-openshift-default-57d8886756-xwmpv"
Sep 09 16:45:31.631826 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:45:31.631711    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-cd0c91-openshift-default-57d8886756-xwmpv"
Sep 09 16:45:31.632490 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:45:31.632472    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-cd0c91-openshift-default-57d8886756-xwmpv"
Sep 09 16:45:35.314275 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:45:35.314239    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:45:35.414428 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:45:35.414395    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:45:38.383480 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:45:38.383450    2583 scope.go:117] "RemoveContainer" containerID="7f9e1f8a76c3a71ed2a5fc2e7df26e3b2bece79a79049fd06fa663502c766623"
Sep 09 16:45:38.391877 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:45:38.391860    2583 scope.go:117] "RemoveContainer" containerID="9a194bc6d75793736ae86cfa74e1c78b30d42ad470631ac5b24cb1796a987a4c"
Sep 09 16:45:38.457781 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:45:38.457758    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-k6wtl_1670d619-612d-46e4-b6a7-f1ed8ccc0fc4/payload-processing/0.log"
Sep 09 16:45:48.421231 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:45:48.421195    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:45:56.880741 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:45:56.880698    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:45:56.981422 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:45:56.981392    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:46:24.559619 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:46:24.559587    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-k6wtl_1670d619-612d-46e4-b6a7-f1ed8ccc0fc4/payload-processing/0.log"
Sep 09 16:46:24.956854 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:46:24.956826    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:46:25.248499 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:46:25.248420    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-89cc2b-openshift-default-548594558b-smdwg"]
Sep 09 16:46:25.252911 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:46:25.252890    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-89cc2b-openshift-default-548594558b-smdwg"
Sep 09 16:46:25.255540 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:46:25.255518    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-cleanup-89cc2b-openshift-default-dockercfg-6pwbp\""
Sep 09 16:46:25.265196 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:46:25.265167    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-89cc2b-openshift-default-548594558b-smdwg"]
Sep 09 16:46:25.278197 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:46:25.278171    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:46:25.360581 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:46:25.360541    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2j7bm\" (UniqueName: \"kubernetes.io/projected/23e58267-abd7-4b60-8ac5-6c9935a2cac3-kube-api-access-2j7bm\") pod \"e2e-ipp-cleanup-89cc2b-openshift-default-548594558b-smdwg\" (UID: \"23e58267-abd7-4b60-8ac5-6c9935a2cac3\") " pod="openshift-ingress/e2e-ipp-cleanup-89cc2b-openshift-default-548594558b-smdwg"
Sep 09 16:46:25.360581 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:46:25.360594    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/23e58267-abd7-4b60-8ac5-6c9935a2cac3-istiod-ca-cert\") pod \"e2e-ipp-cleanup-89cc2b-openshift-default-548594558b-smdwg\" (UID: \"23e58267-abd7-4b60-8ac5-6c9935a2cac3\") " pod="openshift-ingress/e2e-ipp-cleanup-89cc2b-openshift-default-548594558b-smdwg"
Sep 09 16:46:25.360951 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:46:25.360692    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/23e58267-abd7-4b60-8ac5-6c9935a2cac3-credential-socket\") pod \"e2e-ipp-cleanup-89cc2b-openshift-default-548594558b-smdwg\" (UID: \"23e58267-abd7-4b60-8ac5-6c9935a2cac3\") " pod="openshift-ingress/e2e-ipp-cleanup-89cc2b-openshift-default-548594558b-smdwg"
Sep 09 16:46:25.360951 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:46:25.360724    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/23e58267-abd7-4b60-8ac5-6c9935a2cac3-workload-certs\") pod \"e2e-ipp-cleanup-89cc2b-openshift-default-548594558b-smdwg\" (UID: \"23e58267-abd7-4b60-8ac5-6c9935a2cac3\") " pod="openshift-ingress/e2e-ipp-cleanup-89cc2b-openshift-default-548594558b-smdwg"
Sep 09 16:46:25.360951 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:46:25.360759    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/23e58267-abd7-4b60-8ac5-6c9935a2cac3-istio-data\") pod \"e2e-ipp-cleanup-89cc2b-openshift-default-548594558b-smdwg\" (UID: \"23e58267-abd7-4b60-8ac5-6c9935a2cac3\") " pod="openshift-ingress/e2e-ipp-cleanup-89cc2b-openshift-default-548594558b-smdwg"
Sep 09 16:46:25.360951 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:46:25.360814    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/23e58267-abd7-4b60-8ac5-6c9935a2cac3-istio-podinfo\") pod \"e2e-ipp-cleanup-89cc2b-openshift-default-548594558b-smdwg\" (UID: \"23e58267-abd7-4b60-8ac5-6c9935a2cac3\") " pod="openshift-ingress/e2e-ipp-cleanup-89cc2b-openshift-default-548594558b-smdwg"
Sep 09 16:46:25.360951 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:46:25.360849    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/23e58267-abd7-4b60-8ac5-6c9935a2cac3-istio-envoy\") pod \"e2e-ipp-cleanup-89cc2b-openshift-default-548594558b-smdwg\" (UID: \"23e58267-abd7-4b60-8ac5-6c9935a2cac3\") " pod="openshift-ingress/e2e-ipp-cleanup-89cc2b-openshift-default-548594558b-smdwg"
Sep 09 16:46:25.360951 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:46:25.360883    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/23e58267-abd7-4b60-8ac5-6c9935a2cac3-istio-token\") pod \"e2e-ipp-cleanup-89cc2b-openshift-default-548594558b-smdwg\" (UID: \"23e58267-abd7-4b60-8ac5-6c9935a2cac3\") " pod="openshift-ingress/e2e-ipp-cleanup-89cc2b-openshift-default-548594558b-smdwg"
Sep 09 16:46:25.360951 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:46:25.360913    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/23e58267-abd7-4b60-8ac5-6c9935a2cac3-workload-socket\") pod \"e2e-ipp-cleanup-89cc2b-openshift-default-548594558b-smdwg\" (UID: \"23e58267-abd7-4b60-8ac5-6c9935a2cac3\") " pod="openshift-ingress/e2e-ipp-cleanup-89cc2b-openshift-default-548594558b-smdwg"
Sep 09 16:46:25.462541 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:46:25.462499    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/23e58267-abd7-4b60-8ac5-6c9935a2cac3-credential-socket\") pod \"e2e-ipp-cleanup-89cc2b-openshift-default-548594558b-smdwg\" (UID: \"23e58267-abd7-4b60-8ac5-6c9935a2cac3\") " pod="openshift-ingress/e2e-ipp-cleanup-89cc2b-openshift-default-548594558b-smdwg"
Sep 09 16:46:25.462541 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:46:25.462540    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/23e58267-abd7-4b60-8ac5-6c9935a2cac3-workload-certs\") pod \"e2e-ipp-cleanup-89cc2b-openshift-default-548594558b-smdwg\" (UID: \"23e58267-abd7-4b60-8ac5-6c9935a2cac3\") " pod="openshift-ingress/e2e-ipp-cleanup-89cc2b-openshift-default-548594558b-smdwg"
Sep 09 16:46:25.462812 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:46:25.462567    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/23e58267-abd7-4b60-8ac5-6c9935a2cac3-istio-data\") pod \"e2e-ipp-cleanup-89cc2b-openshift-default-548594558b-smdwg\" (UID: \"23e58267-abd7-4b60-8ac5-6c9935a2cac3\") " pod="openshift-ingress/e2e-ipp-cleanup-89cc2b-openshift-default-548594558b-smdwg"
Sep 09 16:46:25.462812 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:46:25.462584    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/23e58267-abd7-4b60-8ac5-6c9935a2cac3-istio-podinfo\") pod \"e2e-ipp-cleanup-89cc2b-openshift-default-548594558b-smdwg\" (UID: \"23e58267-abd7-4b60-8ac5-6c9935a2cac3\") " pod="openshift-ingress/e2e-ipp-cleanup-89cc2b-openshift-default-548594558b-smdwg"
Sep 09 16:46:25.462812 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:46:25.462609    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/23e58267-abd7-4b60-8ac5-6c9935a2cac3-istio-envoy\") pod \"e2e-ipp-cleanup-89cc2b-openshift-default-548594558b-smdwg\" (UID: \"23e58267-abd7-4b60-8ac5-6c9935a2cac3\") " pod="openshift-ingress/e2e-ipp-cleanup-89cc2b-openshift-default-548594558b-smdwg"
Sep 09 16:46:25.462812 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:46:25.462640    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/23e58267-abd7-4b60-8ac5-6c9935a2cac3-istio-token\") pod \"e2e-ipp-cleanup-89cc2b-openshift-default-548594558b-smdwg\" (UID: \"23e58267-abd7-4b60-8ac5-6c9935a2cac3\") " pod="openshift-ingress/e2e-ipp-cleanup-89cc2b-openshift-default-548594558b-smdwg"
Sep 09 16:46:25.462812 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:46:25.462667    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/23e58267-abd7-4b60-8ac5-6c9935a2cac3-workload-socket\") pod \"e2e-ipp-cleanup-89cc2b-openshift-default-548594558b-smdwg\" (UID: \"23e58267-abd7-4b60-8ac5-6c9935a2cac3\") " pod="openshift-ingress/e2e-ipp-cleanup-89cc2b-openshift-default-548594558b-smdwg"
Sep 09 16:46:25.463116 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:46:25.463011    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/23e58267-abd7-4b60-8ac5-6c9935a2cac3-workload-certs\") pod \"e2e-ipp-cleanup-89cc2b-openshift-default-548594558b-smdwg\" (UID: \"23e58267-abd7-4b60-8ac5-6c9935a2cac3\") " pod="openshift-ingress/e2e-ipp-cleanup-89cc2b-openshift-default-548594558b-smdwg"
Sep 09 16:46:25.463116 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:46:25.463060    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/23e58267-abd7-4b60-8ac5-6c9935a2cac3-istio-data\") pod \"e2e-ipp-cleanup-89cc2b-openshift-default-548594558b-smdwg\" (UID: \"23e58267-abd7-4b60-8ac5-6c9935a2cac3\") " pod="openshift-ingress/e2e-ipp-cleanup-89cc2b-openshift-default-548594558b-smdwg"
Sep 09 16:46:25.463116 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:46:25.463097    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/23e58267-abd7-4b60-8ac5-6c9935a2cac3-credential-socket\") pod \"e2e-ipp-cleanup-89cc2b-openshift-default-548594558b-smdwg\" (UID: \"23e58267-abd7-4b60-8ac5-6c9935a2cac3\") " pod="openshift-ingress/e2e-ipp-cleanup-89cc2b-openshift-default-548594558b-smdwg"
Sep 09 16:46:25.463280 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:46:25.463099    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2j7bm\" (UniqueName: \"kubernetes.io/projected/23e58267-abd7-4b60-8ac5-6c9935a2cac3-kube-api-access-2j7bm\") pod \"e2e-ipp-cleanup-89cc2b-openshift-default-548594558b-smdwg\" (UID: \"23e58267-abd7-4b60-8ac5-6c9935a2cac3\") " pod="openshift-ingress/e2e-ipp-cleanup-89cc2b-openshift-default-548594558b-smdwg"
Sep 09 16:46:25.463280 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:46:25.463167    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/23e58267-abd7-4b60-8ac5-6c9935a2cac3-istiod-ca-cert\") pod \"e2e-ipp-cleanup-89cc2b-openshift-default-548594558b-smdwg\" (UID: \"23e58267-abd7-4b60-8ac5-6c9935a2cac3\") " pod="openshift-ingress/e2e-ipp-cleanup-89cc2b-openshift-default-548594558b-smdwg"
Sep 09 16:46:25.463381 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:46:25.463306    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/23e58267-abd7-4b60-8ac5-6c9935a2cac3-workload-socket\") pod \"e2e-ipp-cleanup-89cc2b-openshift-default-548594558b-smdwg\" (UID: \"23e58267-abd7-4b60-8ac5-6c9935a2cac3\") " pod="openshift-ingress/e2e-ipp-cleanup-89cc2b-openshift-default-548594558b-smdwg"
Sep 09 16:46:25.463839 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:46:25.463815    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/23e58267-abd7-4b60-8ac5-6c9935a2cac3-istiod-ca-cert\") pod \"e2e-ipp-cleanup-89cc2b-openshift-default-548594558b-smdwg\" (UID: \"23e58267-abd7-4b60-8ac5-6c9935a2cac3\") " pod="openshift-ingress/e2e-ipp-cleanup-89cc2b-openshift-default-548594558b-smdwg"
Sep 09 16:46:25.464995 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:46:25.464957    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/23e58267-abd7-4b60-8ac5-6c9935a2cac3-istio-envoy\") pod \"e2e-ipp-cleanup-89cc2b-openshift-default-548594558b-smdwg\" (UID: \"23e58267-abd7-4b60-8ac5-6c9935a2cac3\") " pod="openshift-ingress/e2e-ipp-cleanup-89cc2b-openshift-default-548594558b-smdwg"
Sep 09 16:46:25.465316 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:46:25.465294    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/23e58267-abd7-4b60-8ac5-6c9935a2cac3-istio-podinfo\") pod \"e2e-ipp-cleanup-89cc2b-openshift-default-548594558b-smdwg\" (UID: \"23e58267-abd7-4b60-8ac5-6c9935a2cac3\") " pod="openshift-ingress/e2e-ipp-cleanup-89cc2b-openshift-default-548594558b-smdwg"
Sep 09 16:46:25.470116 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:46:25.470092    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2j7bm\" (UniqueName: \"kubernetes.io/projected/23e58267-abd7-4b60-8ac5-6c9935a2cac3-kube-api-access-2j7bm\") pod \"e2e-ipp-cleanup-89cc2b-openshift-default-548594558b-smdwg\" (UID: \"23e58267-abd7-4b60-8ac5-6c9935a2cac3\") " pod="openshift-ingress/e2e-ipp-cleanup-89cc2b-openshift-default-548594558b-smdwg"
Sep 09 16:46:25.470209 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:46:25.470129    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/23e58267-abd7-4b60-8ac5-6c9935a2cac3-istio-token\") pod \"e2e-ipp-cleanup-89cc2b-openshift-default-548594558b-smdwg\" (UID: \"23e58267-abd7-4b60-8ac5-6c9935a2cac3\") " pod="openshift-ingress/e2e-ipp-cleanup-89cc2b-openshift-default-548594558b-smdwg"
Sep 09 16:46:25.565091 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:46:25.565010    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-89cc2b-openshift-default-548594558b-smdwg"
Sep 09 16:46:25.807042 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:46:25.807011    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:46:25.843554 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:46:25.843531    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-89cc2b-openshift-default-548594558b-smdwg"]
Sep 09 16:46:25.845787 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:46:25.845745    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23e58267_abd7_4b60_8ac5_6c9935a2cac3.slice/crio-3473e19c061ce6414c6f2b6da3392d064f2328026a61dff502562b48490e2fca WatchSource:0}: Error finding container 3473e19c061ce6414c6f2b6da3392d064f2328026a61dff502562b48490e2fca: Status 404 returned error can't find the container with id 3473e19c061ce6414c6f2b6da3392d064f2328026a61dff502562b48490e2fca
Sep 09 16:46:25.848154 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:46:25.848120    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 09 16:46:25.848228 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:46:25.848187    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 09 16:46:25.848271 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:46:25.848217    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 09 16:46:26.841680 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:46:26.841642    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-89cc2b-openshift-default-548594558b-smdwg" event={"ID":"23e58267-abd7-4b60-8ac5-6c9935a2cac3","Type":"ContainerStarted","Data":"a7978df8d94d6ff271c23edf55666f7ddf584cc5b77aa08a91e6ad176eae06b3"}
Sep 09 16:46:26.842087 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:46:26.841701    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-89cc2b-openshift-default-548594558b-smdwg" event={"ID":"23e58267-abd7-4b60-8ac5-6c9935a2cac3","Type":"ContainerStarted","Data":"3473e19c061ce6414c6f2b6da3392d064f2328026a61dff502562b48490e2fca"}
Sep 09 16:46:26.862053 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:46:26.862007    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-cleanup-89cc2b-openshift-default-548594558b-smdwg" podStartSLOduration=1.861979205 podStartE2EDuration="1.861979205s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 16:46:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:46:26.859500298 +0000 UTC m=+1969.213230154" watchObservedRunningTime="2026-09-09 16:46:26.861979205 +0000 UTC m=+1969.215709038"
Sep 09 16:46:27.565827 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:46:27.565795    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-89cc2b-openshift-default-548594558b-smdwg"
Sep 09 16:46:27.571456 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:46:27.571433    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-89cc2b-openshift-default-548594558b-smdwg"
Sep 09 16:46:27.847968 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:46:27.847933    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-89cc2b-openshift-default-548594558b-smdwg"
Sep 09 16:46:27.848904 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:46:27.848881    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-89cc2b-openshift-default-548594558b-smdwg"
Sep 09 16:46:28.085253 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:46:28.085225    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:46:28.655715 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:46:28.655682    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:46:28.766547 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:46:28.766519    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:46:28.866383 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:46:28.866352    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:46:29.377235 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:46:29.377206    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:46:30.044961 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:46:30.044926    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:46:30.728157 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:46:30.728123    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:46:31.302570 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:46:31.302474    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:46:31.478804 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:46:31.478773    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:46:31.579042 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:46:31.579018    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:46:31.863644 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:46:31.863567    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:46:31.926801 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:46:31.926774    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:46:38.419319 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:46:38.419287    2583 scope.go:117] "RemoveContainer" containerID="a6f34fb85da0d38a72a8b96d892a775002efe05ef1d33979bbabd1a865ff7c25"
Sep 09 16:46:47.966046 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:46:47.965939    2583 generic.go:356] "Generic (PLEG): container finished" podID="23e58267-abd7-4b60-8ac5-6c9935a2cac3" containerID="a7978df8d94d6ff271c23edf55666f7ddf584cc5b77aa08a91e6ad176eae06b3" exitCode=0
Sep 09 16:46:47.966046 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:46:47.966011    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-89cc2b-openshift-default-548594558b-smdwg" event={"ID":"23e58267-abd7-4b60-8ac5-6c9935a2cac3","Type":"ContainerDied","Data":"a7978df8d94d6ff271c23edf55666f7ddf584cc5b77aa08a91e6ad176eae06b3"}
Sep 09 16:46:47.966467 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:46:47.966447    2583 scope.go:117] "RemoveContainer" containerID="a7978df8d94d6ff271c23edf55666f7ddf584cc5b77aa08a91e6ad176eae06b3"
Sep 09 16:46:47.967823 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:46:47.967791    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 09 16:46:47.967882 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:46:47.967869    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 09 16:46:47.967919 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:46:47.967904    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 09 16:46:48.973464 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:46:48.973426    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-89cc2b-openshift-default-548594558b-smdwg" event={"ID":"23e58267-abd7-4b60-8ac5-6c9935a2cac3","Type":"ContainerStarted","Data":"cb1baedb0bd7055fd16740b0e7479aabeabf6fcb12ded5dbe606ef3162150440"}
Sep 09 16:46:49.566088 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:46:49.566047    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-89cc2b-openshift-default-548594558b-smdwg"
Sep 09 16:46:49.566382 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:46:49.566356    2583 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-89cc2b-openshift-default-548594558b-smdwg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused" start-of-body=
Sep 09 16:46:49.566435 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:46:49.566413    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-89cc2b-openshift-default-548594558b-smdwg" podUID="23e58267-abd7-4b60-8ac5-6c9935a2cac3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused"
Sep 09 16:46:50.566261 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:46:50.566221    2583 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-89cc2b-openshift-default-548594558b-smdwg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused" start-of-body=
Sep 09 16:46:50.566661 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:46:50.566279    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-89cc2b-openshift-default-548594558b-smdwg" podUID="23e58267-abd7-4b60-8ac5-6c9935a2cac3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused"
Sep 09 16:46:51.566136 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:46:51.566103    2583 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-89cc2b-openshift-default-548594558b-smdwg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused" start-of-body=
Sep 09 16:46:51.566314 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:46:51.566172    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-89cc2b-openshift-default-548594558b-smdwg" podUID="23e58267-abd7-4b60-8ac5-6c9935a2cac3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused"
Sep 09 16:46:52.565723 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:46:52.565683    2583 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-89cc2b-openshift-default-548594558b-smdwg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused" start-of-body=
Sep 09 16:46:52.565903 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:46:52.565744    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-89cc2b-openshift-default-548594558b-smdwg" podUID="23e58267-abd7-4b60-8ac5-6c9935a2cac3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused"
Sep 09 16:46:53.566066 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:46:53.566024    2583 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-89cc2b-openshift-default-548594558b-smdwg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused" start-of-body=
Sep 09 16:46:53.566675 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:46:53.566635    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-89cc2b-openshift-default-548594558b-smdwg" podUID="23e58267-abd7-4b60-8ac5-6c9935a2cac3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused"
Sep 09 16:46:54.219609 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:46:54.219548    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:46:54.569941 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:46:54.569855    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-89cc2b-openshift-default-548594558b-smdwg"
Sep 09 16:46:54.570332 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:46:54.570273    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-89cc2b-openshift-default-548594558b-smdwg"
Sep 09 16:46:54.571143 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:46:54.571121    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-89cc2b-openshift-default-548594558b-smdwg"
Sep 09 16:46:54.862663 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:46:54.862628    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:46:55.568261 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:46:55.568223    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:46:56.262742 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:46:56.262701    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:46:56.859479 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:46:56.859436    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:46:57.573305 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:46:57.573274    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:46:58.952217 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:46:58.952189    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:46:59.675243 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:46:59.675204    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-89cc2b-mrlhd"]
Sep 09 16:46:59.680919 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:46:59.680886    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-89cc2b-mrlhd"
Sep 09 16:46:59.683438 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:46:59.683410    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jz5ff\""
Sep 09 16:46:59.683613 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:46:59.683449    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-89cc2b-mrlhd"]
Sep 09 16:46:59.818230 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:46:59.818183    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0ea43b38-b9e0-4748-b406-ffd8e14d2983-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-89cc2b-mrlhd\" (UID: \"0ea43b38-b9e0-4748-b406-ffd8e14d2983\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-89cc2b-mrlhd"
Sep 09 16:46:59.919695 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:46:59.919657    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0ea43b38-b9e0-4748-b406-ffd8e14d2983-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-89cc2b-mrlhd\" (UID: \"0ea43b38-b9e0-4748-b406-ffd8e14d2983\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-89cc2b-mrlhd"
Sep 09 16:46:59.920377 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:46:59.920352    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0ea43b38-b9e0-4748-b406-ffd8e14d2983-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-89cc2b-mrlhd\" (UID: \"0ea43b38-b9e0-4748-b406-ffd8e14d2983\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-89cc2b-mrlhd"
Sep 09 16:46:59.994676 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:46:59.994580    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-89cc2b-mrlhd"
Sep 09 16:47:00.270240 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:47:00.270208    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-89cc2b-mrlhd"]
Sep 09 16:47:00.272937 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:47:00.272911    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ea43b38_b9e0_4748_b406_ffd8e14d2983.slice/crio-7977462a0f7f57fdb7b94665fccd7c8cebe9916fd4a5062d893aa98978e436ec WatchSource:0}: Error finding container 7977462a0f7f57fdb7b94665fccd7c8cebe9916fd4a5062d893aa98978e436ec: Status 404 returned error can't find the container with id 7977462a0f7f57fdb7b94665fccd7c8cebe9916fd4a5062d893aa98978e436ec
Sep 09 16:47:00.358827 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:47:00.358787    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:47:01.056328 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:47:01.056223    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-89cc2b-mrlhd" event={"ID":"0ea43b38-b9e0-4748-b406-ffd8e14d2983","Type":"ContainerStarted","Data":"fc7ee42e8a446a192b78c1721d76c38bc4f2c36b84bf357ab00ce263dbbb4f4e"}
Sep 09 16:47:01.056328 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:47:01.056284    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-89cc2b-mrlhd" event={"ID":"0ea43b38-b9e0-4748-b406-ffd8e14d2983","Type":"ContainerStarted","Data":"7977462a0f7f57fdb7b94665fccd7c8cebe9916fd4a5062d893aa98978e436ec"}
Sep 09 16:47:01.071961 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:47:01.071906    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-89cc2b-mrlhd" podStartSLOduration=2.071887835 podStartE2EDuration="2.071887835s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 16:46:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:47:01.070437533 +0000 UTC m=+2003.424167384" watchObservedRunningTime="2026-09-09 16:47:01.071887835 +0000 UTC m=+2003.425617665"
Sep 09 16:47:01.156946 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:47:01.156912    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:47:01.668285 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:47:01.668253    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:47:02.064126 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:47:02.064034    2583 generic.go:356] "Generic (PLEG): container finished" podID="0ea43b38-b9e0-4748-b406-ffd8e14d2983" containerID="fc7ee42e8a446a192b78c1721d76c38bc4f2c36b84bf357ab00ce263dbbb4f4e" exitCode=0
Sep 09 16:47:02.064126 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:47:02.064078    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-89cc2b-mrlhd" event={"ID":"0ea43b38-b9e0-4748-b406-ffd8e14d2983","Type":"ContainerDied","Data":"fc7ee42e8a446a192b78c1721d76c38bc4f2c36b84bf357ab00ce263dbbb4f4e"}
Sep 09 16:47:02.264149 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:47:02.264117    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:47:02.364109 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:47:02.364069    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:47:02.972980 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:47:02.972939    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:47:03.222629 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:47:03.222600    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-89cc2b-mrlhd"
Sep 09 16:47:03.355459 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:47:03.355428    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0ea43b38-b9e0-4748-b406-ffd8e14d2983-maas-api-service-ca\") pod \"0ea43b38-b9e0-4748-b406-ffd8e14d2983\" (UID: \"0ea43b38-b9e0-4748-b406-ffd8e14d2983\") "
Sep 09 16:47:03.355823 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:47:03.355798    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0ea43b38-b9e0-4748-b406-ffd8e14d2983-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "0ea43b38-b9e0-4748-b406-ffd8e14d2983" (UID: "0ea43b38-b9e0-4748-b406-ffd8e14d2983"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 16:47:03.457333 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:47:03.457298    2583 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0ea43b38-b9e0-4748-b406-ffd8e14d2983-maas-api-service-ca\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\""
Sep 09 16:47:03.559285 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:47:03.559253    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:47:04.078387 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:47:04.078350    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-89cc2b-mrlhd"
Sep 09 16:47:04.078387 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:47:04.078381    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-89cc2b-mrlhd" event={"ID":"0ea43b38-b9e0-4748-b406-ffd8e14d2983","Type":"ContainerDied","Data":"7977462a0f7f57fdb7b94665fccd7c8cebe9916fd4a5062d893aa98978e436ec"}
Sep 09 16:47:04.078618 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:47:04.078437    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7977462a0f7f57fdb7b94665fccd7c8cebe9916fd4a5062d893aa98978e436ec"
Sep 09 16:47:10.449429 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:47:10.449390    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:47:10.550147 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:47:10.550118    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:47:10.619313 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:47:10.619272    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-89cc2b-mrlhd"]
Sep 09 16:47:10.620773 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:47:10.620740    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:47:10.621862 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:47:10.621834    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-89cc2b-mrlhd"]
Sep 09 16:47:10.675865 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:47:10.675828    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:47:11.035130 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:47:11.035098    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:47:11.134955 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:47:11.134906    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:47:11.699684 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:47:11.699624    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:47:12.239549 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:47:12.239512    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0ea43b38-b9e0-4748-b406-ffd8e14d2983" path="/var/lib/kubelet/pods/0ea43b38-b9e0-4748-b406-ffd8e14d2983/volumes"
Sep 09 16:47:12.380276 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:47:12.380231    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:47:13.044937 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:47:13.044906    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:47:13.926256 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:47:13.926206    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:47:16.537565 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:47:16.537526    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:47:16.633649 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:47:16.633611    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:47:16.784957 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:47:16.784922    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-89cc2b-openshift-default-548594558b-smdwg"]
Sep 09 16:47:16.785204 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:47:16.785174    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-cleanup-89cc2b-openshift-default-548594558b-smdwg" podUID="23e58267-abd7-4b60-8ac5-6c9935a2cac3" containerName="istio-proxy" containerID="cri-o://cb1baedb0bd7055fd16740b0e7479aabeabf6fcb12ded5dbe606ef3162150440" gracePeriod=30
Sep 09 16:47:16.805918 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:47:16.805837    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:47:20.678145 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:47:20.678111    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-61f0f9-pm8rx"]
Sep 09 16:47:20.678779 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:47:20.678755    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ea43b38-b9e0-4748-b406-ffd8e14d2983" containerName="revoke-keys"
Sep 09 16:47:20.678960 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:47:20.678947    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ea43b38-b9e0-4748-b406-ffd8e14d2983" containerName="revoke-keys"
Sep 09 16:47:20.679235 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:47:20.679219    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="0ea43b38-b9e0-4748-b406-ffd8e14d2983" containerName="revoke-keys"
Sep 09 16:47:20.682811 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:47:20.682791    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-61f0f9-pm8rx"
Sep 09 16:47:20.685508 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:47:20.685473    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jz5ff\""
Sep 09 16:47:20.687590 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:47:20.687564    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-61f0f9-pm8rx"]
Sep 09 16:47:20.737359 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:47:20.737321    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/49ca5f97-ba01-47b9-8100-e55d464d8e6e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-61f0f9-pm8rx\" (UID: \"49ca5f97-ba01-47b9-8100-e55d464d8e6e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-61f0f9-pm8rx"
Sep 09 16:47:20.790061 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:47:20.790024    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:47:20.838949 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:47:20.838915    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/49ca5f97-ba01-47b9-8100-e55d464d8e6e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-61f0f9-pm8rx\" (UID: \"49ca5f97-ba01-47b9-8100-e55d464d8e6e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-61f0f9-pm8rx"
Sep 09 16:47:20.839528 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:47:20.839504    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/49ca5f97-ba01-47b9-8100-e55d464d8e6e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-61f0f9-pm8rx\" (UID: \"49ca5f97-ba01-47b9-8100-e55d464d8e6e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-61f0f9-pm8rx"
Sep 09 16:47:20.997911 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:47:20.997821    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-61f0f9-pm8rx"
Sep 09 16:47:21.266706 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:47:21.266678    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-61f0f9-pm8rx"]
Sep 09 16:47:21.268310 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:47:21.268278    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49ca5f97_ba01_47b9_8100_e55d464d8e6e.slice/crio-46067a52d994ec5f770924f6e4451e22738cc1d6819b90370e6a64504cdf7e81 WatchSource:0}: Error finding container 46067a52d994ec5f770924f6e4451e22738cc1d6819b90370e6a64504cdf7e81: Status 404 returned error can't find the container with id 46067a52d994ec5f770924f6e4451e22738cc1d6819b90370e6a64504cdf7e81
Sep 09 16:47:21.421047 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:47:21.421015    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:47:22.063558 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:47:22.063523    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:47:22.067259 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:47:22.067227    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-89cc2b-openshift-default-548594558b-smdwg"
Sep 09 16:47:22.151909 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:47:22.151879    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/23e58267-abd7-4b60-8ac5-6c9935a2cac3-istiod-ca-cert\") pod \"23e58267-abd7-4b60-8ac5-6c9935a2cac3\" (UID: \"23e58267-abd7-4b60-8ac5-6c9935a2cac3\") "
Sep 09 16:47:22.151909 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:47:22.151912    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/23e58267-abd7-4b60-8ac5-6c9935a2cac3-istio-podinfo\") pod \"23e58267-abd7-4b60-8ac5-6c9935a2cac3\" (UID: \"23e58267-abd7-4b60-8ac5-6c9935a2cac3\") "
Sep 09 16:47:22.152148 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:47:22.151934    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/23e58267-abd7-4b60-8ac5-6c9935a2cac3-credential-socket\") pod \"23e58267-abd7-4b60-8ac5-6c9935a2cac3\" (UID: \"23e58267-abd7-4b60-8ac5-6c9935a2cac3\") "
Sep 09 16:47:22.152148 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:47:22.152073    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/23e58267-abd7-4b60-8ac5-6c9935a2cac3-workload-certs\") pod \"23e58267-abd7-4b60-8ac5-6c9935a2cac3\" (UID: \"23e58267-abd7-4b60-8ac5-6c9935a2cac3\") "
Sep 09 16:47:22.152148 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:47:22.152125    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2j7bm\" (UniqueName: \"kubernetes.io/projected/23e58267-abd7-4b60-8ac5-6c9935a2cac3-kube-api-access-2j7bm\") pod \"23e58267-abd7-4b60-8ac5-6c9935a2cac3\" (UID: \"23e58267-abd7-4b60-8ac5-6c9935a2cac3\") "
Sep 09 16:47:22.152319 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:47:22.152189    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/23e58267-abd7-4b60-8ac5-6c9935a2cac3-workload-socket\") pod \"23e58267-abd7-4b60-8ac5-6c9935a2cac3\" (UID: \"23e58267-abd7-4b60-8ac5-6c9935a2cac3\") "
Sep 09 16:47:22.152319 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:47:22.152268    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/23e58267-abd7-4b60-8ac5-6c9935a2cac3-istio-data\") pod \"23e58267-abd7-4b60-8ac5-6c9935a2cac3\" (UID: \"23e58267-abd7-4b60-8ac5-6c9935a2cac3\") "
Sep 09 16:47:22.152319 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:47:22.152307    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/23e58267-abd7-4b60-8ac5-6c9935a2cac3-istio-token\") pod \"23e58267-abd7-4b60-8ac5-6c9935a2cac3\" (UID: \"23e58267-abd7-4b60-8ac5-6c9935a2cac3\") "
Sep 09 16:47:22.152319 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:47:22.152310    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/23e58267-abd7-4b60-8ac5-6c9935a2cac3-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "23e58267-abd7-4b60-8ac5-6c9935a2cac3" (UID: "23e58267-abd7-4b60-8ac5-6c9935a2cac3"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 16:47:22.152526 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:47:22.152346    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/23e58267-abd7-4b60-8ac5-6c9935a2cac3-istio-envoy\") pod \"23e58267-abd7-4b60-8ac5-6c9935a2cac3\" (UID: \"23e58267-abd7-4b60-8ac5-6c9935a2cac3\") "
Sep 09 16:47:22.152526 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:47:22.152338    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/23e58267-abd7-4b60-8ac5-6c9935a2cac3-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "23e58267-abd7-4b60-8ac5-6c9935a2cac3" (UID: "23e58267-abd7-4b60-8ac5-6c9935a2cac3"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 16:47:22.152526 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:47:22.152365    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/23e58267-abd7-4b60-8ac5-6c9935a2cac3-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "23e58267-abd7-4b60-8ac5-6c9935a2cac3" (UID: "23e58267-abd7-4b60-8ac5-6c9935a2cac3"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 16:47:22.152526 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:47:22.152483    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/23e58267-abd7-4b60-8ac5-6c9935a2cac3-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "23e58267-abd7-4b60-8ac5-6c9935a2cac3" (UID: "23e58267-abd7-4b60-8ac5-6c9935a2cac3"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 16:47:22.152526 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:47:22.152494    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/23e58267-abd7-4b60-8ac5-6c9935a2cac3-istio-data" (OuterVolumeSpecName: "istio-data") pod "23e58267-abd7-4b60-8ac5-6c9935a2cac3" (UID: "23e58267-abd7-4b60-8ac5-6c9935a2cac3"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 16:47:22.152788 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:47:22.152772    2583 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/23e58267-abd7-4b60-8ac5-6c9935a2cac3-workload-socket\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\""
Sep 09 16:47:22.152845 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:47:22.152790    2583 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/23e58267-abd7-4b60-8ac5-6c9935a2cac3-istio-data\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\""
Sep 09 16:47:22.152845 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:47:22.152804    2583 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/23e58267-abd7-4b60-8ac5-6c9935a2cac3-istiod-ca-cert\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\""
Sep 09 16:47:22.152845 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:47:22.152816    2583 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/23e58267-abd7-4b60-8ac5-6c9935a2cac3-credential-socket\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\""
Sep 09 16:47:22.152845 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:47:22.152827    2583 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/23e58267-abd7-4b60-8ac5-6c9935a2cac3-workload-certs\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\""
Sep 09 16:47:22.154231 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:47:22.154197    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/23e58267-abd7-4b60-8ac5-6c9935a2cac3-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "23e58267-abd7-4b60-8ac5-6c9935a2cac3" (UID: "23e58267-abd7-4b60-8ac5-6c9935a2cac3"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 09 16:47:22.154231 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:47:22.154212    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/23e58267-abd7-4b60-8ac5-6c9935a2cac3-kube-api-access-2j7bm" (OuterVolumeSpecName: "kube-api-access-2j7bm") pod "23e58267-abd7-4b60-8ac5-6c9935a2cac3" (UID: "23e58267-abd7-4b60-8ac5-6c9935a2cac3"). InnerVolumeSpecName "kube-api-access-2j7bm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 16:47:22.154372 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:47:22.154336    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/23e58267-abd7-4b60-8ac5-6c9935a2cac3-istio-token" (OuterVolumeSpecName: "istio-token") pod "23e58267-abd7-4b60-8ac5-6c9935a2cac3" (UID: "23e58267-abd7-4b60-8ac5-6c9935a2cac3"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 16:47:22.154533 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:47:22.154516    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/23e58267-abd7-4b60-8ac5-6c9935a2cac3-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "23e58267-abd7-4b60-8ac5-6c9935a2cac3" (UID: "23e58267-abd7-4b60-8ac5-6c9935a2cac3"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 16:47:22.179470 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:47:22.179444    2583 generic.go:356] "Generic (PLEG): container finished" podID="23e58267-abd7-4b60-8ac5-6c9935a2cac3" containerID="cb1baedb0bd7055fd16740b0e7479aabeabf6fcb12ded5dbe606ef3162150440" exitCode=0
Sep 09 16:47:22.179577 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:47:22.179494    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-89cc2b-openshift-default-548594558b-smdwg"
Sep 09 16:47:22.179577 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:47:22.179526    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-89cc2b-openshift-default-548594558b-smdwg" event={"ID":"23e58267-abd7-4b60-8ac5-6c9935a2cac3","Type":"ContainerDied","Data":"cb1baedb0bd7055fd16740b0e7479aabeabf6fcb12ded5dbe606ef3162150440"}
Sep 09 16:47:22.179577 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:47:22.179572    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-89cc2b-openshift-default-548594558b-smdwg" event={"ID":"23e58267-abd7-4b60-8ac5-6c9935a2cac3","Type":"ContainerDied","Data":"3473e19c061ce6414c6f2b6da3392d064f2328026a61dff502562b48490e2fca"}
Sep 09 16:47:22.179721 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:47:22.179599    2583 scope.go:117] "RemoveContainer" containerID="cb1baedb0bd7055fd16740b0e7479aabeabf6fcb12ded5dbe606ef3162150440"
Sep 09 16:47:22.181297 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:47:22.181275    2583 generic.go:356] "Generic (PLEG): container finished" podID="49ca5f97-ba01-47b9-8100-e55d464d8e6e" containerID="cc60ba21acd5b3f1648bac0943eeb87999269ac8d0a9efbb3e8c9f84c59c5c88" exitCode=0
Sep 09 16:47:22.181416 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:47:22.181344    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-61f0f9-pm8rx" event={"ID":"49ca5f97-ba01-47b9-8100-e55d464d8e6e","Type":"ContainerDied","Data":"cc60ba21acd5b3f1648bac0943eeb87999269ac8d0a9efbb3e8c9f84c59c5c88"}
Sep 09 16:47:22.181416 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:47:22.181376    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-61f0f9-pm8rx" event={"ID":"49ca5f97-ba01-47b9-8100-e55d464d8e6e","Type":"ContainerStarted","Data":"46067a52d994ec5f770924f6e4451e22738cc1d6819b90370e6a64504cdf7e81"}
Sep 09 16:47:22.189716 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:47:22.189699    2583 scope.go:117] "RemoveContainer" containerID="a7978df8d94d6ff271c23edf55666f7ddf584cc5b77aa08a91e6ad176eae06b3"
Sep 09 16:47:22.197869 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:47:22.197845    2583 scope.go:117] "RemoveContainer" containerID="cb1baedb0bd7055fd16740b0e7479aabeabf6fcb12ded5dbe606ef3162150440"
Sep 09 16:47:22.198594 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:47:22.198559    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cb1baedb0bd7055fd16740b0e7479aabeabf6fcb12ded5dbe606ef3162150440\": container with ID starting with cb1baedb0bd7055fd16740b0e7479aabeabf6fcb12ded5dbe606ef3162150440 not found: ID does not exist" containerID="cb1baedb0bd7055fd16740b0e7479aabeabf6fcb12ded5dbe606ef3162150440"
Sep 09 16:47:22.198680 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:47:22.198595    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cb1baedb0bd7055fd16740b0e7479aabeabf6fcb12ded5dbe606ef3162150440"} err="failed to get container status \"cb1baedb0bd7055fd16740b0e7479aabeabf6fcb12ded5dbe606ef3162150440\": rpc error: code = NotFound desc = could not find container \"cb1baedb0bd7055fd16740b0e7479aabeabf6fcb12ded5dbe606ef3162150440\": container with ID starting with cb1baedb0bd7055fd16740b0e7479aabeabf6fcb12ded5dbe606ef3162150440 not found: ID does not exist"
Sep 09 16:47:22.198680 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:47:22.198619    2583 scope.go:117] "RemoveContainer" containerID="a7978df8d94d6ff271c23edf55666f7ddf584cc5b77aa08a91e6ad176eae06b3"
Sep 09 16:47:22.198924 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:47:22.198907    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a7978df8d94d6ff271c23edf55666f7ddf584cc5b77aa08a91e6ad176eae06b3\": container with ID starting with a7978df8d94d6ff271c23edf55666f7ddf584cc5b77aa08a91e6ad176eae06b3 not found: ID does not exist" containerID="a7978df8d94d6ff271c23edf55666f7ddf584cc5b77aa08a91e6ad176eae06b3"
Sep 09 16:47:22.198976 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:47:22.198929    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a7978df8d94d6ff271c23edf55666f7ddf584cc5b77aa08a91e6ad176eae06b3"} err="failed to get container status \"a7978df8d94d6ff271c23edf55666f7ddf584cc5b77aa08a91e6ad176eae06b3\": rpc error: code = NotFound desc = could not find container \"a7978df8d94d6ff271c23edf55666f7ddf584cc5b77aa08a91e6ad176eae06b3\": container with ID starting with a7978df8d94d6ff271c23edf55666f7ddf584cc5b77aa08a91e6ad176eae06b3 not found: ID does not exist"
Sep 09 16:47:22.211777 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:47:22.211708    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-89cc2b-openshift-default-548594558b-smdwg"]
Sep 09 16:47:22.214586 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:47:22.214566    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-89cc2b-openshift-default-548594558b-smdwg"]
Sep 09 16:47:22.238857 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:47:22.238823    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="23e58267-abd7-4b60-8ac5-6c9935a2cac3" path="/var/lib/kubelet/pods/23e58267-abd7-4b60-8ac5-6c9935a2cac3/volumes"
Sep 09 16:47:22.254331 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:47:22.254301    2583 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/23e58267-abd7-4b60-8ac5-6c9935a2cac3-istio-token\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\""
Sep 09 16:47:22.254331 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:47:22.254327    2583 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/23e58267-abd7-4b60-8ac5-6c9935a2cac3-istio-envoy\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\""
Sep 09 16:47:22.254473 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:47:22.254340    2583 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/23e58267-abd7-4b60-8ac5-6c9935a2cac3-istio-podinfo\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\""
Sep 09 16:47:22.254473 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:47:22.254352    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2j7bm\" (UniqueName: \"kubernetes.io/projected/23e58267-abd7-4b60-8ac5-6c9935a2cac3-kube-api-access-2j7bm\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\""
Sep 09 16:47:22.865783 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:47:22.865745    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:47:23.328083 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:47:23.328059    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-61f0f9-pm8rx"
Sep 09 16:47:23.467451 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:47:23.467377    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/49ca5f97-ba01-47b9-8100-e55d464d8e6e-maas-api-service-ca\") pod \"49ca5f97-ba01-47b9-8100-e55d464d8e6e\" (UID: \"49ca5f97-ba01-47b9-8100-e55d464d8e6e\") "
Sep 09 16:47:23.467748 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:47:23.467729    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/49ca5f97-ba01-47b9-8100-e55d464d8e6e-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "49ca5f97-ba01-47b9-8100-e55d464d8e6e" (UID: "49ca5f97-ba01-47b9-8100-e55d464d8e6e"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 16:47:23.564922 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:47:23.564895    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:47:23.577947 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:47:23.568673    2583 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/49ca5f97-ba01-47b9-8100-e55d464d8e6e-maas-api-service-ca\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\""
Sep 09 16:47:24.155751 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:47:24.155715    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:47:24.194786 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:47:24.194760    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-61f0f9-pm8rx"
Sep 09 16:47:24.194920 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:47:24.194785    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-61f0f9-pm8rx" event={"ID":"49ca5f97-ba01-47b9-8100-e55d464d8e6e","Type":"ContainerDied","Data":"46067a52d994ec5f770924f6e4451e22738cc1d6819b90370e6a64504cdf7e81"}
Sep 09 16:47:24.194920 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:47:24.194847    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="46067a52d994ec5f770924f6e4451e22738cc1d6819b90370e6a64504cdf7e81"
Sep 09 16:47:36.105124 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:47:36.105075    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:47:36.107858 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:47:36.107830    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-61f0f9-29816205-4tfdt"]
Sep 09 16:47:36.110511 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:47:36.110480    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-61f0f9-29816205-4tfdt"]
Sep 09 16:47:36.173062 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:47:36.172974    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:47:36.231040 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:47:36.231008    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:47:36.239483 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:47:36.239449    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="809e51ea-bb3c-4367-bc62-e121ee4450e5" path="/var/lib/kubelet/pods/809e51ea-bb3c-4367-bc62-e121ee4450e5/volumes"
Sep 09 16:47:36.287098 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:47:36.287063    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-61f0f9-pm8rx"]
Sep 09 16:47:36.289540 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:47:36.289515    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:47:36.290780 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:47:36.290755    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-61f0f9-pm8rx"]
Sep 09 16:47:36.348290 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:47:36.348260    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:47:36.791842 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:47:36.791799    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:47:36.909965 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:47:36.909932    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:47:37.432675 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:47:37.432640    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:47:38.180233 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:47:38.180196    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:47:38.239962 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:47:38.239930    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="49ca5f97-ba01-47b9-8100-e55d464d8e6e" path="/var/lib/kubelet/pods/49ca5f97-ba01-47b9-8100-e55d464d8e6e/volumes"
Sep 09 16:47:38.775135 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:47:38.775015    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:47:41.714709 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:47:41.714675    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:47:58.929638 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:47:58.929600    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:48:17.803160 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:48:17.803066    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:48:18.635955 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:48:18.635910    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:48:24.102802 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:48:24.102764    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:48:24.240815 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:48:24.240786    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:48:24.369077 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:48:24.368969    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-61f0f9-openshift-default-5f457d8ff8-9kgt8"]
Sep 09 16:48:24.369286 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:48:24.369259    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-a-61f0f9-openshift-default-5f457d8ff8-9kgt8" podUID="b4e002dd-530b-4cf1-bd4c-7705b3ca33ad" containerName="istio-proxy" containerID="cri-o://8057da97218c1a98d18a1f20845aa757316a03a238b231caaeb310ec072c8b9e" gracePeriod=30
Sep 09 16:48:24.761965 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:48:24.761876    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-cd0c91-kq2vz"]
Sep 09 16:48:24.762329 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:48:24.762316    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="23e58267-abd7-4b60-8ac5-6c9935a2cac3" containerName="istio-proxy"
Sep 09 16:48:24.762381 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:48:24.762331    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="23e58267-abd7-4b60-8ac5-6c9935a2cac3" containerName="istio-proxy"
Sep 09 16:48:24.762381 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:48:24.762341    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="49ca5f97-ba01-47b9-8100-e55d464d8e6e" containerName="revoke-keys"
Sep 09 16:48:24.762381 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:48:24.762348    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="49ca5f97-ba01-47b9-8100-e55d464d8e6e" containerName="revoke-keys"
Sep 09 16:48:24.762381 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:48:24.762368    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="23e58267-abd7-4b60-8ac5-6c9935a2cac3" containerName="istio-proxy"
Sep 09 16:48:24.762381 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:48:24.762373    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="23e58267-abd7-4b60-8ac5-6c9935a2cac3" containerName="istio-proxy"
Sep 09 16:48:24.762535 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:48:24.762436    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="23e58267-abd7-4b60-8ac5-6c9935a2cac3" containerName="istio-proxy"
Sep 09 16:48:24.762535 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:48:24.762444    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="23e58267-abd7-4b60-8ac5-6c9935a2cac3" containerName="istio-proxy"
Sep 09 16:48:24.762535 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:48:24.762452    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="49ca5f97-ba01-47b9-8100-e55d464d8e6e" containerName="revoke-keys"
Sep 09 16:48:24.765586 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:48:24.765568    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-cd0c91-kq2vz"
Sep 09 16:48:24.768238 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:48:24.768218    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jz5ff\""
Sep 09 16:48:24.772089 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:48:24.772055    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-cd0c91-kq2vz"]
Sep 09 16:48:24.856763 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:48:24.856727    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f03c19d8-3098-468a-bc6a-48663926b252-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-cd0c91-kq2vz\" (UID: \"f03c19d8-3098-468a-bc6a-48663926b252\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-cd0c91-kq2vz"
Sep 09 16:48:24.959257 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:48:24.958041    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f03c19d8-3098-468a-bc6a-48663926b252-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-cd0c91-kq2vz\" (UID: \"f03c19d8-3098-468a-bc6a-48663926b252\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-cd0c91-kq2vz"
Sep 09 16:48:24.959257 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:48:24.959188    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f03c19d8-3098-468a-bc6a-48663926b252-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-cd0c91-kq2vz\" (UID: \"f03c19d8-3098-468a-bc6a-48663926b252\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-cd0c91-kq2vz"
Sep 09 16:48:25.077487 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:48:25.077439    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-cd0c91-kq2vz"
Sep 09 16:48:25.213665 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:48:25.213633    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:48:25.313767 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:48:25.313734    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:48:25.353495 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:48:25.353464    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-cd0c91-kq2vz"]
Sep 09 16:48:25.355276 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:48:25.355246    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf03c19d8_3098_468a_bc6a_48663926b252.slice/crio-e8553099c12c884061344b44b943302b536e111c86e75465871fc4f7d1759c83 WatchSource:0}: Error finding container e8553099c12c884061344b44b943302b536e111c86e75465871fc4f7d1759c83: Status 404 returned error can't find the container with id e8553099c12c884061344b44b943302b536e111c86e75465871fc4f7d1759c83
Sep 09 16:48:25.535071 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:48:25.535031    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-cd0c91-kq2vz" event={"ID":"f03c19d8-3098-468a-bc6a-48663926b252","Type":"ContainerStarted","Data":"e8553099c12c884061344b44b943302b536e111c86e75465871fc4f7d1759c83"}
Sep 09 16:48:25.633356 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:48:25.633325    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:48:26.355350 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:48:26.355258    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:48:26.543263 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:48:26.543224    2583 generic.go:356] "Generic (PLEG): container finished" podID="f03c19d8-3098-468a-bc6a-48663926b252" containerID="11ad3e857167dac96af4650283c1fd53e7a62a0490d389242ceaf159c609543d" exitCode=0
Sep 09 16:48:26.543431 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:48:26.543304    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-cd0c91-kq2vz" event={"ID":"f03c19d8-3098-468a-bc6a-48663926b252","Type":"ContainerDied","Data":"11ad3e857167dac96af4650283c1fd53e7a62a0490d389242ceaf159c609543d"}
Sep 09 16:48:26.958939 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:48:26.958904    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:48:27.644185 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:48:27.644151    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:48:27.692325 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:48:27.692302    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-cd0c91-kq2vz"
Sep 09 16:48:27.784078 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:48:27.784050    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f03c19d8-3098-468a-bc6a-48663926b252-maas-api-service-ca\") pod \"f03c19d8-3098-468a-bc6a-48663926b252\" (UID: \"f03c19d8-3098-468a-bc6a-48663926b252\") "
Sep 09 16:48:27.784410 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:48:27.784381    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f03c19d8-3098-468a-bc6a-48663926b252-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "f03c19d8-3098-468a-bc6a-48663926b252" (UID: "f03c19d8-3098-468a-bc6a-48663926b252"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 16:48:27.885415 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:48:27.885374    2583 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f03c19d8-3098-468a-bc6a-48663926b252-maas-api-service-ca\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\""
Sep 09 16:48:28.556430 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:48:28.556345    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-cd0c91-kq2vz"
Sep 09 16:48:28.556430 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:48:28.556380    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-cd0c91-kq2vz" event={"ID":"f03c19d8-3098-468a-bc6a-48663926b252","Type":"ContainerDied","Data":"e8553099c12c884061344b44b943302b536e111c86e75465871fc4f7d1759c83"}
Sep 09 16:48:28.556618 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:48:28.556435    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e8553099c12c884061344b44b943302b536e111c86e75465871fc4f7d1759c83"
Sep 09 16:48:29.565826 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:48:29.565796    2583 generic.go:356] "Generic (PLEG): container finished" podID="b4e002dd-530b-4cf1-bd4c-7705b3ca33ad" containerID="8057da97218c1a98d18a1f20845aa757316a03a238b231caaeb310ec072c8b9e" exitCode=0
Sep 09 16:48:29.566287 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:48:29.565868    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-61f0f9-openshift-default-5f457d8ff8-9kgt8" event={"ID":"b4e002dd-530b-4cf1-bd4c-7705b3ca33ad","Type":"ContainerDied","Data":"8057da97218c1a98d18a1f20845aa757316a03a238b231caaeb310ec072c8b9e"}
Sep 09 16:48:29.566287 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:48:29.565934    2583 scope.go:117] "RemoveContainer" containerID="4c30f3df922ffc4e100603c87e0ca99e4b6b8e02c7b39d140ba0a2c28a3b559f"
Sep 09 16:48:29.634411 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:48:29.634392    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-61f0f9-openshift-default-5f457d8ff8-9kgt8"
Sep 09 16:48:29.702514 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:48:29.702486    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b4e002dd-530b-4cf1-bd4c-7705b3ca33ad-istio-token\") pod \"b4e002dd-530b-4cf1-bd4c-7705b3ca33ad\" (UID: \"b4e002dd-530b-4cf1-bd4c-7705b3ca33ad\") "
Sep 09 16:48:29.702663 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:48:29.702529    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hzqlp\" (UniqueName: \"kubernetes.io/projected/b4e002dd-530b-4cf1-bd4c-7705b3ca33ad-kube-api-access-hzqlp\") pod \"b4e002dd-530b-4cf1-bd4c-7705b3ca33ad\" (UID: \"b4e002dd-530b-4cf1-bd4c-7705b3ca33ad\") "
Sep 09 16:48:29.702663 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:48:29.702620    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b4e002dd-530b-4cf1-bd4c-7705b3ca33ad-istiod-ca-cert\") pod \"b4e002dd-530b-4cf1-bd4c-7705b3ca33ad\" (UID: \"b4e002dd-530b-4cf1-bd4c-7705b3ca33ad\") "
Sep 09 16:48:29.702752 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:48:29.702661    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b4e002dd-530b-4cf1-bd4c-7705b3ca33ad-credential-socket\") pod \"b4e002dd-530b-4cf1-bd4c-7705b3ca33ad\" (UID: \"b4e002dd-530b-4cf1-bd4c-7705b3ca33ad\") "
Sep 09 16:48:29.702752 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:48:29.702716    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b4e002dd-530b-4cf1-bd4c-7705b3ca33ad-istio-podinfo\") pod \"b4e002dd-530b-4cf1-bd4c-7705b3ca33ad\" (UID: \"b4e002dd-530b-4cf1-bd4c-7705b3ca33ad\") "
Sep 09 16:48:29.702863 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:48:29.702759    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b4e002dd-530b-4cf1-bd4c-7705b3ca33ad-workload-certs\") pod \"b4e002dd-530b-4cf1-bd4c-7705b3ca33ad\" (UID: \"b4e002dd-530b-4cf1-bd4c-7705b3ca33ad\") "
Sep 09 16:48:29.702863 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:48:29.702805    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b4e002dd-530b-4cf1-bd4c-7705b3ca33ad-workload-socket\") pod \"b4e002dd-530b-4cf1-bd4c-7705b3ca33ad\" (UID: \"b4e002dd-530b-4cf1-bd4c-7705b3ca33ad\") "
Sep 09 16:48:29.702863 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:48:29.702848    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b4e002dd-530b-4cf1-bd4c-7705b3ca33ad-istio-data\") pod \"b4e002dd-530b-4cf1-bd4c-7705b3ca33ad\" (UID: \"b4e002dd-530b-4cf1-bd4c-7705b3ca33ad\") "
Sep 09 16:48:29.703039 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:48:29.702870    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b4e002dd-530b-4cf1-bd4c-7705b3ca33ad-istio-envoy\") pod \"b4e002dd-530b-4cf1-bd4c-7705b3ca33ad\" (UID: \"b4e002dd-530b-4cf1-bd4c-7705b3ca33ad\") "
Sep 09 16:48:29.703039 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:48:29.702995    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b4e002dd-530b-4cf1-bd4c-7705b3ca33ad-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b4e002dd-530b-4cf1-bd4c-7705b3ca33ad" (UID: "b4e002dd-530b-4cf1-bd4c-7705b3ca33ad"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 16:48:29.703167 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:48:29.703109    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b4e002dd-530b-4cf1-bd4c-7705b3ca33ad-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b4e002dd-530b-4cf1-bd4c-7705b3ca33ad" (UID: "b4e002dd-530b-4cf1-bd4c-7705b3ca33ad"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 16:48:29.703220 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:48:29.703164    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b4e002dd-530b-4cf1-bd4c-7705b3ca33ad-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b4e002dd-530b-4cf1-bd4c-7705b3ca33ad" (UID: "b4e002dd-530b-4cf1-bd4c-7705b3ca33ad"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 16:48:29.703376 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:48:29.703351    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b4e002dd-530b-4cf1-bd4c-7705b3ca33ad-istio-data" (OuterVolumeSpecName: "istio-data") pod "b4e002dd-530b-4cf1-bd4c-7705b3ca33ad" (UID: "b4e002dd-530b-4cf1-bd4c-7705b3ca33ad"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 16:48:29.703456 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:48:29.703422    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b4e002dd-530b-4cf1-bd4c-7705b3ca33ad-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b4e002dd-530b-4cf1-bd4c-7705b3ca33ad" (UID: "b4e002dd-530b-4cf1-bd4c-7705b3ca33ad"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 16:48:29.703456 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:48:29.703427    2583 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b4e002dd-530b-4cf1-bd4c-7705b3ca33ad-istiod-ca-cert\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\""
Sep 09 16:48:29.703545 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:48:29.703456    2583 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b4e002dd-530b-4cf1-bd4c-7705b3ca33ad-credential-socket\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\""
Sep 09 16:48:29.703545 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:48:29.703472    2583 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b4e002dd-530b-4cf1-bd4c-7705b3ca33ad-workload-socket\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\""
Sep 09 16:48:29.705219 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:48:29.705195    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b4e002dd-530b-4cf1-bd4c-7705b3ca33ad-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b4e002dd-530b-4cf1-bd4c-7705b3ca33ad" (UID: "b4e002dd-530b-4cf1-bd4c-7705b3ca33ad"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 09 16:48:29.705395 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:48:29.705373    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b4e002dd-530b-4cf1-bd4c-7705b3ca33ad-kube-api-access-hzqlp" (OuterVolumeSpecName: "kube-api-access-hzqlp") pod "b4e002dd-530b-4cf1-bd4c-7705b3ca33ad" (UID: "b4e002dd-530b-4cf1-bd4c-7705b3ca33ad"). InnerVolumeSpecName "kube-api-access-hzqlp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 16:48:29.705511 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:48:29.705391    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b4e002dd-530b-4cf1-bd4c-7705b3ca33ad-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b4e002dd-530b-4cf1-bd4c-7705b3ca33ad" (UID: "b4e002dd-530b-4cf1-bd4c-7705b3ca33ad"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 16:48:29.705511 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:48:29.705408    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b4e002dd-530b-4cf1-bd4c-7705b3ca33ad-istio-token" (OuterVolumeSpecName: "istio-token") pod "b4e002dd-530b-4cf1-bd4c-7705b3ca33ad" (UID: "b4e002dd-530b-4cf1-bd4c-7705b3ca33ad"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 16:48:29.804751 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:48:29.804656    2583 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b4e002dd-530b-4cf1-bd4c-7705b3ca33ad-istio-podinfo\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\""
Sep 09 16:48:29.804751 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:48:29.804692    2583 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b4e002dd-530b-4cf1-bd4c-7705b3ca33ad-workload-certs\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\""
Sep 09 16:48:29.804751 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:48:29.804701    2583 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b4e002dd-530b-4cf1-bd4c-7705b3ca33ad-istio-data\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\""
Sep 09 16:48:29.804751 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:48:29.804711    2583 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b4e002dd-530b-4cf1-bd4c-7705b3ca33ad-istio-envoy\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\""
Sep 09 16:48:29.804751 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:48:29.804718    2583 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b4e002dd-530b-4cf1-bd4c-7705b3ca33ad-istio-token\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\""
Sep 09 16:48:29.804751 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:48:29.804726    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hzqlp\" (UniqueName: \"kubernetes.io/projected/b4e002dd-530b-4cf1-bd4c-7705b3ca33ad-kube-api-access-hzqlp\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\""
Sep 09 16:48:30.573211 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:48:30.573179    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-61f0f9-openshift-default-5f457d8ff8-9kgt8"
Sep 09 16:48:30.573620 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:48:30.573189    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-61f0f9-openshift-default-5f457d8ff8-9kgt8" event={"ID":"b4e002dd-530b-4cf1-bd4c-7705b3ca33ad","Type":"ContainerDied","Data":"e7f0aedcc5b3365ffc46f8bf51bfb4b68c7b57616800c5204fb9a38e9e8612fc"}
Sep 09 16:48:30.573620 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:48:30.573310    2583 scope.go:117] "RemoveContainer" containerID="8057da97218c1a98d18a1f20845aa757316a03a238b231caaeb310ec072c8b9e"
Sep 09 16:48:30.593332 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:48:30.593292    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-61f0f9-openshift-default-5f457d8ff8-9kgt8"]
Sep 09 16:48:30.596447 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:48:30.596410    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-a-61f0f9-openshift-default-5f457d8ff8-9kgt8"]
Sep 09 16:48:31.642086 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:48:31.642048    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:48:32.239219 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:48:32.239183    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b4e002dd-530b-4cf1-bd4c-7705b3ca33ad" path="/var/lib/kubelet/pods/b4e002dd-530b-4cf1-bd4c-7705b3ca33ad/volumes"
Sep 09 16:48:34.876834 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:48:34.876801    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:48:35.496562 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:48:35.496526    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-cd0c91-kq2vz"]
Sep 09 16:48:35.499267 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:48:35.499233    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-cd0c91-kq2vz"]
Sep 09 16:48:36.239638 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:48:36.239604    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f03c19d8-3098-468a-bc6a-48663926b252" path="/var/lib/kubelet/pods/f03c19d8-3098-468a-bc6a-48663926b252/volumes"
Sep 09 16:48:36.967647 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:48:36.967593    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:48:37.052296 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:48:37.052247    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:48:37.366586 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:48:37.366550    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:48:41.561745 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:48:41.561711    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:48:41.618768 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:48:41.618734    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:48:41.822840 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:48:41.822787    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-cd0c91-openshift-default-57d8886756-xwmpv"]
Sep 09 16:48:41.823117 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:48:41.823087    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-b-cd0c91-openshift-default-57d8886756-xwmpv" podUID="2dc3d0d9-3c75-475f-836d-0a544e1907cc" containerName="istio-proxy" containerID="cri-o://53a67ffe927db868a3c84b5a026f6eec66769c02737a404df592c5bbcfe7f1f0" gracePeriod=30
Sep 09 16:48:41.840786 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:48:41.840749    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:48:42.202077 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:48:42.201973    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-331bf8-jv229"]
Sep 09 16:48:42.202674 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:48:42.202653    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f03c19d8-3098-468a-bc6a-48663926b252" containerName="revoke-keys"
Sep 09 16:48:42.202737 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:48:42.202679    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="f03c19d8-3098-468a-bc6a-48663926b252" containerName="revoke-keys"
Sep 09 16:48:42.202737 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:48:42.202697    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b4e002dd-530b-4cf1-bd4c-7705b3ca33ad" containerName="istio-proxy"
Sep 09 16:48:42.202737 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:48:42.202706    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="b4e002dd-530b-4cf1-bd4c-7705b3ca33ad" containerName="istio-proxy"
Sep 09 16:48:42.202737 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:48:42.202721    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b4e002dd-530b-4cf1-bd4c-7705b3ca33ad" containerName="istio-proxy"
Sep 09 16:48:42.202737 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:48:42.202731    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="b4e002dd-530b-4cf1-bd4c-7705b3ca33ad" containerName="istio-proxy"
Sep 09 16:48:42.202900 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:48:42.202850    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="b4e002dd-530b-4cf1-bd4c-7705b3ca33ad" containerName="istio-proxy"
Sep 09 16:48:42.202900 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:48:42.202869    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="f03c19d8-3098-468a-bc6a-48663926b252" containerName="revoke-keys"
Sep 09 16:48:42.208721 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:48:42.208685    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-331bf8-jv229"
Sep 09 16:48:42.218003 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:48:42.211480    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jz5ff\""
Sep 09 16:48:42.218003 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:48:42.215468    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-331bf8-jv229"]
Sep 09 16:48:42.333608 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:48:42.333570    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/914feefd-b955-41f0-910a-10cb5c61c147-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-331bf8-jv229\" (UID: \"914feefd-b955-41f0-910a-10cb5c61c147\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-331bf8-jv229"
Sep 09 16:48:42.435475 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:48:42.435433    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/914feefd-b955-41f0-910a-10cb5c61c147-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-331bf8-jv229\" (UID: \"914feefd-b955-41f0-910a-10cb5c61c147\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-331bf8-jv229"
Sep 09 16:48:42.436146 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:48:42.436119    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/914feefd-b955-41f0-910a-10cb5c61c147-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-331bf8-jv229\" (UID: \"914feefd-b955-41f0-910a-10cb5c61c147\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-331bf8-jv229"
Sep 09 16:48:42.459219 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:48:42.459129    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:48:42.535180 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:48:42.535140    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-331bf8-jv229"
Sep 09 16:48:42.808025 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:48:42.807977    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-331bf8-jv229"]
Sep 09 16:48:42.810016 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:48:42.809944    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod914feefd_b955_41f0_910a_10cb5c61c147.slice/crio-e6d1ac682cdc7381ec94644fb72527cab6d71b61b74eb298293d8b3f7e985060 WatchSource:0}: Error finding container e6d1ac682cdc7381ec94644fb72527cab6d71b61b74eb298293d8b3f7e985060: Status 404 returned error can't find the container with id e6d1ac682cdc7381ec94644fb72527cab6d71b61b74eb298293d8b3f7e985060
Sep 09 16:48:43.167615 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:48:43.167581    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:48:43.659414 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:48:43.659385    2583 generic.go:356] "Generic (PLEG): container finished" podID="914feefd-b955-41f0-910a-10cb5c61c147" containerID="b888b85ca3df120699bf3d0d75b7d580ac68fd11f7bd21769a64bd4cd71bd384" exitCode=0
Sep 09 16:48:43.659583 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:48:43.659475    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-331bf8-jv229" event={"ID":"914feefd-b955-41f0-910a-10cb5c61c147","Type":"ContainerDied","Data":"b888b85ca3df120699bf3d0d75b7d580ac68fd11f7bd21769a64bd4cd71bd384"}
Sep 09 16:48:43.659583 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:48:43.659536    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-331bf8-jv229" event={"ID":"914feefd-b955-41f0-910a-10cb5c61c147","Type":"ContainerStarted","Data":"e6d1ac682cdc7381ec94644fb72527cab6d71b61b74eb298293d8b3f7e985060"}
Sep 09 16:48:43.866204 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:48:43.866163    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:48:44.465347 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:48:44.465319    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:48:44.804340 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:48:44.804311    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-331bf8-jv229"
Sep 09 16:48:44.960202 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:48:44.960171    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/914feefd-b955-41f0-910a-10cb5c61c147-maas-api-service-ca\") pod \"914feefd-b955-41f0-910a-10cb5c61c147\" (UID: \"914feefd-b955-41f0-910a-10cb5c61c147\") "
Sep 09 16:48:44.960565 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:48:44.960517    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/914feefd-b955-41f0-910a-10cb5c61c147-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "914feefd-b955-41f0-910a-10cb5c61c147" (UID: "914feefd-b955-41f0-910a-10cb5c61c147"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 16:48:45.061306 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:48:45.061211    2583 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/914feefd-b955-41f0-910a-10cb5c61c147-maas-api-service-ca\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\""
Sep 09 16:48:45.167592 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:48:45.167548    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:48:45.672876 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:48:45.672847    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-331bf8-jv229"
Sep 09 16:48:45.673084 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:48:45.672890    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-331bf8-jv229" event={"ID":"914feefd-b955-41f0-910a-10cb5c61c147","Type":"ContainerDied","Data":"e6d1ac682cdc7381ec94644fb72527cab6d71b61b74eb298293d8b3f7e985060"}
Sep 09 16:48:45.673084 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:48:45.672947    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e6d1ac682cdc7381ec94644fb72527cab6d71b61b74eb298293d8b3f7e985060"
Sep 09 16:48:46.634587 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:48:46.634551    2583 patch_prober.go:28] interesting pod/e2e-ipp-b-cd0c91-openshift-default-57d8886756-xwmpv container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 09 16:48:46.634952 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:48:46.634608    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-b-cd0c91-openshift-default-57d8886756-xwmpv" podUID="2dc3d0d9-3c75-475f-836d-0a544e1907cc" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 16:48:47.078027 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:48:47.078000    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-cd0c91-openshift-default-57d8886756-xwmpv"
Sep 09 16:48:47.181954 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:48:47.181917    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2dc3d0d9-3c75-475f-836d-0a544e1907cc-istiod-ca-cert\") pod \"2dc3d0d9-3c75-475f-836d-0a544e1907cc\" (UID: \"2dc3d0d9-3c75-475f-836d-0a544e1907cc\") "
Sep 09 16:48:47.182157 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:48:47.182008    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2dc3d0d9-3c75-475f-836d-0a544e1907cc-workload-socket\") pod \"2dc3d0d9-3c75-475f-836d-0a544e1907cc\" (UID: \"2dc3d0d9-3c75-475f-836d-0a544e1907cc\") "
Sep 09 16:48:47.182157 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:48:47.182040    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2dc3d0d9-3c75-475f-836d-0a544e1907cc-istio-envoy\") pod \"2dc3d0d9-3c75-475f-836d-0a544e1907cc\" (UID: \"2dc3d0d9-3c75-475f-836d-0a544e1907cc\") "
Sep 09 16:48:47.182157 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:48:47.182089    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2dc3d0d9-3c75-475f-836d-0a544e1907cc-istio-data\") pod \"2dc3d0d9-3c75-475f-836d-0a544e1907cc\" (UID: \"2dc3d0d9-3c75-475f-836d-0a544e1907cc\") "
Sep 09 16:48:47.182157 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:48:47.182113    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2dc3d0d9-3c75-475f-836d-0a544e1907cc-istio-podinfo\") pod \"2dc3d0d9-3c75-475f-836d-0a544e1907cc\" (UID: \"2dc3d0d9-3c75-475f-836d-0a544e1907cc\") "
Sep 09 16:48:47.182360 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:48:47.182226    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2dc3d0d9-3c75-475f-836d-0a544e1907cc-workload-certs\") pod \"2dc3d0d9-3c75-475f-836d-0a544e1907cc\" (UID: \"2dc3d0d9-3c75-475f-836d-0a544e1907cc\") "
Sep 09 16:48:47.182360 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:48:47.182263    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2dc3d0d9-3c75-475f-836d-0a544e1907cc-credential-socket\") pod \"2dc3d0d9-3c75-475f-836d-0a544e1907cc\" (UID: \"2dc3d0d9-3c75-475f-836d-0a544e1907cc\") "
Sep 09 16:48:47.182360 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:48:47.182296    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-84s9j\" (UniqueName: \"kubernetes.io/projected/2dc3d0d9-3c75-475f-836d-0a544e1907cc-kube-api-access-84s9j\") pod \"2dc3d0d9-3c75-475f-836d-0a544e1907cc\" (UID: \"2dc3d0d9-3c75-475f-836d-0a544e1907cc\") "
Sep 09 16:48:47.182360 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:48:47.182325    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2dc3d0d9-3c75-475f-836d-0a544e1907cc-istio-token\") pod \"2dc3d0d9-3c75-475f-836d-0a544e1907cc\" (UID: \"2dc3d0d9-3c75-475f-836d-0a544e1907cc\") "
Sep 09 16:48:47.182549 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:48:47.182406    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2dc3d0d9-3c75-475f-836d-0a544e1907cc-istio-data" (OuterVolumeSpecName: "istio-data") pod "2dc3d0d9-3c75-475f-836d-0a544e1907cc" (UID: "2dc3d0d9-3c75-475f-836d-0a544e1907cc"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 16:48:47.182549 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:48:47.182323    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2dc3d0d9-3c75-475f-836d-0a544e1907cc-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "2dc3d0d9-3c75-475f-836d-0a544e1907cc" (UID: "2dc3d0d9-3c75-475f-836d-0a544e1907cc"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 16:48:47.182549 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:48:47.182448    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2dc3d0d9-3c75-475f-836d-0a544e1907cc-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "2dc3d0d9-3c75-475f-836d-0a544e1907cc" (UID: "2dc3d0d9-3c75-475f-836d-0a544e1907cc"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 16:48:47.182716 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:48:47.182557    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2dc3d0d9-3c75-475f-836d-0a544e1907cc-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "2dc3d0d9-3c75-475f-836d-0a544e1907cc" (UID: "2dc3d0d9-3c75-475f-836d-0a544e1907cc"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 16:48:47.182716 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:48:47.182596    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2dc3d0d9-3c75-475f-836d-0a544e1907cc-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "2dc3d0d9-3c75-475f-836d-0a544e1907cc" (UID: "2dc3d0d9-3c75-475f-836d-0a544e1907cc"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 16:48:47.182808 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:48:47.182779    2583 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2dc3d0d9-3c75-475f-836d-0a544e1907cc-workload-certs\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\""
Sep 09 16:48:47.182808 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:48:47.182793    2583 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2dc3d0d9-3c75-475f-836d-0a544e1907cc-credential-socket\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\""
Sep 09 16:48:47.182808 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:48:47.182803    2583 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2dc3d0d9-3c75-475f-836d-0a544e1907cc-istiod-ca-cert\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\""
Sep 09 16:48:47.182921 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:48:47.182811    2583 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2dc3d0d9-3c75-475f-836d-0a544e1907cc-workload-socket\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\""
Sep 09 16:48:47.182921 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:48:47.182819    2583 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2dc3d0d9-3c75-475f-836d-0a544e1907cc-istio-data\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\""
Sep 09 16:48:47.184932 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:48:47.184895    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2dc3d0d9-3c75-475f-836d-0a544e1907cc-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "2dc3d0d9-3c75-475f-836d-0a544e1907cc" (UID: "2dc3d0d9-3c75-475f-836d-0a544e1907cc"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 09 16:48:47.185061 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:48:47.184964    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2dc3d0d9-3c75-475f-836d-0a544e1907cc-kube-api-access-84s9j" (OuterVolumeSpecName: "kube-api-access-84s9j") pod "2dc3d0d9-3c75-475f-836d-0a544e1907cc" (UID: "2dc3d0d9-3c75-475f-836d-0a544e1907cc"). InnerVolumeSpecName "kube-api-access-84s9j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 16:48:47.185061 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:48:47.185005    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2dc3d0d9-3c75-475f-836d-0a544e1907cc-istio-token" (OuterVolumeSpecName: "istio-token") pod "2dc3d0d9-3c75-475f-836d-0a544e1907cc" (UID: "2dc3d0d9-3c75-475f-836d-0a544e1907cc"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 16:48:47.185170 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:48:47.185126    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2dc3d0d9-3c75-475f-836d-0a544e1907cc-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "2dc3d0d9-3c75-475f-836d-0a544e1907cc" (UID: "2dc3d0d9-3c75-475f-836d-0a544e1907cc"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 16:48:47.284058 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:48:47.284034    2583 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2dc3d0d9-3c75-475f-836d-0a544e1907cc-istio-envoy\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\""
Sep 09 16:48:47.284058 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:48:47.284056    2583 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2dc3d0d9-3c75-475f-836d-0a544e1907cc-istio-podinfo\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\""
Sep 09 16:48:47.284190 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:48:47.284065    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-84s9j\" (UniqueName: \"kubernetes.io/projected/2dc3d0d9-3c75-475f-836d-0a544e1907cc-kube-api-access-84s9j\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\""
Sep 09 16:48:47.284190 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:48:47.284076    2583 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2dc3d0d9-3c75-475f-836d-0a544e1907cc-istio-token\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\""
Sep 09 16:48:47.686807 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:48:47.686771    2583 generic.go:356] "Generic (PLEG): container finished" podID="2dc3d0d9-3c75-475f-836d-0a544e1907cc" containerID="53a67ffe927db868a3c84b5a026f6eec66769c02737a404df592c5bbcfe7f1f0" exitCode=0
Sep 09 16:48:47.687270 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:48:47.686832    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-cd0c91-openshift-default-57d8886756-xwmpv"
Sep 09 16:48:47.687270 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:48:47.686855    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-cd0c91-openshift-default-57d8886756-xwmpv" event={"ID":"2dc3d0d9-3c75-475f-836d-0a544e1907cc","Type":"ContainerDied","Data":"53a67ffe927db868a3c84b5a026f6eec66769c02737a404df592c5bbcfe7f1f0"}
Sep 09 16:48:47.687270 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:48:47.686911    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-cd0c91-openshift-default-57d8886756-xwmpv" event={"ID":"2dc3d0d9-3c75-475f-836d-0a544e1907cc","Type":"ContainerDied","Data":"97af8bb01a5d273c007f3deace2ef6e18a5b57b268ee135e74464944e2d2ebd3"}
Sep 09 16:48:47.687270 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:48:47.686936    2583 scope.go:117] "RemoveContainer" containerID="53a67ffe927db868a3c84b5a026f6eec66769c02737a404df592c5bbcfe7f1f0"
Sep 09 16:48:47.697007 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:48:47.696964    2583 scope.go:117] "RemoveContainer" containerID="5ba257c9e88c88c15dd2db5664f1a29c7645fc913904560d1d9c74a98a41617b"
Sep 09 16:48:47.706593 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:48:47.706573    2583 scope.go:117] "RemoveContainer" containerID="53a67ffe927db868a3c84b5a026f6eec66769c02737a404df592c5bbcfe7f1f0"
Sep 09 16:48:47.707030 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:48:47.707004    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"53a67ffe927db868a3c84b5a026f6eec66769c02737a404df592c5bbcfe7f1f0\": container with ID starting with 53a67ffe927db868a3c84b5a026f6eec66769c02737a404df592c5bbcfe7f1f0 not found: ID does not exist" containerID="53a67ffe927db868a3c84b5a026f6eec66769c02737a404df592c5bbcfe7f1f0"
Sep 09 16:48:47.707092 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:48:47.707040    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"53a67ffe927db868a3c84b5a026f6eec66769c02737a404df592c5bbcfe7f1f0"} err="failed to get container status \"53a67ffe927db868a3c84b5a026f6eec66769c02737a404df592c5bbcfe7f1f0\": rpc error: code = NotFound desc = could not find container \"53a67ffe927db868a3c84b5a026f6eec66769c02737a404df592c5bbcfe7f1f0\": container with ID starting with 53a67ffe927db868a3c84b5a026f6eec66769c02737a404df592c5bbcfe7f1f0 not found: ID does not exist"
Sep 09 16:48:47.707092 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:48:47.707060    2583 scope.go:117] "RemoveContainer" containerID="5ba257c9e88c88c15dd2db5664f1a29c7645fc913904560d1d9c74a98a41617b"
Sep 09 16:48:47.707377 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:48:47.707353    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5ba257c9e88c88c15dd2db5664f1a29c7645fc913904560d1d9c74a98a41617b\": container with ID starting with 5ba257c9e88c88c15dd2db5664f1a29c7645fc913904560d1d9c74a98a41617b not found: ID does not exist" containerID="5ba257c9e88c88c15dd2db5664f1a29c7645fc913904560d1d9c74a98a41617b"
Sep 09 16:48:47.707487 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:48:47.707380    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5ba257c9e88c88c15dd2db5664f1a29c7645fc913904560d1d9c74a98a41617b"} err="failed to get container status \"5ba257c9e88c88c15dd2db5664f1a29c7645fc913904560d1d9c74a98a41617b\": rpc error: code = NotFound desc = could not find container \"5ba257c9e88c88c15dd2db5664f1a29c7645fc913904560d1d9c74a98a41617b\": container with ID starting with 5ba257c9e88c88c15dd2db5664f1a29c7645fc913904560d1d9c74a98a41617b not found: ID does not exist"
Sep 09 16:48:47.709127 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:48:47.709106    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-cd0c91-openshift-default-57d8886756-xwmpv"]
Sep 09 16:48:47.711943 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:48:47.711917    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-b-cd0c91-openshift-default-57d8886756-xwmpv"]
Sep 09 16:48:48.240933 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:48:48.240896    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2dc3d0d9-3c75-475f-836d-0a544e1907cc" path="/var/lib/kubelet/pods/2dc3d0d9-3c75-475f-836d-0a544e1907cc/volumes"
Sep 09 16:48:52.363353 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:48:52.363317    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:48:52.866533 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:48:52.866501    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-331bf8-29816205-jpr52"]
Sep 09 16:48:52.870112 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:48:52.870084    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:48:52.870922 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:48:52.870902    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-331bf8-29816205-jpr52"]
Sep 09 16:48:52.967924 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:48:52.967891    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:48:53.042073 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:48:53.042026    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-331bf8-jv229"]
Sep 09 16:48:53.044734 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:48:53.044707    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:48:53.046394 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:48:53.046372    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-331bf8-jv229"]
Sep 09 16:48:53.103838 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:48:53.103793    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:48:53.420847 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:48:53.420811    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:48:53.521653 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:48:53.521618    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:48:54.100421 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:48:54.100390    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:48:54.239185 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:48:54.239150    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="464b4cfd-8b8c-4096-a371-dfce187f98d9" path="/var/lib/kubelet/pods/464b4cfd-8b8c-4096-a371-dfce187f98d9/volumes"
Sep 09 16:48:54.239552 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:48:54.239534    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="914feefd-b955-41f0-910a-10cb5c61c147" path="/var/lib/kubelet/pods/914feefd-b955-41f0-910a-10cb5c61c147/volumes"
Sep 09 16:48:59.083764 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:48:59.083735    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:48:59.143046 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:48:59.143021    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:48:59.363848 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:48:59.363767    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:48:59.718379 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:48:59.718288    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-50fcbc-4r25x"]
Sep 09 16:48:59.718798 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:48:59.718776    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2dc3d0d9-3c75-475f-836d-0a544e1907cc" containerName="istio-proxy"
Sep 09 16:48:59.718897 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:48:59.718800    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="2dc3d0d9-3c75-475f-836d-0a544e1907cc" containerName="istio-proxy"
Sep 09 16:48:59.718897 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:48:59.718837    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="914feefd-b955-41f0-910a-10cb5c61c147" containerName="revoke-keys"
Sep 09 16:48:59.718897 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:48:59.718847    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="914feefd-b955-41f0-910a-10cb5c61c147" containerName="revoke-keys"
Sep 09 16:48:59.718897 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:48:59.718855    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2dc3d0d9-3c75-475f-836d-0a544e1907cc" containerName="istio-proxy"
Sep 09 16:48:59.718897 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:48:59.718865    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="2dc3d0d9-3c75-475f-836d-0a544e1907cc" containerName="istio-proxy"
Sep 09 16:48:59.719165 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:48:59.718977    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="2dc3d0d9-3c75-475f-836d-0a544e1907cc" containerName="istio-proxy"
Sep 09 16:48:59.719165 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:48:59.719014    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="b4e002dd-530b-4cf1-bd4c-7705b3ca33ad" containerName="istio-proxy"
Sep 09 16:48:59.719165 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:48:59.719029    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="914feefd-b955-41f0-910a-10cb5c61c147" containerName="revoke-keys"
Sep 09 16:48:59.723965 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:48:59.723944    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-50fcbc-4r25x"
Sep 09 16:48:59.726598 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:48:59.726572    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jz5ff\""
Sep 09 16:48:59.728042 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:48:59.728023    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-50fcbc-4r25x"]
Sep 09 16:48:59.801788 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:48:59.801757    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/47468b57-e3ef-4a4a-ab72-71cdb8b2fdda-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w3-50fcbc-4r25x\" (UID: \"47468b57-e3ef-4a4a-ab72-71cdb8b2fdda\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-50fcbc-4r25x"
Sep 09 16:48:59.902526 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:48:59.902496    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/47468b57-e3ef-4a4a-ab72-71cdb8b2fdda-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w3-50fcbc-4r25x\" (UID: \"47468b57-e3ef-4a4a-ab72-71cdb8b2fdda\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-50fcbc-4r25x"
Sep 09 16:48:59.903138 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:48:59.903118    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/47468b57-e3ef-4a4a-ab72-71cdb8b2fdda-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w3-50fcbc-4r25x\" (UID: \"47468b57-e3ef-4a4a-ab72-71cdb8b2fdda\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-50fcbc-4r25x"
Sep 09 16:49:00.036431 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:49:00.036354    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-50fcbc-4r25x"
Sep 09 16:49:00.309056 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:49:00.309033    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-50fcbc-4r25x"]
Sep 09 16:49:00.762143 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:49:00.762104    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-50fcbc-4r25x" event={"ID":"47468b57-e3ef-4a4a-ab72-71cdb8b2fdda","Type":"ContainerStarted","Data":"d564a8cdac869de427ff1d46e076891464d04940f789dc8a71dfd6f224af40e1"}
Sep 09 16:49:00.762316 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:49:00.762158    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-50fcbc-4r25x" event={"ID":"47468b57-e3ef-4a4a-ab72-71cdb8b2fdda","Type":"ContainerStarted","Data":"3aa78a4290a2f193b8026a5101c21af0dba5b16148df34597482fcfcf18e7964"}
Sep 09 16:49:00.777216 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:49:00.777166    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-50fcbc-4r25x" podStartSLOduration=1.777151118 podStartE2EDuration="1.777151118s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 16:48:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:49:00.776017537 +0000 UTC m=+2123.129747393" watchObservedRunningTime="2026-09-09 16:49:00.777151118 +0000 UTC m=+2123.130880948"
Sep 09 16:49:01.458215 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:49:01.458167    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:49:01.558555 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:49:01.558522    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:49:01.769503 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:49:01.769417    2583 generic.go:356] "Generic (PLEG): container finished" podID="47468b57-e3ef-4a4a-ab72-71cdb8b2fdda" containerID="d564a8cdac869de427ff1d46e076891464d04940f789dc8a71dfd6f224af40e1" exitCode=0
Sep 09 16:49:01.769503 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:49:01.769468    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-50fcbc-4r25x" event={"ID":"47468b57-e3ef-4a4a-ab72-71cdb8b2fdda","Type":"ContainerDied","Data":"d564a8cdac869de427ff1d46e076891464d04940f789dc8a71dfd6f224af40e1"}
Sep 09 16:49:02.906196 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:49:02.906173    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-50fcbc-4r25x"
Sep 09 16:49:02.931144 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:49:02.931121    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/47468b57-e3ef-4a4a-ab72-71cdb8b2fdda-maas-api-service-ca\") pod \"47468b57-e3ef-4a4a-ab72-71cdb8b2fdda\" (UID: \"47468b57-e3ef-4a4a-ab72-71cdb8b2fdda\") "
Sep 09 16:49:02.931431 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:49:02.931409    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/47468b57-e3ef-4a4a-ab72-71cdb8b2fdda-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "47468b57-e3ef-4a4a-ab72-71cdb8b2fdda" (UID: "47468b57-e3ef-4a4a-ab72-71cdb8b2fdda"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 16:49:02.931500 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:49:02.931486    2583 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/47468b57-e3ef-4a4a-ab72-71cdb8b2fdda-maas-api-service-ca\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\""
Sep 09 16:49:03.781855 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:49:03.781826    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-50fcbc-4r25x"
Sep 09 16:49:03.782115 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:49:03.781862    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-50fcbc-4r25x" event={"ID":"47468b57-e3ef-4a4a-ab72-71cdb8b2fdda","Type":"ContainerDied","Data":"3aa78a4290a2f193b8026a5101c21af0dba5b16148df34597482fcfcf18e7964"}
Sep 09 16:49:03.782115 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:49:03.781911    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3aa78a4290a2f193b8026a5101c21af0dba5b16148df34597482fcfcf18e7964"
Sep 09 16:49:10.103514 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:49:10.103482    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:49:10.171719 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:49:10.171673    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:49:10.233169 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:49:10.233140    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:49:10.277310 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:49:10.277274    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-50fcbc-4r25x"]
Sep 09 16:49:10.281976 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:49:10.281947    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-50fcbc-4r25x"]
Sep 09 16:49:10.297818 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:49:10.297790    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:49:10.653703 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:49:10.653669    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:49:10.754879 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:49:10.754847    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:49:12.239104 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:49:12.239066    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="47468b57-e3ef-4a4a-ab72-71cdb8b2fdda" path="/var/lib/kubelet/pods/47468b57-e3ef-4a4a-ab72-71cdb8b2fdda/volumes"
Sep 09 16:49:16.417343 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:49:16.417301    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:49:16.475130 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:49:16.475094    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:49:16.666549 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:49:16.666513    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-50fcbc-openshift-default-7cccc7648d-7j88r"]
Sep 09 16:49:16.666842 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:49:16.666811    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w3-50fcbc-openshift-default-7cccc7648d-7j88r" podUID="9eba3116-8b88-4185-bce0-e9fa72554058" containerName="istio-proxy" containerID="cri-o://2fe37c66d85d290d77bc36e8e6efcb5cc5808c2591358f3d0c8383cfd300c00e" gracePeriod=30
Sep 09 16:49:16.714230 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:49:16.714146    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:49:19.342125 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:49:19.342091    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5c78477868-76mcj"]
Sep 09 16:49:19.342535 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:49:19.342320    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-5c78477868-76mcj" podUID="33da4159-33c7-4fbb-838d-cc094a12c744" containerName="manager" containerID="cri-o://7b2e798982f71a71e1a106810f9a357abc3d3ffbbafa37aaa4d3025ed675f72a" gracePeriod=30
Sep 09 16:49:19.585051 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:49:19.585028    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5c78477868-76mcj"
Sep 09 16:49:19.698432 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:49:19.698351    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/33da4159-33c7-4fbb-838d-cc094a12c744-webhook-cert\") pod \"33da4159-33c7-4fbb-838d-cc094a12c744\" (UID: \"33da4159-33c7-4fbb-838d-cc094a12c744\") "
Sep 09 16:49:19.698432 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:49:19.698395    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/33da4159-33c7-4fbb-838d-cc094a12c744-metrics-certs\") pod \"33da4159-33c7-4fbb-838d-cc094a12c744\" (UID: \"33da4159-33c7-4fbb-838d-cc094a12c744\") "
Sep 09 16:49:19.698639 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:49:19.698442    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x482v\" (UniqueName: \"kubernetes.io/projected/33da4159-33c7-4fbb-838d-cc094a12c744-kube-api-access-x482v\") pod \"33da4159-33c7-4fbb-838d-cc094a12c744\" (UID: \"33da4159-33c7-4fbb-838d-cc094a12c744\") "
Sep 09 16:49:19.700466 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:49:19.700432    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/33da4159-33c7-4fbb-838d-cc094a12c744-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "33da4159-33c7-4fbb-838d-cc094a12c744" (UID: "33da4159-33c7-4fbb-838d-cc094a12c744"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 16:49:19.700466 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:49:19.700455    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/33da4159-33c7-4fbb-838d-cc094a12c744-kube-api-access-x482v" (OuterVolumeSpecName: "kube-api-access-x482v") pod "33da4159-33c7-4fbb-838d-cc094a12c744" (UID: "33da4159-33c7-4fbb-838d-cc094a12c744"). InnerVolumeSpecName "kube-api-access-x482v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 16:49:19.700613 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:49:19.700469    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/33da4159-33c7-4fbb-838d-cc094a12c744-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "33da4159-33c7-4fbb-838d-cc094a12c744" (UID: "33da4159-33c7-4fbb-838d-cc094a12c744"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 16:49:19.800104 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:49:19.800074    2583 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/33da4159-33c7-4fbb-838d-cc094a12c744-webhook-cert\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\""
Sep 09 16:49:19.800104 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:49:19.800101    2583 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/33da4159-33c7-4fbb-838d-cc094a12c744-metrics-certs\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\""
Sep 09 16:49:19.800253 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:49:19.800110    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x482v\" (UniqueName: \"kubernetes.io/projected/33da4159-33c7-4fbb-838d-cc094a12c744-kube-api-access-x482v\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\""
Sep 09 16:49:19.871602 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:49:19.871575    2583 generic.go:356] "Generic (PLEG): container finished" podID="33da4159-33c7-4fbb-838d-cc094a12c744" containerID="7b2e798982f71a71e1a106810f9a357abc3d3ffbbafa37aaa4d3025ed675f72a" exitCode=0
Sep 09 16:49:19.871719 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:49:19.871618    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5c78477868-76mcj"
Sep 09 16:49:19.871719 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:49:19.871648    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5c78477868-76mcj" event={"ID":"33da4159-33c7-4fbb-838d-cc094a12c744","Type":"ContainerDied","Data":"7b2e798982f71a71e1a106810f9a357abc3d3ffbbafa37aaa4d3025ed675f72a"}
Sep 09 16:49:19.871719 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:49:19.871689    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5c78477868-76mcj" event={"ID":"33da4159-33c7-4fbb-838d-cc094a12c744","Type":"ContainerDied","Data":"864f611cba5aaf56fb004f6b36a73b850497a6cca63a1c3b34e9caf2ce288d32"}
Sep 09 16:49:19.871719 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:49:19.871710    2583 scope.go:117] "RemoveContainer" containerID="7b2e798982f71a71e1a106810f9a357abc3d3ffbbafa37aaa4d3025ed675f72a"
Sep 09 16:49:19.883662 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:49:19.883642    2583 scope.go:117] "RemoveContainer" containerID="7b2e798982f71a71e1a106810f9a357abc3d3ffbbafa37aaa4d3025ed675f72a"
Sep 09 16:49:19.884114 ip-10-0-131-48 kubenswrapper[2583]: E0909 16:49:19.884092    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7b2e798982f71a71e1a106810f9a357abc3d3ffbbafa37aaa4d3025ed675f72a\": container with ID starting with 7b2e798982f71a71e1a106810f9a357abc3d3ffbbafa37aaa4d3025ed675f72a not found: ID does not exist" containerID="7b2e798982f71a71e1a106810f9a357abc3d3ffbbafa37aaa4d3025ed675f72a"
Sep 09 16:49:19.884201 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:49:19.884121    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7b2e798982f71a71e1a106810f9a357abc3d3ffbbafa37aaa4d3025ed675f72a"} err="failed to get container status \"7b2e798982f71a71e1a106810f9a357abc3d3ffbbafa37aaa4d3025ed675f72a\": rpc error: code = NotFound desc = could not find container \"7b2e798982f71a71e1a106810f9a357abc3d3ffbbafa37aaa4d3025ed675f72a\": container with ID starting with 7b2e798982f71a71e1a106810f9a357abc3d3ffbbafa37aaa4d3025ed675f72a not found: ID does not exist"
Sep 09 16:49:19.892025 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:49:19.891980    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5c78477868-76mcj"]
Sep 09 16:49:19.895980 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:49:19.895960    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-5c78477868-76mcj"]
Sep 09 16:49:20.239389 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:49:20.239359    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="33da4159-33c7-4fbb-838d-cc094a12c744" path="/var/lib/kubelet/pods/33da4159-33c7-4fbb-838d-cc094a12c744/volumes"
Sep 09 16:49:21.888363 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:49:21.888330    2583 generic.go:356] "Generic (PLEG): container finished" podID="9eba3116-8b88-4185-bce0-e9fa72554058" containerID="2fe37c66d85d290d77bc36e8e6efcb5cc5808c2591358f3d0c8383cfd300c00e" exitCode=0
Sep 09 16:49:21.888730 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:49:21.888405    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-50fcbc-openshift-default-7cccc7648d-7j88r" event={"ID":"9eba3116-8b88-4185-bce0-e9fa72554058","Type":"ContainerDied","Data":"2fe37c66d85d290d77bc36e8e6efcb5cc5808c2591358f3d0c8383cfd300c00e"}
Sep 09 16:49:21.888730 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:49:21.888471    2583 scope.go:117] "RemoveContainer" containerID="64e4e443e167ce00ef597e1e6e258ab40bfd192fb706048b0bd1c959410c9c29"
Sep 09 16:49:21.922710 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:49:21.922693    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-50fcbc-openshift-default-7cccc7648d-7j88r"
Sep 09 16:49:22.019632 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:49:22.019569    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9eba3116-8b88-4185-bce0-e9fa72554058-credential-socket\") pod \"9eba3116-8b88-4185-bce0-e9fa72554058\" (UID: \"9eba3116-8b88-4185-bce0-e9fa72554058\") "
Sep 09 16:49:22.019632 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:49:22.019605    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k8wmd\" (UniqueName: \"kubernetes.io/projected/9eba3116-8b88-4185-bce0-e9fa72554058-kube-api-access-k8wmd\") pod \"9eba3116-8b88-4185-bce0-e9fa72554058\" (UID: \"9eba3116-8b88-4185-bce0-e9fa72554058\") "
Sep 09 16:49:22.019822 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:49:22.019648    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9eba3116-8b88-4185-bce0-e9fa72554058-workload-socket\") pod \"9eba3116-8b88-4185-bce0-e9fa72554058\" (UID: \"9eba3116-8b88-4185-bce0-e9fa72554058\") "
Sep 09 16:49:22.019822 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:49:22.019674    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9eba3116-8b88-4185-bce0-e9fa72554058-istio-envoy\") pod \"9eba3116-8b88-4185-bce0-e9fa72554058\" (UID: \"9eba3116-8b88-4185-bce0-e9fa72554058\") "
Sep 09 16:49:22.019822 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:49:22.019701    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9eba3116-8b88-4185-bce0-e9fa72554058-istio-token\") pod \"9eba3116-8b88-4185-bce0-e9fa72554058\" (UID: \"9eba3116-8b88-4185-bce0-e9fa72554058\") "
Sep 09 16:49:22.019822 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:49:22.019774    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9eba3116-8b88-4185-bce0-e9fa72554058-workload-certs\") pod \"9eba3116-8b88-4185-bce0-e9fa72554058\" (UID: \"9eba3116-8b88-4185-bce0-e9fa72554058\") "
Sep 09 16:49:22.019822 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:49:22.019796    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9eba3116-8b88-4185-bce0-e9fa72554058-istiod-ca-cert\") pod \"9eba3116-8b88-4185-bce0-e9fa72554058\" (UID: \"9eba3116-8b88-4185-bce0-e9fa72554058\") "
Sep 09 16:49:22.020110 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:49:22.019842    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9eba3116-8b88-4185-bce0-e9fa72554058-istio-data\") pod \"9eba3116-8b88-4185-bce0-e9fa72554058\" (UID: \"9eba3116-8b88-4185-bce0-e9fa72554058\") "
Sep 09 16:49:22.020110 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:49:22.019867    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9eba3116-8b88-4185-bce0-e9fa72554058-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "9eba3116-8b88-4185-bce0-e9fa72554058" (UID: "9eba3116-8b88-4185-bce0-e9fa72554058"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 16:49:22.020110 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:49:22.019899    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9eba3116-8b88-4185-bce0-e9fa72554058-istio-podinfo\") pod \"9eba3116-8b88-4185-bce0-e9fa72554058\" (UID: \"9eba3116-8b88-4185-bce0-e9fa72554058\") "
Sep 09 16:49:22.020110 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:49:22.019918    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9eba3116-8b88-4185-bce0-e9fa72554058-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "9eba3116-8b88-4185-bce0-e9fa72554058" (UID: "9eba3116-8b88-4185-bce0-e9fa72554058"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 16:49:22.020110 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:49:22.020040    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9eba3116-8b88-4185-bce0-e9fa72554058-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "9eba3116-8b88-4185-bce0-e9fa72554058" (UID: "9eba3116-8b88-4185-bce0-e9fa72554058"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 16:49:22.020110 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:49:22.020088    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9eba3116-8b88-4185-bce0-e9fa72554058-istio-data" (OuterVolumeSpecName: "istio-data") pod "9eba3116-8b88-4185-bce0-e9fa72554058" (UID: "9eba3116-8b88-4185-bce0-e9fa72554058"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 16:49:22.020422 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:49:22.020198    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9eba3116-8b88-4185-bce0-e9fa72554058-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "9eba3116-8b88-4185-bce0-e9fa72554058" (UID: "9eba3116-8b88-4185-bce0-e9fa72554058"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 16:49:22.020422 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:49:22.020275    2583 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9eba3116-8b88-4185-bce0-e9fa72554058-credential-socket\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\""
Sep 09 16:49:22.020422 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:49:22.020293    2583 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9eba3116-8b88-4185-bce0-e9fa72554058-workload-socket\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\""
Sep 09 16:49:22.020422 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:49:22.020305    2583 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9eba3116-8b88-4185-bce0-e9fa72554058-workload-certs\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\""
Sep 09 16:49:22.020422 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:49:22.020314    2583 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9eba3116-8b88-4185-bce0-e9fa72554058-istiod-ca-cert\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\""
Sep 09 16:49:22.020422 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:49:22.020321    2583 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9eba3116-8b88-4185-bce0-e9fa72554058-istio-data\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\""
Sep 09 16:49:22.021851 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:49:22.021831    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9eba3116-8b88-4185-bce0-e9fa72554058-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "9eba3116-8b88-4185-bce0-e9fa72554058" (UID: "9eba3116-8b88-4185-bce0-e9fa72554058"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 09 16:49:22.021953 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:49:22.021944    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9eba3116-8b88-4185-bce0-e9fa72554058-kube-api-access-k8wmd" (OuterVolumeSpecName: "kube-api-access-k8wmd") pod "9eba3116-8b88-4185-bce0-e9fa72554058" (UID: "9eba3116-8b88-4185-bce0-e9fa72554058"). InnerVolumeSpecName "kube-api-access-k8wmd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 16:49:22.022164 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:49:22.022147    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9eba3116-8b88-4185-bce0-e9fa72554058-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "9eba3116-8b88-4185-bce0-e9fa72554058" (UID: "9eba3116-8b88-4185-bce0-e9fa72554058"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 16:49:22.022277 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:49:22.022264    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9eba3116-8b88-4185-bce0-e9fa72554058-istio-token" (OuterVolumeSpecName: "istio-token") pod "9eba3116-8b88-4185-bce0-e9fa72554058" (UID: "9eba3116-8b88-4185-bce0-e9fa72554058"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 16:49:22.121212 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:49:22.121188    2583 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9eba3116-8b88-4185-bce0-e9fa72554058-istio-podinfo\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\""
Sep 09 16:49:22.121212 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:49:22.121211    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k8wmd\" (UniqueName: \"kubernetes.io/projected/9eba3116-8b88-4185-bce0-e9fa72554058-kube-api-access-k8wmd\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\""
Sep 09 16:49:22.121387 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:49:22.121220    2583 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9eba3116-8b88-4185-bce0-e9fa72554058-istio-envoy\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\""
Sep 09 16:49:22.121387 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:49:22.121229    2583 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9eba3116-8b88-4185-bce0-e9fa72554058-istio-token\") on node \"ip-10-0-131-48.ec2.internal\" DevicePath \"\""
Sep 09 16:49:22.896807 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:49:22.896778    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-50fcbc-openshift-default-7cccc7648d-7j88r"
Sep 09 16:49:22.897319 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:49:22.896784    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-50fcbc-openshift-default-7cccc7648d-7j88r" event={"ID":"9eba3116-8b88-4185-bce0-e9fa72554058","Type":"ContainerDied","Data":"741f59c3227ece601db0fcddc273ab3cdf10c3305c4d7e122f4999dae213a9a0"}
Sep 09 16:49:22.897319 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:49:22.896901    2583 scope.go:117] "RemoveContainer" containerID="2fe37c66d85d290d77bc36e8e6efcb5cc5808c2591358f3d0c8383cfd300c00e"
Sep 09 16:49:22.912643 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:49:22.912616    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-50fcbc-openshift-default-7cccc7648d-7j88r"]
Sep 09 16:49:22.914948 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:49:22.914925    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-50fcbc-openshift-default-7cccc7648d-7j88r"]
Sep 09 16:49:24.238787 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:49:24.238751    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9eba3116-8b88-4185-bce0-e9fa72554058" path="/var/lib/kubelet/pods/9eba3116-8b88-4185-bce0-e9fa72554058/volumes"
Sep 09 16:49:38.467814 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:49:38.467729    2583 scope.go:117] "RemoveContainer" containerID="6637e290e4b0d5383a6da3a5242290fbe6ad288c981dd51e3c5f81fdbec9d41a"
Sep 09 16:50:25.161576 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:50:25.161542    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:50:29.316518 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:50:29.316470    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:50:38.504685 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:50:38.504649    2583 scope.go:117] "RemoveContainer" containerID="a42214cc49f4ae80a528008377be16a0c6cd642417001b5a382fe7daf3e9a83d"
Sep 09 16:50:38.513278 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:50:38.513253    2583 scope.go:117] "RemoveContainer" containerID="2682ba3e55aed30e08c6b6c0dc8b5853d2643300ce90cd32df10fc78debfe8d2"
Sep 09 16:50:38.521538 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:50:38.521519    2583 scope.go:117] "RemoveContainer" containerID="06c9bef15813646c13867f285d1e06ee07149269dc0579ab0984a70b490020f8"
Sep 09 16:50:43.253206 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:50:43.253170    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:50:44.459333 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:50:44.459292    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:51:27.452115 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:51:27.452010    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:51:28.949237 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:51:28.949192    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:51:28.999203 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:51:28.999150    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:51:38.549475 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:51:38.549439    2583 scope.go:117] "RemoveContainer" containerID="9418444b207c618a465ba55faafc59bf28a300aa205d6751e57c99a819ef662e"
Sep 09 16:51:38.558138 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:51:38.558112    2583 scope.go:117] "RemoveContainer" containerID="cd0172b367f83a3f0bd02d5ac26c11c83a4fe7d858c097276cbe6e957a54a141"
Sep 09 16:52:07.891226 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:52:07.891187    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:53:17.568288 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:53:17.568253    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:53:17.672615 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:53:17.672580    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:53:38.294375 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:53:38.294335    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:53:38.591438 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:53:38.591405    2583 scope.go:117] "RemoveContainer" containerID="cc60ba21acd5b3f1648bac0943eeb87999269ac8d0a9efbb3e8c9f84c59c5c88"
Sep 09 16:53:38.600369 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:53:38.600347    2583 scope.go:117] "RemoveContainer" containerID="fc7ee42e8a446a192b78c1721d76c38bc4f2c36b84bf357ab00ce263dbbb4f4e"
Sep 09 16:53:53.023183 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:53:53.023147    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:54:06.649282 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:54:06.649195    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:54:07.602122 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:54:07.602087    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:54:19.789851 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:54:19.789799    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:54:38.626673 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:54:38.626634    2583 scope.go:117] "RemoveContainer" containerID="11ad3e857167dac96af4650283c1fd53e7a62a0490d389242ceaf159c609543d"
Sep 09 16:54:41.927795 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:54:41.927755    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:55:01.647391 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:55:01.647359    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-tbnr4_fd72319f-be1e-426b-be2d-2f205c3ff2ff/server/0.log"
Sep 09 16:55:01.763736 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:55:01.763690    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-hkfmx_57f825c6-5686-4bfa-8628-0462c34b985e/manager/0.log"
Sep 09 16:55:02.121581 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:55:02.121552    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-b9b77fc68-ks84g_894e3a75-e711-4ae0-8e0e-f642fb002381/copy-manifests/0.log"
Sep 09 16:55:02.127950 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:55:02.127921    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-b9b77fc68-ks84g_894e3a75-e711-4ae0-8e0e-f642fb002381/manager/0.log"
Sep 09 16:55:02.685659 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:55:02.685623    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29816190-vrtv4_518132fd-45a2-4aa8-9830-a04f7f813ac1/cleanup/0.log"
Sep 09 16:55:02.800437 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:55:02.800403    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29816205-wh9ns_864c724f-3e27-410a-aa42-ae258ecd73da/cleanup/0.log"
Sep 09 16:55:02.922610 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:55:02.922581    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-w6cmq_d1cbe05e-e99d-48c8-a70f-5eecb668a546/postgres/0.log"
Sep 09 16:55:04.794127 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:55:04.794088    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799cb22vs_411bb526-f17b-4fed-9822-40ab7d718269/istio-proxy/0.log"
Sep 09 16:55:04.902977 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:55:04.902944    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-rfp6l_858db771-fbc1-4365-abd7-7364b86f3627/discovery/0.log"
Sep 09 16:55:05.337088 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:55:05.337054    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-nwt87_15bad01e-04b1-432d-8f0d-72b35180aece/payload-pre-processing/0.log"
Sep 09 16:55:05.461538 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:55:05.461505    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-k6wtl_1670d619-612d-46e4-b6a7-f1ed8ccc0fc4/payload-processing/0.log"
Sep 09 16:55:05.564924 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:55:05.564890    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-55d847bddd-kr8vk_42d53258-31de-41f2-8ef9-887e6e89cac2/router/0.log"
Sep 09 16:55:06.111893 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:55:06.111861    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-embedding-simulated-kserve-bcc9ff8d8-kjm44_84d16051-d700-46e4-8f2b-69b1ef21e0a4/main/0.log"
Sep 09 16:55:06.337874 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:55:06.337843    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc99ql_7893110f-67fc-4091-9f94-141037357086/main/0.log"
Sep 09 16:55:13.362753 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:55:13.362719    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:55:13.463176 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:55:13.463141    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:55:14.990274 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:55:14.990246    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-stpmj_2e619341-a4d2-42fc-b5d9-e33ffeebd306/global-pull-secret-syncer/0.log"
Sep 09 16:55:15.034157 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:55:15.034121    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log"
Sep 09 16:55:15.114119 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:55:15.114073    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-131-48.ec2.internal_da4295cbced7cf805209af4a484bf441/haproxy/0.log"
Sep 09 16:55:21.282176 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:55:21.282133    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-867mp_d01fa91c-300b-4d4b-8a2f-3646eb02566c/konnectivity-agent/0.log" limit=1024
Sep 09 16:55:21.625902 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:55:21.625865    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6cdcc96965-cx95g_83ef6f08-6c9b-4e4a-8d3f-2ac0e855bd2c/cluster-monitoring-operator/0.log"
Sep 09 16:55:21.728400 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:55:21.728302    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-6757d4d54b-8nns5_b15afba3-4609-4699-9ec9-870c9353fabb/metrics-server/0.log"
Sep 09 16:55:21.966235 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:55:21.966178    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-c6fx6_e4465728-7c0e-41ab-93d5-1ac31555a62f/node-exporter/0.log"
Sep 09 16:55:21.985896 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:55:21.985815    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-c6fx6_e4465728-7c0e-41ab-93d5-1ac31555a62f/kube-rbac-proxy/0.log"
Sep 09 16:55:22.003652 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:55:22.003625    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-c6fx6_e4465728-7c0e-41ab-93d5-1ac31555a62f/init-textfile/0.log"
Sep 09 16:55:22.033227 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:55:22.033196    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-657fd6c54-qd5n5_467ebbdd-a09d-4509-8bc2-2e13273e1258/kube-rbac-proxy-main/0.log"
Sep 09 16:55:22.060702 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:55:22.060673    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-657fd6c54-qd5n5_467ebbdd-a09d-4509-8bc2-2e13273e1258/kube-rbac-proxy-self/0.log"
Sep 09 16:55:22.078340 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:55:22.078310    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-657fd6c54-qd5n5_467ebbdd-a09d-4509-8bc2-2e13273e1258/openshift-state-metrics/0.log"
Sep 09 16:55:22.117899 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:55:22.117866    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a2b8c539-75f8-46d4-b173-7bf84f07b147/prometheus/0.log"
Sep 09 16:55:22.137143 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:55:22.137105    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a2b8c539-75f8-46d4-b173-7bf84f07b147/config-reloader/0.log"
Sep 09 16:55:22.156177 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:55:22.156149    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a2b8c539-75f8-46d4-b173-7bf84f07b147/thanos-sidecar/0.log"
Sep 09 16:55:22.177659 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:55:22.177614    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a2b8c539-75f8-46d4-b173-7bf84f07b147/kube-rbac-proxy-web/0.log"
Sep 09 16:55:22.200034 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:55:22.199994    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a2b8c539-75f8-46d4-b173-7bf84f07b147/kube-rbac-proxy/0.log"
Sep 09 16:55:22.217811 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:55:22.217776    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a2b8c539-75f8-46d4-b173-7bf84f07b147/kube-rbac-proxy-thanos/0.log"
Sep 09 16:55:22.239304 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:55:22.239200    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a2b8c539-75f8-46d4-b173-7bf84f07b147/init-config-reloader/0.log"
Sep 09 16:55:22.325217 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:55:22.325187    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-78f599db79-gclwc_9da2b140-3a48-4380-9c19-fd0ef92e8c26/prometheus-operator-admission-webhook/0.log"
Sep 09 16:55:22.353338 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:55:22.353292    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-86b488f9f4-fzh9c_7da7fa1f-0b0c-425b-a5f0-136fe665f4a9/telemeter-client/0.log"
Sep 09 16:55:22.376559 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:55:22.376531    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-86b488f9f4-fzh9c_7da7fa1f-0b0c-425b-a5f0-136fe665f4a9/reload/0.log"
Sep 09 16:55:22.397479 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:55:22.397448    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-86b488f9f4-fzh9c_7da7fa1f-0b0c-425b-a5f0-136fe665f4a9/kube-rbac-proxy/0.log"
Sep 09 16:55:23.764075 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:55:23.764045    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-79977f9844-779cg_c4338f01-9c80-4c3d-b2e1-187d647cb696/networking-console-plugin/0.log"
Sep 09 16:55:24.817003 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:55:24.816946    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-8s7bt/perf-node-gather-daemonset-g28pl"]
Sep 09 16:55:24.817578 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:55:24.817550    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9eba3116-8b88-4185-bce0-e9fa72554058" containerName="istio-proxy"
Sep 09 16:55:24.817578 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:55:24.817578    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="9eba3116-8b88-4185-bce0-e9fa72554058" containerName="istio-proxy"
Sep 09 16:55:24.817716 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:55:24.817608    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="33da4159-33c7-4fbb-838d-cc094a12c744" containerName="manager"
Sep 09 16:55:24.817716 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:55:24.817618    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="33da4159-33c7-4fbb-838d-cc094a12c744" containerName="manager"
Sep 09 16:55:24.817716 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:55:24.817635    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9eba3116-8b88-4185-bce0-e9fa72554058" containerName="istio-proxy"
Sep 09 16:55:24.817716 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:55:24.817644    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="9eba3116-8b88-4185-bce0-e9fa72554058" containerName="istio-proxy"
Sep 09 16:55:24.817716 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:55:24.817653    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="47468b57-e3ef-4a4a-ab72-71cdb8b2fdda" containerName="revoke-keys"
Sep 09 16:55:24.817716 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:55:24.817662    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="47468b57-e3ef-4a4a-ab72-71cdb8b2fdda" containerName="revoke-keys"
Sep 09 16:55:24.818031 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:55:24.817780    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="9eba3116-8b88-4185-bce0-e9fa72554058" containerName="istio-proxy"
Sep 09 16:55:24.818031 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:55:24.817794    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="9eba3116-8b88-4185-bce0-e9fa72554058" containerName="istio-proxy"
Sep 09 16:55:24.818031 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:55:24.817807    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="33da4159-33c7-4fbb-838d-cc094a12c744" containerName="manager"
Sep 09 16:55:24.818031 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:55:24.817816    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="2dc3d0d9-3c75-475f-836d-0a544e1907cc" containerName="istio-proxy"
Sep 09 16:55:24.818031 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:55:24.817825    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="47468b57-e3ef-4a4a-ab72-71cdb8b2fdda" containerName="revoke-keys"
Sep 09 16:55:24.821184 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:55:24.821158    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8s7bt/perf-node-gather-daemonset-g28pl"
Sep 09 16:55:24.824008 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:55:24.823899    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-8s7bt\"/\"kube-root-ca.crt\""
Sep 09 16:55:24.824247 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:55:24.824218    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-8s7bt\"/\"openshift-service-ca.crt\""
Sep 09 16:55:24.825210 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:55:24.825193    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-8s7bt\"/\"default-dockercfg-jl267\""
Sep 09 16:55:24.829806 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:55:24.829782    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8s7bt/perf-node-gather-daemonset-g28pl"]
Sep 09 16:55:24.867354 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:55:24.867311    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bcflk\" (UniqueName: \"kubernetes.io/projected/5b8ec114-fd74-4635-b035-0f9bfddeb3b6-kube-api-access-bcflk\") pod \"perf-node-gather-daemonset-g28pl\" (UID: \"5b8ec114-fd74-4635-b035-0f9bfddeb3b6\") " pod="openshift-must-gather-8s7bt/perf-node-gather-daemonset-g28pl"
Sep 09 16:55:24.867568 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:55:24.867382    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5b8ec114-fd74-4635-b035-0f9bfddeb3b6-lib-modules\") pod \"perf-node-gather-daemonset-g28pl\" (UID: \"5b8ec114-fd74-4635-b035-0f9bfddeb3b6\") " pod="openshift-must-gather-8s7bt/perf-node-gather-daemonset-g28pl"
Sep 09 16:55:24.867568 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:55:24.867482    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5b8ec114-fd74-4635-b035-0f9bfddeb3b6-podres\") pod \"perf-node-gather-daemonset-g28pl\" (UID: \"5b8ec114-fd74-4635-b035-0f9bfddeb3b6\") " pod="openshift-must-gather-8s7bt/perf-node-gather-daemonset-g28pl"
Sep 09 16:55:24.867568 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:55:24.867538    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5b8ec114-fd74-4635-b035-0f9bfddeb3b6-sys\") pod \"perf-node-gather-daemonset-g28pl\" (UID: \"5b8ec114-fd74-4635-b035-0f9bfddeb3b6\") " pod="openshift-must-gather-8s7bt/perf-node-gather-daemonset-g28pl"
Sep 09 16:55:24.867568 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:55:24.867562    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5b8ec114-fd74-4635-b035-0f9bfddeb3b6-proc\") pod \"perf-node-gather-daemonset-g28pl\" (UID: \"5b8ec114-fd74-4635-b035-0f9bfddeb3b6\") " pod="openshift-must-gather-8s7bt/perf-node-gather-daemonset-g28pl"
Sep 09 16:55:24.893482 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:55:24.893445    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-85d98c998f-wclnp_26eb930e-4ab4-45f3-bc28-2e2bdd63e036/download-server/0.log"
Sep 09 16:55:24.968716 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:55:24.968678    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bcflk\" (UniqueName: \"kubernetes.io/projected/5b8ec114-fd74-4635-b035-0f9bfddeb3b6-kube-api-access-bcflk\") pod \"perf-node-gather-daemonset-g28pl\" (UID: \"5b8ec114-fd74-4635-b035-0f9bfddeb3b6\") " pod="openshift-must-gather-8s7bt/perf-node-gather-daemonset-g28pl"
Sep 09 16:55:24.968917 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:55:24.968744    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5b8ec114-fd74-4635-b035-0f9bfddeb3b6-lib-modules\") pod \"perf-node-gather-daemonset-g28pl\" (UID: \"5b8ec114-fd74-4635-b035-0f9bfddeb3b6\") " pod="openshift-must-gather-8s7bt/perf-node-gather-daemonset-g28pl"
Sep 09 16:55:24.968917 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:55:24.968779    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5b8ec114-fd74-4635-b035-0f9bfddeb3b6-podres\") pod \"perf-node-gather-daemonset-g28pl\" (UID: \"5b8ec114-fd74-4635-b035-0f9bfddeb3b6\") " pod="openshift-must-gather-8s7bt/perf-node-gather-daemonset-g28pl"
Sep 09 16:55:24.968917 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:55:24.968804    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5b8ec114-fd74-4635-b035-0f9bfddeb3b6-sys\") pod \"perf-node-gather-daemonset-g28pl\" (UID: \"5b8ec114-fd74-4635-b035-0f9bfddeb3b6\") " pod="openshift-must-gather-8s7bt/perf-node-gather-daemonset-g28pl"
Sep 09 16:55:24.968917 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:55:24.968820    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5b8ec114-fd74-4635-b035-0f9bfddeb3b6-proc\") pod \"perf-node-gather-daemonset-g28pl\" (UID: \"5b8ec114-fd74-4635-b035-0f9bfddeb3b6\") " pod="openshift-must-gather-8s7bt/perf-node-gather-daemonset-g28pl"
Sep 09 16:55:24.969116 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:55:24.968919    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5b8ec114-fd74-4635-b035-0f9bfddeb3b6-sys\") pod \"perf-node-gather-daemonset-g28pl\" (UID: \"5b8ec114-fd74-4635-b035-0f9bfddeb3b6\") " pod="openshift-must-gather-8s7bt/perf-node-gather-daemonset-g28pl"
Sep 09 16:55:24.969116 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:55:24.968941    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5b8ec114-fd74-4635-b035-0f9bfddeb3b6-podres\") pod \"perf-node-gather-daemonset-g28pl\" (UID: \"5b8ec114-fd74-4635-b035-0f9bfddeb3b6\") " pod="openshift-must-gather-8s7bt/perf-node-gather-daemonset-g28pl"
Sep 09 16:55:24.969116 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:55:24.968951    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5b8ec114-fd74-4635-b035-0f9bfddeb3b6-lib-modules\") pod \"perf-node-gather-daemonset-g28pl\" (UID: \"5b8ec114-fd74-4635-b035-0f9bfddeb3b6\") " pod="openshift-must-gather-8s7bt/perf-node-gather-daemonset-g28pl"
Sep 09 16:55:24.969116 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:55:24.968950    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5b8ec114-fd74-4635-b035-0f9bfddeb3b6-proc\") pod \"perf-node-gather-daemonset-g28pl\" (UID: \"5b8ec114-fd74-4635-b035-0f9bfddeb3b6\") " pod="openshift-must-gather-8s7bt/perf-node-gather-daemonset-g28pl"
Sep 09 16:55:24.976411 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:55:24.976375    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bcflk\" (UniqueName: \"kubernetes.io/projected/5b8ec114-fd74-4635-b035-0f9bfddeb3b6-kube-api-access-bcflk\") pod \"perf-node-gather-daemonset-g28pl\" (UID: \"5b8ec114-fd74-4635-b035-0f9bfddeb3b6\") " pod="openshift-must-gather-8s7bt/perf-node-gather-daemonset-g28pl"
Sep 09 16:55:25.132633 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:55:25.132589    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8s7bt/perf-node-gather-daemonset-g28pl"
Sep 09 16:55:25.405098 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:55:25.405022    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8s7bt/perf-node-gather-daemonset-g28pl"]
Sep 09 16:55:25.407589 ip-10-0-131-48 kubenswrapper[2583]: W0909 16:55:25.407557    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod5b8ec114_fd74_4635_b035_0f9bfddeb3b6.slice/crio-dfbe9e627bccb352c550a88f7cdcd0791164a467aca014152f63cbf83d63fa90 WatchSource:0}: Error finding container dfbe9e627bccb352c550a88f7cdcd0791164a467aca014152f63cbf83d63fa90: Status 404 returned error can't find the container with id dfbe9e627bccb352c550a88f7cdcd0791164a467aca014152f63cbf83d63fa90
Sep 09 16:55:25.533977 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:55:25.533942    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-695c895bd6-j7hwj_f45ba4c9-fc40-4998-a7f4-df0799d03123/volume-data-source-validator/0.log"
Sep 09 16:55:25.849714 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:55:25.849678    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8s7bt/perf-node-gather-daemonset-g28pl" event={"ID":"5b8ec114-fd74-4635-b035-0f9bfddeb3b6","Type":"ContainerStarted","Data":"041ade1dd008b246e186674c39915bcf2f60c7acfb5555b56015f0bc24bdbb64"}
Sep 09 16:55:25.850212 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:55:25.849732    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8s7bt/perf-node-gather-daemonset-g28pl" event={"ID":"5b8ec114-fd74-4635-b035-0f9bfddeb3b6","Type":"ContainerStarted","Data":"dfbe9e627bccb352c550a88f7cdcd0791164a467aca014152f63cbf83d63fa90"}
Sep 09 16:55:25.850212 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:55:25.849770    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-8s7bt/perf-node-gather-daemonset-g28pl"
Sep 09 16:55:25.865778 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:55:25.865722    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-8s7bt/perf-node-gather-daemonset-g28pl" podStartSLOduration=1.8657013070000001 podStartE2EDuration="1.865701307s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 16:55:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 16:55:25.86340856 +0000 UTC m=+2508.217138414" watchObservedRunningTime="2026-09-09 16:55:25.865701307 +0000 UTC m=+2508.219431140"
Sep 09 16:55:26.710101 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:55:26.710066    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-xzslz_3b749ab0-b112-4083-8efc-6d45e9c5e6c2/dns/0.log"
Sep 09 16:55:26.727159 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:55:26.727129    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-xzslz_3b749ab0-b112-4083-8efc-6d45e9c5e6c2/kube-rbac-proxy/0.log"
Sep 09 16:55:26.746629 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:55:26.746598    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-6df6z_b8492dc1-21be-43db-bd0c-8860f4b76f97/dns-node-resolver/0.log"
Sep 09 16:55:27.344780 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:55:27.344732    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-xfwg5_23975f85-e5cd-4329-9152-0d52fbdefcde/node-ca/0.log"
Sep 09 16:55:28.163088 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:55:28.163054    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799cb22vs_411bb526-f17b-4fed-9822-40ab7d718269/istio-proxy/0.log"
Sep 09 16:55:28.508423 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:55:28.508328    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-rfp6l_858db771-fbc1-4365-abd7-7364b86f3627/discovery/0.log"
Sep 09 16:55:28.618037 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:55:28.617994    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-nwt87_15bad01e-04b1-432d-8f0d-72b35180aece/payload-pre-processing/0.log"
Sep 09 16:55:28.649571 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:55:28.649517    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-k6wtl_1670d619-612d-46e4-b6a7-f1ed8ccc0fc4/payload-processing/0.log"
Sep 09 16:55:28.669422 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:55:28.669371    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-55d847bddd-kr8vk_42d53258-31de-41f2-8ef9-887e6e89cac2/router/0.log"
Sep 09 16:55:29.492375 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:55:29.492288    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-n7vc2_b16dca46-9632-4408-9ae4-320cc254b225/serve-healthcheck-canary/0.log"
Sep 09 16:55:30.069743 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:55:30.069715    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hl5wh_0761a4d2-2ff2-4d33-8462-771ecc0961e6/kube-rbac-proxy/0.log"
Sep 09 16:55:30.089418 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:55:30.089387    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hl5wh_0761a4d2-2ff2-4d33-8462-771ecc0961e6/exporter/0.log"
Sep 09 16:55:30.107547 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:55:30.107495    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hl5wh_0761a4d2-2ff2-4d33-8462-771ecc0961e6/extractor/0.log"
Sep 09 16:55:31.865488 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:55:31.865411    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-8s7bt/perf-node-gather-daemonset-g28pl"
Sep 09 16:55:32.351409 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:55:32.351379    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-tbnr4_fd72319f-be1e-426b-be2d-2f205c3ff2ff/server/0.log"
Sep 09 16:55:32.438430 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:55:32.438397    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-hkfmx_57f825c6-5686-4bfa-8628-0462c34b985e/manager/0.log"
Sep 09 16:55:32.592285 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:55:32.592249    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-b9b77fc68-ks84g_894e3a75-e711-4ae0-8e0e-f642fb002381/manager/0.log"
Sep 09 16:55:32.608331 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:55:32.608252    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-b9b77fc68-ks84g_894e3a75-e711-4ae0-8e0e-f642fb002381/copy-manifests/0.log"
Sep 09 16:55:33.653907 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:55:33.653879    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-6bb9f9f6c8-4f64g_b9ca8bf6-8122-4240-9044-0b5bc2e215f4/manager/0.log"
Sep 09 16:55:34.460567 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:55:34.460532    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799cb22vs_411bb526-f17b-4fed-9822-40ab7d718269/istio-proxy/0.log"
Sep 09 16:55:34.791920 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:55:34.791821    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-rfp6l_858db771-fbc1-4365-abd7-7364b86f3627/discovery/0.log"
Sep 09 16:55:34.882165 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:55:34.882133    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-nwt87_15bad01e-04b1-432d-8f0d-72b35180aece/payload-pre-processing/0.log"
Sep 09 16:55:34.907655 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:55:34.907606    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-k6wtl_1670d619-612d-46e4-b6a7-f1ed8ccc0fc4/payload-processing/0.log"
Sep 09 16:55:34.919737 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:55:34.919709    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-55d847bddd-kr8vk_42d53258-31de-41f2-8ef9-887e6e89cac2/router/0.log"
Sep 09 16:55:36.581924 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:55:36.581890    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799cb22vs_411bb526-f17b-4fed-9822-40ab7d718269/istio-proxy/0.log"
Sep 09 16:55:36.921115 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:55:36.921024    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-rfp6l_858db771-fbc1-4365-abd7-7364b86f3627/discovery/0.log"
Sep 09 16:55:37.021311 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:55:37.021273    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-nwt87_15bad01e-04b1-432d-8f0d-72b35180aece/payload-pre-processing/0.log"
Sep 09 16:55:37.047973 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:55:37.047938    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-k6wtl_1670d619-612d-46e4-b6a7-f1ed8ccc0fc4/payload-processing/0.log"
Sep 09 16:55:37.064121 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:55:37.064091    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-55d847bddd-kr8vk_42d53258-31de-41f2-8ef9-887e6e89cac2/router/0.log"
Sep 09 16:55:38.626065 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:55:38.626029    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-fdbb8fdff-2pz8r_350079f0-f663-4f7b-9eda-5e51a24eb243/migrator/0.log"
Sep 09 16:55:38.642926 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:55:38.642894    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-fdbb8fdff-2pz8r_350079f0-f663-4f7b-9eda-5e51a24eb243/graceful-termination/0.log"
Sep 09 16:55:38.647227 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:55:38.647201    2583 scope.go:117] "RemoveContainer" containerID="d564a8cdac869de427ff1d46e076891464d04940f789dc8a71dfd6f224af40e1"
Sep 09 16:55:38.655875 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:55:38.655849    2583 scope.go:117] "RemoveContainer" containerID="b888b85ca3df120699bf3d0d75b7d580ac68fd11f7bd21769a64bd4cd71bd384"
Sep 09 16:55:38.985725 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:55:38.985642    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-8d7dd4675-dl57k_2e7595e7-f00a-4fa7-be8e-f8e4adb4e628/kube-storage-version-migrator-operator/1.log"
Sep 09 16:55:38.986712 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:55:38.986690    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-8d7dd4675-dl57k_2e7595e7-f00a-4fa7-be8e-f8e4adb4e628/kube-storage-version-migrator-operator/0.log"
Sep 09 16:55:40.067094 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:55:40.067063    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-djp68_be6bb207-ddbb-459e-af6c-bc2500a92955/kube-multus-additional-cni-plugins/0.log"
Sep 09 16:55:40.084562 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:55:40.084536    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-djp68_be6bb207-ddbb-459e-af6c-bc2500a92955/egress-router-binary-copy/0.log"
Sep 09 16:55:40.102740 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:55:40.102709    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-djp68_be6bb207-ddbb-459e-af6c-bc2500a92955/cni-plugins/0.log"
Sep 09 16:55:40.120208 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:55:40.120175    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-djp68_be6bb207-ddbb-459e-af6c-bc2500a92955/bond-cni-plugin/0.log"
Sep 09 16:55:40.139651 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:55:40.139617    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-djp68_be6bb207-ddbb-459e-af6c-bc2500a92955/routeoverride-cni/0.log"
Sep 09 16:55:40.158237 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:55:40.158200    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-djp68_be6bb207-ddbb-459e-af6c-bc2500a92955/whereabouts-cni-bincopy/0.log"
Sep 09 16:55:40.175327 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:55:40.175301    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-djp68_be6bb207-ddbb-459e-af6c-bc2500a92955/whereabouts-cni/0.log"
Sep 09 16:55:40.384993 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:55:40.384941    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-grl6q_ab137fdc-62f3-4f47-ab97-f1c896ce3d56/kube-multus/0.log"
Sep 09 16:55:40.477219 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:55:40.477190    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-qmp4p_f8a2ea6e-22df-4b6d-b1b1-e554e877f94c/network-metrics-daemon/0.log"
Sep 09 16:55:40.492403 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:55:40.492364    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-qmp4p_f8a2ea6e-22df-4b6d-b1b1-e554e877f94c/kube-rbac-proxy/0.log"
Sep 09 16:55:41.213781 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:55:41.213740    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8xkw6_45de5b46-a121-43e3-b141-4de97a0ad121/ovn-controller/0.log"
Sep 09 16:55:41.229031 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:55:41.228972    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8xkw6_45de5b46-a121-43e3-b141-4de97a0ad121/ovn-acl-logging/0.log"
Sep 09 16:55:41.252516 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:55:41.252485    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8xkw6_45de5b46-a121-43e3-b141-4de97a0ad121/kube-rbac-proxy-node/0.log"
Sep 09 16:55:41.270396 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:55:41.270363    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8xkw6_45de5b46-a121-43e3-b141-4de97a0ad121/kube-rbac-proxy-ovn-metrics/0.log"
Sep 09 16:55:41.287306 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:55:41.287277    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8xkw6_45de5b46-a121-43e3-b141-4de97a0ad121/northd/0.log"
Sep 09 16:55:41.305189 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:55:41.305159    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8xkw6_45de5b46-a121-43e3-b141-4de97a0ad121/nbdb/0.log"
Sep 09 16:55:41.323148 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:55:41.323118    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8xkw6_45de5b46-a121-43e3-b141-4de97a0ad121/sbdb/0.log"
Sep 09 16:55:41.381329 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:55:41.381292    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8xkw6_45de5b46-a121-43e3-b141-4de97a0ad121/ovnkube-controller/0.log"
Sep 09 16:55:42.771010 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:55:42.770962    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-source-685456655f-lk5jk_c72a79fa-90df-448d-9b09-23262729fa2e/check-endpoints/0.log"
Sep 09 16:55:42.829776 ip-10-0-131-48 kubenswrapper[2583]: I0909 16:55:42.829737    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-vgwn2_f7554c3b-d296-4424-8822-a3e75a994efa/network-check-target-container/0.log"