Jul 24 18:42:01.020576 ip-10-0-141-146 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 24 18:42:01.020591 ip-10-0-141-146 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 24 18:42:01.020601 ip-10-0-141-146 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 24 18:42:01.020937 ip-10-0-141-146 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 24 18:42:10.671799 ip-10-0-141-146 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 24 18:42:10.671812 ip-10-0-141-146 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 8a7066925f7f4af0998c670114dae213 --
Jul 24 18:44:04.682492 ip-10-0-141-146 systemd[1]: Starting Kubernetes Kubelet...
Jul 24 18:44:05.033447 ip-10-0-141-146 kubenswrapper[2580]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 24 18:44:05.033447 ip-10-0-141-146 kubenswrapper[2580]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 24 18:44:05.033447 ip-10-0-141-146 kubenswrapper[2580]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 24 18:44:05.033447 ip-10-0-141-146 kubenswrapper[2580]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 24 18:44:05.033447 ip-10-0-141-146 kubenswrapper[2580]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 24 18:44:05.034388 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.034244    2580 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 24 18:44:05.038039 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.038002    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 24 18:44:05.038039 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.038031    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 24 18:44:05.038039 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.038037    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 24 18:44:05.038039 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.038042    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 24 18:44:05.038039 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.038046    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 24 18:44:05.038039 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.038051    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 24 18:44:05.038364 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.038056    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 24 18:44:05.038364 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.038060    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 24 18:44:05.038364 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.038064    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 24 18:44:05.038364 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.038068    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 24 18:44:05.038364 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.038073    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 24 18:44:05.038364 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.038077    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 24 18:44:05.038364 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.038081    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 24 18:44:05.038364 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.038085    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 24 18:44:05.038364 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.038093    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 24 18:44:05.038364 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.038097    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 24 18:44:05.038364 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.038101    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 24 18:44:05.038364 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.038107    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 24 18:44:05.038364 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.038111    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 24 18:44:05.038364 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.038115    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 24 18:44:05.038364 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.038135    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 24 18:44:05.038364 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.038139    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 24 18:44:05.038364 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.038144    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 24 18:44:05.038364 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.038148    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 24 18:44:05.038364 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.038154    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 24 18:44:05.038364 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.038158    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 24 18:44:05.038957 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.038162    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 24 18:44:05.038957 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.038171    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 24 18:44:05.038957 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.038175    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 24 18:44:05.038957 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.038179    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 24 18:44:05.038957 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.038183    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 24 18:44:05.038957 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.038187    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 24 18:44:05.038957 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.038191    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 24 18:44:05.038957 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.038195    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 24 18:44:05.038957 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.038199    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 24 18:44:05.038957 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.038203    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 24 18:44:05.038957 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.038207    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 24 18:44:05.038957 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.038213    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 24 18:44:05.038957 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.038221    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 24 18:44:05.038957 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.038230    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 24 18:44:05.038957 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.038235    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 24 18:44:05.038957 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.038240    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 24 18:44:05.038957 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.038244    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 24 18:44:05.038957 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.038248    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 24 18:44:05.038957 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.038252    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 24 18:44:05.039443 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.038256    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 24 18:44:05.039443 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.038260    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 24 18:44:05.039443 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.038264    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 24 18:44:05.039443 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.038268    2580 feature_gate.go:328] unrecognized feature gate: Example
Jul 24 18:44:05.039443 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.038273    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 24 18:44:05.039443 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.038277    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 24 18:44:05.039443 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.038281    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 24 18:44:05.039443 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.038290    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 24 18:44:05.039443 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.038294    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 24 18:44:05.039443 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.038298    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 24 18:44:05.039443 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.038302    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 24 18:44:05.039443 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.038306    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 24 18:44:05.039443 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.038311    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 24 18:44:05.039443 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.038315    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 24 18:44:05.039443 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.038319    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 24 18:44:05.039443 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.038323    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 24 18:44:05.039443 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.038327    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 24 18:44:05.039443 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.038331    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 24 18:44:05.039443 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.038337    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 24 18:44:05.039443 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.038346    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 24 18:44:05.039907 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.038349    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 24 18:44:05.039907 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.038353    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 24 18:44:05.039907 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.038357    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 24 18:44:05.039907 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.038361    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 24 18:44:05.039907 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.038365    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 24 18:44:05.039907 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.038370    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 24 18:44:05.039907 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.038377    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 24 18:44:05.039907 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.038384    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 24 18:44:05.039907 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.038390    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 24 18:44:05.039907 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.038394    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 24 18:44:05.039907 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.038399    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 24 18:44:05.039907 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.038408    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 24 18:44:05.039907 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.038412    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 24 18:44:05.039907 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.038417    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 24 18:44:05.039907 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.038422    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 24 18:44:05.039907 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.038426    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 24 18:44:05.039907 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.038433    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 24 18:44:05.039907 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.038438    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 24 18:44:05.039907 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.038443    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 24 18:44:05.040412 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.038448    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 24 18:44:05.040412 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.038452    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 24 18:44:05.040412 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.038456    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 24 18:44:05.040412 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.038461    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 24 18:44:05.040412 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.038469    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 24 18:44:05.040412 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.038473    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 24 18:44:05.040412 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.038481    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 24 18:44:05.040412 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.038485    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 24 18:44:05.040412 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.038489    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 24 18:44:05.040412 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.038494    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 24 18:44:05.040412 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.038498    2580 feature_gate.go:328] unrecognized feature gate: Example2
Jul 24 18:44:05.040412 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.038502    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 24 18:44:05.040412 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.038505    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 24 18:44:05.040412 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.038509    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 24 18:44:05.040412 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.038513    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 24 18:44:05.040412 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.039609    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 24 18:44:05.040412 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.039621    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 24 18:44:05.040412 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.039625    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 24 18:44:05.040412 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.039628    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 24 18:44:05.040412 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.039631    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 24 18:44:05.040885 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.039634    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 24 18:44:05.040885 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.039637    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 24 18:44:05.040885 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.039640    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 24 18:44:05.040885 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.039642    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 24 18:44:05.040885 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.039645    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 24 18:44:05.040885 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.039647    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 24 18:44:05.040885 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.039649    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 24 18:44:05.040885 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.039652    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 24 18:44:05.040885 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.039654    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 24 18:44:05.040885 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.039657    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 24 18:44:05.040885 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.039660    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 24 18:44:05.040885 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.039662    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 24 18:44:05.040885 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.039664    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 24 18:44:05.040885 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.039667    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 24 18:44:05.040885 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.039669    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 24 18:44:05.040885 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.039671    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 24 18:44:05.040885 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.039674    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 24 18:44:05.040885 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.039676    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 24 18:44:05.040885 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.039678    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 24 18:44:05.041371 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.039681    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 24 18:44:05.041371 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.039683    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 24 18:44:05.041371 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.039686    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 24 18:44:05.041371 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.039689    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 24 18:44:05.041371 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.039693    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 24 18:44:05.041371 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.039697    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 24 18:44:05.041371 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.039700    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 24 18:44:05.041371 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.039703    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 24 18:44:05.041371 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.039707    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 24 18:44:05.041371 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.039711    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 24 18:44:05.041371 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.039714    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 24 18:44:05.041371 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.039717    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 24 18:44:05.041371 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.039720    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 24 18:44:05.041371 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.039723    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 24 18:44:05.041371 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.039726    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 24 18:44:05.041371 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.039728    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 24 18:44:05.041371 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.039731    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 24 18:44:05.041371 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.039734    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 24 18:44:05.041371 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.039737    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 24 18:44:05.041829 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.039739    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 24 18:44:05.041829 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.039742    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 24 18:44:05.041829 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.039745    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 24 18:44:05.041829 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.039747    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 24 18:44:05.041829 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.039750    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 24 18:44:05.041829 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.039752    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 24 18:44:05.041829 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.039754    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 24 18:44:05.041829 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.039757    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 24 18:44:05.041829 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.039760    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 24 18:44:05.041829 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.039762    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 24 18:44:05.041829 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.039764    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 24 18:44:05.041829 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.039767    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 24 18:44:05.041829 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.039769    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 24 18:44:05.041829 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.039772    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 24 18:44:05.041829 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.039774    2580 feature_gate.go:328] unrecognized feature gate: Example
Jul 24 18:44:05.041829 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.039776    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 24 18:44:05.041829 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.039779    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 24 18:44:05.041829 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.039781    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 24 18:44:05.041829 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.039784    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 24 18:44:05.041829 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.039786    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 24 18:44:05.042323 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.039789    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 24 18:44:05.042323 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.039791    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 24 18:44:05.042323 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.039795    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 24 18:44:05.042323 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.039797    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 24 18:44:05.042323 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.039799    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 24 18:44:05.042323 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.039802    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 24 18:44:05.042323 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.039804    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 24 18:44:05.042323 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.039806    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 24 18:44:05.042323 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.039809    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 24 18:44:05.042323 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.039811    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 24 18:44:05.042323 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.039813    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 24 18:44:05.042323 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.039815    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 24 18:44:05.042323 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.039818    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 24 18:44:05.042323 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.039820    2580 feature_gate.go:328] unrecognized feature gate: Example2
Jul 24 18:44:05.042323 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.039823    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 24 18:44:05.042323 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.039826    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 24 18:44:05.042323 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.039828    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 24 18:44:05.042323 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.039830    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 24 18:44:05.042323 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.039832    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 24 18:44:05.042323 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.039835    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 24 18:44:05.042777 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.039838    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 24 18:44:05.042777 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.039840    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 24 18:44:05.042777 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.039842    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 24 18:44:05.042777 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.039845    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 24 18:44:05.042777 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.039848    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 24 18:44:05.042777 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.039851    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 24 18:44:05.042777 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.039854    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 24 18:44:05.042777 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.039911    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 24 18:44:05.042777 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.039916    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 24 18:44:05.042777 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.039919    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 24 18:44:05.042777 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.039922    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 24 18:44:05.042777 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.039925    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 24 18:44:05.042777 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.039928    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 24 18:44:05.042777 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.039931    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 24 18:44:05.042777 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.039934    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 24 18:44:05.042777 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.039936    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 24 18:44:05.042777 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.040317    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 24 18:44:05.042777 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.040322    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 24 18:44:05.042777 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.040325    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 24 18:44:05.043234 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.040328    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 24 18:44:05.043234 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.040331    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 24 18:44:05.043234 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.040333    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 24 18:44:05.043234 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.040336    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 24 18:44:05.043234 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.040338    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 24 18:44:05.043234 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.040340    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 24 18:44:05.043234 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.040343    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 24 18:44:05.043234 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.040345    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 24 18:44:05.043234 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.040348    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 24 18:44:05.043234 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.040351    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 24 18:44:05.043234 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.040353    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 24 18:44:05.043234 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.040355    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 24 18:44:05.043234 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.040358    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 24 18:44:05.043234 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.040362    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 24 18:44:05.043234 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.040364    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 24 18:44:05.043234 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.040367    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 24 18:44:05.043234 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.040369    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 24 18:44:05.043234 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.040372    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 24 18:44:05.043234 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.040374    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 24 18:44:05.043234 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.040377    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 24 18:44:05.043701 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.040379    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 24 18:44:05.043701 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.040382    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 24 18:44:05.043701 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.040384    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 24 18:44:05.043701 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.040386    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 24 18:44:05.043701 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.040389    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 24 18:44:05.043701 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.040391    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 24 18:44:05.043701 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.040395    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 24 18:44:05.043701 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.040397    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 24 18:44:05.043701 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.040400    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 24 18:44:05.043701 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.040402    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 24 18:44:05.043701 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.040405    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 24 18:44:05.043701 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.040407    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 24 18:44:05.043701 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.040409    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 24 18:44:05.043701 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.040411    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 24 18:44:05.043701 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.040414    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 24 18:44:05.043701 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.040416    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 24 18:44:05.043701 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.040426    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 24 18:44:05.043701 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.040429    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 24 18:44:05.043701 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.040432    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 24 18:44:05.043701 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.040435    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 24 18:44:05.044195 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.040437    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 24 18:44:05.044195 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.040440    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 24 18:44:05.044195 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.040442    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 24 18:44:05.044195 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.040445    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 24 18:44:05.044195 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.040447    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 24 18:44:05.044195 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.040450    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 24 18:44:05.044195 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.040452    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 24 18:44:05.044195 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.040455    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 24 18:44:05.044195 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.040457    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 24 18:44:05.044195 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.040459    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 24 18:44:05.044195 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.040462    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 24 18:44:05.044195 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.040464    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 24 18:44:05.044195 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.040469    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 24 18:44:05.044195 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.040471    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 24 18:44:05.044195 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.040474    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 24 18:44:05.044195 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.040476    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 24 18:44:05.044195 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.040479    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 24 18:44:05.044195 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.040481    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 24 18:44:05.044195 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.040484    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 24 18:44:05.044653 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.040486    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 24 18:44:05.044653 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.040489    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 24 18:44:05.044653 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.040493    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 24 18:44:05.044653 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.040495    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 24 18:44:05.044653 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.040498    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 24 18:44:05.044653 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.040500    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 24 18:44:05.044653 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.040505    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 24 18:44:05.044653 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.040508    2580 feature_gate.go:328] unrecognized feature gate: Example
Jul 24 18:44:05.044653 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.040511    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 24 18:44:05.044653 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.040514    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 24 18:44:05.044653 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.040516    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 24 18:44:05.044653 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.040519    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 24 18:44:05.044653 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.040521    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 24 18:44:05.044653 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.040524    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 24 18:44:05.044653 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.040527    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 24 18:44:05.044653 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.040530    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 24 18:44:05.044653 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.040533    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 24 18:44:05.044653 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.040536    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 24 18:44:05.044653 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.040538    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 24 18:44:05.045134 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.040541    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 24 18:44:05.045134 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.040544    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 24 18:44:05.045134 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.040546    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 24 18:44:05.045134 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.040549    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 24 18:44:05.045134 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.040551    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 24 18:44:05.045134 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.040554    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 24 18:44:05.045134 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.040558    2580 feature_gate.go:328] unrecognized feature gate: Example2
Jul 24 18:44:05.045134 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.040561    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 24 18:44:05.045134 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.040563    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 24 18:44:05.045134 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.040565    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 24 18:44:05.045134 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.040568    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 24 18:44:05.045134 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.040571    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 24 18:44:05.045134 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.040573    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 24 18:44:05.045134 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.040575    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 24 18:44:05.045134 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.040578    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 24 18:44:05.045134 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.040580    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 24 18:44:05.045134 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.040583    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 24 18:44:05.045134 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.040585    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 24 18:44:05.045134 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.040662    2580 flags.go:64] FLAG: --address="0.0.0.0"
Jul 24 18:44:05.045134 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.040672    2580 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 24 18:44:05.045134 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.040682    2580 flags.go:64] FLAG: --anonymous-auth="true"
Jul 24 18:44:05.045624 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.040688    2580 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 24 18:44:05.045624 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.040693    2580 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 24 18:44:05.045624 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.040698    2580 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 24 18:44:05.045624 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.040704    2580 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 24 18:44:05.045624 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.040709    2580 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 24 18:44:05.045624 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.040712    2580 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 24 18:44:05.045624 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.040715    2580 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 24 18:44:05.045624 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.040719    2580 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 24 18:44:05.045624 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.040722    2580 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 24 18:44:05.045624 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.040724    2580 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 24 18:44:05.045624 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.040728    2580 flags.go:64] FLAG: --cgroup-root=""
Jul 24 18:44:05.045624 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.040730    2580 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 24 18:44:05.045624 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.040733    2580 flags.go:64] FLAG: --client-ca-file=""
Jul 24 18:44:05.045624 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.040736    2580 flags.go:64] FLAG: --cloud-provider="external"
Jul 24 18:44:05.045624 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.040739    2580 flags.go:64] FLAG: --cluster-dns="[]"
Jul 24 18:44:05.045624 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.040743    2580 flags.go:64] FLAG: --cluster-domain=""
Jul 24 18:44:05.045624 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.040745    2580 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 24 18:44:05.045624 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.040749    2580 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 24 18:44:05.045624 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.040752    2580 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 24 18:44:05.045624 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.040755    2580 flags.go:64] FLAG: --container-log-max-files="5"
Jul 24 18:44:05.045624 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.040759    2580 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 24 18:44:05.045624 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.040762    2580 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 24 18:44:05.045624 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.040764    2580 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 24 18:44:05.046170 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.040767    2580 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 24 18:44:05.046170 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.040770    2580 flags.go:64] FLAG: --contention-profiling="false"
Jul 24 18:44:05.046170 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.040773    2580 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 24 18:44:05.046170 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.040776    2580 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 24 18:44:05.046170 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.040779    2580 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 24 18:44:05.046170 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.040782    2580 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 24 18:44:05.046170 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.040786    2580 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 24 18:44:05.046170 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.040788    2580 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 24 18:44:05.046170 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.040791    2580 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 24 18:44:05.046170 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.040794    2580 flags.go:64] FLAG: --enable-load-reader="false"
Jul 24 18:44:05.046170 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.040796    2580 flags.go:64] FLAG: --enable-server="true"
Jul 24 18:44:05.046170 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.040799    2580 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 24 18:44:05.046170 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.040804    2580 flags.go:64] FLAG: --event-burst="100"
Jul 24 18:44:05.046170 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.040807    2580 flags.go:64] FLAG: --event-qps="50"
Jul 24 18:44:05.046170 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.040809    2580 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 24 18:44:05.046170 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.040812    2580 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 24 18:44:05.046170 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.040815    2580 flags.go:64] FLAG: --eviction-hard=""
Jul 24 18:44:05.046170 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.040819    2580 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 24 18:44:05.046170 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.040821    2580 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 24 18:44:05.046170 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.040824    2580 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 24 18:44:05.046170 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.040827    2580 flags.go:64] FLAG: --eviction-soft=""
Jul 24 18:44:05.046170 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.040830    2580 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 24 18:44:05.046170 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.040832    2580 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 24 18:44:05.046170 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.040836    2580 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 24 18:44:05.046170 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.040839    2580 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 24 18:44:05.046760 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.040842    2580 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 24 18:44:05.046760 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.040846    2580 flags.go:64] FLAG: --fail-swap-on="true"
Jul 24 18:44:05.046760 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.040848    2580 flags.go:64] FLAG: --feature-gates=""
Jul 24 18:44:05.046760 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.040852    2580 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 24 18:44:05.046760 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.040855    2580 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 24 18:44:05.046760 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.040857    2580 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 24 18:44:05.046760 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.040860    2580 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 24 18:44:05.046760 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.040863    2580 flags.go:64] FLAG: --healthz-port="10248"
Jul 24 18:44:05.046760 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.040866    2580 flags.go:64] FLAG: --help="false"
Jul 24 18:44:05.046760 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.040868    2580 flags.go:64] FLAG: --hostname-override="ip-10-0-141-146.ec2.internal"
Jul 24 18:44:05.046760 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.040871    2580 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 24 18:44:05.046760 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.040874    2580 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 24 18:44:05.046760 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.040877    2580 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 24 18:44:05.046760 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.040880    2580 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 24 18:44:05.046760 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.040883    2580 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 24 18:44:05.046760 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.040886    2580 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 24 18:44:05.046760 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.040888    2580 flags.go:64] FLAG: --image-service-endpoint=""
Jul 24 18:44:05.046760 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.040891    2580 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 24 18:44:05.046760 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.040894    2580 flags.go:64] FLAG: --kube-api-burst="100"
Jul 24 18:44:05.046760 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.040897    2580 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 24 18:44:05.046760 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.040900    2580 flags.go:64] FLAG: --kube-api-qps="50"
Jul 24 18:44:05.046760 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.040902    2580 flags.go:64] FLAG: --kube-reserved=""
Jul 24 18:44:05.046760 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.040905    2580 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 24 18:44:05.046760 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.040908    2580 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 24 18:44:05.047389 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.040911    2580 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 24 18:44:05.047389 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.040913    2580 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 24 18:44:05.047389 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.040916    2580 flags.go:64] FLAG: --lock-file=""
Jul 24 18:44:05.047389 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.040919    2580 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 24 18:44:05.047389 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.040921    2580 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 24 18:44:05.047389 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.040924    2580 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 24 18:44:05.047389 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.040929    2580 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 24 18:44:05.047389 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.040935    2580 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 24 18:44:05.047389 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.040937    2580 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 24 18:44:05.047389 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.040941    2580 flags.go:64] FLAG: --logging-format="text"
Jul 24 18:44:05.047389 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.040944    2580 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 24 18:44:05.047389 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.040947    2580 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 24 18:44:05.047389 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.040950    2580 flags.go:64] FLAG: --manifest-url=""
Jul 24 18:44:05.047389 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.040952    2580 flags.go:64] FLAG: --manifest-url-header=""
Jul 24 18:44:05.047389 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.040956    2580 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 24 18:44:05.047389 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.040959    2580 flags.go:64] FLAG: --max-open-files="1000000"
Jul 24 18:44:05.047389 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.040963    2580 flags.go:64] FLAG: --max-pods="110"
Jul 24 18:44:05.047389 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.040966    2580 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 24 18:44:05.047389 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.040968    2580 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 24 18:44:05.047389 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.040971    2580 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 24 18:44:05.047389 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.040974    2580 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 24 18:44:05.047389 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.040977    2580 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 24 18:44:05.047389 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.040979    2580 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 24 18:44:05.047389 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.040982    2580 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 24 18:44:05.047389 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.040989    2580 flags.go:64] FLAG: --node-status-max-images="50"
Jul 24 18:44:05.047976 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.040991    2580 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 24 18:44:05.047976 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.040995    2580 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 24 18:44:05.047976 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.040998    2580 flags.go:64] FLAG: --pod-cidr=""
Jul 24 18:44:05.047976 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.041001    2580 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb"
Jul 24 18:44:05.047976 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.041005    2580 flags.go:64] FLAG: --pod-manifest-path=""
Jul 24 18:44:05.047976 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.041008    2580 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 24 18:44:05.047976 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.041010    2580 flags.go:64] FLAG: --pods-per-core="0"
Jul 24 18:44:05.047976 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.041013    2580 flags.go:64] FLAG: --port="10250"
Jul 24 18:44:05.047976 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.041016    2580 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 24 18:44:05.047976 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.041018    2580 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0456b694e5443b72d"
Jul 24 18:44:05.047976 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.041021    2580 flags.go:64] FLAG: --qos-reserved=""
Jul 24 18:44:05.047976 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.041024    2580 flags.go:64] FLAG: --read-only-port="10255"
Jul 24 18:44:05.047976 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.041026    2580 flags.go:64] FLAG: --register-node="true"
Jul 24 18:44:05.047976 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.041029    2580 flags.go:64] FLAG: --register-with-taints=""
Jul 24 18:44:05.047976 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.041034    2580 flags.go:64] FLAG: --registry-burst="10"
Jul 24 18:44:05.047976 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.041037    2580 flags.go:64] FLAG: --registry-qps="5"
Jul 24 18:44:05.047976 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.041040    2580 flags.go:64] FLAG: --reserved-cpus=""
Jul 24 18:44:05.047976 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.041044    2580 flags.go:64] FLAG: --reserved-memory=""
Jul 24 18:44:05.047976 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.041047    2580 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 24 18:44:05.047976 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.041050    2580 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 24 18:44:05.047976 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.041052    2580 flags.go:64] FLAG: --rotate-certificates="false"
Jul 24 18:44:05.047976 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.041055    2580 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 24 18:44:05.047976 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.041058    2580 flags.go:64] FLAG: --runonce="false"
Jul 24 18:44:05.047976 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.041061    2580 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 24 18:44:05.047976 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.041064    2580 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 24 18:44:05.048609 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.041067    2580 flags.go:64] FLAG: --seccomp-default="false"
Jul 24 18:44:05.048609 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.041069    2580 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 24 18:44:05.048609 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.041072    2580 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 24 18:44:05.048609 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.041075    2580 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 24 18:44:05.048609 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.041077    2580 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 24 18:44:05.048609 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.041080    2580 flags.go:64] FLAG: --storage-driver-password="root"
Jul 24 18:44:05.048609 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.041083    2580 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 24 18:44:05.048609 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.041085    2580 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 24 18:44:05.048609 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.041088    2580 flags.go:64] FLAG: --storage-driver-user="root"
Jul 24 18:44:05.048609 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.041090    2580 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 24 18:44:05.048609 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.041093    2580 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 24 18:44:05.048609 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.041096    2580 flags.go:64] FLAG: --system-cgroups=""
Jul 24 18:44:05.048609 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.041098    2580 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 24 18:44:05.048609 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.041103    2580 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 24 18:44:05.048609 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.041106    2580 flags.go:64] FLAG: --tls-cert-file=""
Jul 24 18:44:05.048609 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.041108    2580 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 24 18:44:05.048609 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.041112    2580 flags.go:64] FLAG: --tls-min-version=""
Jul 24 18:44:05.048609 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.041114    2580 flags.go:64] FLAG: --tls-private-key-file=""
Jul 24 18:44:05.048609 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.041129    2580 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 24 18:44:05.048609 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.041133    2580 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 24 18:44:05.048609 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.041135    2580 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 24 18:44:05.048609 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.041139    2580 flags.go:64] FLAG: --v="2"
Jul 24 18:44:05.048609 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.041143    2580 flags.go:64] FLAG: --version="false"
Jul 24 18:44:05.048609 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.041147    2580 flags.go:64] FLAG: --vmodule=""
Jul 24 18:44:05.048609 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.041153    2580 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 24 18:44:05.049322 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.041156    2580 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 24 18:44:05.049322 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.041265    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 24 18:44:05.049322 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.041269    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 24 18:44:05.049322 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.041272    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 24 18:44:05.049322 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.041274    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 24 18:44:05.049322 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.041277    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 24 18:44:05.049322 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.041280    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 24 18:44:05.049322 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.041282    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 24 18:44:05.049322 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.041285    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 24 18:44:05.049322 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.041288    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 24 18:44:05.049322 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.041290    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 24 18:44:05.049322 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.041292    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 24 18:44:05.049322 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.041295    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 24 18:44:05.049322 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.041297    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 24 18:44:05.049322 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.041299    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 24 18:44:05.049322 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.041302    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 24 18:44:05.049322 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.041306    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 24 18:44:05.049322 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.041309    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 24 18:44:05.049322 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.041312    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 24 18:44:05.049322 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.041315    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 24 18:44:05.049786 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.041317    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 24 18:44:05.049786 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.041320    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 24 18:44:05.049786 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.041322    2580 feature_gate.go:328] unrecognized feature gate: Example
Jul 24 18:44:05.049786 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.041325    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 24 18:44:05.049786 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.041327    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 24 18:44:05.049786 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.041329    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 24 18:44:05.049786 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.041331    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 24 18:44:05.049786 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.041334    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 24 18:44:05.049786 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.041338    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 24 18:44:05.049786 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.041340    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 24 18:44:05.049786 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.041343    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 24 18:44:05.049786 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.041347    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 24 18:44:05.049786 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.041350    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 24 18:44:05.049786 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.041352    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 24 18:44:05.049786 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.041355    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 24 18:44:05.049786 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.041357    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 24 18:44:05.049786 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.041359    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 24 18:44:05.049786 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.041362    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 24 18:44:05.049786 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.041366    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 24 18:44:05.049786 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.041369    2580 feature_gate.go:328] unrecognized feature gate: Example2
Jul 24 18:44:05.050266 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.041372    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 24 18:44:05.050266 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.041375    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 24 18:44:05.050266 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.041378    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 24 18:44:05.050266 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.041381    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 24 18:44:05.050266 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.041383    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 24 18:44:05.050266 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.041386    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 24 18:44:05.050266 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.041389    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 24 18:44:05.050266 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.041392    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 24 18:44:05.050266 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.041394    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 24 18:44:05.050266 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.041396    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 24 18:44:05.050266 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.041399    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 24 18:44:05.050266 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.041401    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 24 18:44:05.050266 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.041404    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 24 18:44:05.050266 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.041406    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 24 18:44:05.050266 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.041408    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 24 18:44:05.050266 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.041410    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 24 18:44:05.050266 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.041413    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 24 18:44:05.050266 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.041415    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 24 18:44:05.050266 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.041417    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 24 18:44:05.050266 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.041420    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 24 18:44:05.050743 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.041424    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 24 18:44:05.050743 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.041426    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 24 18:44:05.050743 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.041428    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 24 18:44:05.050743 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.041431    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 24 18:44:05.050743 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.041435    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 24 18:44:05.050743 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.041437    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 24 18:44:05.050743 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.041440    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 24 18:44:05.050743 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.041442    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 24 18:44:05.050743 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.041444    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 24 18:44:05.050743 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.041447    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 24 18:44:05.050743 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.041449    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 24 18:44:05.050743 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.041451    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 24 18:44:05.050743 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.041454    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 24 18:44:05.050743 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.041456    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 24 18:44:05.050743 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.041458    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 24 18:44:05.050743 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.041461    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 24 18:44:05.050743 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.041463    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 24 18:44:05.050743 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.041465    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 24 18:44:05.050743 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.041468    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 24 18:44:05.050743 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.041470    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 24 18:44:05.051224 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.041472    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 24 18:44:05.051224 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.041475    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 24 18:44:05.051224 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.041477    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 24 18:44:05.051224 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.041481    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 24 18:44:05.051224 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.041484    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 24 18:44:05.051224 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.041487    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 24 18:44:05.051224 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.041489    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 24 18:44:05.051224 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.041492    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 24 18:44:05.051224 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.041495    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 24 18:44:05.051224 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.041497    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 24 18:44:05.051224 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.041499    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 24 18:44:05.051224 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.041502    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 24 18:44:05.051224 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.041505    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 24 18:44:05.051224 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.041508    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 24 18:44:05.051224 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.041510    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 24 18:44:05.051224 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.041513    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 24 18:44:05.051224 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.041515    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 24 18:44:05.051224 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.041518    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 24 18:44:05.051224 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.041521    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 24 18:44:05.051677 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.041523    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 24 18:44:05.051677 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.042051    2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 24 18:44:05.051677 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.048529    2580 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 24 18:44:05.051677 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.048545    2580 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 24 18:44:05.051677 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.048564    2580 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 24 18:44:05.051677 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.048570    2580 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 24 18:44:05.051677 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.048630    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 24 18:44:05.051677 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.048635    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 24 18:44:05.051677 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.048639    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 24 18:44:05.051677 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.048642    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 24 18:44:05.051677 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.048645    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 24 18:44:05.051677 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.048649    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 24 18:44:05.051677 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.048651    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 24 18:44:05.051677 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.048654    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 24 18:44:05.051677 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.048656    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 24 18:44:05.052040 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.048659    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 24 18:44:05.052040 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.048661    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 24 18:44:05.052040 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.048664    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 24 18:44:05.052040 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.048667    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 24 18:44:05.052040 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.048669    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 24 18:44:05.052040 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.048672    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 24 18:44:05.052040 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.048676    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 24 18:44:05.052040 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.048680    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 24 18:44:05.052040 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.048684    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 24 18:44:05.052040 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.048687    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 24 18:44:05.052040 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.048690    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 24 18:44:05.052040 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.048693    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 24 18:44:05.052040 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.048696    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 24 18:44:05.052040 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.048699    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 24 18:44:05.052040 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.048701    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 24 18:44:05.052040 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.048705    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 24 18:44:05.052040 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.048707    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 24 18:44:05.052040 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.048710    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 24 18:44:05.052040 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.048712    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 24 18:44:05.052505 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.048715    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 24 18:44:05.052505 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.048718    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 24 18:44:05.052505 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.048721    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 24 18:44:05.052505 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.048723    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 24 18:44:05.052505 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.048726    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 24 18:44:05.052505 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.048729    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 24 18:44:05.052505 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.048731    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 24 18:44:05.052505 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.048734    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 24 18:44:05.052505 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.048737    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 24 18:44:05.052505 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.048739    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 24 18:44:05.052505 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.048742    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 24 18:44:05.052505 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.048744    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 24 18:44:05.052505 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.048747    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 24 18:44:05.052505 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.048750    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 24 18:44:05.052505 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.048752    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 24 18:44:05.052505 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.048754    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 24 18:44:05.052505 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.048758    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 24 18:44:05.052505 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.048761    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 24 18:44:05.052505 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.048764    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 24 18:44:05.052952 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.048767    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 24 18:44:05.052952 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.048770    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 24 18:44:05.052952 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.048772    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 24 18:44:05.052952 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.048775    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 24 18:44:05.052952 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.048777    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 24 18:44:05.052952 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.048780    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 24 18:44:05.052952 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.048783    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 24 18:44:05.052952 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.048786    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 24 18:44:05.052952 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.048789    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 24 18:44:05.052952 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.048792    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 24 18:44:05.052952 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.048795    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 24 18:44:05.052952 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.048797    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 24 18:44:05.052952 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.048800    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 24 18:44:05.052952 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.048802    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 24 18:44:05.052952 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.048805    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 24 18:44:05.052952 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.048808    2580 feature_gate.go:328] unrecognized feature gate: Example
Jul 24 18:44:05.052952 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.048810    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 24 18:44:05.052952 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.048812    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 24 18:44:05.052952 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.048815    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 24 18:44:05.052952 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.048818    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 24 18:44:05.053504 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.048820    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 24 18:44:05.053504 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.048822    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 24 18:44:05.053504 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.048825    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 24 18:44:05.053504 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.048827    2580 feature_gate.go:328] unrecognized feature gate: Example2
Jul 24 18:44:05.053504 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.048830    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 24 18:44:05.053504 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.048833    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 24 18:44:05.053504 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.048836    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 24 18:44:05.053504 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.048838    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 24 18:44:05.053504 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.048840    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 24 18:44:05.053504 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.048843    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 24 18:44:05.053504 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.048846    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 24 18:44:05.053504 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.048849    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 24 18:44:05.053504 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.048851    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 24 18:44:05.053504 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.048853    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 24 18:44:05.053504 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.048856    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 24 18:44:05.053504 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.048858    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 24 18:44:05.053504 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.048861    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 24 18:44:05.053504 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.048863    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 24 18:44:05.053504 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.048866    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 24 18:44:05.053504 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.048869    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 24 18:44:05.053973 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.048871    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 24 18:44:05.053973 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.048874    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 24 18:44:05.053973 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.048876    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 24 18:44:05.053973 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.048886    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 24 18:44:05.053973 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.048889    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 24 18:44:05.053973 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.048891    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 24 18:44:05.053973 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.048894    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 24 18:44:05.053973 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.048897    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 24 18:44:05.053973 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.048899    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 24 18:44:05.053973 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.048902    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 24 18:44:05.053973 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.048904    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 24 18:44:05.053973 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.048907    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 24 18:44:05.053973 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.048912    2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 24 18:44:05.053973 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.049036    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 24 18:44:05.054319 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.049040    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 24 18:44:05.054319 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.049043    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 24 18:44:05.054319 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.049046    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 24 18:44:05.054319 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.049048    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 24 18:44:05.054319 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.049051    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 24 18:44:05.054319 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.049054    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 24 18:44:05.054319 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.049056    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 24 18:44:05.054319 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.049059    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 24 18:44:05.054319 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.049061    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 24 18:44:05.054319 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.049065    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 24 18:44:05.054319 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.049068    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 24 18:44:05.054319 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.049071    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 24 18:44:05.054319 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.049074    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 24 18:44:05.054319 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.049076    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 24 18:44:05.054319 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.049079    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 24 18:44:05.054319 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.049081    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 24 18:44:05.054319 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.049084    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 24 18:44:05.054319 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.049086    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 24 18:44:05.054319 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.049089    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 24 18:44:05.054319 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.049091    2580 feature_gate.go:328] unrecognized feature gate: Example
Jul 24 18:44:05.054790 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.049094    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 24 18:44:05.054790 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.049096    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 24 18:44:05.054790 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.049100    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 24 18:44:05.054790 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.049102    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 24 18:44:05.054790 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.049105    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 24 18:44:05.054790 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.049107    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 24 18:44:05.054790 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.049109    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 24 18:44:05.054790 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.049112    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 24 18:44:05.054790 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.049114    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 24 18:44:05.054790 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.049131    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 24 18:44:05.054790 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.049134    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 24 18:44:05.054790 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.049136    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 24 18:44:05.054790 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.049139    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 24 18:44:05.054790 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.049142    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 24 18:44:05.054790 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.049144    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 24 18:44:05.054790 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.049147    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 24 18:44:05.054790 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.049149    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 24 18:44:05.054790 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.049152    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 24 18:44:05.054790 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.049154    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 24 18:44:05.054790 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.049157    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 24 18:44:05.055295 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.049160    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 24 18:44:05.055295 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.049164    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 24 18:44:05.055295 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.049166    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 24 18:44:05.055295 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.049169    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 24 18:44:05.055295 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.049171    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 24 18:44:05.055295 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.049174    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 24 18:44:05.055295 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.049177    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 24 18:44:05.055295 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.049179    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 24 18:44:05.055295 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.049181    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 24 18:44:05.055295 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.049184    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 24 18:44:05.055295 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.049187    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 24 18:44:05.055295 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.049189    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 24 18:44:05.055295 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.049192    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 24 18:44:05.055295 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.049194    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 24 18:44:05.055295 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.049196    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 24 18:44:05.055295 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.049199    2580 feature_gate.go:328] unrecognized feature gate: Example2
Jul 24 18:44:05.055295 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.049202    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 24 18:44:05.055295 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.049205    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 24 18:44:05.055295 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.049207    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 24 18:44:05.055295 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.049209    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 24 18:44:05.055836 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.049212    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 24 18:44:05.055836 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.049214    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 24 18:44:05.055836 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.049216    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 24 18:44:05.055836 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.049218    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 24 18:44:05.055836 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.049221    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 24 18:44:05.055836 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.049223    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 24 18:44:05.055836 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.049226    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 24 18:44:05.055836 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.049228    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 24 18:44:05.055836 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.049230    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 24 18:44:05.055836 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.049233    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 24 18:44:05.055836 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.049236    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 24 18:44:05.055836 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.049238    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 24 18:44:05.055836 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.049241    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 24 18:44:05.055836 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.049243    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 24 18:44:05.055836 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.049246    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 24 18:44:05.055836 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.049248    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 24 18:44:05.055836 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.049251    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 24 18:44:05.055836 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.049253    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 24 18:44:05.055836 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.049255    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 24 18:44:05.056372 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.049258    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 24 18:44:05.056372 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.049261    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 24 18:44:05.056372 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.049263    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 24 18:44:05.056372 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.049266    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 24 18:44:05.056372 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.049268    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 24 18:44:05.056372 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.049270    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 24 18:44:05.056372 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.049273    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 24 18:44:05.056372 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.049275    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 24 18:44:05.056372 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.049278    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 24 18:44:05.056372 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.049281    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 24 18:44:05.056372 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.049283    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 24 18:44:05.056372 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.049286    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 24 18:44:05.056372 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.049288    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 24 18:44:05.056372 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.049290    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 24 18:44:05.056372 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.049293    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 24 18:44:05.056372 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.049295    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 24 18:44:05.056372 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.049298    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 24 18:44:05.056372 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.049300    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 24 18:44:05.056372 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:05.049303    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 24 18:44:05.056826 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.049308    2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 24 18:44:05.056826 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.049408    2580 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 24 18:44:05.056826 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.051248    2580 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 24 18:44:05.056826 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.052339    2580 server.go:1019] "Starting client certificate rotation"
Jul 24 18:44:05.056826 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.052445    2580 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 24 18:44:05.056826 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.053150    2580 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 24 18:44:05.056826 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.054873    2580 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 24 18:44:05.058495 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.058477    2580 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 24 18:44:05.070357 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.070336    2580 log.go:25] "Validated CRI v1 runtime API"
Jul 24 18:44:05.072140 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.072105    2580 log.go:25] "Validated CRI v1 image API"
Jul 24 18:44:05.072908 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.072893    2580 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 24 18:44:05.075019 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.075001    2580 fs.go:135] Filesystem UUIDs: map[4dcdaa46-bb97-40aa-a73f-b1de8fcbda2d:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 f49cdd5b-c5f6-468a-9286-69d8226a0897:/dev/nvme0n1p3]
Jul 24 18:44:05.075066 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.075019    2580 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 24 18:44:05.079042 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.078943    2580 manager.go:216] Machine: {Timestamp:2026-07-24 18:44:05.078495406 +0000 UTC m=+0.287867439 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3101226 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2a242e1f1979d30ffeb75b9f527d15 SystemUUID:ec2a242e-1f19-79d3-0ffe-b75b9f527d15 BootID:8a706692-5f7f-4af0-998c-670114dae213 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:27:eb:76:0f:81 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:27:eb:76:0f:81 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ca:9d:6d:b3:61:79 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 24 18:44:05.079042 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.079041    2580 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 24 18:44:05.079165 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.079115    2580 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 24 18:44:05.080089 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.080067    2580 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 24 18:44:05.080256 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.080092    2580 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-141-146.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 24 18:44:05.080800 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.080789    2580 topology_manager.go:138] "Creating topology manager with none policy"
Jul 24 18:44:05.080840 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.080804    2580 container_manager_linux.go:309] "Creating device plugin manager"
Jul 24 18:44:05.080840 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.080811    2580 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 24 18:44:05.080840 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.080828    2580 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 24 18:44:05.081854 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.081843    2580 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 24 18:44:05.083576 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.083562    2580 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 24 18:44:05.084543 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.084532    2580 state_mem.go:36] "Initialized new in-memory state store"
Jul 24 18:44:05.084658 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.084649    2580 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 24 18:44:05.084694 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.084679    2580 kubelet.go:486] "Attempting to sync node with API server"
Jul 24 18:44:05.084726 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.084695    2580 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 24 18:44:05.084726 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.084705    2580 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 24 18:44:05.084726 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.084713    2580 kubelet.go:398] "Adding apiserver pod source"
Jul 24 18:44:05.084726 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.084722    2580 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 24 18:44:05.085085 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.085062    2580 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 24 18:44:05.085141 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.085093    2580 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 24 18:44:05.087017 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.086998    2580 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 24 18:44:05.088102 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.088090    2580 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 24 18:44:05.088158 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.088136    2580 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 24 18:44:05.088604 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.088594    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 24 18:44:05.088645 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.088610    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 24 18:44:05.088645 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.088616    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 24 18:44:05.088645 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.088622    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 24 18:44:05.088645 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.088630    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 24 18:44:05.088645 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.088635    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 24 18:44:05.088783 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.088699    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 24 18:44:05.088783 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.088705    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 24 18:44:05.088783 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.088712    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 24 18:44:05.088783 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.088717    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 24 18:44:05.088783 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.088726    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 24 18:44:05.088783 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.088733    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 24 18:44:05.088783 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.088771    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 24 18:44:05.088783 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.088777    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 24 18:44:05.091972 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.091960    2580 server.go:1268] "Started kubelet"
Jul 24 18:44:05.092259 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.092213    2580 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 24 18:44:05.092550 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.092115    2580 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 24 18:44:05.092629 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.092580    2580 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 24 18:44:05.092874 ip-10-0-141-146 systemd[1]: Started Kubernetes Kubelet.
Jul 24 18:44:05.096751 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.096726    2580 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 24 18:44:05.096751 ip-10-0-141-146 kubenswrapper[2580]: E0724 18:44:05.096707    2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-141-146.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 24 18:44:05.096891 ip-10-0-141-146 kubenswrapper[2580]: E0724 18:44:05.096849    2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 24 18:44:05.097136 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.097097    2580 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-141-146.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 18:44:05.097811 ip-10-0-141-146 kubenswrapper[2580]: E0724 18:44:05.097706    2580 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 24 18:44:05.098460 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.098437    2580 server.go:310] "Adding debug handlers to kubelet server"
Jul 24 18:44:05.100134 ip-10-0-141-146 kubenswrapper[2580]: E0724 18:44:05.099272    2580 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-146.ec2.internal.18c54e0d01ad1a4a  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-146.ec2.internal,UID:ip-10-0-141-146.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-141-146.ec2.internal,},FirstTimestamp:2026-07-24 18:44:05.091932746 +0000 UTC m=+0.301304778,LastTimestamp:2026-07-24 18:44:05.091932746 +0000 UTC m=+0.301304778,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-146.ec2.internal,}"
Jul 24 18:44:05.102169 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.102151    2580 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 24 18:44:05.102268 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.102172    2580 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 24 18:44:05.102415 ip-10-0-141-146 kubenswrapper[2580]: E0724 18:44:05.102395    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-146.ec2.internal\" not found"
Jul 24 18:44:05.104027 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.102865    2580 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 24 18:44:05.104027 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.102886    2580 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 24 18:44:05.104027 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.103023    2580 reconstruct.go:97] "Volume reconstruction finished"
Jul 24 18:44:05.104027 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.103031    2580 reconciler.go:29] "Reconciler: start to sync state"
Jul 24 18:44:05.104027 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.103047    2580 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 24 18:44:05.104027 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.103795    2580 factory.go:55] Registering systemd factory
Jul 24 18:44:05.104027 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.103810    2580 factory.go:223] Registration of the systemd container factory successfully
Jul 24 18:44:05.104380 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.104080    2580 factory.go:153] Registering CRI-O factory
Jul 24 18:44:05.104380 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.104091    2580 factory.go:223] Registration of the crio container factory successfully
Jul 24 18:44:05.104380 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.104166    2580 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 24 18:44:05.104380 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.104189    2580 factory.go:103] Registering Raw factory
Jul 24 18:44:05.104380 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.104205    2580 manager.go:1196] Started watching for new ooms in manager
Jul 24 18:44:05.104822 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.104796    2580 manager.go:349] Starting recovery of all containers
Jul 24 18:44:05.105911 ip-10-0-141-146 kubenswrapper[2580]: E0724 18:44:05.105574    2580 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-141-146.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 24 18:44:05.105911 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.105626    2580 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-vxpqz"
Jul 24 18:44:05.105911 ip-10-0-141-146 kubenswrapper[2580]: E0724 18:44:05.105710    2580 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 24 18:44:05.113626 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.113498    2580 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-vxpqz"
Jul 24 18:44:05.115498 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.115478    2580 manager.go:354] Recovery completed
Jul 24 18:44:05.120609 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.120595    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 18:44:05.122623 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.122606    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-146.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 18:44:05.122698 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.122641    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-146.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 18:44:05.122698 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.122677    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-146.ec2.internal" event="NodeHasSufficientPID"
Jul 24 18:44:05.123208 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.123193    2580 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 24 18:44:05.123208 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.123208    2580 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 24 18:44:05.123331 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.123203    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 18:44:05.123331 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.123228    2580 state_mem.go:36] "Initialized new in-memory state store"
Jul 24 18:44:05.123894 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.123877    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-146.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 18:44:05.123951 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.123906    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-146.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 18:44:05.123951 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.123916    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-146.ec2.internal" event="NodeHasSufficientPID"
Jul 24 18:44:05.124337 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.124326    2580 policy_none.go:49] "None policy: Start"
Jul 24 18:44:05.124397 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.124344    2580 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 24 18:44:05.124397 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.124354    2580 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 24 18:44:05.125271 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.125260    2580 policy_none.go:47] "Start"
Jul 24 18:44:05.174764 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.174745    2580 manager.go:337] "Starting Device Plugin manager"
Jul 24 18:44:05.174882 ip-10-0-141-146 kubenswrapper[2580]: E0724 18:44:05.174783    2580 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 24 18:44:05.174882 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.174799    2580 server.go:87] "Starting device plugin registration server"
Jul 24 18:44:05.175097 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.175086    2580 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 24 18:44:05.175173 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.175099    2580 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 24 18:44:05.175250 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.175203    2580 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 24 18:44:05.175407 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.175383    2580 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 24 18:44:05.175407 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.175399    2580 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 24 18:44:05.175880 ip-10-0-141-146 kubenswrapper[2580]: E0724 18:44:05.175857    2580 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 24 18:44:05.175953 ip-10-0-141-146 kubenswrapper[2580]: E0724 18:44:05.175904    2580 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-141-146.ec2.internal\" not found"
Jul 24 18:44:05.233683 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.233641    2580 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 24 18:44:05.235047 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.235028    2580 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 24 18:44:05.235175 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.235062    2580 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 24 18:44:05.235175 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.235085    2580 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 24 18:44:05.235175 ip-10-0-141-146 kubenswrapper[2580]: E0724 18:44:05.235144    2580 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 24 18:44:05.237494 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.237476    2580 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 24 18:44:05.275421 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.275389    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 18:44:05.276426 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.276394    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-146.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 18:44:05.276426 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.276430    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-146.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 18:44:05.276583 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.276441    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-146.ec2.internal" event="NodeHasSufficientPID"
Jul 24 18:44:05.276583 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.276472    2580 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-141-146.ec2.internal"
Jul 24 18:44:05.284379 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.284326    2580 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-141-146.ec2.internal"
Jul 24 18:44:05.284379 ip-10-0-141-146 kubenswrapper[2580]: E0724 18:44:05.284352    2580 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-141-146.ec2.internal\": node \"ip-10-0-141-146.ec2.internal\" not found"
Jul 24 18:44:05.298269 ip-10-0-141-146 kubenswrapper[2580]: E0724 18:44:05.298239    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-146.ec2.internal\" not found"
Jul 24 18:44:05.336468 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.335959    2580 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-146.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-141-146.ec2.internal"]
Jul 24 18:44:05.336568 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.336511    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 18:44:05.337482 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.337464    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-146.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 18:44:05.337567 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.337503    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-146.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 18:44:05.337567 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.337515    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-146.ec2.internal" event="NodeHasSufficientPID"
Jul 24 18:44:05.338862 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.338847    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 18:44:05.338997 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.338982    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-146.ec2.internal"
Jul 24 18:44:05.339059 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.339017    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 18:44:05.339623 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.339605    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-146.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 18:44:05.339623 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.339615    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-146.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 18:44:05.339775 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.339633    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-146.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 18:44:05.339775 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.339650    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-146.ec2.internal" event="NodeHasSufficientPID"
Jul 24 18:44:05.339775 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.339634    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-146.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 18:44:05.339775 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.339718    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-146.ec2.internal" event="NodeHasSufficientPID"
Jul 24 18:44:05.340763 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.340747    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-146.ec2.internal"
Jul 24 18:44:05.340826 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.340771    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 18:44:05.341456 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.341433    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-146.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 18:44:05.341456 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.341454    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-146.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 18:44:05.341598 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.341468    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-146.ec2.internal" event="NodeHasSufficientPID"
Jul 24 18:44:05.370890 ip-10-0-141-146 kubenswrapper[2580]: E0724 18:44:05.370865    2580 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-146.ec2.internal\" not found" node="ip-10-0-141-146.ec2.internal"
Jul 24 18:44:05.375597 ip-10-0-141-146 kubenswrapper[2580]: E0724 18:44:05.375581    2580 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-146.ec2.internal\" not found" node="ip-10-0-141-146.ec2.internal"
Jul 24 18:44:05.398887 ip-10-0-141-146 kubenswrapper[2580]: E0724 18:44:05.398858    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-146.ec2.internal\" not found"
Jul 24 18:44:05.404390 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.404355    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d91a83fc84345123f3da435634f47e28-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-146.ec2.internal\" (UID: \"d91a83fc84345123f3da435634f47e28\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-146.ec2.internal"
Jul 24 18:44:05.404484 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.404396    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4d95d964f6f5196d055ec9fd47d5b92d-config\") pod \"kube-apiserver-proxy-ip-10-0-141-146.ec2.internal\" (UID: \"4d95d964f6f5196d055ec9fd47d5b92d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-146.ec2.internal"
Jul 24 18:44:05.404484 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.404416    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d91a83fc84345123f3da435634f47e28-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-146.ec2.internal\" (UID: \"d91a83fc84345123f3da435634f47e28\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-146.ec2.internal"
Jul 24 18:44:05.499927 ip-10-0-141-146 kubenswrapper[2580]: E0724 18:44:05.499889    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-146.ec2.internal\" not found"
Jul 24 18:44:05.505301 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.505284    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d91a83fc84345123f3da435634f47e28-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-146.ec2.internal\" (UID: \"d91a83fc84345123f3da435634f47e28\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-146.ec2.internal"
Jul 24 18:44:05.505395 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.505307    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d91a83fc84345123f3da435634f47e28-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-146.ec2.internal\" (UID: \"d91a83fc84345123f3da435634f47e28\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-146.ec2.internal"
Jul 24 18:44:05.505395 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.505331    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d91a83fc84345123f3da435634f47e28-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-146.ec2.internal\" (UID: \"d91a83fc84345123f3da435634f47e28\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-146.ec2.internal"
Jul 24 18:44:05.505395 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.505356    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4d95d964f6f5196d055ec9fd47d5b92d-config\") pod \"kube-apiserver-proxy-ip-10-0-141-146.ec2.internal\" (UID: \"4d95d964f6f5196d055ec9fd47d5b92d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-146.ec2.internal"
Jul 24 18:44:05.505395 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.505376    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d91a83fc84345123f3da435634f47e28-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-146.ec2.internal\" (UID: \"d91a83fc84345123f3da435634f47e28\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-146.ec2.internal"
Jul 24 18:44:05.505530 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.505402    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4d95d964f6f5196d055ec9fd47d5b92d-config\") pod \"kube-apiserver-proxy-ip-10-0-141-146.ec2.internal\" (UID: \"4d95d964f6f5196d055ec9fd47d5b92d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-146.ec2.internal"
Jul 24 18:44:05.600794 ip-10-0-141-146 kubenswrapper[2580]: E0724 18:44:05.600717    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-146.ec2.internal\" not found"
Jul 24 18:44:05.673315 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.673287    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-146.ec2.internal"
Jul 24 18:44:05.679257 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:05.679240    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-146.ec2.internal"
Jul 24 18:44:05.701528 ip-10-0-141-146 kubenswrapper[2580]: E0724 18:44:05.700937    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-146.ec2.internal\" not found"
Jul 24 18:44:05.801545 ip-10-0-141-146 kubenswrapper[2580]: E0724 18:44:05.801508    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-146.ec2.internal\" not found"
Jul 24 18:44:05.902086 ip-10-0-141-146 kubenswrapper[2580]: E0724 18:44:05.902014    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-146.ec2.internal\" not found"
Jul 24 18:44:06.002466 ip-10-0-141-146 kubenswrapper[2580]: E0724 18:44:06.002430    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-146.ec2.internal\" not found"
Jul 24 18:44:06.051836 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:06.051806    2580 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 24 18:44:06.052331 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:06.051947    2580 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 24 18:44:06.102605 ip-10-0-141-146 kubenswrapper[2580]: E0724 18:44:06.102576    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-146.ec2.internal\" not found"
Jul 24 18:44:06.117583 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:06.117550    2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-23 18:39:05 +0000 UTC" deadline="2028-02-17 12:14:05.32593406 +0000 UTC"
Jul 24 18:44:06.117583 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:06.117576    2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13745h29m59.208361766s"
Jul 24 18:44:06.203562 ip-10-0-141-146 kubenswrapper[2580]: E0724 18:44:06.203532    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-146.ec2.internal\" not found"
Jul 24 18:44:06.204041 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:06.204023    2580 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 24 18:44:06.220670 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:06.220641    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d95d964f6f5196d055ec9fd47d5b92d.slice/crio-5c56e94566d169a6530c4754a994ccaf96d8920ff052b60c317b223370596158 WatchSource:0}: Error finding container 5c56e94566d169a6530c4754a994ccaf96d8920ff052b60c317b223370596158: Status 404 returned error can't find the container with id 5c56e94566d169a6530c4754a994ccaf96d8920ff052b60c317b223370596158
Jul 24 18:44:06.220990 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:06.220976    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd91a83fc84345123f3da435634f47e28.slice/crio-cdd1f84d53e7323f9db12b3ca988eb2b9729cea483e8be5e8909e941f278dfbb WatchSource:0}: Error finding container cdd1f84d53e7323f9db12b3ca988eb2b9729cea483e8be5e8909e941f278dfbb: Status 404 returned error can't find the container with id cdd1f84d53e7323f9db12b3ca988eb2b9729cea483e8be5e8909e941f278dfbb
Jul 24 18:44:06.225644 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:06.225624    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 24 18:44:06.238223 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:06.238172    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-146.ec2.internal" event={"ID":"d91a83fc84345123f3da435634f47e28","Type":"ContainerStarted","Data":"cdd1f84d53e7323f9db12b3ca988eb2b9729cea483e8be5e8909e941f278dfbb"}
Jul 24 18:44:06.239334 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:06.239313    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-146.ec2.internal" event={"ID":"4d95d964f6f5196d055ec9fd47d5b92d","Type":"ContainerStarted","Data":"5c56e94566d169a6530c4754a994ccaf96d8920ff052b60c317b223370596158"}
Jul 24 18:44:06.280535 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:06.280515    2580 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 24 18:44:06.302730 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:06.302700    2580 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-146.ec2.internal"
Jul 24 18:44:06.314566 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:06.314546    2580 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 24 18:44:06.316187 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:06.316175    2580 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-146.ec2.internal"
Jul 24 18:44:06.335324 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:06.335312    2580 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 24 18:44:06.445495 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:06.445474    2580 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 24 18:44:07.085697 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.085658    2580 apiserver.go:52] "Watching apiserver"
Jul 24 18:44:07.093312 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.093285    2580 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 24 18:44:07.094874 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.094851    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-5mtg4","kube-system/kube-apiserver-proxy-ip-10-0-141-146.ec2.internal","openshift-cluster-node-tuning-operator/tuned-5tl49","openshift-image-registry/node-ca-wgt82","openshift-multus/multus-mtsh4","openshift-multus/network-metrics-daemon-nsc2s","openshift-ovn-kubernetes/ovnkube-node-qvzgb","kube-system/global-pull-secret-syncer-phl62","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qdmrt","openshift-dns/node-resolver-r9l62","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-146.ec2.internal","openshift-multus/multus-additional-cni-plugins-pvjzc","openshift-network-diagnostics/network-check-target-4722z","openshift-network-operator/iptables-alerter-g48lh"]
Jul 24 18:44:07.096542 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.096519    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-qvzgb"
Jul 24 18:44:07.097829 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.097812    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4722z"
Jul 24 18:44:07.097921 ip-10-0-141-146 kubenswrapper[2580]: E0724 18:44:07.097881    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4722z" podUID="d0cb8d6d-2dda-4fee-89ee-c7d163e5d80d"
Jul 24 18:44:07.098830 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.098776    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-dcjck\""
Jul 24 18:44:07.098925 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.098846    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-5tl49"
Jul 24 18:44:07.098925 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.098863    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 24 18:44:07.099799 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.099781    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-wgt82"
Jul 24 18:44:07.100092 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.100056    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 24 18:44:07.100353 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.100340    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 24 18:44:07.100526 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.100515    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 24 18:44:07.100640 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.100625    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 24 18:44:07.100744 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.100731    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 24 18:44:07.100952 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.100932    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-mtsh4"
Jul 24 18:44:07.101145 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.101132    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 24 18:44:07.101291 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.101280    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-t7pf4\""
Jul 24 18:44:07.101471 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.101457    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 24 18:44:07.101771 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.101754    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 24 18:44:07.102289 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.102174    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 24 18:44:07.102289 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.102190    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-drt4g\""
Jul 24 18:44:07.102450 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.102432    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nsc2s"
Jul 24 18:44:07.102542 ip-10-0-141-146 kubenswrapper[2580]: E0724 18:44:07.102502    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nsc2s" podUID="34b58fb0-dbc2-49de-86e2-4bd31bb3250a"
Jul 24 18:44:07.102656 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.102640    2580 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 24 18:44:07.102790 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.102754    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 24 18:44:07.103158 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.103140    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 24 18:44:07.103466 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.103363    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-77sjv\""
Jul 24 18:44:07.103548 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.103502    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 24 18:44:07.103548 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.103539    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 24 18:44:07.103820 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.103704    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 24 18:44:07.105209 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.105172    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qdmrt"
Jul 24 18:44:07.106040 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.106027    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-5mtg4"
Jul 24 18:44:07.107091 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.107078    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 24 18:44:07.107357 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.107330    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 24 18:44:07.107357 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.107353    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 24 18:44:07.107490 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.107473    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-lsnbz\""
Jul 24 18:44:07.107605 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.107591    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-g48lh"
Jul 24 18:44:07.108828 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.108812    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-stdbq\""
Jul 24 18:44:07.108909 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.108880    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 24 18:44:07.109010 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.108813    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 24 18:44:07.109568 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.109550    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-r9l62"
Jul 24 18:44:07.109847 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.109832    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 24 18:44:07.110402 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.110378    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 24 18:44:07.110483 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.110455    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-khfl8\""
Jul 24 18:44:07.110584 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.110570    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 24 18:44:07.111854 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.111839    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-phl62"
Jul 24 18:44:07.111923 ip-10-0-141-146 kubenswrapper[2580]: E0724 18:44:07.111897    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-phl62" podUID="84828167-a9ed-4515-9976-e266991f89fb"
Jul 24 18:44:07.112085 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.112071    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 24 18:44:07.112888 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.112871    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-4w9p8\""
Jul 24 18:44:07.113086 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.113065    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 24 18:44:07.113593 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.113558    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/85ac7f24-5c20-43ce-b04a-77229c7608e3-etc-systemd\") pod \"tuned-5tl49\" (UID: \"85ac7f24-5c20-43ce-b04a-77229c7608e3\") " pod="openshift-cluster-node-tuning-operator/tuned-5tl49"
Jul 24 18:44:07.113654 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.113592    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a5c64a4d-9068-4079-a7cf-e4f591e50243-cnibin\") pod \"multus-mtsh4\" (UID: \"a5c64a4d-9068-4079-a7cf-e4f591e50243\") " pod="openshift-multus/multus-mtsh4"
Jul 24 18:44:07.113654 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.113620    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dd21fc27-5a24-4f3a-a912-043af27a4342-host-run-ovn-kubernetes\") pod \"ovnkube-node-qvzgb\" (UID: \"dd21fc27-5a24-4f3a-a912-043af27a4342\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvzgb"
Jul 24 18:44:07.113654 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.113641    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/85ac7f24-5c20-43ce-b04a-77229c7608e3-etc-modprobe-d\") pod \"tuned-5tl49\" (UID: \"85ac7f24-5c20-43ce-b04a-77229c7608e3\") " pod="openshift-cluster-node-tuning-operator/tuned-5tl49"
Jul 24 18:44:07.113654 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.113646    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-pvjzc"
Jul 24 18:44:07.113839 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.113663    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a5c64a4d-9068-4079-a7cf-e4f591e50243-host-var-lib-cni-bin\") pod \"multus-mtsh4\" (UID: \"a5c64a4d-9068-4079-a7cf-e4f591e50243\") " pod="openshift-multus/multus-mtsh4"
Jul 24 18:44:07.113839 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.113684    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vmj25\" (UniqueName: \"kubernetes.io/projected/fec4f688-25f1-4137-9f75-a824811d6f2b-kube-api-access-vmj25\") pod \"aws-ebs-csi-driver-node-qdmrt\" (UID: \"fec4f688-25f1-4137-9f75-a824811d6f2b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qdmrt"
Jul 24 18:44:07.113839 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.113704    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dd21fc27-5a24-4f3a-a912-043af27a4342-etc-openvswitch\") pod \"ovnkube-node-qvzgb\" (UID: \"dd21fc27-5a24-4f3a-a912-043af27a4342\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvzgb"
Jul 24 18:44:07.113839 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.113724    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/dd21fc27-5a24-4f3a-a912-043af27a4342-run-ovn\") pod \"ovnkube-node-qvzgb\" (UID: \"dd21fc27-5a24-4f3a-a912-043af27a4342\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvzgb"
Jul 24 18:44:07.113839 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.113745    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a5c64a4d-9068-4079-a7cf-e4f591e50243-multus-conf-dir\") pod \"multus-mtsh4\" (UID: \"a5c64a4d-9068-4079-a7cf-e4f591e50243\") " pod="openshift-multus/multus-mtsh4"
Jul 24 18:44:07.113839 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.113766    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/dd21fc27-5a24-4f3a-a912-043af27a4342-ovnkube-config\") pod \"ovnkube-node-qvzgb\" (UID: \"dd21fc27-5a24-4f3a-a912-043af27a4342\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvzgb"
Jul 24 18:44:07.113839 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.113785    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/85ac7f24-5c20-43ce-b04a-77229c7608e3-sys\") pod \"tuned-5tl49\" (UID: \"85ac7f24-5c20-43ce-b04a-77229c7608e3\") " pod="openshift-cluster-node-tuning-operator/tuned-5tl49"
Jul 24 18:44:07.113839 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.113805    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a5c64a4d-9068-4079-a7cf-e4f591e50243-host-run-k8s-cni-cncf-io\") pod \"multus-mtsh4\" (UID: \"a5c64a4d-9068-4079-a7cf-e4f591e50243\") " pod="openshift-multus/multus-mtsh4"
Jul 24 18:44:07.113839 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.113826    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a5c64a4d-9068-4079-a7cf-e4f591e50243-etc-kubernetes\") pod \"multus-mtsh4\" (UID: \"a5c64a4d-9068-4079-a7cf-e4f591e50243\") " pod="openshift-multus/multus-mtsh4"
Jul 24 18:44:07.114247 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.113847    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/34b58fb0-dbc2-49de-86e2-4bd31bb3250a-metrics-certs\") pod \"network-metrics-daemon-nsc2s\" (UID: \"34b58fb0-dbc2-49de-86e2-4bd31bb3250a\") " pod="openshift-multus/network-metrics-daemon-nsc2s"
Jul 24 18:44:07.114247 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.113868    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/dd21fc27-5a24-4f3a-a912-043af27a4342-log-socket\") pod \"ovnkube-node-qvzgb\" (UID: \"dd21fc27-5a24-4f3a-a912-043af27a4342\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvzgb"
Jul 24 18:44:07.114247 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.113887    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a5c64a4d-9068-4079-a7cf-e4f591e50243-host-run-netns\") pod \"multus-mtsh4\" (UID: \"a5c64a4d-9068-4079-a7cf-e4f591e50243\") " pod="openshift-multus/multus-mtsh4"
Jul 24 18:44:07.114247 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.113907    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sxm5g\" (UniqueName: \"kubernetes.io/projected/8bcaaf05-ea88-48e2-9f47-a6c9b10f4ec3-kube-api-access-sxm5g\") pod \"node-ca-wgt82\" (UID: \"8bcaaf05-ea88-48e2-9f47-a6c9b10f4ec3\") " pod="openshift-image-registry/node-ca-wgt82"
Jul 24 18:44:07.114247 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.113928    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/fec4f688-25f1-4137-9f75-a824811d6f2b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qdmrt\" (UID: \"fec4f688-25f1-4137-9f75-a824811d6f2b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qdmrt"
Jul 24 18:44:07.114247 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.113953    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/fec4f688-25f1-4137-9f75-a824811d6f2b-etc-selinux\") pod \"aws-ebs-csi-driver-node-qdmrt\" (UID: \"fec4f688-25f1-4137-9f75-a824811d6f2b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qdmrt"
Jul 24 18:44:07.114247 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.113980    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/dd21fc27-5a24-4f3a-a912-043af27a4342-run-systemd\") pod \"ovnkube-node-qvzgb\" (UID: \"dd21fc27-5a24-4f3a-a912-043af27a4342\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvzgb"
Jul 24 18:44:07.114247 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.114014    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/85ac7f24-5c20-43ce-b04a-77229c7608e3-etc-tuned\") pod \"tuned-5tl49\" (UID: \"85ac7f24-5c20-43ce-b04a-77229c7608e3\") " pod="openshift-cluster-node-tuning-operator/tuned-5tl49"
Jul 24 18:44:07.114247 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.114052    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/dd21fc27-5a24-4f3a-a912-043af27a4342-host-kubelet\") pod \"ovnkube-node-qvzgb\" (UID: \"dd21fc27-5a24-4f3a-a912-043af27a4342\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvzgb"
Jul 24 18:44:07.114247 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.114144    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/dd21fc27-5a24-4f3a-a912-043af27a4342-ovnkube-script-lib\") pod \"ovnkube-node-qvzgb\" (UID: \"dd21fc27-5a24-4f3a-a912-043af27a4342\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvzgb"
Jul 24 18:44:07.114247 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.114171    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a5c64a4d-9068-4079-a7cf-e4f591e50243-cni-binary-copy\") pod \"multus-mtsh4\" (UID: \"a5c64a4d-9068-4079-a7cf-e4f591e50243\") " pod="openshift-multus/multus-mtsh4"
Jul 24 18:44:07.114247 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.114186    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/fec4f688-25f1-4137-9f75-a824811d6f2b-socket-dir\") pod \"aws-ebs-csi-driver-node-qdmrt\" (UID: \"fec4f688-25f1-4137-9f75-a824811d6f2b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qdmrt"
Jul 24 18:44:07.114247 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.114198    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8bcaaf05-ea88-48e2-9f47-a6c9b10f4ec3-host\") pod \"node-ca-wgt82\" (UID: \"8bcaaf05-ea88-48e2-9f47-a6c9b10f4ec3\") " pod="openshift-image-registry/node-ca-wgt82"
Jul 24 18:44:07.114247 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.114213    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a5c64a4d-9068-4079-a7cf-e4f591e50243-host-run-multus-certs\") pod \"multus-mtsh4\" (UID: \"a5c64a4d-9068-4079-a7cf-e4f591e50243\") " pod="openshift-multus/multus-mtsh4"
Jul 24 18:44:07.114247 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.114239    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lkmnw\" (UniqueName: \"kubernetes.io/projected/a5c64a4d-9068-4079-a7cf-e4f591e50243-kube-api-access-lkmnw\") pod \"multus-mtsh4\" (UID: \"a5c64a4d-9068-4079-a7cf-e4f591e50243\") " pod="openshift-multus/multus-mtsh4"
Jul 24 18:44:07.114247 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.114253    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/dd21fc27-5a24-4f3a-a912-043af27a4342-host-cni-netd\") pod \"ovnkube-node-qvzgb\" (UID: \"dd21fc27-5a24-4f3a-a912-043af27a4342\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvzgb"
Jul 24 18:44:07.114890 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.114266    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dd21fc27-5a24-4f3a-a912-043af27a4342-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-qvzgb\" (UID: \"dd21fc27-5a24-4f3a-a912-043af27a4342\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvzgb"
Jul 24 18:44:07.114890 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.114307    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/85ac7f24-5c20-43ce-b04a-77229c7608e3-tmp\") pod \"tuned-5tl49\" (UID: \"85ac7f24-5c20-43ce-b04a-77229c7608e3\") " pod="openshift-cluster-node-tuning-operator/tuned-5tl49"
Jul 24 18:44:07.114890 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.114336    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/dd21fc27-5a24-4f3a-a912-043af27a4342-host-slash\") pod \"ovnkube-node-qvzgb\" (UID: \"dd21fc27-5a24-4f3a-a912-043af27a4342\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvzgb"
Jul 24 18:44:07.114890 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.114357    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dd21fc27-5a24-4f3a-a912-043af27a4342-var-lib-openvswitch\") pod \"ovnkube-node-qvzgb\" (UID: \"dd21fc27-5a24-4f3a-a912-043af27a4342\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvzgb"
Jul 24 18:44:07.114890 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.114380    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dd21fc27-5a24-4f3a-a912-043af27a4342-run-openvswitch\") pod \"ovnkube-node-qvzgb\" (UID: \"dd21fc27-5a24-4f3a-a912-043af27a4342\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvzgb"
Jul 24 18:44:07.114890 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.114393    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/85ac7f24-5c20-43ce-b04a-77229c7608e3-etc-sysctl-d\") pod \"tuned-5tl49\" (UID: \"85ac7f24-5c20-43ce-b04a-77229c7608e3\") " pod="openshift-cluster-node-tuning-operator/tuned-5tl49"
Jul 24 18:44:07.114890 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.114405    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/85ac7f24-5c20-43ce-b04a-77229c7608e3-run\") pod \"tuned-5tl49\" (UID: \"85ac7f24-5c20-43ce-b04a-77229c7608e3\") " pod="openshift-cluster-node-tuning-operator/tuned-5tl49"
Jul 24 18:44:07.114890 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.114417    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/85ac7f24-5c20-43ce-b04a-77229c7608e3-host\") pod \"tuned-5tl49\" (UID: \"85ac7f24-5c20-43ce-b04a-77229c7608e3\") " pod="openshift-cluster-node-tuning-operator/tuned-5tl49"
Jul 24 18:44:07.114890 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.114436    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a5c64a4d-9068-4079-a7cf-e4f591e50243-multus-cni-dir\") pod \"multus-mtsh4\" (UID: \"a5c64a4d-9068-4079-a7cf-e4f591e50243\") " pod="openshift-multus/multus-mtsh4"
Jul 24 18:44:07.114890 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.114471    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/85ac7f24-5c20-43ce-b04a-77229c7608e3-etc-sysctl-conf\") pod \"tuned-5tl49\" (UID: \"85ac7f24-5c20-43ce-b04a-77229c7608e3\") " pod="openshift-cluster-node-tuning-operator/tuned-5tl49"
Jul 24 18:44:07.114890 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.114497    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a5c64a4d-9068-4079-a7cf-e4f591e50243-host-var-lib-kubelet\") pod \"multus-mtsh4\" (UID: \"a5c64a4d-9068-4079-a7cf-e4f591e50243\") " pod="openshift-multus/multus-mtsh4"
Jul 24 18:44:07.114890 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.114513    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-98p27\" (UniqueName: \"kubernetes.io/projected/34b58fb0-dbc2-49de-86e2-4bd31bb3250a-kube-api-access-98p27\") pod \"network-metrics-daemon-nsc2s\" (UID: \"34b58fb0-dbc2-49de-86e2-4bd31bb3250a\") " pod="openshift-multus/network-metrics-daemon-nsc2s"
Jul 24 18:44:07.114890 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.114535    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/fec4f688-25f1-4137-9f75-a824811d6f2b-sys-fs\") pod \"aws-ebs-csi-driver-node-qdmrt\" (UID: \"fec4f688-25f1-4137-9f75-a824811d6f2b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qdmrt"
Jul 24 18:44:07.114890 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.114557    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a5c64a4d-9068-4079-a7cf-e4f591e50243-system-cni-dir\") pod \"multus-mtsh4\" (UID: \"a5c64a4d-9068-4079-a7cf-e4f591e50243\") " pod="openshift-multus/multus-mtsh4"
Jul 24 18:44:07.114890 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.114578    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a5c64a4d-9068-4079-a7cf-e4f591e50243-multus-daemon-config\") pod \"multus-mtsh4\" (UID: \"a5c64a4d-9068-4079-a7cf-e4f591e50243\") " pod="openshift-multus/multus-mtsh4"
Jul 24 18:44:07.114890 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.114598    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8bcaaf05-ea88-48e2-9f47-a6c9b10f4ec3-serviceca\") pod \"node-ca-wgt82\" (UID: \"8bcaaf05-ea88-48e2-9f47-a6c9b10f4ec3\") " pod="openshift-image-registry/node-ca-wgt82"
Jul 24 18:44:07.114890 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.114618    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a5c64a4d-9068-4079-a7cf-e4f591e50243-multus-socket-dir-parent\") pod \"multus-mtsh4\" (UID: \"a5c64a4d-9068-4079-a7cf-e4f591e50243\") " pod="openshift-multus/multus-mtsh4"
Jul 24 18:44:07.115663 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.114639    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/dd21fc27-5a24-4f3a-a912-043af27a4342-ovn-node-metrics-cert\") pod \"ovnkube-node-qvzgb\" (UID: \"dd21fc27-5a24-4f3a-a912-043af27a4342\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvzgb"
Jul 24 18:44:07.115663 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.114659    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-88k69\" (UniqueName: \"kubernetes.io/projected/d0cb8d6d-2dda-4fee-89ee-c7d163e5d80d-kube-api-access-88k69\") pod \"network-check-target-4722z\" (UID: \"d0cb8d6d-2dda-4fee-89ee-c7d163e5d80d\") " pod="openshift-network-diagnostics/network-check-target-4722z"
Jul 24 18:44:07.115663 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.114677    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/85ac7f24-5c20-43ce-b04a-77229c7608e3-lib-modules\") pod \"tuned-5tl49\" (UID: \"85ac7f24-5c20-43ce-b04a-77229c7608e3\") " pod="openshift-cluster-node-tuning-operator/tuned-5tl49"
Jul 24 18:44:07.115663 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.114691    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n6ltl\" (UniqueName: \"kubernetes.io/projected/85ac7f24-5c20-43ce-b04a-77229c7608e3-kube-api-access-n6ltl\") pod \"tuned-5tl49\" (UID: \"85ac7f24-5c20-43ce-b04a-77229c7608e3\") " pod="openshift-cluster-node-tuning-operator/tuned-5tl49"
Jul 24 18:44:07.115663 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.114709    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a5c64a4d-9068-4079-a7cf-e4f591e50243-hostroot\") pod \"multus-mtsh4\" (UID: \"a5c64a4d-9068-4079-a7cf-e4f591e50243\") " pod="openshift-multus/multus-mtsh4"
Jul 24 18:44:07.115663 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.114729    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/fec4f688-25f1-4137-9f75-a824811d6f2b-registration-dir\") pod \"aws-ebs-csi-driver-node-qdmrt\" (UID: \"fec4f688-25f1-4137-9f75-a824811d6f2b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qdmrt"
Jul 24 18:44:07.115663 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.114749    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/fec4f688-25f1-4137-9f75-a824811d6f2b-device-dir\") pod \"aws-ebs-csi-driver-node-qdmrt\" (UID: \"fec4f688-25f1-4137-9f75-a824811d6f2b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qdmrt"
Jul 24 18:44:07.115663 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.114773    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/dd21fc27-5a24-4f3a-a912-043af27a4342-host-run-netns\") pod \"ovnkube-node-qvzgb\" (UID: \"dd21fc27-5a24-4f3a-a912-043af27a4342\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvzgb"
Jul 24 18:44:07.115663 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.114787    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/dd21fc27-5a24-4f3a-a912-043af27a4342-node-log\") pod \"ovnkube-node-qvzgb\" (UID: \"dd21fc27-5a24-4f3a-a912-043af27a4342\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvzgb"
Jul 24 18:44:07.115663 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.114813    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/85ac7f24-5c20-43ce-b04a-77229c7608e3-etc-sysconfig\") pod \"tuned-5tl49\" (UID: \"85ac7f24-5c20-43ce-b04a-77229c7608e3\") " pod="openshift-cluster-node-tuning-operator/tuned-5tl49"
Jul 24 18:44:07.115663 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.114851    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/85ac7f24-5c20-43ce-b04a-77229c7608e3-var-lib-kubelet\") pod \"tuned-5tl49\" (UID: \"85ac7f24-5c20-43ce-b04a-77229c7608e3\") " pod="openshift-cluster-node-tuning-operator/tuned-5tl49"
Jul 24 18:44:07.115663 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.114871    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a5c64a4d-9068-4079-a7cf-e4f591e50243-host-var-lib-cni-multus\") pod \"multus-mtsh4\" (UID: \"a5c64a4d-9068-4079-a7cf-e4f591e50243\") " pod="openshift-multus/multus-mtsh4"
Jul 24 18:44:07.115663 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.114877    2580 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 24 18:44:07.115663 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.114890    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/dd21fc27-5a24-4f3a-a912-043af27a4342-env-overrides\") pod \"ovnkube-node-qvzgb\" (UID: \"dd21fc27-5a24-4f3a-a912-043af27a4342\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvzgb"
Jul 24 18:44:07.115663 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.114909    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a5c64a4d-9068-4079-a7cf-e4f591e50243-os-release\") pod \"multus-mtsh4\" (UID: \"a5c64a4d-9068-4079-a7cf-e4f591e50243\") " pod="openshift-multus/multus-mtsh4"
Jul 24 18:44:07.115663 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.114929    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/dd21fc27-5a24-4f3a-a912-043af27a4342-systemd-units\") pod \"ovnkube-node-qvzgb\" (UID: \"dd21fc27-5a24-4f3a-a912-043af27a4342\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvzgb"
Jul 24 18:44:07.115663 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.114949    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/dd21fc27-5a24-4f3a-a912-043af27a4342-host-cni-bin\") pod \"ovnkube-node-qvzgb\" (UID: \"dd21fc27-5a24-4f3a-a912-043af27a4342\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvzgb"
Jul 24 18:44:07.116226 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.114989    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fj27s\" (UniqueName: \"kubernetes.io/projected/dd21fc27-5a24-4f3a-a912-043af27a4342-kube-api-access-fj27s\") pod \"ovnkube-node-qvzgb\" (UID: \"dd21fc27-5a24-4f3a-a912-043af27a4342\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvzgb"
Jul 24 18:44:07.116226 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.115009    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/85ac7f24-5c20-43ce-b04a-77229c7608e3-etc-kubernetes\") pod \"tuned-5tl49\" (UID: \"85ac7f24-5c20-43ce-b04a-77229c7608e3\") " pod="openshift-cluster-node-tuning-operator/tuned-5tl49"
Jul 24 18:44:07.116226 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.115880    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 24 18:44:07.116226 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.115885    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-zf8t7\""
Jul 24 18:44:07.116226 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.115889    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 24 18:44:07.132813 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.132794    2580 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-8d75t"
Jul 24 18:44:07.140185 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.140169    2580 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-8d75t"
Jul 24 18:44:07.203786 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.203749    2580 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 24 18:44:07.216092 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.215516    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8bcaaf05-ea88-48e2-9f47-a6c9b10f4ec3-serviceca\") pod \"node-ca-wgt82\" (UID: \"8bcaaf05-ea88-48e2-9f47-a6c9b10f4ec3\") " pod="openshift-image-registry/node-ca-wgt82"
Jul 24 18:44:07.216092 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.215565    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a5c64a4d-9068-4079-a7cf-e4f591e50243-multus-socket-dir-parent\") pod \"multus-mtsh4\" (UID: \"a5c64a4d-9068-4079-a7cf-e4f591e50243\") " pod="openshift-multus/multus-mtsh4"
Jul 24 18:44:07.216092 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.215590    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/dd21fc27-5a24-4f3a-a912-043af27a4342-ovn-node-metrics-cert\") pod \"ovnkube-node-qvzgb\" (UID: \"dd21fc27-5a24-4f3a-a912-043af27a4342\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvzgb"
Jul 24 18:44:07.216092 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.215606    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-88k69\" (UniqueName: \"kubernetes.io/projected/d0cb8d6d-2dda-4fee-89ee-c7d163e5d80d-kube-api-access-88k69\") pod \"network-check-target-4722z\" (UID: \"d0cb8d6d-2dda-4fee-89ee-c7d163e5d80d\") " pod="openshift-network-diagnostics/network-check-target-4722z"
Jul 24 18:44:07.216092 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.215623    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/85ac7f24-5c20-43ce-b04a-77229c7608e3-lib-modules\") pod \"tuned-5tl49\" (UID: \"85ac7f24-5c20-43ce-b04a-77229c7608e3\") " pod="openshift-cluster-node-tuning-operator/tuned-5tl49"
Jul 24 18:44:07.216092 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.215674    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a5c64a4d-9068-4079-a7cf-e4f591e50243-multus-socket-dir-parent\") pod \"multus-mtsh4\" (UID: \"a5c64a4d-9068-4079-a7cf-e4f591e50243\") " pod="openshift-multus/multus-mtsh4"
Jul 24 18:44:07.216092 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.215741    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n6ltl\" (UniqueName: \"kubernetes.io/projected/85ac7f24-5c20-43ce-b04a-77229c7608e3-kube-api-access-n6ltl\") pod \"tuned-5tl49\" (UID: \"85ac7f24-5c20-43ce-b04a-77229c7608e3\") " pod="openshift-cluster-node-tuning-operator/tuned-5tl49"
Jul 24 18:44:07.216092 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.215781    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a5c64a4d-9068-4079-a7cf-e4f591e50243-hostroot\") pod \"multus-mtsh4\" (UID: \"a5c64a4d-9068-4079-a7cf-e4f591e50243\") " pod="openshift-multus/multus-mtsh4"
Jul 24 18:44:07.216092 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.215805    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/fec4f688-25f1-4137-9f75-a824811d6f2b-registration-dir\") pod \"aws-ebs-csi-driver-node-qdmrt\" (UID: \"fec4f688-25f1-4137-9f75-a824811d6f2b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qdmrt"
Jul 24 18:44:07.216092 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.215827    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/fec4f688-25f1-4137-9f75-a824811d6f2b-device-dir\") pod \"aws-ebs-csi-driver-node-qdmrt\" (UID: \"fec4f688-25f1-4137-9f75-a824811d6f2b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qdmrt"
Jul 24 18:44:07.216092 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.215848    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/dd21fc27-5a24-4f3a-a912-043af27a4342-host-run-netns\") pod \"ovnkube-node-qvzgb\" (UID: \"dd21fc27-5a24-4f3a-a912-043af27a4342\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvzgb"
Jul 24 18:44:07.216092 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.215868    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/dd21fc27-5a24-4f3a-a912-043af27a4342-node-log\") pod \"ovnkube-node-qvzgb\" (UID: \"dd21fc27-5a24-4f3a-a912-043af27a4342\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvzgb"
Jul 24 18:44:07.216092 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.215889    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/85ac7f24-5c20-43ce-b04a-77229c7608e3-etc-sysconfig\") pod \"tuned-5tl49\" (UID: \"85ac7f24-5c20-43ce-b04a-77229c7608e3\") " pod="openshift-cluster-node-tuning-operator/tuned-5tl49"
Jul 24 18:44:07.216092 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.215908    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/85ac7f24-5c20-43ce-b04a-77229c7608e3-var-lib-kubelet\") pod \"tuned-5tl49\" (UID: \"85ac7f24-5c20-43ce-b04a-77229c7608e3\") " pod="openshift-cluster-node-tuning-operator/tuned-5tl49"
Jul 24 18:44:07.216092 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.215742    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/85ac7f24-5c20-43ce-b04a-77229c7608e3-lib-modules\") pod \"tuned-5tl49\" (UID: \"85ac7f24-5c20-43ce-b04a-77229c7608e3\") " pod="openshift-cluster-node-tuning-operator/tuned-5tl49"
Jul 24 18:44:07.216092 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.215930    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a5c64a4d-9068-4079-a7cf-e4f591e50243-host-var-lib-cni-multus\") pod \"multus-mtsh4\" (UID: \"a5c64a4d-9068-4079-a7cf-e4f591e50243\") " pod="openshift-multus/multus-mtsh4"
Jul 24 18:44:07.216092 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.215929    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/fec4f688-25f1-4137-9f75-a824811d6f2b-registration-dir\") pod \"aws-ebs-csi-driver-node-qdmrt\" (UID: \"fec4f688-25f1-4137-9f75-a824811d6f2b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qdmrt"
Jul 24 18:44:07.216894 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.215958    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/11aff377-f4e2-4161-8232-2535dbd115f2-host-slash\") pod \"iptables-alerter-g48lh\" (UID: \"11aff377-f4e2-4161-8232-2535dbd115f2\") " pod="openshift-network-operator/iptables-alerter-g48lh"
Jul 24 18:44:07.216894 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.215979    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8bcaaf05-ea88-48e2-9f47-a6c9b10f4ec3-serviceca\") pod \"node-ca-wgt82\" (UID: \"8bcaaf05-ea88-48e2-9f47-a6c9b10f4ec3\") " pod="openshift-image-registry/node-ca-wgt82"
Jul 24 18:44:07.216894 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.215983    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/dd21fc27-5a24-4f3a-a912-043af27a4342-env-overrides\") pod \"ovnkube-node-qvzgb\" (UID: \"dd21fc27-5a24-4f3a-a912-043af27a4342\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvzgb"
Jul 24 18:44:07.216894 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.215990    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/dd21fc27-5a24-4f3a-a912-043af27a4342-host-run-netns\") pod \"ovnkube-node-qvzgb\" (UID: \"dd21fc27-5a24-4f3a-a912-043af27a4342\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvzgb"
Jul 24 18:44:07.216894 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.215996    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/85ac7f24-5c20-43ce-b04a-77229c7608e3-etc-sysconfig\") pod \"tuned-5tl49\" (UID: \"85ac7f24-5c20-43ce-b04a-77229c7608e3\") " pod="openshift-cluster-node-tuning-operator/tuned-5tl49"
Jul 24 18:44:07.216894 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.216003    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a5c64a4d-9068-4079-a7cf-e4f591e50243-os-release\") pod \"multus-mtsh4\" (UID: \"a5c64a4d-9068-4079-a7cf-e4f591e50243\") " pod="openshift-multus/multus-mtsh4"
Jul 24 18:44:07.216894 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.215956    2580 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 24 18:44:07.216894 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.216021    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/fec4f688-25f1-4137-9f75-a824811d6f2b-device-dir\") pod \"aws-ebs-csi-driver-node-qdmrt\" (UID: \"fec4f688-25f1-4137-9f75-a824811d6f2b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qdmrt"
Jul 24 18:44:07.216894 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.216030    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/359b63b5-ced8-4939-9897-521d32070ec0-hosts-file\") pod \"node-resolver-r9l62\" (UID: \"359b63b5-ced8-4939-9897-521d32070ec0\") " pod="openshift-dns/node-resolver-r9l62"
Jul 24 18:44:07.216894 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.216033    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a5c64a4d-9068-4079-a7cf-e4f591e50243-hostroot\") pod \"multus-mtsh4\" (UID: \"a5c64a4d-9068-4079-a7cf-e4f591e50243\") " pod="openshift-multus/multus-mtsh4"
Jul 24 18:44:07.216894 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.216004    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a5c64a4d-9068-4079-a7cf-e4f591e50243-host-var-lib-cni-multus\") pod \"multus-mtsh4\" (UID: \"a5c64a4d-9068-4079-a7cf-e4f591e50243\") " pod="openshift-multus/multus-mtsh4"
Jul 24 18:44:07.216894 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.216061    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/dd21fc27-5a24-4f3a-a912-043af27a4342-node-log\") pod \"ovnkube-node-qvzgb\" (UID: \"dd21fc27-5a24-4f3a-a912-043af27a4342\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvzgb"
Jul 24 18:44:07.216894 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.215993    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/85ac7f24-5c20-43ce-b04a-77229c7608e3-var-lib-kubelet\") pod \"tuned-5tl49\" (UID: \"85ac7f24-5c20-43ce-b04a-77229c7608e3\") " pod="openshift-cluster-node-tuning-operator/tuned-5tl49"
Jul 24 18:44:07.216894 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.216093    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/84828167-a9ed-4515-9976-e266991f89fb-dbus\") pod \"global-pull-secret-syncer-phl62\" (UID: \"84828167-a9ed-4515-9976-e266991f89fb\") " pod="kube-system/global-pull-secret-syncer-phl62"
Jul 24 18:44:07.216894 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.216142    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5a4bc620-43ec-46ad-9438-c5265aa52de9-os-release\") pod \"multus-additional-cni-plugins-pvjzc\" (UID: \"5a4bc620-43ec-46ad-9438-c5265aa52de9\") " pod="openshift-multus/multus-additional-cni-plugins-pvjzc"
Jul 24 18:44:07.216894 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.216165    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/dd21fc27-5a24-4f3a-a912-043af27a4342-systemd-units\") pod \"ovnkube-node-qvzgb\" (UID: \"dd21fc27-5a24-4f3a-a912-043af27a4342\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvzgb"
Jul 24 18:44:07.216894 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.216183    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/dd21fc27-5a24-4f3a-a912-043af27a4342-host-cni-bin\") pod \"ovnkube-node-qvzgb\" (UID: \"dd21fc27-5a24-4f3a-a912-043af27a4342\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvzgb"
Jul 24 18:44:07.216894 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.216144    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a5c64a4d-9068-4079-a7cf-e4f591e50243-os-release\") pod \"multus-mtsh4\" (UID: \"a5c64a4d-9068-4079-a7cf-e4f591e50243\") " pod="openshift-multus/multus-mtsh4"
Jul 24 18:44:07.217380 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.216203    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fj27s\" (UniqueName: \"kubernetes.io/projected/dd21fc27-5a24-4f3a-a912-043af27a4342-kube-api-access-fj27s\") pod \"ovnkube-node-qvzgb\" (UID: \"dd21fc27-5a24-4f3a-a912-043af27a4342\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvzgb"
Jul 24 18:44:07.217380 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.216222    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/85ac7f24-5c20-43ce-b04a-77229c7608e3-etc-kubernetes\") pod \"tuned-5tl49\" (UID: \"85ac7f24-5c20-43ce-b04a-77229c7608e3\") " pod="openshift-cluster-node-tuning-operator/tuned-5tl49"
Jul 24 18:44:07.217380 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.216231    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/dd21fc27-5a24-4f3a-a912-043af27a4342-host-cni-bin\") pod \"ovnkube-node-qvzgb\" (UID: \"dd21fc27-5a24-4f3a-a912-043af27a4342\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvzgb"
Jul 24 18:44:07.217380 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.216240    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/85ac7f24-5c20-43ce-b04a-77229c7608e3-etc-systemd\") pod \"tuned-5tl49\" (UID: \"85ac7f24-5c20-43ce-b04a-77229c7608e3\") " pod="openshift-cluster-node-tuning-operator/tuned-5tl49"
Jul 24 18:44:07.217380 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.216279    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/85ac7f24-5c20-43ce-b04a-77229c7608e3-etc-kubernetes\") pod \"tuned-5tl49\" (UID: \"85ac7f24-5c20-43ce-b04a-77229c7608e3\") " pod="openshift-cluster-node-tuning-operator/tuned-5tl49"
Jul 24 18:44:07.217380 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.216286    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a5c64a4d-9068-4079-a7cf-e4f591e50243-cnibin\") pod \"multus-mtsh4\" (UID: \"a5c64a4d-9068-4079-a7cf-e4f591e50243\") " pod="openshift-multus/multus-mtsh4"
Jul 24 18:44:07.217380 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.216242    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/dd21fc27-5a24-4f3a-a912-043af27a4342-systemd-units\") pod \"ovnkube-node-qvzgb\" (UID: \"dd21fc27-5a24-4f3a-a912-043af27a4342\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvzgb"
Jul 24 18:44:07.217380 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.216309    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hdpd5\" (UniqueName: \"kubernetes.io/projected/5a4bc620-43ec-46ad-9438-c5265aa52de9-kube-api-access-hdpd5\") pod \"multus-additional-cni-plugins-pvjzc\" (UID: \"5a4bc620-43ec-46ad-9438-c5265aa52de9\") " pod="openshift-multus/multus-additional-cni-plugins-pvjzc"
Jul 24 18:44:07.217380 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.216320    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/85ac7f24-5c20-43ce-b04a-77229c7608e3-etc-systemd\") pod \"tuned-5tl49\" (UID: \"85ac7f24-5c20-43ce-b04a-77229c7608e3\") " pod="openshift-cluster-node-tuning-operator/tuned-5tl49"
Jul 24 18:44:07.217380 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.216332    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dd21fc27-5a24-4f3a-a912-043af27a4342-host-run-ovn-kubernetes\") pod \"ovnkube-node-qvzgb\" (UID: \"dd21fc27-5a24-4f3a-a912-043af27a4342\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvzgb"
Jul 24 18:44:07.217380 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.216353    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/85ac7f24-5c20-43ce-b04a-77229c7608e3-etc-modprobe-d\") pod \"tuned-5tl49\" (UID: \"85ac7f24-5c20-43ce-b04a-77229c7608e3\") " pod="openshift-cluster-node-tuning-operator/tuned-5tl49"
Jul 24 18:44:07.217380 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.216365    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a5c64a4d-9068-4079-a7cf-e4f591e50243-cnibin\") pod \"multus-mtsh4\" (UID: \"a5c64a4d-9068-4079-a7cf-e4f591e50243\") " pod="openshift-multus/multus-mtsh4"
Jul 24 18:44:07.217380 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.216372    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a5c64a4d-9068-4079-a7cf-e4f591e50243-host-var-lib-cni-bin\") pod \"multus-mtsh4\" (UID: \"a5c64a4d-9068-4079-a7cf-e4f591e50243\") " pod="openshift-multus/multus-mtsh4"
Jul 24 18:44:07.217380 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.216401    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vmj25\" (UniqueName: \"kubernetes.io/projected/fec4f688-25f1-4137-9f75-a824811d6f2b-kube-api-access-vmj25\") pod \"aws-ebs-csi-driver-node-qdmrt\" (UID: \"fec4f688-25f1-4137-9f75-a824811d6f2b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qdmrt"
Jul 24 18:44:07.217380 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.216406    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dd21fc27-5a24-4f3a-a912-043af27a4342-host-run-ovn-kubernetes\") pod \"ovnkube-node-qvzgb\" (UID: \"dd21fc27-5a24-4f3a-a912-043af27a4342\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvzgb"
Jul 24 18:44:07.217380 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.216418    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/dd21fc27-5a24-4f3a-a912-043af27a4342-env-overrides\") pod \"ovnkube-node-qvzgb\" (UID: \"dd21fc27-5a24-4f3a-a912-043af27a4342\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvzgb"
Jul 24 18:44:07.217380 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.216428    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dd21fc27-5a24-4f3a-a912-043af27a4342-etc-openvswitch\") pod \"ovnkube-node-qvzgb\" (UID: \"dd21fc27-5a24-4f3a-a912-043af27a4342\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvzgb"
Jul 24 18:44:07.218227 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.216424    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a5c64a4d-9068-4079-a7cf-e4f591e50243-host-var-lib-cni-bin\") pod \"multus-mtsh4\" (UID: \"a5c64a4d-9068-4079-a7cf-e4f591e50243\") " pod="openshift-multus/multus-mtsh4"
Jul 24 18:44:07.218227 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.216459    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/85ac7f24-5c20-43ce-b04a-77229c7608e3-etc-modprobe-d\") pod \"tuned-5tl49\" (UID: \"85ac7f24-5c20-43ce-b04a-77229c7608e3\") " pod="openshift-cluster-node-tuning-operator/tuned-5tl49"
Jul 24 18:44:07.218227 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.216477    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dd21fc27-5a24-4f3a-a912-043af27a4342-etc-openvswitch\") pod \"ovnkube-node-qvzgb\" (UID: \"dd21fc27-5a24-4f3a-a912-043af27a4342\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvzgb"
Jul 24 18:44:07.218227 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.216506    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/dd21fc27-5a24-4f3a-a912-043af27a4342-run-ovn\") pod \"ovnkube-node-qvzgb\" (UID: \"dd21fc27-5a24-4f3a-a912-043af27a4342\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvzgb"
Jul 24 18:44:07.218227 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.216525    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/dd21fc27-5a24-4f3a-a912-043af27a4342-run-ovn\") pod \"ovnkube-node-qvzgb\" (UID: \"dd21fc27-5a24-4f3a-a912-043af27a4342\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvzgb"
Jul 24 18:44:07.218227 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.216544    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a5c64a4d-9068-4079-a7cf-e4f591e50243-multus-conf-dir\") pod \"multus-mtsh4\" (UID: \"a5c64a4d-9068-4079-a7cf-e4f591e50243\") " pod="openshift-multus/multus-mtsh4"
Jul 24 18:44:07.218227 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.216568    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tcvzd\" (UniqueName: \"kubernetes.io/projected/359b63b5-ced8-4939-9897-521d32070ec0-kube-api-access-tcvzd\") pod \"node-resolver-r9l62\" (UID: \"359b63b5-ced8-4939-9897-521d32070ec0\") " pod="openshift-dns/node-resolver-r9l62"
Jul 24 18:44:07.218227 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.216580    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a5c64a4d-9068-4079-a7cf-e4f591e50243-multus-conf-dir\") pod \"multus-mtsh4\" (UID: \"a5c64a4d-9068-4079-a7cf-e4f591e50243\") " pod="openshift-multus/multus-mtsh4"
Jul 24 18:44:07.218227 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.216593    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/dd21fc27-5a24-4f3a-a912-043af27a4342-ovnkube-config\") pod \"ovnkube-node-qvzgb\" (UID: \"dd21fc27-5a24-4f3a-a912-043af27a4342\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvzgb"
Jul 24 18:44:07.218227 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.216614    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/85ac7f24-5c20-43ce-b04a-77229c7608e3-sys\") pod \"tuned-5tl49\" (UID: \"85ac7f24-5c20-43ce-b04a-77229c7608e3\") " pod="openshift-cluster-node-tuning-operator/tuned-5tl49"
Jul 24 18:44:07.218227 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.216635    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a5c64a4d-9068-4079-a7cf-e4f591e50243-host-run-k8s-cni-cncf-io\") pod \"multus-mtsh4\" (UID: \"a5c64a4d-9068-4079-a7cf-e4f591e50243\") " pod="openshift-multus/multus-mtsh4"
Jul 24 18:44:07.218227 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.216656    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a5c64a4d-9068-4079-a7cf-e4f591e50243-etc-kubernetes\") pod \"multus-mtsh4\" (UID: \"a5c64a4d-9068-4079-a7cf-e4f591e50243\") " pod="openshift-multus/multus-mtsh4"
Jul 24 18:44:07.218227 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.216678    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/34b58fb0-dbc2-49de-86e2-4bd31bb3250a-metrics-certs\") pod \"network-metrics-daemon-nsc2s\" (UID: \"34b58fb0-dbc2-49de-86e2-4bd31bb3250a\") " pod="openshift-multus/network-metrics-daemon-nsc2s"
Jul 24 18:44:07.218227 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.216684    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a5c64a4d-9068-4079-a7cf-e4f591e50243-host-run-k8s-cni-cncf-io\") pod \"multus-mtsh4\" (UID: \"a5c64a4d-9068-4079-a7cf-e4f591e50243\") " pod="openshift-multus/multus-mtsh4"
Jul 24 18:44:07.218227 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.216702    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/11aff377-f4e2-4161-8232-2535dbd115f2-iptables-alerter-script\") pod \"iptables-alerter-g48lh\" (UID: \"11aff377-f4e2-4161-8232-2535dbd115f2\") " pod="openshift-network-operator/iptables-alerter-g48lh"
Jul 24 18:44:07.218227 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.216721    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/dd21fc27-5a24-4f3a-a912-043af27a4342-log-socket\") pod \"ovnkube-node-qvzgb\" (UID: \"dd21fc27-5a24-4f3a-a912-043af27a4342\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvzgb"
Jul 24 18:44:07.218227 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.216742    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a5c64a4d-9068-4079-a7cf-e4f591e50243-host-run-netns\") pod \"multus-mtsh4\" (UID: \"a5c64a4d-9068-4079-a7cf-e4f591e50243\") " pod="openshift-multus/multus-mtsh4"
Jul 24 18:44:07.218227 ip-10-0-141-146 kubenswrapper[2580]: E0724 18:44:07.216755    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 18:44:07.218982 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.216758    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f0ecb1aa-4b7d-47cf-896b-45714daec302-agent-certs\") pod \"konnectivity-agent-5mtg4\" (UID: \"f0ecb1aa-4b7d-47cf-896b-45714daec302\") " pod="kube-system/konnectivity-agent-5mtg4"
Jul 24 18:44:07.218982 ip-10-0-141-146 kubenswrapper[2580]: E0724 18:44:07.216808    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/34b58fb0-dbc2-49de-86e2-4bd31bb3250a-metrics-certs podName:34b58fb0-dbc2-49de-86e2-4bd31bb3250a nodeName:}" failed. No retries permitted until 2026-07-24 18:44:07.716792939 +0000 UTC m=+2.926164958 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/34b58fb0-dbc2-49de-86e2-4bd31bb3250a-metrics-certs") pod "network-metrics-daemon-nsc2s" (UID: "34b58fb0-dbc2-49de-86e2-4bd31bb3250a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 18:44:07.218982 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.216888    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a5c64a4d-9068-4079-a7cf-e4f591e50243-host-run-netns\") pod \"multus-mtsh4\" (UID: \"a5c64a4d-9068-4079-a7cf-e4f591e50243\") " pod="openshift-multus/multus-mtsh4"
Jul 24 18:44:07.218982 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.216919    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rsc2v\" (UniqueName: \"kubernetes.io/projected/11aff377-f4e2-4161-8232-2535dbd115f2-kube-api-access-rsc2v\") pod \"iptables-alerter-g48lh\" (UID: \"11aff377-f4e2-4161-8232-2535dbd115f2\") " pod="openshift-network-operator/iptables-alerter-g48lh"
Jul 24 18:44:07.218982 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.216943    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5a4bc620-43ec-46ad-9438-c5265aa52de9-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-pvjzc\" (UID: \"5a4bc620-43ec-46ad-9438-c5265aa52de9\") " pod="openshift-multus/multus-additional-cni-plugins-pvjzc"
Jul 24 18:44:07.218982 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.216948    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/85ac7f24-5c20-43ce-b04a-77229c7608e3-sys\") pod \"tuned-5tl49\" (UID: \"85ac7f24-5c20-43ce-b04a-77229c7608e3\") " pod="openshift-cluster-node-tuning-operator/tuned-5tl49"
Jul 24 18:44:07.218982 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.216973    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5a4bc620-43ec-46ad-9438-c5265aa52de9-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-pvjzc\" (UID: \"5a4bc620-43ec-46ad-9438-c5265aa52de9\") " pod="openshift-multus/multus-additional-cni-plugins-pvjzc"
Jul 24 18:44:07.218982 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.216988    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/dd21fc27-5a24-4f3a-a912-043af27a4342-log-socket\") pod \"ovnkube-node-qvzgb\" (UID: \"dd21fc27-5a24-4f3a-a912-043af27a4342\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvzgb"
Jul 24 18:44:07.218982 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.216998    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sxm5g\" (UniqueName: \"kubernetes.io/projected/8bcaaf05-ea88-48e2-9f47-a6c9b10f4ec3-kube-api-access-sxm5g\") pod \"node-ca-wgt82\" (UID: \"8bcaaf05-ea88-48e2-9f47-a6c9b10f4ec3\") " pod="openshift-image-registry/node-ca-wgt82"
Jul 24 18:44:07.218982 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.217025    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/fec4f688-25f1-4137-9f75-a824811d6f2b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qdmrt\" (UID: \"fec4f688-25f1-4137-9f75-a824811d6f2b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qdmrt"
Jul 24 18:44:07.218982 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.217146    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/fec4f688-25f1-4137-9f75-a824811d6f2b-etc-selinux\") pod \"aws-ebs-csi-driver-node-qdmrt\" (UID: \"fec4f688-25f1-4137-9f75-a824811d6f2b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qdmrt"
Jul 24 18:44:07.218982 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.217169    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/dd21fc27-5a24-4f3a-a912-043af27a4342-run-systemd\") pod \"ovnkube-node-qvzgb\" (UID: \"dd21fc27-5a24-4f3a-a912-043af27a4342\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvzgb"
Jul 24 18:44:07.218982 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.217189    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/85ac7f24-5c20-43ce-b04a-77229c7608e3-etc-tuned\") pod \"tuned-5tl49\" (UID: \"85ac7f24-5c20-43ce-b04a-77229c7608e3\") " pod="openshift-cluster-node-tuning-operator/tuned-5tl49"
Jul 24 18:44:07.218982 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.217218    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/dd21fc27-5a24-4f3a-a912-043af27a4342-host-kubelet\") pod \"ovnkube-node-qvzgb\" (UID: \"dd21fc27-5a24-4f3a-a912-043af27a4342\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvzgb"
Jul 24 18:44:07.218982 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.217230    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/fec4f688-25f1-4137-9f75-a824811d6f2b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qdmrt\" (UID: \"fec4f688-25f1-4137-9f75-a824811d6f2b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qdmrt"
Jul 24 18:44:07.218982 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.217262    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/dd21fc27-5a24-4f3a-a912-043af27a4342-ovnkube-config\") pod \"ovnkube-node-qvzgb\" (UID: \"dd21fc27-5a24-4f3a-a912-043af27a4342\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvzgb"
Jul 24 18:44:07.219624 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.217339    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/fec4f688-25f1-4137-9f75-a824811d6f2b-etc-selinux\") pod \"aws-ebs-csi-driver-node-qdmrt\" (UID: \"fec4f688-25f1-4137-9f75-a824811d6f2b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qdmrt"
Jul 24 18:44:07.219624 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.217375    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/dd21fc27-5a24-4f3a-a912-043af27a4342-run-systemd\") pod \"ovnkube-node-qvzgb\" (UID: \"dd21fc27-5a24-4f3a-a912-043af27a4342\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvzgb"
Jul 24 18:44:07.219624 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.217404    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a5c64a4d-9068-4079-a7cf-e4f591e50243-etc-kubernetes\") pod \"multus-mtsh4\" (UID: \"a5c64a4d-9068-4079-a7cf-e4f591e50243\") " pod="openshift-multus/multus-mtsh4"
Jul 24 18:44:07.219624 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.217267    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/dd21fc27-5a24-4f3a-a912-043af27a4342-ovnkube-script-lib\") pod \"ovnkube-node-qvzgb\" (UID: \"dd21fc27-5a24-4f3a-a912-043af27a4342\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvzgb"
Jul 24 18:44:07.219624 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.217820    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a5c64a4d-9068-4079-a7cf-e4f591e50243-cni-binary-copy\") pod \"multus-mtsh4\" (UID: \"a5c64a4d-9068-4079-a7cf-e4f591e50243\") " pod="openshift-multus/multus-mtsh4"
Jul 24 18:44:07.219624 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.217835    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/84828167-a9ed-4515-9976-e266991f89fb-original-pull-secret\") pod \"global-pull-secret-syncer-phl62\" (UID: \"84828167-a9ed-4515-9976-e266991f89fb\") " pod="kube-system/global-pull-secret-syncer-phl62"
Jul 24 18:44:07.219624 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.217849    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/fec4f688-25f1-4137-9f75-a824811d6f2b-socket-dir\") pod \"aws-ebs-csi-driver-node-qdmrt\" (UID: \"fec4f688-25f1-4137-9f75-a824811d6f2b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qdmrt"
Jul 24 18:44:07.219624 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.217868    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8bcaaf05-ea88-48e2-9f47-a6c9b10f4ec3-host\") pod \"node-ca-wgt82\" (UID: \"8bcaaf05-ea88-48e2-9f47-a6c9b10f4ec3\") " pod="openshift-image-registry/node-ca-wgt82"
Jul 24 18:44:07.219624 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.217882    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a5c64a4d-9068-4079-a7cf-e4f591e50243-host-run-multus-certs\") pod \"multus-mtsh4\" (UID: \"a5c64a4d-9068-4079-a7cf-e4f591e50243\") " pod="openshift-multus/multus-mtsh4"
Jul 24 18:44:07.219624 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.217895    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lkmnw\" (UniqueName: \"kubernetes.io/projected/a5c64a4d-9068-4079-a7cf-e4f591e50243-kube-api-access-lkmnw\") pod \"multus-mtsh4\" (UID: \"a5c64a4d-9068-4079-a7cf-e4f591e50243\") " pod="openshift-multus/multus-mtsh4"
Jul 24 18:44:07.219624 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.217909    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5a4bc620-43ec-46ad-9438-c5265aa52de9-tuning-conf-dir\") pod \"multus-additional-cni-plugins-pvjzc\" (UID: \"5a4bc620-43ec-46ad-9438-c5265aa52de9\") " pod="openshift-multus/multus-additional-cni-plugins-pvjzc"
Jul 24 18:44:07.219624 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.217921    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/dd21fc27-5a24-4f3a-a912-043af27a4342-host-cni-netd\") pod \"ovnkube-node-qvzgb\" (UID: \"dd21fc27-5a24-4f3a-a912-043af27a4342\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvzgb"
Jul 24 18:44:07.219624 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.217934    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dd21fc27-5a24-4f3a-a912-043af27a4342-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-qvzgb\" (UID: \"dd21fc27-5a24-4f3a-a912-043af27a4342\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvzgb"
Jul 24 18:44:07.219624 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.217947    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5a4bc620-43ec-46ad-9438-c5265aa52de9-cnibin\") pod \"multus-additional-cni-plugins-pvjzc\" (UID: \"5a4bc620-43ec-46ad-9438-c5265aa52de9\") " pod="openshift-multus/multus-additional-cni-plugins-pvjzc"
Jul 24 18:44:07.219624 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.217954    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a5c64a4d-9068-4079-a7cf-e4f591e50243-host-run-multus-certs\") pod \"multus-mtsh4\" (UID: \"a5c64a4d-9068-4079-a7cf-e4f591e50243\") " pod="openshift-multus/multus-mtsh4"
Jul 24 18:44:07.219624 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.217962    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/85ac7f24-5c20-43ce-b04a-77229c7608e3-tmp\") pod \"tuned-5tl49\" (UID: \"85ac7f24-5c20-43ce-b04a-77229c7608e3\") " pod="openshift-cluster-node-tuning-operator/tuned-5tl49"
Jul 24 18:44:07.219624 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.218000    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f0ecb1aa-4b7d-47cf-896b-45714daec302-konnectivity-ca\") pod \"konnectivity-agent-5mtg4\" (UID: \"f0ecb1aa-4b7d-47cf-896b-45714daec302\") " pod="kube-system/konnectivity-agent-5mtg4"
Jul 24 18:44:07.220073 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.218028    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/dd21fc27-5a24-4f3a-a912-043af27a4342-host-slash\") pod \"ovnkube-node-qvzgb\" (UID: \"dd21fc27-5a24-4f3a-a912-043af27a4342\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvzgb"
Jul 24 18:44:07.220073 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.218063    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dd21fc27-5a24-4f3a-a912-043af27a4342-var-lib-openvswitch\") pod \"ovnkube-node-qvzgb\" (UID: \"dd21fc27-5a24-4f3a-a912-043af27a4342\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvzgb"
Jul 24 18:44:07.220073 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.218087    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dd21fc27-5a24-4f3a-a912-043af27a4342-run-openvswitch\") pod \"ovnkube-node-qvzgb\" (UID: \"dd21fc27-5a24-4f3a-a912-043af27a4342\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvzgb"
Jul 24 18:44:07.220073 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.218130    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/85ac7f24-5c20-43ce-b04a-77229c7608e3-etc-sysctl-d\") pod \"tuned-5tl49\" (UID: \"85ac7f24-5c20-43ce-b04a-77229c7608e3\") " pod="openshift-cluster-node-tuning-operator/tuned-5tl49"
Jul 24 18:44:07.220073 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.218138    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/dd21fc27-5a24-4f3a-a912-043af27a4342-ovnkube-script-lib\") pod \"ovnkube-node-qvzgb\" (UID: \"dd21fc27-5a24-4f3a-a912-043af27a4342\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvzgb"
Jul 24 18:44:07.220073 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.218154    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/85ac7f24-5c20-43ce-b04a-77229c7608e3-run\") pod \"tuned-5tl49\" (UID: \"85ac7f24-5c20-43ce-b04a-77229c7608e3\") " pod="openshift-cluster-node-tuning-operator/tuned-5tl49"
Jul 24 18:44:07.220073 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.218189    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/dd21fc27-5a24-4f3a-a912-043af27a4342-host-kubelet\") pod \"ovnkube-node-qvzgb\" (UID: \"dd21fc27-5a24-4f3a-a912-043af27a4342\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvzgb"
Jul 24 18:44:07.220073 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.218201    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/85ac7f24-5c20-43ce-b04a-77229c7608e3-run\") pod \"tuned-5tl49\" (UID: \"85ac7f24-5c20-43ce-b04a-77229c7608e3\") " pod="openshift-cluster-node-tuning-operator/tuned-5tl49"
Jul 24 18:44:07.220073 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.218212    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/85ac7f24-5c20-43ce-b04a-77229c7608e3-host\") pod \"tuned-5tl49\" (UID: \"85ac7f24-5c20-43ce-b04a-77229c7608e3\") " pod="openshift-cluster-node-tuning-operator/tuned-5tl49"
Jul 24 18:44:07.220073 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.218232    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a5c64a4d-9068-4079-a7cf-e4f591e50243-multus-cni-dir\") pod \"multus-mtsh4\" (UID: \"a5c64a4d-9068-4079-a7cf-e4f591e50243\") " pod="openshift-multus/multus-mtsh4"
Jul 24 18:44:07.220073 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.218253    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/359b63b5-ced8-4939-9897-521d32070ec0-tmp-dir\") pod \"node-resolver-r9l62\" (UID: \"359b63b5-ced8-4939-9897-521d32070ec0\") " pod="openshift-dns/node-resolver-r9l62"
Jul 24 18:44:07.220073 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.218275    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/85ac7f24-5c20-43ce-b04a-77229c7608e3-etc-sysctl-conf\") pod \"tuned-5tl49\" (UID: \"85ac7f24-5c20-43ce-b04a-77229c7608e3\") " pod="openshift-cluster-node-tuning-operator/tuned-5tl49"
Jul 24 18:44:07.220073 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.218289    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/fec4f688-25f1-4137-9f75-a824811d6f2b-socket-dir\") pod \"aws-ebs-csi-driver-node-qdmrt\" (UID: \"fec4f688-25f1-4137-9f75-a824811d6f2b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qdmrt"
Jul 24 18:44:07.220073 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.218294    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a5c64a4d-9068-4079-a7cf-e4f591e50243-host-var-lib-kubelet\") pod \"multus-mtsh4\" (UID: \"a5c64a4d-9068-4079-a7cf-e4f591e50243\") " pod="openshift-multus/multus-mtsh4"
Jul 24 18:44:07.220073 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.218326    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-98p27\" (UniqueName: \"kubernetes.io/projected/34b58fb0-dbc2-49de-86e2-4bd31bb3250a-kube-api-access-98p27\") pod \"network-metrics-daemon-nsc2s\" (UID: \"34b58fb0-dbc2-49de-86e2-4bd31bb3250a\") " pod="openshift-multus/network-metrics-daemon-nsc2s"
Jul 24 18:44:07.220073 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.218332    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a5c64a4d-9068-4079-a7cf-e4f591e50243-host-var-lib-kubelet\") pod \"multus-mtsh4\" (UID: \"a5c64a4d-9068-4079-a7cf-e4f591e50243\") " pod="openshift-multus/multus-mtsh4"
Jul 24 18:44:07.220073 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.218357    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/dd21fc27-5a24-4f3a-a912-043af27a4342-host-slash\") pod \"ovnkube-node-qvzgb\" (UID: \"dd21fc27-5a24-4f3a-a912-043af27a4342\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvzgb"
Jul 24 18:44:07.220073 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.218354    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/84828167-a9ed-4515-9976-e266991f89fb-kubelet-config\") pod \"global-pull-secret-syncer-phl62\" (UID: \"84828167-a9ed-4515-9976-e266991f89fb\") " pod="kube-system/global-pull-secret-syncer-phl62"
Jul 24 18:44:07.220787 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.218392    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a5c64a4d-9068-4079-a7cf-e4f591e50243-cni-binary-copy\") pod \"multus-mtsh4\" (UID: \"a5c64a4d-9068-4079-a7cf-e4f591e50243\") " pod="openshift-multus/multus-mtsh4"
Jul 24 18:44:07.220787 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.218404    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5a4bc620-43ec-46ad-9438-c5265aa52de9-system-cni-dir\") pod \"multus-additional-cni-plugins-pvjzc\" (UID: \"5a4bc620-43ec-46ad-9438-c5265aa52de9\") " pod="openshift-multus/multus-additional-cni-plugins-pvjzc"
Jul 24 18:44:07.220787 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.218403    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8bcaaf05-ea88-48e2-9f47-a6c9b10f4ec3-host\") pod \"node-ca-wgt82\" (UID: \"8bcaaf05-ea88-48e2-9f47-a6c9b10f4ec3\") " pod="openshift-image-registry/node-ca-wgt82"
Jul 24 18:44:07.220787 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.218445    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/fec4f688-25f1-4137-9f75-a824811d6f2b-sys-fs\") pod \"aws-ebs-csi-driver-node-qdmrt\" (UID: \"fec4f688-25f1-4137-9f75-a824811d6f2b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qdmrt"
Jul 24 18:44:07.220787 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.218375    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/85ac7f24-5c20-43ce-b04a-77229c7608e3-host\") pod \"tuned-5tl49\" (UID: \"85ac7f24-5c20-43ce-b04a-77229c7608e3\") " pod="openshift-cluster-node-tuning-operator/tuned-5tl49"
Jul 24 18:44:07.220787 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.218497    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/85ac7f24-5c20-43ce-b04a-77229c7608e3-etc-sysctl-d\") pod \"tuned-5tl49\" (UID: \"85ac7f24-5c20-43ce-b04a-77229c7608e3\") " pod="openshift-cluster-node-tuning-operator/tuned-5tl49"
Jul 24 18:44:07.220787 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.218470    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a5c64a4d-9068-4079-a7cf-e4f591e50243-system-cni-dir\") pod \"multus-mtsh4\" (UID: \"a5c64a4d-9068-4079-a7cf-e4f591e50243\") " pod="openshift-multus/multus-mtsh4"
Jul 24 18:44:07.220787 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.218512    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a5c64a4d-9068-4079-a7cf-e4f591e50243-system-cni-dir\") pod \"multus-mtsh4\" (UID: \"a5c64a4d-9068-4079-a7cf-e4f591e50243\") " pod="openshift-multus/multus-mtsh4"
Jul 24 18:44:07.220787 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.218553    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/fec4f688-25f1-4137-9f75-a824811d6f2b-sys-fs\") pod \"aws-ebs-csi-driver-node-qdmrt\" (UID: \"fec4f688-25f1-4137-9f75-a824811d6f2b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qdmrt"
Jul 24 18:44:07.220787 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.218553    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dd21fc27-5a24-4f3a-a912-043af27a4342-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-qvzgb\" (UID: \"dd21fc27-5a24-4f3a-a912-043af27a4342\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvzgb"
Jul 24 18:44:07.220787 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.218556    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a5c64a4d-9068-4079-a7cf-e4f591e50243-multus-daemon-config\") pod \"multus-mtsh4\" (UID: \"a5c64a4d-9068-4079-a7cf-e4f591e50243\") " pod="openshift-multus/multus-mtsh4"
Jul 24 18:44:07.220787 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.218581    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dd21fc27-5a24-4f3a-a912-043af27a4342-var-lib-openvswitch\") pod \"ovnkube-node-qvzgb\" (UID: \"dd21fc27-5a24-4f3a-a912-043af27a4342\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvzgb"
Jul 24 18:44:07.220787 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.218592    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5a4bc620-43ec-46ad-9438-c5265aa52de9-cni-binary-copy\") pod \"multus-additional-cni-plugins-pvjzc\" (UID: \"5a4bc620-43ec-46ad-9438-c5265aa52de9\") " pod="openshift-multus/multus-additional-cni-plugins-pvjzc"
Jul 24 18:44:07.220787 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.218654    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a5c64a4d-9068-4079-a7cf-e4f591e50243-multus-cni-dir\") pod \"multus-mtsh4\" (UID: \"a5c64a4d-9068-4079-a7cf-e4f591e50243\") " pod="openshift-multus/multus-mtsh4"
Jul 24 18:44:07.220787 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.218679    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/85ac7f24-5c20-43ce-b04a-77229c7608e3-etc-sysctl-conf\") pod \"tuned-5tl49\" (UID: \"85ac7f24-5c20-43ce-b04a-77229c7608e3\") " pod="openshift-cluster-node-tuning-operator/tuned-5tl49"
Jul 24 18:44:07.220787 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.218696    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dd21fc27-5a24-4f3a-a912-043af27a4342-run-openvswitch\") pod \"ovnkube-node-qvzgb\" (UID: \"dd21fc27-5a24-4f3a-a912-043af27a4342\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvzgb"
Jul 24 18:44:07.220787 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.218840    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/dd21fc27-5a24-4f3a-a912-043af27a4342-host-cni-netd\") pod \"ovnkube-node-qvzgb\" (UID: \"dd21fc27-5a24-4f3a-a912-043af27a4342\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvzgb"
Jul 24 18:44:07.220787 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.218951    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a5c64a4d-9068-4079-a7cf-e4f591e50243-multus-daemon-config\") pod \"multus-mtsh4\" (UID: \"a5c64a4d-9068-4079-a7cf-e4f591e50243\") " pod="openshift-multus/multus-mtsh4"
Jul 24 18:44:07.221319 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.219573    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/dd21fc27-5a24-4f3a-a912-043af27a4342-ovn-node-metrics-cert\") pod \"ovnkube-node-qvzgb\" (UID: \"dd21fc27-5a24-4f3a-a912-043af27a4342\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvzgb"
Jul 24 18:44:07.221319 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.219608    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/85ac7f24-5c20-43ce-b04a-77229c7608e3-etc-tuned\") pod \"tuned-5tl49\" (UID: \"85ac7f24-5c20-43ce-b04a-77229c7608e3\") " pod="openshift-cluster-node-tuning-operator/tuned-5tl49"
Jul 24 18:44:07.221319 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.219888    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/85ac7f24-5c20-43ce-b04a-77229c7608e3-tmp\") pod \"tuned-5tl49\" (UID: \"85ac7f24-5c20-43ce-b04a-77229c7608e3\") " pod="openshift-cluster-node-tuning-operator/tuned-5tl49"
Jul 24 18:44:07.221319 ip-10-0-141-146 kubenswrapper[2580]: E0724 18:44:07.220793    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 18:44:07.221319 ip-10-0-141-146 kubenswrapper[2580]: E0724 18:44:07.220810    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 18:44:07.221319 ip-10-0-141-146 kubenswrapper[2580]: E0724 18:44:07.220819    2580 projected.go:196] Error preparing data for projected volume kube-api-access-88k69 for pod openshift-network-diagnostics/network-check-target-4722z: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 18:44:07.221319 ip-10-0-141-146 kubenswrapper[2580]: E0724 18:44:07.220867    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d0cb8d6d-2dda-4fee-89ee-c7d163e5d80d-kube-api-access-88k69 podName:d0cb8d6d-2dda-4fee-89ee-c7d163e5d80d nodeName:}" failed. No retries permitted until 2026-07-24 18:44:07.720853795 +0000 UTC m=+2.930225826 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-88k69" (UniqueName: "kubernetes.io/projected/d0cb8d6d-2dda-4fee-89ee-c7d163e5d80d-kube-api-access-88k69") pod "network-check-target-4722z" (UID: "d0cb8d6d-2dda-4fee-89ee-c7d163e5d80d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 18:44:07.225337 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.225315    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vmj25\" (UniqueName: \"kubernetes.io/projected/fec4f688-25f1-4137-9f75-a824811d6f2b-kube-api-access-vmj25\") pod \"aws-ebs-csi-driver-node-qdmrt\" (UID: \"fec4f688-25f1-4137-9f75-a824811d6f2b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qdmrt"
Jul 24 18:44:07.225512 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.225360    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n6ltl\" (UniqueName: \"kubernetes.io/projected/85ac7f24-5c20-43ce-b04a-77229c7608e3-kube-api-access-n6ltl\") pod \"tuned-5tl49\" (UID: \"85ac7f24-5c20-43ce-b04a-77229c7608e3\") " pod="openshift-cluster-node-tuning-operator/tuned-5tl49"
Jul 24 18:44:07.225573 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.225559    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sxm5g\" (UniqueName: \"kubernetes.io/projected/8bcaaf05-ea88-48e2-9f47-a6c9b10f4ec3-kube-api-access-sxm5g\") pod \"node-ca-wgt82\" (UID: \"8bcaaf05-ea88-48e2-9f47-a6c9b10f4ec3\") " pod="openshift-image-registry/node-ca-wgt82"
Jul 24 18:44:07.225713 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.225697    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fj27s\" (UniqueName: \"kubernetes.io/projected/dd21fc27-5a24-4f3a-a912-043af27a4342-kube-api-access-fj27s\") pod \"ovnkube-node-qvzgb\" (UID: \"dd21fc27-5a24-4f3a-a912-043af27a4342\") " pod="openshift-ovn-kubernetes/ovnkube-node-qvzgb"
Jul 24 18:44:07.228852 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.228834    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-98p27\" (UniqueName: \"kubernetes.io/projected/34b58fb0-dbc2-49de-86e2-4bd31bb3250a-kube-api-access-98p27\") pod \"network-metrics-daemon-nsc2s\" (UID: \"34b58fb0-dbc2-49de-86e2-4bd31bb3250a\") " pod="openshift-multus/network-metrics-daemon-nsc2s"
Jul 24 18:44:07.229642 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.229613    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lkmnw\" (UniqueName: \"kubernetes.io/projected/a5c64a4d-9068-4079-a7cf-e4f591e50243-kube-api-access-lkmnw\") pod \"multus-mtsh4\" (UID: \"a5c64a4d-9068-4079-a7cf-e4f591e50243\") " pod="openshift-multus/multus-mtsh4"
Jul 24 18:44:07.319585 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.319547    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f0ecb1aa-4b7d-47cf-896b-45714daec302-konnectivity-ca\") pod \"konnectivity-agent-5mtg4\" (UID: \"f0ecb1aa-4b7d-47cf-896b-45714daec302\") " pod="kube-system/konnectivity-agent-5mtg4"
Jul 24 18:44:07.319764 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.319596    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/359b63b5-ced8-4939-9897-521d32070ec0-tmp-dir\") pod \"node-resolver-r9l62\" (UID: \"359b63b5-ced8-4939-9897-521d32070ec0\") " pod="openshift-dns/node-resolver-r9l62"
Jul 24 18:44:07.319764 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.319716    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/84828167-a9ed-4515-9976-e266991f89fb-kubelet-config\") pod \"global-pull-secret-syncer-phl62\" (UID: \"84828167-a9ed-4515-9976-e266991f89fb\") " pod="kube-system/global-pull-secret-syncer-phl62"
Jul 24 18:44:07.319764 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.319756    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5a4bc620-43ec-46ad-9438-c5265aa52de9-system-cni-dir\") pod \"multus-additional-cni-plugins-pvjzc\" (UID: \"5a4bc620-43ec-46ad-9438-c5265aa52de9\") " pod="openshift-multus/multus-additional-cni-plugins-pvjzc"
Jul 24 18:44:07.319921 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.319785    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5a4bc620-43ec-46ad-9438-c5265aa52de9-cni-binary-copy\") pod \"multus-additional-cni-plugins-pvjzc\" (UID: \"5a4bc620-43ec-46ad-9438-c5265aa52de9\") " pod="openshift-multus/multus-additional-cni-plugins-pvjzc"
Jul 24 18:44:07.319921 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.319841    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/11aff377-f4e2-4161-8232-2535dbd115f2-host-slash\") pod \"iptables-alerter-g48lh\" (UID: \"11aff377-f4e2-4161-8232-2535dbd115f2\") " pod="openshift-network-operator/iptables-alerter-g48lh"
Jul 24 18:44:07.319921 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.319887    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/359b63b5-ced8-4939-9897-521d32070ec0-hosts-file\") pod \"node-resolver-r9l62\" (UID: \"359b63b5-ced8-4939-9897-521d32070ec0\") " pod="openshift-dns/node-resolver-r9l62"
Jul 24 18:44:07.319921 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.319909    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/84828167-a9ed-4515-9976-e266991f89fb-dbus\") pod \"global-pull-secret-syncer-phl62\" (UID: \"84828167-a9ed-4515-9976-e266991f89fb\") " pod="kube-system/global-pull-secret-syncer-phl62"
Jul 24 18:44:07.320107 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.319924    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/359b63b5-ced8-4939-9897-521d32070ec0-tmp-dir\") pod \"node-resolver-r9l62\" (UID: \"359b63b5-ced8-4939-9897-521d32070ec0\") " pod="openshift-dns/node-resolver-r9l62"
Jul 24 18:44:07.320107 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.319933    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5a4bc620-43ec-46ad-9438-c5265aa52de9-os-release\") pod \"multus-additional-cni-plugins-pvjzc\" (UID: \"5a4bc620-43ec-46ad-9438-c5265aa52de9\") " pod="openshift-multus/multus-additional-cni-plugins-pvjzc"
Jul 24 18:44:07.320107 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.319979    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hdpd5\" (UniqueName: \"kubernetes.io/projected/5a4bc620-43ec-46ad-9438-c5265aa52de9-kube-api-access-hdpd5\") pod \"multus-additional-cni-plugins-pvjzc\" (UID: \"5a4bc620-43ec-46ad-9438-c5265aa52de9\") " pod="openshift-multus/multus-additional-cni-plugins-pvjzc"
Jul 24 18:44:07.320107 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.319987    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/11aff377-f4e2-4161-8232-2535dbd115f2-host-slash\") pod \"iptables-alerter-g48lh\" (UID: \"11aff377-f4e2-4161-8232-2535dbd115f2\") " pod="openshift-network-operator/iptables-alerter-g48lh"
Jul 24 18:44:07.320107 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.320013    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tcvzd\" (UniqueName: \"kubernetes.io/projected/359b63b5-ced8-4939-9897-521d32070ec0-kube-api-access-tcvzd\") pod \"node-resolver-r9l62\" (UID: \"359b63b5-ced8-4939-9897-521d32070ec0\") " pod="openshift-dns/node-resolver-r9l62"
Jul 24 18:44:07.320107 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.320041    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/84828167-a9ed-4515-9976-e266991f89fb-kubelet-config\") pod \"global-pull-secret-syncer-phl62\" (UID: \"84828167-a9ed-4515-9976-e266991f89fb\") " pod="kube-system/global-pull-secret-syncer-phl62"
Jul 24 18:44:07.320107 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.320068    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/11aff377-f4e2-4161-8232-2535dbd115f2-iptables-alerter-script\") pod \"iptables-alerter-g48lh\" (UID: \"11aff377-f4e2-4161-8232-2535dbd115f2\") " pod="openshift-network-operator/iptables-alerter-g48lh"
Jul 24 18:44:07.320107 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.320095    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f0ecb1aa-4b7d-47cf-896b-45714daec302-agent-certs\") pod \"konnectivity-agent-5mtg4\" (UID: \"f0ecb1aa-4b7d-47cf-896b-45714daec302\") " pod="kube-system/konnectivity-agent-5mtg4"
Jul 24 18:44:07.320554 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.320120    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rsc2v\" (UniqueName: \"kubernetes.io/projected/11aff377-f4e2-4161-8232-2535dbd115f2-kube-api-access-rsc2v\") pod \"iptables-alerter-g48lh\" (UID: \"11aff377-f4e2-4161-8232-2535dbd115f2\") " pod="openshift-network-operator/iptables-alerter-g48lh"
Jul 24 18:44:07.320554 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.320163    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5a4bc620-43ec-46ad-9438-c5265aa52de9-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-pvjzc\" (UID: \"5a4bc620-43ec-46ad-9438-c5265aa52de9\") " pod="openshift-multus/multus-additional-cni-plugins-pvjzc"
Jul 24 18:44:07.320554 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.320169    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f0ecb1aa-4b7d-47cf-896b-45714daec302-konnectivity-ca\") pod \"konnectivity-agent-5mtg4\" (UID: \"f0ecb1aa-4b7d-47cf-896b-45714daec302\") " pod="kube-system/konnectivity-agent-5mtg4"
Jul 24 18:44:07.320554 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.320219    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5a4bc620-43ec-46ad-9438-c5265aa52de9-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-pvjzc\" (UID: \"5a4bc620-43ec-46ad-9438-c5265aa52de9\") " pod="openshift-multus/multus-additional-cni-plugins-pvjzc"
Jul 24 18:44:07.320554 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.320257    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/84828167-a9ed-4515-9976-e266991f89fb-original-pull-secret\") pod \"global-pull-secret-syncer-phl62\" (UID: \"84828167-a9ed-4515-9976-e266991f89fb\") " pod="kube-system/global-pull-secret-syncer-phl62"
Jul 24 18:44:07.320554 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.320258    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/359b63b5-ced8-4939-9897-521d32070ec0-hosts-file\") pod \"node-resolver-r9l62\" (UID: \"359b63b5-ced8-4939-9897-521d32070ec0\") " pod="openshift-dns/node-resolver-r9l62"
Jul 24 18:44:07.320554 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.320287    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5a4bc620-43ec-46ad-9438-c5265aa52de9-tuning-conf-dir\") pod \"multus-additional-cni-plugins-pvjzc\" (UID: \"5a4bc620-43ec-46ad-9438-c5265aa52de9\") " pod="openshift-multus/multus-additional-cni-plugins-pvjzc"
Jul 24 18:44:07.320554 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.320315    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5a4bc620-43ec-46ad-9438-c5265aa52de9-cnibin\") pod \"multus-additional-cni-plugins-pvjzc\" (UID: \"5a4bc620-43ec-46ad-9438-c5265aa52de9\") " pod="openshift-multus/multus-additional-cni-plugins-pvjzc"
Jul 24 18:44:07.320554 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.320387    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5a4bc620-43ec-46ad-9438-c5265aa52de9-cnibin\") pod \"multus-additional-cni-plugins-pvjzc\" (UID: \"5a4bc620-43ec-46ad-9438-c5265aa52de9\") " pod="openshift-multus/multus-additional-cni-plugins-pvjzc"
Jul 24 18:44:07.320554 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.320386    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/84828167-a9ed-4515-9976-e266991f89fb-dbus\") pod \"global-pull-secret-syncer-phl62\" (UID: \"84828167-a9ed-4515-9976-e266991f89fb\") " pod="kube-system/global-pull-secret-syncer-phl62"
Jul 24 18:44:07.320554 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.320436    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5a4bc620-43ec-46ad-9438-c5265aa52de9-os-release\") pod \"multus-additional-cni-plugins-pvjzc\" (UID: \"5a4bc620-43ec-46ad-9438-c5265aa52de9\") " pod="openshift-multus/multus-additional-cni-plugins-pvjzc"
Jul 24 18:44:07.320554 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.320437    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5a4bc620-43ec-46ad-9438-c5265aa52de9-system-cni-dir\") pod \"multus-additional-cni-plugins-pvjzc\" (UID: \"5a4bc620-43ec-46ad-9438-c5265aa52de9\") " pod="openshift-multus/multus-additional-cni-plugins-pvjzc"
Jul 24 18:44:07.320554 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.320547    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5a4bc620-43ec-46ad-9438-c5265aa52de9-cni-binary-copy\") pod \"multus-additional-cni-plugins-pvjzc\" (UID: \"5a4bc620-43ec-46ad-9438-c5265aa52de9\") " pod="openshift-multus/multus-additional-cni-plugins-pvjzc"
Jul 24 18:44:07.321183 ip-10-0-141-146 kubenswrapper[2580]: E0724 18:44:07.320923    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 18:44:07.321183 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.320944    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/11aff377-f4e2-4161-8232-2535dbd115f2-iptables-alerter-script\") pod \"iptables-alerter-g48lh\" (UID: \"11aff377-f4e2-4161-8232-2535dbd115f2\") " pod="openshift-network-operator/iptables-alerter-g48lh"
Jul 24 18:44:07.321183 ip-10-0-141-146 kubenswrapper[2580]: E0724 18:44:07.320999    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/84828167-a9ed-4515-9976-e266991f89fb-original-pull-secret podName:84828167-a9ed-4515-9976-e266991f89fb nodeName:}" failed. No retries permitted until 2026-07-24 18:44:07.820982239 +0000 UTC m=+3.030354263 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/84828167-a9ed-4515-9976-e266991f89fb-original-pull-secret") pod "global-pull-secret-syncer-phl62" (UID: "84828167-a9ed-4515-9976-e266991f89fb") : object "kube-system"/"original-pull-secret" not registered
Jul 24 18:44:07.321183 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.321009    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5a4bc620-43ec-46ad-9438-c5265aa52de9-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-pvjzc\" (UID: \"5a4bc620-43ec-46ad-9438-c5265aa52de9\") " pod="openshift-multus/multus-additional-cni-plugins-pvjzc"
Jul 24 18:44:07.321183 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.321088    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5a4bc620-43ec-46ad-9438-c5265aa52de9-tuning-conf-dir\") pod \"multus-additional-cni-plugins-pvjzc\" (UID: \"5a4bc620-43ec-46ad-9438-c5265aa52de9\") " pod="openshift-multus/multus-additional-cni-plugins-pvjzc"
Jul 24 18:44:07.321521 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.321505    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5a4bc620-43ec-46ad-9438-c5265aa52de9-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-pvjzc\" (UID: \"5a4bc620-43ec-46ad-9438-c5265aa52de9\") " pod="openshift-multus/multus-additional-cni-plugins-pvjzc"
Jul 24 18:44:07.323688 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.323670    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f0ecb1aa-4b7d-47cf-896b-45714daec302-agent-certs\") pod \"konnectivity-agent-5mtg4\" (UID: \"f0ecb1aa-4b7d-47cf-896b-45714daec302\") " pod="kube-system/konnectivity-agent-5mtg4"
Jul 24 18:44:07.332960 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.332934    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hdpd5\" (UniqueName: \"kubernetes.io/projected/5a4bc620-43ec-46ad-9438-c5265aa52de9-kube-api-access-hdpd5\") pod \"multus-additional-cni-plugins-pvjzc\" (UID: \"5a4bc620-43ec-46ad-9438-c5265aa52de9\") " pod="openshift-multus/multus-additional-cni-plugins-pvjzc"
Jul 24 18:44:07.333500 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.333476    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rsc2v\" (UniqueName: \"kubernetes.io/projected/11aff377-f4e2-4161-8232-2535dbd115f2-kube-api-access-rsc2v\") pod \"iptables-alerter-g48lh\" (UID: \"11aff377-f4e2-4161-8232-2535dbd115f2\") " pod="openshift-network-operator/iptables-alerter-g48lh"
Jul 24 18:44:07.333607 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.333585    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tcvzd\" (UniqueName: \"kubernetes.io/projected/359b63b5-ced8-4939-9897-521d32070ec0-kube-api-access-tcvzd\") pod \"node-resolver-r9l62\" (UID: \"359b63b5-ced8-4939-9897-521d32070ec0\") " pod="openshift-dns/node-resolver-r9l62"
Jul 24 18:44:07.372414 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.372344    2580 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 24 18:44:07.407750 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.407706    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-qvzgb"
Jul 24 18:44:07.416502 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.416475    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-5tl49"
Jul 24 18:44:07.428507 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.428481    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-wgt82"
Jul 24 18:44:07.433891 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.433868    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-mtsh4"
Jul 24 18:44:07.439984 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.439965    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qdmrt"
Jul 24 18:44:07.445675 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.445656    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-5mtg4"
Jul 24 18:44:07.452793 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.452772    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-g48lh"
Jul 24 18:44:07.458701 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.458684    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-r9l62"
Jul 24 18:44:07.463259 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.463241    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-pvjzc"
Jul 24 18:44:07.723309 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.723271    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/34b58fb0-dbc2-49de-86e2-4bd31bb3250a-metrics-certs\") pod \"network-metrics-daemon-nsc2s\" (UID: \"34b58fb0-dbc2-49de-86e2-4bd31bb3250a\") " pod="openshift-multus/network-metrics-daemon-nsc2s"
Jul 24 18:44:07.723474 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.723369    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-88k69\" (UniqueName: \"kubernetes.io/projected/d0cb8d6d-2dda-4fee-89ee-c7d163e5d80d-kube-api-access-88k69\") pod \"network-check-target-4722z\" (UID: \"d0cb8d6d-2dda-4fee-89ee-c7d163e5d80d\") " pod="openshift-network-diagnostics/network-check-target-4722z"
Jul 24 18:44:07.723474 ip-10-0-141-146 kubenswrapper[2580]: E0724 18:44:07.723448    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 18:44:07.723578 ip-10-0-141-146 kubenswrapper[2580]: E0724 18:44:07.723494    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 18:44:07.723578 ip-10-0-141-146 kubenswrapper[2580]: E0724 18:44:07.723513    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 18:44:07.723578 ip-10-0-141-146 kubenswrapper[2580]: E0724 18:44:07.723517    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/34b58fb0-dbc2-49de-86e2-4bd31bb3250a-metrics-certs podName:34b58fb0-dbc2-49de-86e2-4bd31bb3250a nodeName:}" failed. No retries permitted until 2026-07-24 18:44:08.723498098 +0000 UTC m=+3.932870120 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/34b58fb0-dbc2-49de-86e2-4bd31bb3250a-metrics-certs") pod "network-metrics-daemon-nsc2s" (UID: "34b58fb0-dbc2-49de-86e2-4bd31bb3250a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 18:44:07.723578 ip-10-0-141-146 kubenswrapper[2580]: E0724 18:44:07.723537    2580 projected.go:196] Error preparing data for projected volume kube-api-access-88k69 for pod openshift-network-diagnostics/network-check-target-4722z: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 18:44:07.723578 ip-10-0-141-146 kubenswrapper[2580]: E0724 18:44:07.723579    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d0cb8d6d-2dda-4fee-89ee-c7d163e5d80d-kube-api-access-88k69 podName:d0cb8d6d-2dda-4fee-89ee-c7d163e5d80d nodeName:}" failed. No retries permitted until 2026-07-24 18:44:08.723565947 +0000 UTC m=+3.932937967 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-88k69" (UniqueName: "kubernetes.io/projected/d0cb8d6d-2dda-4fee-89ee-c7d163e5d80d-kube-api-access-88k69") pod "network-check-target-4722z" (UID: "d0cb8d6d-2dda-4fee-89ee-c7d163e5d80d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 18:44:07.824703 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:07.824663    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/84828167-a9ed-4515-9976-e266991f89fb-original-pull-secret\") pod \"global-pull-secret-syncer-phl62\" (UID: \"84828167-a9ed-4515-9976-e266991f89fb\") " pod="kube-system/global-pull-secret-syncer-phl62"
Jul 24 18:44:07.824861 ip-10-0-141-146 kubenswrapper[2580]: E0724 18:44:07.824787    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 18:44:07.824861 ip-10-0-141-146 kubenswrapper[2580]: E0724 18:44:07.824858    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/84828167-a9ed-4515-9976-e266991f89fb-original-pull-secret podName:84828167-a9ed-4515-9976-e266991f89fb nodeName:}" failed. No retries permitted until 2026-07-24 18:44:08.82483962 +0000 UTC m=+4.034211645 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/84828167-a9ed-4515-9976-e266991f89fb-original-pull-secret") pod "global-pull-secret-syncer-phl62" (UID: "84828167-a9ed-4515-9976-e266991f89fb") : object "kube-system"/"original-pull-secret" not registered
Jul 24 18:44:08.012677 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:08.012653    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd21fc27_5a24_4f3a_a912_043af27a4342.slice/crio-c315b8a8e1599c9d8eafb1f6d2c0d735f61025852b07219544f8ef5bf3a0b913 WatchSource:0}: Error finding container c315b8a8e1599c9d8eafb1f6d2c0d735f61025852b07219544f8ef5bf3a0b913: Status 404 returned error can't find the container with id c315b8a8e1599c9d8eafb1f6d2c0d735f61025852b07219544f8ef5bf3a0b913
Jul 24 18:44:08.013886 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:08.013857    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5c64a4d_9068_4079_a7cf_e4f591e50243.slice/crio-abc00b59d43f98530a93fd0109dc6f693085336c362cbd2f6fd99f4ceafdb324 WatchSource:0}: Error finding container abc00b59d43f98530a93fd0109dc6f693085336c362cbd2f6fd99f4ceafdb324: Status 404 returned error can't find the container with id abc00b59d43f98530a93fd0109dc6f693085336c362cbd2f6fd99f4ceafdb324
Jul 24 18:44:08.016489 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:08.016383    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85ac7f24_5c20_43ce_b04a_77229c7608e3.slice/crio-604de7aa5a8908ea951e12bccd77130632960e98bacade3a2ae3cb98066e2ad3 WatchSource:0}: Error finding container 604de7aa5a8908ea951e12bccd77130632960e98bacade3a2ae3cb98066e2ad3: Status 404 returned error can't find the container with id 604de7aa5a8908ea951e12bccd77130632960e98bacade3a2ae3cb98066e2ad3
Jul 24 18:44:08.018728 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:08.018615    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfec4f688_25f1_4137_9f75_a824811d6f2b.slice/crio-387af4eae61701a84366a80a7aff3b9b8cdb8d59ebc442c43d4895bc7612cb96 WatchSource:0}: Error finding container 387af4eae61701a84366a80a7aff3b9b8cdb8d59ebc442c43d4895bc7612cb96: Status 404 returned error can't find the container with id 387af4eae61701a84366a80a7aff3b9b8cdb8d59ebc442c43d4895bc7612cb96
Jul 24 18:44:08.019628 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:08.019600    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0ecb1aa_4b7d_47cf_896b_45714daec302.slice/crio-d0ac82756520d22703423afcb4fc4e1041299549b51521366185a0de45e6670d WatchSource:0}: Error finding container d0ac82756520d22703423afcb4fc4e1041299549b51521366185a0de45e6670d: Status 404 returned error can't find the container with id d0ac82756520d22703423afcb4fc4e1041299549b51521366185a0de45e6670d
Jul 24 18:44:08.021306 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:08.021227    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a4bc620_43ec_46ad_9438_c5265aa52de9.slice/crio-1c4788160307dc5f473c31bf1063309d49bd88f5588a26c097ab3711bdfac0ff WatchSource:0}: Error finding container 1c4788160307dc5f473c31bf1063309d49bd88f5588a26c097ab3711bdfac0ff: Status 404 returned error can't find the container with id 1c4788160307dc5f473c31bf1063309d49bd88f5588a26c097ab3711bdfac0ff
Jul 24 18:44:08.022060 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:08.021988    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod359b63b5_ced8_4939_9897_521d32070ec0.slice/crio-cdf703cb39d12deefa73b7fbd45e7089ad05dd9a3ce9d8e23c8e0756b64d069c WatchSource:0}: Error finding container cdf703cb39d12deefa73b7fbd45e7089ad05dd9a3ce9d8e23c8e0756b64d069c: Status 404 returned error can't find the container with id cdf703cb39d12deefa73b7fbd45e7089ad05dd9a3ce9d8e23c8e0756b64d069c
Jul 24 18:44:08.023441 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:08.023087    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11aff377_f4e2_4161_8232_2535dbd115f2.slice/crio-ac07716be7f332e87efc3d267937c69aa78d67d92c31757afaf48866e23ce437 WatchSource:0}: Error finding container ac07716be7f332e87efc3d267937c69aa78d67d92c31757afaf48866e23ce437: Status 404 returned error can't find the container with id ac07716be7f332e87efc3d267937c69aa78d67d92c31757afaf48866e23ce437
Jul 24 18:44:08.024335 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:08.024110    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8bcaaf05_ea88_48e2_9f47_a6c9b10f4ec3.slice/crio-b772d7d89bd48020e1c3d4f5690a59df12b1766aca1f63d6408b81982fdb9573 WatchSource:0}: Error finding container b772d7d89bd48020e1c3d4f5690a59df12b1766aca1f63d6408b81982fdb9573: Status 404 returned error can't find the container with id b772d7d89bd48020e1c3d4f5690a59df12b1766aca1f63d6408b81982fdb9573
Jul 24 18:44:08.142618 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:08.142567    2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-23 18:39:07 +0000 UTC" deadline="2028-04-06 12:14:18.767506574 +0000 UTC"
Jul 24 18:44:08.142618 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:08.142614    2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14921h30m10.624895155s"
Jul 24 18:44:08.235983 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:08.235956    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nsc2s"
Jul 24 18:44:08.236101 ip-10-0-141-146 kubenswrapper[2580]: E0724 18:44:08.236067    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nsc2s" podUID="34b58fb0-dbc2-49de-86e2-4bd31bb3250a"
Jul 24 18:44:08.243856 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:08.243825    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-146.ec2.internal" event={"ID":"4d95d964f6f5196d055ec9fd47d5b92d","Type":"ContainerStarted","Data":"f5113b49540ea40b2294d42b136959cd2fad871cca218f3cb2428bfd1f264599"}
Jul 24 18:44:08.244869 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:08.244850    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-r9l62" event={"ID":"359b63b5-ced8-4939-9897-521d32070ec0","Type":"ContainerStarted","Data":"cdf703cb39d12deefa73b7fbd45e7089ad05dd9a3ce9d8e23c8e0756b64d069c"}
Jul 24 18:44:08.245812 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:08.245794    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-5mtg4" event={"ID":"f0ecb1aa-4b7d-47cf-896b-45714daec302","Type":"ContainerStarted","Data":"d0ac82756520d22703423afcb4fc4e1041299549b51521366185a0de45e6670d"}
Jul 24 18:44:08.246730 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:08.246711    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-5tl49" event={"ID":"85ac7f24-5c20-43ce-b04a-77229c7608e3","Type":"ContainerStarted","Data":"604de7aa5a8908ea951e12bccd77130632960e98bacade3a2ae3cb98066e2ad3"}
Jul 24 18:44:08.247766 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:08.247680    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-mtsh4" event={"ID":"a5c64a4d-9068-4079-a7cf-e4f591e50243","Type":"ContainerStarted","Data":"abc00b59d43f98530a93fd0109dc6f693085336c362cbd2f6fd99f4ceafdb324"}
Jul 24 18:44:08.248814 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:08.248797    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qvzgb" event={"ID":"dd21fc27-5a24-4f3a-a912-043af27a4342","Type":"ContainerStarted","Data":"c315b8a8e1599c9d8eafb1f6d2c0d735f61025852b07219544f8ef5bf3a0b913"}
Jul 24 18:44:08.250174 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:08.250156    2580 generic.go:356] "Generic (PLEG): container finished" podID="d91a83fc84345123f3da435634f47e28" containerID="e6d67903ab096e028deb4480ae29b5805573f6b7bddf7bc6db0774575adf530c" exitCode=0
Jul 24 18:44:08.250248 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:08.250210    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-146.ec2.internal" event={"ID":"d91a83fc84345123f3da435634f47e28","Type":"ContainerDied","Data":"e6d67903ab096e028deb4480ae29b5805573f6b7bddf7bc6db0774575adf530c"}
Jul 24 18:44:08.251194 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:08.251174    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-wgt82" event={"ID":"8bcaaf05-ea88-48e2-9f47-a6c9b10f4ec3","Type":"ContainerStarted","Data":"b772d7d89bd48020e1c3d4f5690a59df12b1766aca1f63d6408b81982fdb9573"}
Jul 24 18:44:08.252186 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:08.252166    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-g48lh" event={"ID":"11aff377-f4e2-4161-8232-2535dbd115f2","Type":"ContainerStarted","Data":"ac07716be7f332e87efc3d267937c69aa78d67d92c31757afaf48866e23ce437"}
Jul 24 18:44:08.253224 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:08.253206    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pvjzc" event={"ID":"5a4bc620-43ec-46ad-9438-c5265aa52de9","Type":"ContainerStarted","Data":"1c4788160307dc5f473c31bf1063309d49bd88f5588a26c097ab3711bdfac0ff"}
Jul 24 18:44:08.254113 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:08.254087    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qdmrt" event={"ID":"fec4f688-25f1-4137-9f75-a824811d6f2b","Type":"ContainerStarted","Data":"387af4eae61701a84366a80a7aff3b9b8cdb8d59ebc442c43d4895bc7612cb96"}
Jul 24 18:44:08.258411 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:08.258343    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-146.ec2.internal" podStartSLOduration=2.2583250870000002 podStartE2EDuration="2.258325087s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 18:44:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:44:08.257983126 +0000 UTC m=+3.467355167" watchObservedRunningTime="2026-07-24 18:44:08.258325087 +0000 UTC m=+3.467697131"
Jul 24 18:44:08.731709 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:08.731666    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/34b58fb0-dbc2-49de-86e2-4bd31bb3250a-metrics-certs\") pod \"network-metrics-daemon-nsc2s\" (UID: \"34b58fb0-dbc2-49de-86e2-4bd31bb3250a\") " pod="openshift-multus/network-metrics-daemon-nsc2s"
Jul 24 18:44:08.731884 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:08.731760    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-88k69\" (UniqueName: \"kubernetes.io/projected/d0cb8d6d-2dda-4fee-89ee-c7d163e5d80d-kube-api-access-88k69\") pod \"network-check-target-4722z\" (UID: \"d0cb8d6d-2dda-4fee-89ee-c7d163e5d80d\") " pod="openshift-network-diagnostics/network-check-target-4722z"
Jul 24 18:44:08.731964 ip-10-0-141-146 kubenswrapper[2580]: E0724 18:44:08.731913    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 18:44:08.731964 ip-10-0-141-146 kubenswrapper[2580]: E0724 18:44:08.731931    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 18:44:08.731964 ip-10-0-141-146 kubenswrapper[2580]: E0724 18:44:08.731945    2580 projected.go:196] Error preparing data for projected volume kube-api-access-88k69 for pod openshift-network-diagnostics/network-check-target-4722z: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 18:44:08.732102 ip-10-0-141-146 kubenswrapper[2580]: E0724 18:44:08.732000    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d0cb8d6d-2dda-4fee-89ee-c7d163e5d80d-kube-api-access-88k69 podName:d0cb8d6d-2dda-4fee-89ee-c7d163e5d80d nodeName:}" failed. No retries permitted until 2026-07-24 18:44:10.731983274 +0000 UTC m=+5.941355299 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-88k69" (UniqueName: "kubernetes.io/projected/d0cb8d6d-2dda-4fee-89ee-c7d163e5d80d-kube-api-access-88k69") pod "network-check-target-4722z" (UID: "d0cb8d6d-2dda-4fee-89ee-c7d163e5d80d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 18:44:08.732445 ip-10-0-141-146 kubenswrapper[2580]: E0724 18:44:08.732429    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 18:44:08.732502 ip-10-0-141-146 kubenswrapper[2580]: E0724 18:44:08.732481    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/34b58fb0-dbc2-49de-86e2-4bd31bb3250a-metrics-certs podName:34b58fb0-dbc2-49de-86e2-4bd31bb3250a nodeName:}" failed. No retries permitted until 2026-07-24 18:44:10.732466798 +0000 UTC m=+5.941838824 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/34b58fb0-dbc2-49de-86e2-4bd31bb3250a-metrics-certs") pod "network-metrics-daemon-nsc2s" (UID: "34b58fb0-dbc2-49de-86e2-4bd31bb3250a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 18:44:08.832454 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:08.832416    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/84828167-a9ed-4515-9976-e266991f89fb-original-pull-secret\") pod \"global-pull-secret-syncer-phl62\" (UID: \"84828167-a9ed-4515-9976-e266991f89fb\") " pod="kube-system/global-pull-secret-syncer-phl62"
Jul 24 18:44:08.832640 ip-10-0-141-146 kubenswrapper[2580]: E0724 18:44:08.832557    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 18:44:08.832640 ip-10-0-141-146 kubenswrapper[2580]: E0724 18:44:08.832622    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/84828167-a9ed-4515-9976-e266991f89fb-original-pull-secret podName:84828167-a9ed-4515-9976-e266991f89fb nodeName:}" failed. No retries permitted until 2026-07-24 18:44:10.832601485 +0000 UTC m=+6.041973509 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/84828167-a9ed-4515-9976-e266991f89fb-original-pull-secret") pod "global-pull-secret-syncer-phl62" (UID: "84828167-a9ed-4515-9976-e266991f89fb") : object "kube-system"/"original-pull-secret" not registered
Jul 24 18:44:09.143491 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:09.143366    2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-23 18:39:07 +0000 UTC" deadline="2028-04-05 23:02:06.856098612 +0000 UTC"
Jul 24 18:44:09.143491 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:09.143409    2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14908h17m57.712694226s"
Jul 24 18:44:09.236551 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:09.236518    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-phl62"
Jul 24 18:44:09.236731 ip-10-0-141-146 kubenswrapper[2580]: E0724 18:44:09.236653    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-phl62" podUID="84828167-a9ed-4515-9976-e266991f89fb"
Jul 24 18:44:09.237263 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:09.237111    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4722z"
Jul 24 18:44:09.237263 ip-10-0-141-146 kubenswrapper[2580]: E0724 18:44:09.237227    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4722z" podUID="d0cb8d6d-2dda-4fee-89ee-c7d163e5d80d"
Jul 24 18:44:09.267759 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:09.267687    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-146.ec2.internal" event={"ID":"d91a83fc84345123f3da435634f47e28","Type":"ContainerStarted","Data":"1be0d87fea940081d727b7ecbeaa5f35a09cb743231fe3c7683ca3a9b68c730c"}
Jul 24 18:44:10.235702 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:10.235668    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nsc2s"
Jul 24 18:44:10.236212 ip-10-0-141-146 kubenswrapper[2580]: E0724 18:44:10.235814    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nsc2s" podUID="34b58fb0-dbc2-49de-86e2-4bd31bb3250a"
Jul 24 18:44:10.754626 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:10.754583    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-88k69\" (UniqueName: \"kubernetes.io/projected/d0cb8d6d-2dda-4fee-89ee-c7d163e5d80d-kube-api-access-88k69\") pod \"network-check-target-4722z\" (UID: \"d0cb8d6d-2dda-4fee-89ee-c7d163e5d80d\") " pod="openshift-network-diagnostics/network-check-target-4722z"
Jul 24 18:44:10.754827 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:10.754662    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/34b58fb0-dbc2-49de-86e2-4bd31bb3250a-metrics-certs\") pod \"network-metrics-daemon-nsc2s\" (UID: \"34b58fb0-dbc2-49de-86e2-4bd31bb3250a\") " pod="openshift-multus/network-metrics-daemon-nsc2s"
Jul 24 18:44:10.754827 ip-10-0-141-146 kubenswrapper[2580]: E0724 18:44:10.754819    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 18:44:10.754953 ip-10-0-141-146 kubenswrapper[2580]: E0724 18:44:10.754879    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/34b58fb0-dbc2-49de-86e2-4bd31bb3250a-metrics-certs podName:34b58fb0-dbc2-49de-86e2-4bd31bb3250a nodeName:}" failed. No retries permitted until 2026-07-24 18:44:14.754863884 +0000 UTC m=+9.964235906 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/34b58fb0-dbc2-49de-86e2-4bd31bb3250a-metrics-certs") pod "network-metrics-daemon-nsc2s" (UID: "34b58fb0-dbc2-49de-86e2-4bd31bb3250a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 18:44:10.755284 ip-10-0-141-146 kubenswrapper[2580]: E0724 18:44:10.755265    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 18:44:10.755373 ip-10-0-141-146 kubenswrapper[2580]: E0724 18:44:10.755290    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 18:44:10.755373 ip-10-0-141-146 kubenswrapper[2580]: E0724 18:44:10.755302    2580 projected.go:196] Error preparing data for projected volume kube-api-access-88k69 for pod openshift-network-diagnostics/network-check-target-4722z: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 18:44:10.755373 ip-10-0-141-146 kubenswrapper[2580]: E0724 18:44:10.755346    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d0cb8d6d-2dda-4fee-89ee-c7d163e5d80d-kube-api-access-88k69 podName:d0cb8d6d-2dda-4fee-89ee-c7d163e5d80d nodeName:}" failed. No retries permitted until 2026-07-24 18:44:14.755333532 +0000 UTC m=+9.964705558 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-88k69" (UniqueName: "kubernetes.io/projected/d0cb8d6d-2dda-4fee-89ee-c7d163e5d80d-kube-api-access-88k69") pod "network-check-target-4722z" (UID: "d0cb8d6d-2dda-4fee-89ee-c7d163e5d80d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 18:44:10.855664 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:10.855621    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/84828167-a9ed-4515-9976-e266991f89fb-original-pull-secret\") pod \"global-pull-secret-syncer-phl62\" (UID: \"84828167-a9ed-4515-9976-e266991f89fb\") " pod="kube-system/global-pull-secret-syncer-phl62"
Jul 24 18:44:10.855847 ip-10-0-141-146 kubenswrapper[2580]: E0724 18:44:10.855767    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 18:44:10.855847 ip-10-0-141-146 kubenswrapper[2580]: E0724 18:44:10.855829    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/84828167-a9ed-4515-9976-e266991f89fb-original-pull-secret podName:84828167-a9ed-4515-9976-e266991f89fb nodeName:}" failed. No retries permitted until 2026-07-24 18:44:14.855812439 +0000 UTC m=+10.065184465 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/84828167-a9ed-4515-9976-e266991f89fb-original-pull-secret") pod "global-pull-secret-syncer-phl62" (UID: "84828167-a9ed-4515-9976-e266991f89fb") : object "kube-system"/"original-pull-secret" not registered
Jul 24 18:44:11.236359 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:11.236070    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-phl62"
Jul 24 18:44:11.236359 ip-10-0-141-146 kubenswrapper[2580]: E0724 18:44:11.236228    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-phl62" podUID="84828167-a9ed-4515-9976-e266991f89fb"
Jul 24 18:44:11.236359 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:11.236236    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4722z"
Jul 24 18:44:11.236359 ip-10-0-141-146 kubenswrapper[2580]: E0724 18:44:11.236324    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4722z" podUID="d0cb8d6d-2dda-4fee-89ee-c7d163e5d80d"
Jul 24 18:44:12.235448 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:12.235413    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nsc2s"
Jul 24 18:44:12.235617 ip-10-0-141-146 kubenswrapper[2580]: E0724 18:44:12.235560    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nsc2s" podUID="34b58fb0-dbc2-49de-86e2-4bd31bb3250a"
Jul 24 18:44:13.235747 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:13.235707    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-phl62"
Jul 24 18:44:13.236191 ip-10-0-141-146 kubenswrapper[2580]: E0724 18:44:13.235847    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-phl62" podUID="84828167-a9ed-4515-9976-e266991f89fb"
Jul 24 18:44:13.236401 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:13.236384    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4722z"
Jul 24 18:44:13.236498 ip-10-0-141-146 kubenswrapper[2580]: E0724 18:44:13.236479    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4722z" podUID="d0cb8d6d-2dda-4fee-89ee-c7d163e5d80d"
Jul 24 18:44:14.235442 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:14.235409    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nsc2s"
Jul 24 18:44:14.235643 ip-10-0-141-146 kubenswrapper[2580]: E0724 18:44:14.235542    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nsc2s" podUID="34b58fb0-dbc2-49de-86e2-4bd31bb3250a"
Jul 24 18:44:14.790382 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:14.790334    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/34b58fb0-dbc2-49de-86e2-4bd31bb3250a-metrics-certs\") pod \"network-metrics-daemon-nsc2s\" (UID: \"34b58fb0-dbc2-49de-86e2-4bd31bb3250a\") " pod="openshift-multus/network-metrics-daemon-nsc2s"
Jul 24 18:44:14.790868 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:14.790449    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-88k69\" (UniqueName: \"kubernetes.io/projected/d0cb8d6d-2dda-4fee-89ee-c7d163e5d80d-kube-api-access-88k69\") pod \"network-check-target-4722z\" (UID: \"d0cb8d6d-2dda-4fee-89ee-c7d163e5d80d\") " pod="openshift-network-diagnostics/network-check-target-4722z"
Jul 24 18:44:14.790868 ip-10-0-141-146 kubenswrapper[2580]: E0724 18:44:14.790590    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 18:44:14.790868 ip-10-0-141-146 kubenswrapper[2580]: E0724 18:44:14.790613    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 18:44:14.790868 ip-10-0-141-146 kubenswrapper[2580]: E0724 18:44:14.790626    2580 projected.go:196] Error preparing data for projected volume kube-api-access-88k69 for pod openshift-network-diagnostics/network-check-target-4722z: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 18:44:14.790868 ip-10-0-141-146 kubenswrapper[2580]: E0724 18:44:14.790682    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d0cb8d6d-2dda-4fee-89ee-c7d163e5d80d-kube-api-access-88k69 podName:d0cb8d6d-2dda-4fee-89ee-c7d163e5d80d nodeName:}" failed. No retries permitted until 2026-07-24 18:44:22.790664472 +0000 UTC m=+18.000036496 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-88k69" (UniqueName: "kubernetes.io/projected/d0cb8d6d-2dda-4fee-89ee-c7d163e5d80d-kube-api-access-88k69") pod "network-check-target-4722z" (UID: "d0cb8d6d-2dda-4fee-89ee-c7d163e5d80d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 18:44:14.791175 ip-10-0-141-146 kubenswrapper[2580]: E0724 18:44:14.791010    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 18:44:14.791175 ip-10-0-141-146 kubenswrapper[2580]: E0724 18:44:14.791097    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/34b58fb0-dbc2-49de-86e2-4bd31bb3250a-metrics-certs podName:34b58fb0-dbc2-49de-86e2-4bd31bb3250a nodeName:}" failed. No retries permitted until 2026-07-24 18:44:22.791077855 +0000 UTC m=+18.000449878 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/34b58fb0-dbc2-49de-86e2-4bd31bb3250a-metrics-certs") pod "network-metrics-daemon-nsc2s" (UID: "34b58fb0-dbc2-49de-86e2-4bd31bb3250a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 18:44:14.891730 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:14.891590    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/84828167-a9ed-4515-9976-e266991f89fb-original-pull-secret\") pod \"global-pull-secret-syncer-phl62\" (UID: \"84828167-a9ed-4515-9976-e266991f89fb\") " pod="kube-system/global-pull-secret-syncer-phl62"
Jul 24 18:44:14.891900 ip-10-0-141-146 kubenswrapper[2580]: E0724 18:44:14.891878    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 18:44:14.892246 ip-10-0-141-146 kubenswrapper[2580]: E0724 18:44:14.891961    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/84828167-a9ed-4515-9976-e266991f89fb-original-pull-secret podName:84828167-a9ed-4515-9976-e266991f89fb nodeName:}" failed. No retries permitted until 2026-07-24 18:44:22.891939726 +0000 UTC m=+18.101311774 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/84828167-a9ed-4515-9976-e266991f89fb-original-pull-secret") pod "global-pull-secret-syncer-phl62" (UID: "84828167-a9ed-4515-9976-e266991f89fb") : object "kube-system"/"original-pull-secret" not registered
Jul 24 18:44:15.236438 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:15.236222    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-phl62"
Jul 24 18:44:15.236438 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:15.236252    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4722z"
Jul 24 18:44:15.236438 ip-10-0-141-146 kubenswrapper[2580]: E0724 18:44:15.236331    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-phl62" podUID="84828167-a9ed-4515-9976-e266991f89fb"
Jul 24 18:44:15.236438 ip-10-0-141-146 kubenswrapper[2580]: E0724 18:44:15.236408    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4722z" podUID="d0cb8d6d-2dda-4fee-89ee-c7d163e5d80d"
Jul 24 18:44:16.236351 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:16.236318    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nsc2s"
Jul 24 18:44:16.236783 ip-10-0-141-146 kubenswrapper[2580]: E0724 18:44:16.236465    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nsc2s" podUID="34b58fb0-dbc2-49de-86e2-4bd31bb3250a"
Jul 24 18:44:17.236224 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:17.236187    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-phl62"
Jul 24 18:44:17.236386 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:17.236187    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4722z"
Jul 24 18:44:17.236386 ip-10-0-141-146 kubenswrapper[2580]: E0724 18:44:17.236320    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-phl62" podUID="84828167-a9ed-4515-9976-e266991f89fb"
Jul 24 18:44:17.236683 ip-10-0-141-146 kubenswrapper[2580]: E0724 18:44:17.236388    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4722z" podUID="d0cb8d6d-2dda-4fee-89ee-c7d163e5d80d"
Jul 24 18:44:18.235690 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:18.235655    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nsc2s"
Jul 24 18:44:18.235836 ip-10-0-141-146 kubenswrapper[2580]: E0724 18:44:18.235761    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nsc2s" podUID="34b58fb0-dbc2-49de-86e2-4bd31bb3250a"
Jul 24 18:44:19.235681 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:19.235652    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4722z"
Jul 24 18:44:19.236190 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:19.235652    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-phl62"
Jul 24 18:44:19.236190 ip-10-0-141-146 kubenswrapper[2580]: E0724 18:44:19.235768    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4722z" podUID="d0cb8d6d-2dda-4fee-89ee-c7d163e5d80d"
Jul 24 18:44:19.236190 ip-10-0-141-146 kubenswrapper[2580]: E0724 18:44:19.235817    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-phl62" podUID="84828167-a9ed-4515-9976-e266991f89fb"
Jul 24 18:44:20.235417 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:20.235384    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nsc2s"
Jul 24 18:44:20.235603 ip-10-0-141-146 kubenswrapper[2580]: E0724 18:44:20.235492    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nsc2s" podUID="34b58fb0-dbc2-49de-86e2-4bd31bb3250a"
Jul 24 18:44:21.235815 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:21.235775    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-phl62"
Jul 24 18:44:21.236287 ip-10-0-141-146 kubenswrapper[2580]: E0724 18:44:21.235923    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-phl62" podUID="84828167-a9ed-4515-9976-e266991f89fb"
Jul 24 18:44:21.239042 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:21.236549    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4722z"
Jul 24 18:44:21.239042 ip-10-0-141-146 kubenswrapper[2580]: E0724 18:44:21.236758    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4722z" podUID="d0cb8d6d-2dda-4fee-89ee-c7d163e5d80d"
Jul 24 18:44:22.235597 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:22.235561    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nsc2s"
Jul 24 18:44:22.235804 ip-10-0-141-146 kubenswrapper[2580]: E0724 18:44:22.235672    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nsc2s" podUID="34b58fb0-dbc2-49de-86e2-4bd31bb3250a"
Jul 24 18:44:22.851180 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:22.851137    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-88k69\" (UniqueName: \"kubernetes.io/projected/d0cb8d6d-2dda-4fee-89ee-c7d163e5d80d-kube-api-access-88k69\") pod \"network-check-target-4722z\" (UID: \"d0cb8d6d-2dda-4fee-89ee-c7d163e5d80d\") " pod="openshift-network-diagnostics/network-check-target-4722z"
Jul 24 18:44:22.851684 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:22.851219    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/34b58fb0-dbc2-49de-86e2-4bd31bb3250a-metrics-certs\") pod \"network-metrics-daemon-nsc2s\" (UID: \"34b58fb0-dbc2-49de-86e2-4bd31bb3250a\") " pod="openshift-multus/network-metrics-daemon-nsc2s"
Jul 24 18:44:22.851684 ip-10-0-141-146 kubenswrapper[2580]: E0724 18:44:22.851376    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 18:44:22.851684 ip-10-0-141-146 kubenswrapper[2580]: E0724 18:44:22.851442    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/34b58fb0-dbc2-49de-86e2-4bd31bb3250a-metrics-certs podName:34b58fb0-dbc2-49de-86e2-4bd31bb3250a nodeName:}" failed. No retries permitted until 2026-07-24 18:44:38.851422112 +0000 UTC m=+34.060794141 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/34b58fb0-dbc2-49de-86e2-4bd31bb3250a-metrics-certs") pod "network-metrics-daemon-nsc2s" (UID: "34b58fb0-dbc2-49de-86e2-4bd31bb3250a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 18:44:22.851935 ip-10-0-141-146 kubenswrapper[2580]: E0724 18:44:22.851874    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 18:44:22.851935 ip-10-0-141-146 kubenswrapper[2580]: E0724 18:44:22.851891    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 18:44:22.851935 ip-10-0-141-146 kubenswrapper[2580]: E0724 18:44:22.851904    2580 projected.go:196] Error preparing data for projected volume kube-api-access-88k69 for pod openshift-network-diagnostics/network-check-target-4722z: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 18:44:22.852050 ip-10-0-141-146 kubenswrapper[2580]: E0724 18:44:22.851947    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d0cb8d6d-2dda-4fee-89ee-c7d163e5d80d-kube-api-access-88k69 podName:d0cb8d6d-2dda-4fee-89ee-c7d163e5d80d nodeName:}" failed. No retries permitted until 2026-07-24 18:44:38.851935663 +0000 UTC m=+34.061307686 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-88k69" (UniqueName: "kubernetes.io/projected/d0cb8d6d-2dda-4fee-89ee-c7d163e5d80d-kube-api-access-88k69") pod "network-check-target-4722z" (UID: "d0cb8d6d-2dda-4fee-89ee-c7d163e5d80d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 18:44:22.952654 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:22.952595    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/84828167-a9ed-4515-9976-e266991f89fb-original-pull-secret\") pod \"global-pull-secret-syncer-phl62\" (UID: \"84828167-a9ed-4515-9976-e266991f89fb\") " pod="kube-system/global-pull-secret-syncer-phl62"
Jul 24 18:44:22.952843 ip-10-0-141-146 kubenswrapper[2580]: E0724 18:44:22.952748    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 18:44:22.952843 ip-10-0-141-146 kubenswrapper[2580]: E0724 18:44:22.952810    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/84828167-a9ed-4515-9976-e266991f89fb-original-pull-secret podName:84828167-a9ed-4515-9976-e266991f89fb nodeName:}" failed. No retries permitted until 2026-07-24 18:44:38.952792292 +0000 UTC m=+34.162164315 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/84828167-a9ed-4515-9976-e266991f89fb-original-pull-secret") pod "global-pull-secret-syncer-phl62" (UID: "84828167-a9ed-4515-9976-e266991f89fb") : object "kube-system"/"original-pull-secret" not registered
Jul 24 18:44:23.239557 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:23.239528    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-phl62"
Jul 24 18:44:23.239737 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:23.239530    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4722z"
Jul 24 18:44:23.239737 ip-10-0-141-146 kubenswrapper[2580]: E0724 18:44:23.239634    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-phl62" podUID="84828167-a9ed-4515-9976-e266991f89fb"
Jul 24 18:44:23.239737 ip-10-0-141-146 kubenswrapper[2580]: E0724 18:44:23.239725    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4722z" podUID="d0cb8d6d-2dda-4fee-89ee-c7d163e5d80d"
Jul 24 18:44:24.235299 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:24.235266    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nsc2s"
Jul 24 18:44:24.235771 ip-10-0-141-146 kubenswrapper[2580]: E0724 18:44:24.235401    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nsc2s" podUID="34b58fb0-dbc2-49de-86e2-4bd31bb3250a"
Jul 24 18:44:25.238768 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:25.238739    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4722z"
Jul 24 18:44:25.239190 ip-10-0-141-146 kubenswrapper[2580]: E0724 18:44:25.238842    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4722z" podUID="d0cb8d6d-2dda-4fee-89ee-c7d163e5d80d"
Jul 24 18:44:25.239190 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:25.238908    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-phl62"
Jul 24 18:44:25.239190 ip-10-0-141-146 kubenswrapper[2580]: E0724 18:44:25.239008    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-phl62" podUID="84828167-a9ed-4515-9976-e266991f89fb"
Jul 24 18:44:26.236277 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:26.236242    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nsc2s"
Jul 24 18:44:26.236382 ip-10-0-141-146 kubenswrapper[2580]: E0724 18:44:26.236368    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nsc2s" podUID="34b58fb0-dbc2-49de-86e2-4bd31bb3250a"
Jul 24 18:44:27.239671 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:27.239255    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4722z"
Jul 24 18:44:27.240371 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:27.239260    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-phl62"
Jul 24 18:44:27.240371 ip-10-0-141-146 kubenswrapper[2580]: E0724 18:44:27.239788    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4722z" podUID="d0cb8d6d-2dda-4fee-89ee-c7d163e5d80d"
Jul 24 18:44:27.240371 ip-10-0-141-146 kubenswrapper[2580]: E0724 18:44:27.239914    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-phl62" podUID="84828167-a9ed-4515-9976-e266991f89fb"
Jul 24 18:44:27.304822 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:27.304781    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-wgt82" event={"ID":"8bcaaf05-ea88-48e2-9f47-a6c9b10f4ec3","Type":"ContainerStarted","Data":"f1ca0399ee6b4a0f10b29cfecc066b6848c773b0b25d34726b37823ca34e4a89"}
Jul 24 18:44:27.306640 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:27.306607    2580 generic.go:356] "Generic (PLEG): container finished" podID="5a4bc620-43ec-46ad-9438-c5265aa52de9" containerID="99c600fcbde298a0cabc4ef4f4a13d264cb95ebc03740e37f3efecf79322d94a" exitCode=0
Jul 24 18:44:27.306788 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:27.306690    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pvjzc" event={"ID":"5a4bc620-43ec-46ad-9438-c5265aa52de9","Type":"ContainerDied","Data":"99c600fcbde298a0cabc4ef4f4a13d264cb95ebc03740e37f3efecf79322d94a"}
Jul 24 18:44:27.308447 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:27.308418    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qdmrt" event={"ID":"fec4f688-25f1-4137-9f75-a824811d6f2b","Type":"ContainerStarted","Data":"b64090af9345af0626535369edbd0d3e913d242853cd3fc390f82d506d96eac3"}
Jul 24 18:44:27.309992 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:27.309958    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-r9l62" event={"ID":"359b63b5-ced8-4939-9897-521d32070ec0","Type":"ContainerStarted","Data":"4fc29c0a79e8b2884ae11616e6ee446f0d389196065a11448c64e4f82011f988"}
Jul 24 18:44:27.311705 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:27.311683    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-5mtg4" event={"ID":"f0ecb1aa-4b7d-47cf-896b-45714daec302","Type":"ContainerStarted","Data":"7b9a64cbec692be0353fc6c3313d00a1703b299846249fddbd98175d6f8010d8"}
Jul 24 18:44:27.313290 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:27.313270    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-5tl49" event={"ID":"85ac7f24-5c20-43ce-b04a-77229c7608e3","Type":"ContainerStarted","Data":"1f8aac360e1e9bff0bead87e03605df094ebac1ca5c093422bc4aa217c525ed5"}
Jul 24 18:44:27.315070 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:27.315050    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-mtsh4" event={"ID":"a5c64a4d-9068-4079-a7cf-e4f591e50243","Type":"ContainerStarted","Data":"f11f7af68e64919bf2ca30eb9f5e38a915d3572d439936584d781989bce660a4"}
Jul 24 18:44:27.318360 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:27.318341    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qvzgb_dd21fc27-5a24-4f3a-a912-043af27a4342/ovn-acl-logging/0.log"
Jul 24 18:44:27.318740 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:27.318721    2580 generic.go:356] "Generic (PLEG): container finished" podID="dd21fc27-5a24-4f3a-a912-043af27a4342" containerID="a7b049d1e91decf9f2c0ec90a7626305a3d730edfff59a2812b869689091a338" exitCode=1
Jul 24 18:44:27.318819 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:27.318751    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qvzgb" event={"ID":"dd21fc27-5a24-4f3a-a912-043af27a4342","Type":"ContainerStarted","Data":"a4ebb6cc4020b14f5e83bbe51702c2926ff30069bfdae266b3d7e87900b38893"}
Jul 24 18:44:27.318819 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:27.318794    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qvzgb" event={"ID":"dd21fc27-5a24-4f3a-a912-043af27a4342","Type":"ContainerStarted","Data":"8b6bc0ed8e58de79f364deee34e2716990ac31d9f332969f940ccb70d836a53c"}
Jul 24 18:44:27.318902 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:27.318823    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qvzgb" event={"ID":"dd21fc27-5a24-4f3a-a912-043af27a4342","Type":"ContainerStarted","Data":"d51bc049b6cf6b0d1d9a979b8a3ae9bd8e90576712e139981a625dffe7ba08a1"}
Jul 24 18:44:27.318902 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:27.318850    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qvzgb" event={"ID":"dd21fc27-5a24-4f3a-a912-043af27a4342","Type":"ContainerStarted","Data":"916b74a605627bf2e20ee06618bc4b15e57d91674e9278d44917a35325c51de4"}
Jul 24 18:44:27.318902 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:27.318877    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qvzgb" event={"ID":"dd21fc27-5a24-4f3a-a912-043af27a4342","Type":"ContainerDied","Data":"a7b049d1e91decf9f2c0ec90a7626305a3d730edfff59a2812b869689091a338"}
Jul 24 18:44:27.319025 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:27.318904    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qvzgb" event={"ID":"dd21fc27-5a24-4f3a-a912-043af27a4342","Type":"ContainerStarted","Data":"81daead2902a00205db2edd3070c5bbcb033e1c083c7efa850026f2160743f8a"}
Jul 24 18:44:27.321666 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:27.321623    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-146.ec2.internal" podStartSLOduration=21.321607786 podStartE2EDuration="21.321607786s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 18:44:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:44:09.283913538 +0000 UTC m=+4.493285580" watchObservedRunningTime="2026-07-24 18:44:27.321607786 +0000 UTC m=+22.530979830"
Jul 24 18:44:27.321988 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:27.321946    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-wgt82" podStartSLOduration=4.204414947 podStartE2EDuration="22.321937164s" totalImagesPullingTime="18.117522217s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 18:44:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:44:27.321210598 +0000 UTC m=+22.530582643" watchObservedRunningTime="2026-07-24 18:44:27.321937164 +0000 UTC m=+22.531309207"
Jul 24 18:44:27.338095 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:27.338059    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-r9l62" podStartSLOduration=4.163491694 podStartE2EDuration="22.338046196s" totalImagesPullingTime="18.174554502s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 18:44:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:44:27.337778601 +0000 UTC m=+22.547150645" watchObservedRunningTime="2026-07-24 18:44:27.338046196 +0000 UTC m=+22.547418239"
Jul 24 18:44:27.390052 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:27.390009    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-5tl49" podStartSLOduration=4.207584596 podStartE2EDuration="22.389994473s" totalImagesPullingTime="18.182409877s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 18:44:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:44:27.3897546 +0000 UTC m=+22.599126645" watchObservedRunningTime="2026-07-24 18:44:27.389994473 +0000 UTC m=+22.599366515"
Jul 24 18:44:27.408206 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:27.408160    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-mtsh4" podStartSLOduration=3.551125866 podStartE2EDuration="22.408146899s" totalImagesPullingTime="18.857021033s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 18:44:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:44:27.408006279 +0000 UTC m=+22.617378323" watchObservedRunningTime="2026-07-24 18:44:27.408146899 +0000 UTC m=+22.617518945"
Jul 24 18:44:27.422904 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:27.422862    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-5mtg4" podStartSLOduration=8.023635282 podStartE2EDuration="22.422849096s" totalImagesPullingTime="14.399213814s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 18:44:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:44:27.422793885 +0000 UTC m=+22.632165939" watchObservedRunningTime="2026-07-24 18:44:27.422849096 +0000 UTC m=+22.632221139"
Jul 24 18:44:27.453233 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:27.453166    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-5mtg4"
Jul 24 18:44:27.453685 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:27.453669    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-5mtg4"
Jul 24 18:44:27.582669 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:27.582642    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:44:27.829833 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:27.829805    2580 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 24 18:44:27.987147 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:27.987050    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:44:28.195320 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:28.195187    2580 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-24T18:44:27.82982357Z","UUID":"dea0540b-d556-41ad-bdcf-8a5a32c7244e","Handler":null,"Name":"","Endpoint":""}
Jul 24 18:44:28.196805 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:28.196784    2580 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 24 18:44:28.196951 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:28.196829    2580 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 24 18:44:28.235391 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:28.235359    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nsc2s"
Jul 24 18:44:28.235561 ip-10-0-141-146 kubenswrapper[2580]: E0724 18:44:28.235494    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nsc2s" podUID="34b58fb0-dbc2-49de-86e2-4bd31bb3250a"
Jul 24 18:44:28.322908 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:28.322827    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-g48lh" event={"ID":"11aff377-f4e2-4161-8232-2535dbd115f2","Type":"ContainerStarted","Data":"3a89a2bb4aa223dbadc4899f56fa27ced80b69b1f8c6ccabc7f76af6af70ddea"}
Jul 24 18:44:28.325331 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:28.325249    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qdmrt" event={"ID":"fec4f688-25f1-4137-9f75-a824811d6f2b","Type":"ContainerStarted","Data":"bab7d1294a7b841166b6c88dcbff36b41bfc2fb2e4b9b3503134252153b61867"}
Jul 24 18:44:28.340726 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:28.340666    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-g48lh" podStartSLOduration=5.167621413 podStartE2EDuration="23.34064767s" totalImagesPullingTime="18.173026257s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 18:44:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:44:28.340188602 +0000 UTC m=+23.549560643" watchObservedRunningTime="2026-07-24 18:44:28.34064767 +0000 UTC m=+23.550019716"
Jul 24 18:44:28.622824 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:28.622748    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:44:28.726257 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:28.726228    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:44:29.183093 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:29.182852    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:44:29.236310 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:29.236269    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-phl62"
Jul 24 18:44:29.236491 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:29.236269    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4722z"
Jul 24 18:44:29.236491 ip-10-0-141-146 kubenswrapper[2580]: E0724 18:44:29.236411    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-phl62" podUID="84828167-a9ed-4515-9976-e266991f89fb"
Jul 24 18:44:29.236491 ip-10-0-141-146 kubenswrapper[2580]: E0724 18:44:29.236430    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4722z" podUID="d0cb8d6d-2dda-4fee-89ee-c7d163e5d80d"
Jul 24 18:44:29.330558 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:29.330535    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qvzgb_dd21fc27-5a24-4f3a-a912-043af27a4342/ovn-acl-logging/0.log"
Jul 24 18:44:29.330938 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:29.330927    2580 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 24 18:44:29.330995 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:29.330947    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qvzgb" event={"ID":"dd21fc27-5a24-4f3a-a912-043af27a4342","Type":"ContainerStarted","Data":"3204c783f2e7dbac5559af0467681edc6143e2ba9c8912e659749fe1673592fe"}
Jul 24 18:44:29.387357 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:29.387319    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:44:29.589085 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:29.589005    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:44:30.000328 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:30.000292    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:44:30.235616 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:30.235583    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nsc2s"
Jul 24 18:44:30.235809 ip-10-0-141-146 kubenswrapper[2580]: E0724 18:44:30.235694    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nsc2s" podUID="34b58fb0-dbc2-49de-86e2-4bd31bb3250a"
Jul 24 18:44:30.335958 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:30.335867    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qdmrt" event={"ID":"fec4f688-25f1-4137-9f75-a824811d6f2b","Type":"ContainerStarted","Data":"c7b23603d3b581b3d1bdcf4f4ccaa4a7caaa662771c1ae99cb93f6815ce5cde5"}
Jul 24 18:44:30.361419 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:30.361364    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qdmrt" podStartSLOduration=4.551380434 podStartE2EDuration="25.361347699s" totalImagesPullingTime="20.809967265s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 18:44:05 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:44:30.359956114 +0000 UTC m=+25.569328157" watchObservedRunningTime="2026-07-24 18:44:30.361347699 +0000 UTC m=+25.570719741"
Jul 24 18:44:30.560040 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:30.560008    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-5mtg4"
Jul 24 18:44:30.560258 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:30.560163    2580 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 24 18:44:30.560609 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:30.560586    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-5mtg4"
Jul 24 18:44:30.603677 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:30.603601    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:44:31.010347 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:31.010319    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:44:31.236503 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:31.235763    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4722z"
Jul 24 18:44:31.236503 ip-10-0-141-146 kubenswrapper[2580]: E0724 18:44:31.235901    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4722z" podUID="d0cb8d6d-2dda-4fee-89ee-c7d163e5d80d"
Jul 24 18:44:31.236503 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:31.236359    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-phl62"
Jul 24 18:44:31.236503 ip-10-0-141-146 kubenswrapper[2580]: E0724 18:44:31.236457    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-phl62" podUID="84828167-a9ed-4515-9976-e266991f89fb"
Jul 24 18:44:31.388148 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:31.388045    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:44:31.781184 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:31.781153    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:44:32.014626 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:32.014446    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:44:32.188311 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:32.188277    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:44:32.235564 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:32.235532    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nsc2s"
Jul 24 18:44:32.235696 ip-10-0-141-146 kubenswrapper[2580]: E0724 18:44:32.235640    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nsc2s" podUID="34b58fb0-dbc2-49de-86e2-4bd31bb3250a"
Jul 24 18:44:32.343639 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:32.343569    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qvzgb_dd21fc27-5a24-4f3a-a912-043af27a4342/ovn-acl-logging/0.log"
Jul 24 18:44:32.343957 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:32.343936    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qvzgb" event={"ID":"dd21fc27-5a24-4f3a-a912-043af27a4342","Type":"ContainerStarted","Data":"73c8874ee49cca9bd263c3e7f8ab55d31639e50f5dceb9b9b4c0248f1e387e4e"}
Jul 24 18:44:32.344210 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:32.344192    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-qvzgb"
Jul 24 18:44:32.344467 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:32.344450    2580 scope.go:117] "RemoveContainer" containerID="a7b049d1e91decf9f2c0ec90a7626305a3d730edfff59a2812b869689091a338"
Jul 24 18:44:32.345925 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:32.345891    2580 generic.go:356] "Generic (PLEG): container finished" podID="5a4bc620-43ec-46ad-9438-c5265aa52de9" containerID="95b3332c69d6ad9c323babc30b7a2d5f8cd486aa0862999af5d0798feb7cf590" exitCode=0
Jul 24 18:44:32.346002 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:32.345935    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pvjzc" event={"ID":"5a4bc620-43ec-46ad-9438-c5265aa52de9","Type":"ContainerDied","Data":"95b3332c69d6ad9c323babc30b7a2d5f8cd486aa0862999af5d0798feb7cf590"}
Jul 24 18:44:32.361761 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:32.361668    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-qvzgb"
Jul 24 18:44:32.402538 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:32.402509    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:44:32.782483 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:32.782445    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:44:33.123376 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:33.123303    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:44:33.224646 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:33.224618    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:44:33.235829 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:33.235805    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-phl62"
Jul 24 18:44:33.235829 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:33.235833    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4722z"
Jul 24 18:44:33.236111 ip-10-0-141-146 kubenswrapper[2580]: E0724 18:44:33.235922    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-phl62" podUID="84828167-a9ed-4515-9976-e266991f89fb"
Jul 24 18:44:33.236111 ip-10-0-141-146 kubenswrapper[2580]: E0724 18:44:33.236067    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4722z" podUID="d0cb8d6d-2dda-4fee-89ee-c7d163e5d80d"
Jul 24 18:44:33.325251 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:33.325220    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:44:33.352639 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:33.352616    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qvzgb_dd21fc27-5a24-4f3a-a912-043af27a4342/ovn-acl-logging/0.log"
Jul 24 18:44:33.352964 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:33.352943    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qvzgb" event={"ID":"dd21fc27-5a24-4f3a-a912-043af27a4342","Type":"ContainerStarted","Data":"67dbb72e5dd5508bb38cc0b2862b9b0fb0f540d88803075acef5110115f2fd8e"}
Jul 24 18:44:33.353110 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:33.353096    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-qvzgb"
Jul 24 18:44:33.353189 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:33.353179    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-qvzgb"
Jul 24 18:44:33.368722 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:33.368696    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-qvzgb"
Jul 24 18:44:33.382102 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:33.382031    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-qvzgb" podStartSLOduration=10.053149537 podStartE2EDuration="28.382018666s" totalImagesPullingTime="18.328869129s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 18:44:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:44:33.381584203 +0000 UTC m=+28.590956247" watchObservedRunningTime="2026-07-24 18:44:33.382018666 +0000 UTC m=+28.591390708"
Jul 24 18:44:33.384466 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:33.384446    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:44:33.455173 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:33.455137    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:44:33.609898 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:33.609876    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:44:33.710683 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:33.710660    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:44:33.810878 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:33.810847    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:44:33.911567 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:33.911488    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:44:34.059966 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:34.059932    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:44:34.235446 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:34.235411    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nsc2s"
Jul 24 18:44:34.235629 ip-10-0-141-146 kubenswrapper[2580]: E0724 18:44:34.235530    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nsc2s" podUID="34b58fb0-dbc2-49de-86e2-4bd31bb3250a"
Jul 24 18:44:34.356922 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:34.356892    2580 generic.go:356] "Generic (PLEG): container finished" podID="5a4bc620-43ec-46ad-9438-c5265aa52de9" containerID="b29797554b18cf2ab6143677998e412d9a80d2c674c96d7244cf96685d8a84cc" exitCode=0
Jul 24 18:44:34.357060 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:34.356971    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pvjzc" event={"ID":"5a4bc620-43ec-46ad-9438-c5265aa52de9","Type":"ContainerDied","Data":"b29797554b18cf2ab6143677998e412d9a80d2c674c96d7244cf96685d8a84cc"}
Jul 24 18:44:34.625522 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:34.625407    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:44:34.821222 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:34.820806    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:44:35.114878 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:35.114844    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:44:35.214533 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:35.214497    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:44:35.236331 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:35.236308    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4722z"
Jul 24 18:44:35.236456 ip-10-0-141-146 kubenswrapper[2580]: E0724 18:44:35.236398    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4722z" podUID="d0cb8d6d-2dda-4fee-89ee-c7d163e5d80d"
Jul 24 18:44:35.236456 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:35.236441    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-phl62"
Jul 24 18:44:35.236553 ip-10-0-141-146 kubenswrapper[2580]: E0724 18:44:35.236502    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-phl62" podUID="84828167-a9ed-4515-9976-e266991f89fb"
Jul 24 18:44:36.235885 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:36.235706    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nsc2s"
Jul 24 18:44:36.236291 ip-10-0-141-146 kubenswrapper[2580]: E0724 18:44:36.235965    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nsc2s" podUID="34b58fb0-dbc2-49de-86e2-4bd31bb3250a"
Jul 24 18:44:36.363699 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:36.363663    2580 generic.go:356] "Generic (PLEG): container finished" podID="5a4bc620-43ec-46ad-9438-c5265aa52de9" containerID="ae30fb2dc823164018c548a9254108ef7a1d3bf51ff479d3eba63b09775c0f1e" exitCode=0
Jul 24 18:44:36.363859 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:36.363725    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pvjzc" event={"ID":"5a4bc620-43ec-46ad-9438-c5265aa52de9","Type":"ContainerDied","Data":"ae30fb2dc823164018c548a9254108ef7a1d3bf51ff479d3eba63b09775c0f1e"}
Jul 24 18:44:37.236070 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:37.236037    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4722z"
Jul 24 18:44:37.236549 ip-10-0-141-146 kubenswrapper[2580]: E0724 18:44:37.236187    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4722z" podUID="d0cb8d6d-2dda-4fee-89ee-c7d163e5d80d"
Jul 24 18:44:37.236549 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:37.236244    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-phl62"
Jul 24 18:44:37.236549 ip-10-0-141-146 kubenswrapper[2580]: E0724 18:44:37.236341    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-phl62" podUID="84828167-a9ed-4515-9976-e266991f89fb"
Jul 24 18:44:38.236261 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:38.236222    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nsc2s"
Jul 24 18:44:38.236678 ip-10-0-141-146 kubenswrapper[2580]: E0724 18:44:38.236371    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nsc2s" podUID="34b58fb0-dbc2-49de-86e2-4bd31bb3250a"
Jul 24 18:44:38.874301 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:38.874256    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/34b58fb0-dbc2-49de-86e2-4bd31bb3250a-metrics-certs\") pod \"network-metrics-daemon-nsc2s\" (UID: \"34b58fb0-dbc2-49de-86e2-4bd31bb3250a\") " pod="openshift-multus/network-metrics-daemon-nsc2s"
Jul 24 18:44:38.874460 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:38.874328    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-88k69\" (UniqueName: \"kubernetes.io/projected/d0cb8d6d-2dda-4fee-89ee-c7d163e5d80d-kube-api-access-88k69\") pod \"network-check-target-4722z\" (UID: \"d0cb8d6d-2dda-4fee-89ee-c7d163e5d80d\") " pod="openshift-network-diagnostics/network-check-target-4722z"
Jul 24 18:44:38.874460 ip-10-0-141-146 kubenswrapper[2580]: E0724 18:44:38.874376    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 18:44:38.874460 ip-10-0-141-146 kubenswrapper[2580]: E0724 18:44:38.874441    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/34b58fb0-dbc2-49de-86e2-4bd31bb3250a-metrics-certs podName:34b58fb0-dbc2-49de-86e2-4bd31bb3250a nodeName:}" failed. No retries permitted until 2026-07-24 18:45:10.874425698 +0000 UTC m=+66.083797719 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/34b58fb0-dbc2-49de-86e2-4bd31bb3250a-metrics-certs") pod "network-metrics-daemon-nsc2s" (UID: "34b58fb0-dbc2-49de-86e2-4bd31bb3250a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 18:44:38.874460 ip-10-0-141-146 kubenswrapper[2580]: E0724 18:44:38.874441    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 18:44:38.874460 ip-10-0-141-146 kubenswrapper[2580]: E0724 18:44:38.874457    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 18:44:38.874640 ip-10-0-141-146 kubenswrapper[2580]: E0724 18:44:38.874466    2580 projected.go:196] Error preparing data for projected volume kube-api-access-88k69 for pod openshift-network-diagnostics/network-check-target-4722z: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 18:44:38.874640 ip-10-0-141-146 kubenswrapper[2580]: E0724 18:44:38.874507    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d0cb8d6d-2dda-4fee-89ee-c7d163e5d80d-kube-api-access-88k69 podName:d0cb8d6d-2dda-4fee-89ee-c7d163e5d80d nodeName:}" failed. No retries permitted until 2026-07-24 18:45:10.874491567 +0000 UTC m=+66.083863591 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-88k69" (UniqueName: "kubernetes.io/projected/d0cb8d6d-2dda-4fee-89ee-c7d163e5d80d-kube-api-access-88k69") pod "network-check-target-4722z" (UID: "d0cb8d6d-2dda-4fee-89ee-c7d163e5d80d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 18:44:38.975063 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:38.975019    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/84828167-a9ed-4515-9976-e266991f89fb-original-pull-secret\") pod \"global-pull-secret-syncer-phl62\" (UID: \"84828167-a9ed-4515-9976-e266991f89fb\") " pod="kube-system/global-pull-secret-syncer-phl62"
Jul 24 18:44:38.975259 ip-10-0-141-146 kubenswrapper[2580]: E0724 18:44:38.975214    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 18:44:38.975322 ip-10-0-141-146 kubenswrapper[2580]: E0724 18:44:38.975291    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/84828167-a9ed-4515-9976-e266991f89fb-original-pull-secret podName:84828167-a9ed-4515-9976-e266991f89fb nodeName:}" failed. No retries permitted until 2026-07-24 18:45:10.975273252 +0000 UTC m=+66.184645278 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/84828167-a9ed-4515-9976-e266991f89fb-original-pull-secret") pod "global-pull-secret-syncer-phl62" (UID: "84828167-a9ed-4515-9976-e266991f89fb") : object "kube-system"/"original-pull-secret" not registered
Jul 24 18:44:39.236339 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:39.236312    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-phl62"
Jul 24 18:44:39.236774 ip-10-0-141-146 kubenswrapper[2580]: E0724 18:44:39.236432    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-phl62" podUID="84828167-a9ed-4515-9976-e266991f89fb"
Jul 24 18:44:39.236774 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:39.236471    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4722z"
Jul 24 18:44:39.236774 ip-10-0-141-146 kubenswrapper[2580]: E0724 18:44:39.236550    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4722z" podUID="d0cb8d6d-2dda-4fee-89ee-c7d163e5d80d"
Jul 24 18:44:40.023412 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:40.023372    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:44:40.076650 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:40.076613    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:44:40.236022 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:40.235992    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nsc2s"
Jul 24 18:44:40.236239 ip-10-0-141-146 kubenswrapper[2580]: E0724 18:44:40.236102    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nsc2s" podUID="34b58fb0-dbc2-49de-86e2-4bd31bb3250a"
Jul 24 18:44:40.412097 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:40.412074    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:44:40.469082 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:40.469052    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:44:41.167625 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:41.167596    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:44:41.224855 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:41.224829    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:44:41.235380 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:41.235350    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-phl62"
Jul 24 18:44:41.235544 ip-10-0-141-146 kubenswrapper[2580]: E0724 18:44:41.235474    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-phl62" podUID="84828167-a9ed-4515-9976-e266991f89fb"
Jul 24 18:44:41.235687 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:41.235665    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4722z"
Jul 24 18:44:41.235794 ip-10-0-141-146 kubenswrapper[2580]: E0724 18:44:41.235760    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4722z" podUID="d0cb8d6d-2dda-4fee-89ee-c7d163e5d80d"
Jul 24 18:44:41.378528 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:41.378494    2580 generic.go:356] "Generic (PLEG): container finished" podID="5a4bc620-43ec-46ad-9438-c5265aa52de9" containerID="284aeb8fcb5f5fc6cb8c492ae5f8b4c9e4a9b4d24db34f573fc3f087d8b85c97" exitCode=0
Jul 24 18:44:41.378705 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:41.378556    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pvjzc" event={"ID":"5a4bc620-43ec-46ad-9438-c5265aa52de9","Type":"ContainerDied","Data":"284aeb8fcb5f5fc6cb8c492ae5f8b4c9e4a9b4d24db34f573fc3f087d8b85c97"}
Jul 24 18:44:42.236335 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:42.236296    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nsc2s"
Jul 24 18:44:42.236757 ip-10-0-141-146 kubenswrapper[2580]: E0724 18:44:42.236410    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nsc2s" podUID="34b58fb0-dbc2-49de-86e2-4bd31bb3250a"
Jul 24 18:44:42.384405 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:42.384365    2580 generic.go:356] "Generic (PLEG): container finished" podID="5a4bc620-43ec-46ad-9438-c5265aa52de9" containerID="36572e0db696bd6df4db9971f64992aecb3ad20dcabc6919624619fd9a7f7047" exitCode=0
Jul 24 18:44:42.384405 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:42.384411    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pvjzc" event={"ID":"5a4bc620-43ec-46ad-9438-c5265aa52de9","Type":"ContainerDied","Data":"36572e0db696bd6df4db9971f64992aecb3ad20dcabc6919624619fd9a7f7047"}
Jul 24 18:44:43.028328 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:43.028292    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:44:43.086771 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:43.086742    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:44:43.235678 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:43.235643    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-phl62"
Jul 24 18:44:43.235870 ip-10-0-141-146 kubenswrapper[2580]: E0724 18:44:43.235759    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-phl62" podUID="84828167-a9ed-4515-9976-e266991f89fb"
Jul 24 18:44:43.235870 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:43.235819    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4722z"
Jul 24 18:44:43.235986 ip-10-0-141-146 kubenswrapper[2580]: E0724 18:44:43.235930    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4722z" podUID="d0cb8d6d-2dda-4fee-89ee-c7d163e5d80d"
Jul 24 18:44:43.390443 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:43.390366    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pvjzc" event={"ID":"5a4bc620-43ec-46ad-9438-c5265aa52de9","Type":"ContainerStarted","Data":"35d32e3e9c0a1d80a26729d5e375089b19b586fb030887b9fcb3f2d445ed7721"}
Jul 24 18:44:43.416340 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:43.416290    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-pvjzc" podStartSLOduration=9.406492497 podStartE2EDuration="38.416274442s" totalImagesPullingTime="29.009781945s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 18:44:05 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:44:43.415704253 +0000 UTC m=+38.625076295" watchObservedRunningTime="2026-07-24 18:44:43.416274442 +0000 UTC m=+38.625646485"
Jul 24 18:44:44.235829 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:44.235794    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nsc2s"
Jul 24 18:44:44.235999 ip-10-0-141-146 kubenswrapper[2580]: E0724 18:44:44.235904    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nsc2s" podUID="34b58fb0-dbc2-49de-86e2-4bd31bb3250a"
Jul 24 18:44:44.530695 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:44.530610    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:44:45.225388 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:45.225358    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:44:45.236044 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:45.236026    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4722z"
Jul 24 18:44:45.236175 ip-10-0-141-146 kubenswrapper[2580]: E0724 18:44:45.236100    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4722z" podUID="d0cb8d6d-2dda-4fee-89ee-c7d163e5d80d"
Jul 24 18:44:45.236222 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:45.236198    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-phl62"
Jul 24 18:44:45.236307 ip-10-0-141-146 kubenswrapper[2580]: E0724 18:44:45.236284    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-phl62" podUID="84828167-a9ed-4515-9976-e266991f89fb"
Jul 24 18:44:45.280245 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:45.280213    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:44:45.914513 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:45.914482    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:44:46.038606 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:46.038576    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:44:46.137684 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:46.137654    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:44:46.234413 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:46.234385    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:44:46.235659 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:46.235632    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nsc2s"
Jul 24 18:44:46.235786 ip-10-0-141-146 kubenswrapper[2580]: E0724 18:44:46.235758    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nsc2s" podUID="34b58fb0-dbc2-49de-86e2-4bd31bb3250a"
Jul 24 18:44:46.333376 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:46.333341    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:44:46.432112 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:46.432077    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:44:47.088645 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:47.088600    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-4722z"]
Jul 24 18:44:47.089378 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:47.088715    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4722z"
Jul 24 18:44:47.089378 ip-10-0-141-146 kubenswrapper[2580]: E0724 18:44:47.088823    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4722z" podUID="d0cb8d6d-2dda-4fee-89ee-c7d163e5d80d"
Jul 24 18:44:47.089378 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:47.089358    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-phl62"]
Jul 24 18:44:47.089533 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:47.089521    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-phl62"
Jul 24 18:44:47.089694 ip-10-0-141-146 kubenswrapper[2580]: E0724 18:44:47.089669    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-phl62" podUID="84828167-a9ed-4515-9976-e266991f89fb"
Jul 24 18:44:47.090063 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:47.090018    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-nsc2s"]
Jul 24 18:44:47.090114 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:47.090085    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nsc2s"
Jul 24 18:44:47.090192 ip-10-0-141-146 kubenswrapper[2580]: E0724 18:44:47.090176    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nsc2s" podUID="34b58fb0-dbc2-49de-86e2-4bd31bb3250a"
Jul 24 18:44:48.235418 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:48.235382    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-phl62"
Jul 24 18:44:48.235779 ip-10-0-141-146 kubenswrapper[2580]: E0724 18:44:48.235492    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-phl62" podUID="84828167-a9ed-4515-9976-e266991f89fb"
Jul 24 18:44:49.021815 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:49.021781    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:44:49.088052 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:49.088017    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:44:49.155839 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:49.155804    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:44:49.236521 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:49.236276    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nsc2s"
Jul 24 18:44:49.236889 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:49.236321    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4722z"
Jul 24 18:44:49.236889 ip-10-0-141-146 kubenswrapper[2580]: E0724 18:44:49.236647    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nsc2s" podUID="34b58fb0-dbc2-49de-86e2-4bd31bb3250a"
Jul 24 18:44:49.236889 ip-10-0-141-146 kubenswrapper[2580]: E0724 18:44:49.236751    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4722z" podUID="d0cb8d6d-2dda-4fee-89ee-c7d163e5d80d"
Jul 24 18:44:49.261675 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:49.261637    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:44:49.365762 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:49.365688    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:44:49.461880 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:49.461848    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:44:49.557989 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:49.557956    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:44:50.235840 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:50.235807    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-phl62"
Jul 24 18:44:50.236020 ip-10-0-141-146 kubenswrapper[2580]: E0724 18:44:50.235941    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-phl62" podUID="84828167-a9ed-4515-9976-e266991f89fb"
Jul 24 18:44:50.236873 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:50.236838    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:44:50.337265 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:50.337233    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:44:50.604154 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:50.604031    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-146.ec2.internal" event="NodeReady"
Jul 24 18:44:50.604307 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:50.604179    2580 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 24 18:44:50.642406 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:50.642373    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6c848b7cd9-9vxgb"]
Jul 24 18:44:50.651693 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:50.651664    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6c848b7cd9-9vxgb"
Jul 24 18:44:50.654398 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:50.654365    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 24 18:44:50.654670 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:50.654414    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 24 18:44:50.654670 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:50.654482    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-4z6xk\""
Jul 24 18:44:50.655390 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:50.655369    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-q7dr8"]
Jul 24 18:44:50.655765 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:50.655746    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 24 18:44:50.657348 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:50.657327    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/38d8deb1-fcf4-434a-bc3a-d19f6e944f09-installation-pull-secrets\") pod \"image-registry-6c848b7cd9-9vxgb\" (UID: \"38d8deb1-fcf4-434a-bc3a-d19f6e944f09\") " pod="openshift-image-registry/image-registry-6c848b7cd9-9vxgb"
Jul 24 18:44:50.657449 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:50.657352    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/38d8deb1-fcf4-434a-bc3a-d19f6e944f09-bound-sa-token\") pod \"image-registry-6c848b7cd9-9vxgb\" (UID: \"38d8deb1-fcf4-434a-bc3a-d19f6e944f09\") " pod="openshift-image-registry/image-registry-6c848b7cd9-9vxgb"
Jul 24 18:44:50.657449 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:50.657369    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/38d8deb1-fcf4-434a-bc3a-d19f6e944f09-trusted-ca\") pod \"image-registry-6c848b7cd9-9vxgb\" (UID: \"38d8deb1-fcf4-434a-bc3a-d19f6e944f09\") " pod="openshift-image-registry/image-registry-6c848b7cd9-9vxgb"
Jul 24 18:44:50.657449 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:50.657393    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/38d8deb1-fcf4-434a-bc3a-d19f6e944f09-ca-trust-extracted\") pod \"image-registry-6c848b7cd9-9vxgb\" (UID: \"38d8deb1-fcf4-434a-bc3a-d19f6e944f09\") " pod="openshift-image-registry/image-registry-6c848b7cd9-9vxgb"
Jul 24 18:44:50.657449 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:50.657415    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-84np7\" (UniqueName: \"kubernetes.io/projected/38d8deb1-fcf4-434a-bc3a-d19f6e944f09-kube-api-access-84np7\") pod \"image-registry-6c848b7cd9-9vxgb\" (UID: \"38d8deb1-fcf4-434a-bc3a-d19f6e944f09\") " pod="openshift-image-registry/image-registry-6c848b7cd9-9vxgb"
Jul 24 18:44:50.657449 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:50.657447    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/38d8deb1-fcf4-434a-bc3a-d19f6e944f09-registry-certificates\") pod \"image-registry-6c848b7cd9-9vxgb\" (UID: \"38d8deb1-fcf4-434a-bc3a-d19f6e944f09\") " pod="openshift-image-registry/image-registry-6c848b7cd9-9vxgb"
Jul 24 18:44:50.657680 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:50.657464    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/38d8deb1-fcf4-434a-bc3a-d19f6e944f09-image-registry-private-configuration\") pod \"image-registry-6c848b7cd9-9vxgb\" (UID: \"38d8deb1-fcf4-434a-bc3a-d19f6e944f09\") " pod="openshift-image-registry/image-registry-6c848b7cd9-9vxgb"
Jul 24 18:44:50.657680 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:50.657515    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/38d8deb1-fcf4-434a-bc3a-d19f6e944f09-registry-tls\") pod \"image-registry-6c848b7cd9-9vxgb\" (UID: \"38d8deb1-fcf4-434a-bc3a-d19f6e944f09\") " pod="openshift-image-registry/image-registry-6c848b7cd9-9vxgb"
Jul 24 18:44:50.660003 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:50.659984    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 24 18:44:50.664589 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:50.664571    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:44:50.672987 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:50.672072    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6c848b7cd9-9vxgb"]
Jul 24 18:44:50.672987 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:50.672145    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-dcckq"]
Jul 24 18:44:50.673166 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:50.673139    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-q7dr8"
Jul 24 18:44:50.678818 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:50.678766    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 24 18:44:50.678818 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:50.678781    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 24 18:44:50.678993 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:50.678786    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-fjp2z\""
Jul 24 18:44:50.682302 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:50.682285    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-q7dr8"]
Jul 24 18:44:50.682395 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:50.682313    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-dcckq"]
Jul 24 18:44:50.682436 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:50.682393    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-dcckq"
Jul 24 18:44:50.684769 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:50.684748    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 24 18:44:50.685062 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:50.685040    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 24 18:44:50.685195 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:50.685094    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 24 18:44:50.685195 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:50.685186    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-5dvls\""
Jul 24 18:44:50.685338 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:50.685322    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 24 18:44:50.728995 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:50.728966    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:44:50.758267 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:50.758231    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/38d8deb1-fcf4-434a-bc3a-d19f6e944f09-trusted-ca\") pod \"image-registry-6c848b7cd9-9vxgb\" (UID: \"38d8deb1-fcf4-434a-bc3a-d19f6e944f09\") " pod="openshift-image-registry/image-registry-6c848b7cd9-9vxgb"
Jul 24 18:44:50.758425 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:50.758281    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/38d8deb1-fcf4-434a-bc3a-d19f6e944f09-ca-trust-extracted\") pod \"image-registry-6c848b7cd9-9vxgb\" (UID: \"38d8deb1-fcf4-434a-bc3a-d19f6e944f09\") " pod="openshift-image-registry/image-registry-6c848b7cd9-9vxgb"
Jul 24 18:44:50.758425 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:50.758303    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-84np7\" (UniqueName: \"kubernetes.io/projected/38d8deb1-fcf4-434a-bc3a-d19f6e944f09-kube-api-access-84np7\") pod \"image-registry-6c848b7cd9-9vxgb\" (UID: \"38d8deb1-fcf4-434a-bc3a-d19f6e944f09\") " pod="openshift-image-registry/image-registry-6c848b7cd9-9vxgb"
Jul 24 18:44:50.758425 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:50.758324    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0afd7f1b-febd-4ba1-aceb-b5cfd32f5ac9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dcckq\" (UID: \"0afd7f1b-febd-4ba1-aceb-b5cfd32f5ac9\") " pod="openshift-insights/insights-runtime-extractor-dcckq"
Jul 24 18:44:50.758573 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:50.758453    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tgvwn\" (UniqueName: \"kubernetes.io/projected/fc688138-e740-43b8-b546-24938b83af0c-kube-api-access-tgvwn\") pod \"dns-default-q7dr8\" (UID: \"fc688138-e740-43b8-b546-24938b83af0c\") " pod="openshift-dns/dns-default-q7dr8"
Jul 24 18:44:50.758573 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:50.758480    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/38d8deb1-fcf4-434a-bc3a-d19f6e944f09-registry-certificates\") pod \"image-registry-6c848b7cd9-9vxgb\" (UID: \"38d8deb1-fcf4-434a-bc3a-d19f6e944f09\") " pod="openshift-image-registry/image-registry-6c848b7cd9-9vxgb"
Jul 24 18:44:50.758573 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:50.758525    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/38d8deb1-fcf4-434a-bc3a-d19f6e944f09-image-registry-private-configuration\") pod \"image-registry-6c848b7cd9-9vxgb\" (UID: \"38d8deb1-fcf4-434a-bc3a-d19f6e944f09\") " pod="openshift-image-registry/image-registry-6c848b7cd9-9vxgb"
Jul 24 18:44:50.758714 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:50.758586    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/38d8deb1-fcf4-434a-bc3a-d19f6e944f09-registry-tls\") pod \"image-registry-6c848b7cd9-9vxgb\" (UID: \"38d8deb1-fcf4-434a-bc3a-d19f6e944f09\") " pod="openshift-image-registry/image-registry-6c848b7cd9-9vxgb"
Jul 24 18:44:50.758714 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:50.758624    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qtcfs\" (UniqueName: \"kubernetes.io/projected/0afd7f1b-febd-4ba1-aceb-b5cfd32f5ac9-kube-api-access-qtcfs\") pod \"insights-runtime-extractor-dcckq\" (UID: \"0afd7f1b-febd-4ba1-aceb-b5cfd32f5ac9\") " pod="openshift-insights/insights-runtime-extractor-dcckq"
Jul 24 18:44:50.758714 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:50.758645    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/fc688138-e740-43b8-b546-24938b83af0c-config-volume\") pod \"dns-default-q7dr8\" (UID: \"fc688138-e740-43b8-b546-24938b83af0c\") " pod="openshift-dns/dns-default-q7dr8"
Jul 24 18:44:50.758714 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:50.758673    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0afd7f1b-febd-4ba1-aceb-b5cfd32f5ac9-crio-socket\") pod \"insights-runtime-extractor-dcckq\" (UID: \"0afd7f1b-febd-4ba1-aceb-b5cfd32f5ac9\") " pod="openshift-insights/insights-runtime-extractor-dcckq"
Jul 24 18:44:50.758714 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:50.758696    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fc688138-e740-43b8-b546-24938b83af0c-metrics-tls\") pod \"dns-default-q7dr8\" (UID: \"fc688138-e740-43b8-b546-24938b83af0c\") " pod="openshift-dns/dns-default-q7dr8"
Jul 24 18:44:50.758957 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:50.758720    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fc688138-e740-43b8-b546-24938b83af0c-tmp-dir\") pod \"dns-default-q7dr8\" (UID: \"fc688138-e740-43b8-b546-24938b83af0c\") " pod="openshift-dns/dns-default-q7dr8"
Jul 24 18:44:50.758957 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:50.758755    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/38d8deb1-fcf4-434a-bc3a-d19f6e944f09-ca-trust-extracted\") pod \"image-registry-6c848b7cd9-9vxgb\" (UID: \"38d8deb1-fcf4-434a-bc3a-d19f6e944f09\") " pod="openshift-image-registry/image-registry-6c848b7cd9-9vxgb"
Jul 24 18:44:50.758957 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:50.758759    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0afd7f1b-febd-4ba1-aceb-b5cfd32f5ac9-data-volume\") pod \"insights-runtime-extractor-dcckq\" (UID: \"0afd7f1b-febd-4ba1-aceb-b5cfd32f5ac9\") " pod="openshift-insights/insights-runtime-extractor-dcckq"
Jul 24 18:44:50.758957 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:50.758791    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-b68cl"]
Jul 24 18:44:50.758957 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:50.758911    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/38d8deb1-fcf4-434a-bc3a-d19f6e944f09-installation-pull-secrets\") pod \"image-registry-6c848b7cd9-9vxgb\" (UID: \"38d8deb1-fcf4-434a-bc3a-d19f6e944f09\") " pod="openshift-image-registry/image-registry-6c848b7cd9-9vxgb"
Jul 24 18:44:50.758957 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:50.758946    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/38d8deb1-fcf4-434a-bc3a-d19f6e944f09-bound-sa-token\") pod \"image-registry-6c848b7cd9-9vxgb\" (UID: \"38d8deb1-fcf4-434a-bc3a-d19f6e944f09\") " pod="openshift-image-registry/image-registry-6c848b7cd9-9vxgb"
Jul 24 18:44:50.759264 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:50.758974    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0afd7f1b-febd-4ba1-aceb-b5cfd32f5ac9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dcckq\" (UID: \"0afd7f1b-febd-4ba1-aceb-b5cfd32f5ac9\") " pod="openshift-insights/insights-runtime-extractor-dcckq"
Jul 24 18:44:50.759383 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:50.759356    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/38d8deb1-fcf4-434a-bc3a-d19f6e944f09-registry-certificates\") pod \"image-registry-6c848b7cd9-9vxgb\" (UID: \"38d8deb1-fcf4-434a-bc3a-d19f6e944f09\") " pod="openshift-image-registry/image-registry-6c848b7cd9-9vxgb"
Jul 24 18:44:50.759480 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:50.759402    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/38d8deb1-fcf4-434a-bc3a-d19f6e944f09-trusted-ca\") pod \"image-registry-6c848b7cd9-9vxgb\" (UID: \"38d8deb1-fcf4-434a-bc3a-d19f6e944f09\") " pod="openshift-image-registry/image-registry-6c848b7cd9-9vxgb"
Jul 24 18:44:50.762764 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:50.762742    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/38d8deb1-fcf4-434a-bc3a-d19f6e944f09-installation-pull-secrets\") pod \"image-registry-6c848b7cd9-9vxgb\" (UID: \"38d8deb1-fcf4-434a-bc3a-d19f6e944f09\") " pod="openshift-image-registry/image-registry-6c848b7cd9-9vxgb"
Jul 24 18:44:50.762841 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:50.762799    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/38d8deb1-fcf4-434a-bc3a-d19f6e944f09-registry-tls\") pod \"image-registry-6c848b7cd9-9vxgb\" (UID: \"38d8deb1-fcf4-434a-bc3a-d19f6e944f09\") " pod="openshift-image-registry/image-registry-6c848b7cd9-9vxgb"
Jul 24 18:44:50.762841 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:50.762831    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/38d8deb1-fcf4-434a-bc3a-d19f6e944f09-image-registry-private-configuration\") pod \"image-registry-6c848b7cd9-9vxgb\" (UID: \"38d8deb1-fcf4-434a-bc3a-d19f6e944f09\") " pod="openshift-image-registry/image-registry-6c848b7cd9-9vxgb"
Jul 24 18:44:50.768636 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:50.768548    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-84np7\" (UniqueName: \"kubernetes.io/projected/38d8deb1-fcf4-434a-bc3a-d19f6e944f09-kube-api-access-84np7\") pod \"image-registry-6c848b7cd9-9vxgb\" (UID: \"38d8deb1-fcf4-434a-bc3a-d19f6e944f09\") " pod="openshift-image-registry/image-registry-6c848b7cd9-9vxgb"
Jul 24 18:44:50.769990 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:50.769970    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/38d8deb1-fcf4-434a-bc3a-d19f6e944f09-bound-sa-token\") pod \"image-registry-6c848b7cd9-9vxgb\" (UID: \"38d8deb1-fcf4-434a-bc3a-d19f6e944f09\") " pod="openshift-image-registry/image-registry-6c848b7cd9-9vxgb"
Jul 24 18:44:50.776563 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:50.776535    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-b68cl"]
Jul 24 18:44:50.776682 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:50.776666    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-b68cl"
Jul 24 18:44:50.779235 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:50.779218    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 24 18:44:50.779343 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:50.779327    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 24 18:44:50.779388 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:50.779356    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 24 18:44:50.779423 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:50.779331    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-twnl6\""
Jul 24 18:44:50.803583 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:50.803557    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:44:50.859659 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:50.859582    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0afd7f1b-febd-4ba1-aceb-b5cfd32f5ac9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dcckq\" (UID: \"0afd7f1b-febd-4ba1-aceb-b5cfd32f5ac9\") " pod="openshift-insights/insights-runtime-extractor-dcckq"
Jul 24 18:44:50.859659 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:50.859627    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tgvwn\" (UniqueName: \"kubernetes.io/projected/fc688138-e740-43b8-b546-24938b83af0c-kube-api-access-tgvwn\") pod \"dns-default-q7dr8\" (UID: \"fc688138-e740-43b8-b546-24938b83af0c\") " pod="openshift-dns/dns-default-q7dr8"
Jul 24 18:44:50.859659 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:50.859658    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qtcfs\" (UniqueName: \"kubernetes.io/projected/0afd7f1b-febd-4ba1-aceb-b5cfd32f5ac9-kube-api-access-qtcfs\") pod \"insights-runtime-extractor-dcckq\" (UID: \"0afd7f1b-febd-4ba1-aceb-b5cfd32f5ac9\") " pod="openshift-insights/insights-runtime-extractor-dcckq"
Jul 24 18:44:50.859950 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:50.859674    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/fc688138-e740-43b8-b546-24938b83af0c-config-volume\") pod \"dns-default-q7dr8\" (UID: \"fc688138-e740-43b8-b546-24938b83af0c\") " pod="openshift-dns/dns-default-q7dr8"
Jul 24 18:44:50.859950 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:50.859690    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0afd7f1b-febd-4ba1-aceb-b5cfd32f5ac9-crio-socket\") pod \"insights-runtime-extractor-dcckq\" (UID: \"0afd7f1b-febd-4ba1-aceb-b5cfd32f5ac9\") " pod="openshift-insights/insights-runtime-extractor-dcckq"
Jul 24 18:44:50.859950 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:50.859704    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fc688138-e740-43b8-b546-24938b83af0c-metrics-tls\") pod \"dns-default-q7dr8\" (UID: \"fc688138-e740-43b8-b546-24938b83af0c\") " pod="openshift-dns/dns-default-q7dr8"
Jul 24 18:44:50.859950 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:50.859796    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fc688138-e740-43b8-b546-24938b83af0c-tmp-dir\") pod \"dns-default-q7dr8\" (UID: \"fc688138-e740-43b8-b546-24938b83af0c\") " pod="openshift-dns/dns-default-q7dr8"
Jul 24 18:44:50.859950 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:50.859849    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0afd7f1b-febd-4ba1-aceb-b5cfd32f5ac9-data-volume\") pod \"insights-runtime-extractor-dcckq\" (UID: \"0afd7f1b-febd-4ba1-aceb-b5cfd32f5ac9\") " pod="openshift-insights/insights-runtime-extractor-dcckq"
Jul 24 18:44:50.859950 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:50.859880    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5f6614f2-4b6e-49c0-8a97-f3b8934a4080-cert\") pod \"ingress-canary-b68cl\" (UID: \"5f6614f2-4b6e-49c0-8a97-f3b8934a4080\") " pod="openshift-ingress-canary/ingress-canary-b68cl"
Jul 24 18:44:50.859950 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:50.859920    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0afd7f1b-febd-4ba1-aceb-b5cfd32f5ac9-crio-socket\") pod \"insights-runtime-extractor-dcckq\" (UID: \"0afd7f1b-febd-4ba1-aceb-b5cfd32f5ac9\") " pod="openshift-insights/insights-runtime-extractor-dcckq"
Jul 24 18:44:50.859950 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:50.859924    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0afd7f1b-febd-4ba1-aceb-b5cfd32f5ac9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dcckq\" (UID: \"0afd7f1b-febd-4ba1-aceb-b5cfd32f5ac9\") " pod="openshift-insights/insights-runtime-extractor-dcckq"
Jul 24 18:44:50.859950 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:50.859964    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b2dsf\" (UniqueName: \"kubernetes.io/projected/5f6614f2-4b6e-49c0-8a97-f3b8934a4080-kube-api-access-b2dsf\") pod \"ingress-canary-b68cl\" (UID: \"5f6614f2-4b6e-49c0-8a97-f3b8934a4080\") " pod="openshift-ingress-canary/ingress-canary-b68cl"
Jul 24 18:44:50.860515 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:50.860218    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fc688138-e740-43b8-b546-24938b83af0c-tmp-dir\") pod \"dns-default-q7dr8\" (UID: \"fc688138-e740-43b8-b546-24938b83af0c\") " pod="openshift-dns/dns-default-q7dr8"
Jul 24 18:44:50.860515 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:50.860338    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/fc688138-e740-43b8-b546-24938b83af0c-config-volume\") pod \"dns-default-q7dr8\" (UID: \"fc688138-e740-43b8-b546-24938b83af0c\") " pod="openshift-dns/dns-default-q7dr8"
Jul 24 18:44:50.860644 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:50.860547    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0afd7f1b-febd-4ba1-aceb-b5cfd32f5ac9-data-volume\") pod \"insights-runtime-extractor-dcckq\" (UID: \"0afd7f1b-febd-4ba1-aceb-b5cfd32f5ac9\") " pod="openshift-insights/insights-runtime-extractor-dcckq"
Jul 24 18:44:50.860644 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:50.860632    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0afd7f1b-febd-4ba1-aceb-b5cfd32f5ac9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dcckq\" (UID: \"0afd7f1b-febd-4ba1-aceb-b5cfd32f5ac9\") " pod="openshift-insights/insights-runtime-extractor-dcckq"
Jul 24 18:44:50.860772 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:50.860753    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:44:50.862850 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:50.862830    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fc688138-e740-43b8-b546-24938b83af0c-metrics-tls\") pod \"dns-default-q7dr8\" (UID: \"fc688138-e740-43b8-b546-24938b83af0c\") " pod="openshift-dns/dns-default-q7dr8"
Jul 24 18:44:50.862932 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:50.862867    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0afd7f1b-febd-4ba1-aceb-b5cfd32f5ac9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dcckq\" (UID: \"0afd7f1b-febd-4ba1-aceb-b5cfd32f5ac9\") " pod="openshift-insights/insights-runtime-extractor-dcckq"
Jul 24 18:44:50.868591 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:50.868573    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tgvwn\" (UniqueName: \"kubernetes.io/projected/fc688138-e740-43b8-b546-24938b83af0c-kube-api-access-tgvwn\") pod \"dns-default-q7dr8\" (UID: \"fc688138-e740-43b8-b546-24938b83af0c\") " pod="openshift-dns/dns-default-q7dr8"
Jul 24 18:44:50.868677 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:50.868593    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qtcfs\" (UniqueName: \"kubernetes.io/projected/0afd7f1b-febd-4ba1-aceb-b5cfd32f5ac9-kube-api-access-qtcfs\") pod \"insights-runtime-extractor-dcckq\" (UID: \"0afd7f1b-febd-4ba1-aceb-b5cfd32f5ac9\") " pod="openshift-insights/insights-runtime-extractor-dcckq"
Jul 24 18:44:50.960314 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:50.960274    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5f6614f2-4b6e-49c0-8a97-f3b8934a4080-cert\") pod \"ingress-canary-b68cl\" (UID: \"5f6614f2-4b6e-49c0-8a97-f3b8934a4080\") " pod="openshift-ingress-canary/ingress-canary-b68cl"
Jul 24 18:44:50.960569 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:50.960326    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b2dsf\" (UniqueName: \"kubernetes.io/projected/5f6614f2-4b6e-49c0-8a97-f3b8934a4080-kube-api-access-b2dsf\") pod \"ingress-canary-b68cl\" (UID: \"5f6614f2-4b6e-49c0-8a97-f3b8934a4080\") " pod="openshift-ingress-canary/ingress-canary-b68cl"
Jul 24 18:44:50.962931 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:50.962906    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5f6614f2-4b6e-49c0-8a97-f3b8934a4080-cert\") pod \"ingress-canary-b68cl\" (UID: \"5f6614f2-4b6e-49c0-8a97-f3b8934a4080\") " pod="openshift-ingress-canary/ingress-canary-b68cl"
Jul 24 18:44:50.963064 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:50.963047    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6c848b7cd9-9vxgb"
Jul 24 18:44:50.968275 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:50.968256    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b2dsf\" (UniqueName: \"kubernetes.io/projected/5f6614f2-4b6e-49c0-8a97-f3b8934a4080-kube-api-access-b2dsf\") pod \"ingress-canary-b68cl\" (UID: \"5f6614f2-4b6e-49c0-8a97-f3b8934a4080\") " pod="openshift-ingress-canary/ingress-canary-b68cl"
Jul 24 18:44:50.983099 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:50.983082    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-q7dr8"
Jul 24 18:44:50.991232 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:50.991217    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-dcckq"
Jul 24 18:44:51.086044 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:51.085805    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-b68cl"
Jul 24 18:44:51.180017 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:51.179948    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-q7dr8"]
Jul 24 18:44:51.188081 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:51.187747    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc688138_e740_43b8_b546_24938b83af0c.slice/crio-4359640f29b0169bb35fbc31fc382fd12c08085a8901a0c1ffa56aa1f8f561f4 WatchSource:0}: Error finding container 4359640f29b0169bb35fbc31fc382fd12c08085a8901a0c1ffa56aa1f8f561f4: Status 404 returned error can't find the container with id 4359640f29b0169bb35fbc31fc382fd12c08085a8901a0c1ffa56aa1f8f561f4
Jul 24 18:44:51.188222 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:51.188199    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6c848b7cd9-9vxgb"]
Jul 24 18:44:51.192628 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:51.192607    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38d8deb1_fcf4_434a_bc3a_d19f6e944f09.slice/crio-d40a228b5090d7a7e03d1d386b0a29e171c51de0bd807fc6d1bf7293dcf4e3ca WatchSource:0}: Error finding container d40a228b5090d7a7e03d1d386b0a29e171c51de0bd807fc6d1bf7293dcf4e3ca: Status 404 returned error can't find the container with id d40a228b5090d7a7e03d1d386b0a29e171c51de0bd807fc6d1bf7293dcf4e3ca
Jul 24 18:44:51.205443 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:51.205415    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-dcckq"]
Jul 24 18:44:51.210630 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:51.210560    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0afd7f1b_febd_4ba1_aceb_b5cfd32f5ac9.slice/crio-61b8a64272e28be0260b4f99f79ae1309da13804a5bc2845240b776012cef672 WatchSource:0}: Error finding container 61b8a64272e28be0260b4f99f79ae1309da13804a5bc2845240b776012cef672: Status 404 returned error can't find the container with id 61b8a64272e28be0260b4f99f79ae1309da13804a5bc2845240b776012cef672
Jul 24 18:44:51.235715 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:51.235691    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nsc2s"
Jul 24 18:44:51.235881 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:51.235861    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4722z"
Jul 24 18:44:51.238745 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:51.238723    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 24 18:44:51.239047 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:51.238872    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 24 18:44:51.239047 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:51.238885    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-96zrd\""
Jul 24 18:44:51.239047 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:51.238882    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-6w7xn\""
Jul 24 18:44:51.239047 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:51.238953    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 24 18:44:51.263187 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:51.263011    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-b68cl"]
Jul 24 18:44:51.266671 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:51.266650    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f6614f2_4b6e_49c0_8a97_f3b8934a4080.slice/crio-21281eebe46bb3950bf244b09bbb4c6c87fe1a5d81a71b0a49fdeafe203e3721 WatchSource:0}: Error finding container 21281eebe46bb3950bf244b09bbb4c6c87fe1a5d81a71b0a49fdeafe203e3721: Status 404 returned error can't find the container with id 21281eebe46bb3950bf244b09bbb4c6c87fe1a5d81a71b0a49fdeafe203e3721
Jul 24 18:44:51.410522 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:51.410446    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6c848b7cd9-9vxgb" event={"ID":"38d8deb1-fcf4-434a-bc3a-d19f6e944f09","Type":"ContainerStarted","Data":"145a31ef6f35360ebd60f5a8716f1a55e97db34b2380e3558ec18f8b2d9cd9ac"}
Jul 24 18:44:51.410522 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:51.410505    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6c848b7cd9-9vxgb" event={"ID":"38d8deb1-fcf4-434a-bc3a-d19f6e944f09","Type":"ContainerStarted","Data":"d40a228b5090d7a7e03d1d386b0a29e171c51de0bd807fc6d1bf7293dcf4e3ca"}
Jul 24 18:44:51.410742 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:51.410545    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6c848b7cd9-9vxgb"
Jul 24 18:44:51.411752 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:51.411728    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-q7dr8" event={"ID":"fc688138-e740-43b8-b546-24938b83af0c","Type":"ContainerStarted","Data":"4359640f29b0169bb35fbc31fc382fd12c08085a8901a0c1ffa56aa1f8f561f4"}
Jul 24 18:44:51.412894 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:51.412870    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-b68cl" event={"ID":"5f6614f2-4b6e-49c0-8a97-f3b8934a4080","Type":"ContainerStarted","Data":"21281eebe46bb3950bf244b09bbb4c6c87fe1a5d81a71b0a49fdeafe203e3721"}
Jul 24 18:44:51.413996 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:51.413974    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dcckq" event={"ID":"0afd7f1b-febd-4ba1-aceb-b5cfd32f5ac9","Type":"ContainerStarted","Data":"61b8a64272e28be0260b4f99f79ae1309da13804a5bc2845240b776012cef672"}
Jul 24 18:44:51.431137 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:51.431070    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6c848b7cd9-9vxgb" podStartSLOduration=6.431052265 podStartE2EDuration="6.431052265s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 18:44:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:44:51.430185568 +0000 UTC m=+46.639557611" watchObservedRunningTime="2026-07-24 18:44:51.431052265 +0000 UTC m=+46.640424311"
Jul 24 18:44:51.777252 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:51.777215    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:44:51.878083 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:51.878026    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:44:52.028932 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:52.028799    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:44:52.083170 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:52.083115    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:44:52.236225 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:52.235499    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-phl62"
Jul 24 18:44:52.239090 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:52.239064    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 24 18:44:54.120070 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:54.120021    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:44:54.182745 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:54.182709    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:44:54.432228 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:54.432161    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:44:54.492895 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:54.492855    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:44:55.264930 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:55.264900    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-657778b767-7tkt4"]
Jul 24 18:44:55.351991 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:55.351901    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-657778b767-7tkt4"]
Jul 24 18:44:55.352186 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:55.352017    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-657778b767-7tkt4"
Jul 24 18:44:55.356095 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:55.356061    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 24 18:44:55.356240 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:55.356061    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 24 18:44:55.356967 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:55.356935    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 24 18:44:55.356967 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:55.356947    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 24 18:44:55.357164 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:55.357002    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 24 18:44:55.357164 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:55.357017    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 24 18:44:55.357164 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:55.356941    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 24 18:44:55.357164 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:55.356943    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-rw2c6\""
Jul 24 18:44:55.368926 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:55.368899    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 24 18:44:55.392040 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:55.392008    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7d6e53ad-4342-45bf-a64e-3c16dbe38451-service-ca\") pod \"console-657778b767-7tkt4\" (UID: \"7d6e53ad-4342-45bf-a64e-3c16dbe38451\") " pod="openshift-console/console-657778b767-7tkt4"
Jul 24 18:44:55.392040 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:55.392044    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7d6e53ad-4342-45bf-a64e-3c16dbe38451-oauth-serving-cert\") pod \"console-657778b767-7tkt4\" (UID: \"7d6e53ad-4342-45bf-a64e-3c16dbe38451\") " pod="openshift-console/console-657778b767-7tkt4"
Jul 24 18:44:55.392270 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:55.392159    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7d6e53ad-4342-45bf-a64e-3c16dbe38451-console-serving-cert\") pod \"console-657778b767-7tkt4\" (UID: \"7d6e53ad-4342-45bf-a64e-3c16dbe38451\") " pod="openshift-console/console-657778b767-7tkt4"
Jul 24 18:44:55.392270 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:55.392242    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7d6e53ad-4342-45bf-a64e-3c16dbe38451-console-config\") pod \"console-657778b767-7tkt4\" (UID: \"7d6e53ad-4342-45bf-a64e-3c16dbe38451\") " pod="openshift-console/console-657778b767-7tkt4"
Jul 24 18:44:55.392358 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:55.392287    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7d6e53ad-4342-45bf-a64e-3c16dbe38451-trusted-ca-bundle\") pod \"console-657778b767-7tkt4\" (UID: \"7d6e53ad-4342-45bf-a64e-3c16dbe38451\") " pod="openshift-console/console-657778b767-7tkt4"
Jul 24 18:44:55.392358 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:55.392308    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7d6e53ad-4342-45bf-a64e-3c16dbe38451-console-oauth-config\") pod \"console-657778b767-7tkt4\" (UID: \"7d6e53ad-4342-45bf-a64e-3c16dbe38451\") " pod="openshift-console/console-657778b767-7tkt4"
Jul 24 18:44:55.392358 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:55.392331    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pl26g\" (UniqueName: \"kubernetes.io/projected/7d6e53ad-4342-45bf-a64e-3c16dbe38451-kube-api-access-pl26g\") pod \"console-657778b767-7tkt4\" (UID: \"7d6e53ad-4342-45bf-a64e-3c16dbe38451\") " pod="openshift-console/console-657778b767-7tkt4"
Jul 24 18:44:55.435928 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:55.435893    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:44:55.493772 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:55.493732    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7d6e53ad-4342-45bf-a64e-3c16dbe38451-console-serving-cert\") pod \"console-657778b767-7tkt4\" (UID: \"7d6e53ad-4342-45bf-a64e-3c16dbe38451\") " pod="openshift-console/console-657778b767-7tkt4"
Jul 24 18:44:55.493952 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:55.493808    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7d6e53ad-4342-45bf-a64e-3c16dbe38451-console-config\") pod \"console-657778b767-7tkt4\" (UID: \"7d6e53ad-4342-45bf-a64e-3c16dbe38451\") " pod="openshift-console/console-657778b767-7tkt4"
Jul 24 18:44:55.493952 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:55.493835    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7d6e53ad-4342-45bf-a64e-3c16dbe38451-trusted-ca-bundle\") pod \"console-657778b767-7tkt4\" (UID: \"7d6e53ad-4342-45bf-a64e-3c16dbe38451\") " pod="openshift-console/console-657778b767-7tkt4"
Jul 24 18:44:55.493952 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:55.493861    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7d6e53ad-4342-45bf-a64e-3c16dbe38451-console-oauth-config\") pod \"console-657778b767-7tkt4\" (UID: \"7d6e53ad-4342-45bf-a64e-3c16dbe38451\") " pod="openshift-console/console-657778b767-7tkt4"
Jul 24 18:44:55.493952 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:55.493882    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pl26g\" (UniqueName: \"kubernetes.io/projected/7d6e53ad-4342-45bf-a64e-3c16dbe38451-kube-api-access-pl26g\") pod \"console-657778b767-7tkt4\" (UID: \"7d6e53ad-4342-45bf-a64e-3c16dbe38451\") " pod="openshift-console/console-657778b767-7tkt4"
Jul 24 18:44:55.493952 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:55.493906    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7d6e53ad-4342-45bf-a64e-3c16dbe38451-service-ca\") pod \"console-657778b767-7tkt4\" (UID: \"7d6e53ad-4342-45bf-a64e-3c16dbe38451\") " pod="openshift-console/console-657778b767-7tkt4"
Jul 24 18:44:55.493952 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:55.493926    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7d6e53ad-4342-45bf-a64e-3c16dbe38451-oauth-serving-cert\") pod \"console-657778b767-7tkt4\" (UID: \"7d6e53ad-4342-45bf-a64e-3c16dbe38451\") " pod="openshift-console/console-657778b767-7tkt4"
Jul 24 18:44:55.494618 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:55.494591    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7d6e53ad-4342-45bf-a64e-3c16dbe38451-console-config\") pod \"console-657778b767-7tkt4\" (UID: \"7d6e53ad-4342-45bf-a64e-3c16dbe38451\") " pod="openshift-console/console-657778b767-7tkt4"
Jul 24 18:44:55.494618 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:55.494607    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7d6e53ad-4342-45bf-a64e-3c16dbe38451-oauth-serving-cert\") pod \"console-657778b767-7tkt4\" (UID: \"7d6e53ad-4342-45bf-a64e-3c16dbe38451\") " pod="openshift-console/console-657778b767-7tkt4"
Jul 24 18:44:55.494792 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:55.494726    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7d6e53ad-4342-45bf-a64e-3c16dbe38451-trusted-ca-bundle\") pod \"console-657778b767-7tkt4\" (UID: \"7d6e53ad-4342-45bf-a64e-3c16dbe38451\") " pod="openshift-console/console-657778b767-7tkt4"
Jul 24 18:44:55.494848 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:55.494834    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7d6e53ad-4342-45bf-a64e-3c16dbe38451-service-ca\") pod \"console-657778b767-7tkt4\" (UID: \"7d6e53ad-4342-45bf-a64e-3c16dbe38451\") " pod="openshift-console/console-657778b767-7tkt4"
Jul 24 18:44:55.497805 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:55.497784    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7d6e53ad-4342-45bf-a64e-3c16dbe38451-console-serving-cert\") pod \"console-657778b767-7tkt4\" (UID: \"7d6e53ad-4342-45bf-a64e-3c16dbe38451\") " pod="openshift-console/console-657778b767-7tkt4"
Jul 24 18:44:55.497902 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:55.497846    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7d6e53ad-4342-45bf-a64e-3c16dbe38451-console-oauth-config\") pod \"console-657778b767-7tkt4\" (UID: \"7d6e53ad-4342-45bf-a64e-3c16dbe38451\") " pod="openshift-console/console-657778b767-7tkt4"
Jul 24 18:44:55.503336 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:55.503316    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pl26g\" (UniqueName: \"kubernetes.io/projected/7d6e53ad-4342-45bf-a64e-3c16dbe38451-kube-api-access-pl26g\") pod \"console-657778b767-7tkt4\" (UID: \"7d6e53ad-4342-45bf-a64e-3c16dbe38451\") " pod="openshift-console/console-657778b767-7tkt4"
Jul 24 18:44:55.538782 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:55.538705    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:44:55.663369 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:55.663332    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-657778b767-7tkt4"
Jul 24 18:44:56.007360 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:56.007331    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:44:56.086198 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:56.086102    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:44:58.007109 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:58.006792    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-657778b767-7tkt4"]
Jul 24 18:44:58.068898 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:58.068862    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d6e53ad_4342_45bf_a64e_3c16dbe38451.slice/crio-ef98c90bc77037c5aa1b93f04aaa05abea1c3e6416e6588adbbb2d957d824c3c WatchSource:0}: Error finding container ef98c90bc77037c5aa1b93f04aaa05abea1c3e6416e6588adbbb2d957d824c3c: Status 404 returned error can't find the container with id ef98c90bc77037c5aa1b93f04aaa05abea1c3e6416e6588adbbb2d957d824c3c
Jul 24 18:44:58.219441 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:58.219408    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:44:58.336507 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:58.336472    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:44:58.350878 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:58.350851    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-gb6zp"]
Jul 24 18:44:58.352721 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:58.352696    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-84d69f794d-gb6zp"
Jul 24 18:44:58.356158 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:58.356111    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 24 18:44:58.356450 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:58.356185    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 24 18:44:58.356450 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:58.356318    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 24 18:44:58.356803 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:58.356789    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 24 18:44:58.356883 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:58.356821    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-xrvk6\""
Jul 24 18:44:58.356983 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:58.356963    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 24 18:44:58.374458 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:58.374381    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-gb6zp"]
Jul 24 18:44:58.417079 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:58.417044    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/5677e339-73f3-4122-a206-4eb54863b56c-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-gb6zp\" (UID: \"5677e339-73f3-4122-a206-4eb54863b56c\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-gb6zp"
Jul 24 18:44:58.417241 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:58.417102    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sz6b8\" (UniqueName: \"kubernetes.io/projected/5677e339-73f3-4122-a206-4eb54863b56c-kube-api-access-sz6b8\") pod \"prometheus-operator-84d69f794d-gb6zp\" (UID: \"5677e339-73f3-4122-a206-4eb54863b56c\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-gb6zp"
Jul 24 18:44:58.417241 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:58.417187    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5677e339-73f3-4122-a206-4eb54863b56c-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-gb6zp\" (UID: \"5677e339-73f3-4122-a206-4eb54863b56c\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-gb6zp"
Jul 24 18:44:58.417312 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:58.417249    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5677e339-73f3-4122-a206-4eb54863b56c-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-gb6zp\" (UID: \"5677e339-73f3-4122-a206-4eb54863b56c\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-gb6zp"
Jul 24 18:44:58.434200 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:58.434165    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-q7dr8" event={"ID":"fc688138-e740-43b8-b546-24938b83af0c","Type":"ContainerStarted","Data":"ee5995645c27275455d0f910ac2f691d116adabdeee18ceb6b60bb86c0cde5f4"}
Jul 24 18:44:58.434341 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:58.434249    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-q7dr8" event={"ID":"fc688138-e740-43b8-b546-24938b83af0c","Type":"ContainerStarted","Data":"7b3ea50ee8d2d76f282c83033709347031fc8af558f4feb1478f80e69ff4c4c0"}
Jul 24 18:44:58.434341 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:58.434281    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-q7dr8"
Jul 24 18:44:58.435732 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:58.435708    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-b68cl" event={"ID":"5f6614f2-4b6e-49c0-8a97-f3b8934a4080","Type":"ContainerStarted","Data":"221a6c24f1266398553bb841ec263200e25cdae0709116e3bbaa6ed3a0669280"}
Jul 24 18:44:58.437253 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:58.437230    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dcckq" event={"ID":"0afd7f1b-febd-4ba1-aceb-b5cfd32f5ac9","Type":"ContainerStarted","Data":"2c29df263638e351782ab8e6c48746aa0ddd51343fe2b13be9dc264575fca108"}
Jul 24 18:44:58.438517 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:58.438498    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-657778b767-7tkt4" event={"ID":"7d6e53ad-4342-45bf-a64e-3c16dbe38451","Type":"ContainerStarted","Data":"ef98c90bc77037c5aa1b93f04aaa05abea1c3e6416e6588adbbb2d957d824c3c"}
Jul 24 18:44:58.472435 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:58.472387    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-q7dr8" podStartSLOduration=1.8000682559999999 podStartE2EDuration="8.472370278s" totalImagesPullingTime="6.672302022s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 18:44:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:44:58.471109605 +0000 UTC m=+53.680481648" watchObservedRunningTime="2026-07-24 18:44:58.472370278 +0000 UTC m=+53.681742377"
Jul 24 18:44:58.484719 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:58.484690    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:44:58.495326 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:58.495282    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-b68cl" podStartSLOduration=1.902077125 podStartE2EDuration="8.495266034s" totalImagesPullingTime="6.593188909s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 18:44:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:44:58.494109141 +0000 UTC m=+53.703481174" watchObservedRunningTime="2026-07-24 18:44:58.495266034 +0000 UTC m=+53.704638076"
Jul 24 18:44:58.518214 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:58.518176    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5677e339-73f3-4122-a206-4eb54863b56c-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-gb6zp\" (UID: \"5677e339-73f3-4122-a206-4eb54863b56c\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-gb6zp"
Jul 24 18:44:58.518365 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:58.518232    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/5677e339-73f3-4122-a206-4eb54863b56c-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-gb6zp\" (UID: \"5677e339-73f3-4122-a206-4eb54863b56c\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-gb6zp"
Jul 24 18:44:58.518365 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:58.518326    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sz6b8\" (UniqueName: \"kubernetes.io/projected/5677e339-73f3-4122-a206-4eb54863b56c-kube-api-access-sz6b8\") pod \"prometheus-operator-84d69f794d-gb6zp\" (UID: \"5677e339-73f3-4122-a206-4eb54863b56c\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-gb6zp"
Jul 24 18:44:58.518365 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:58.518351    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5677e339-73f3-4122-a206-4eb54863b56c-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-gb6zp\" (UID: \"5677e339-73f3-4122-a206-4eb54863b56c\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-gb6zp"
Jul 24 18:44:58.519045 ip-10-0-141-146 kubenswrapper[2580]: E0724 18:44:58.518750    2580 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found
Jul 24 18:44:58.519045 ip-10-0-141-146 kubenswrapper[2580]: E0724 18:44:58.519013    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5677e339-73f3-4122-a206-4eb54863b56c-prometheus-operator-tls podName:5677e339-73f3-4122-a206-4eb54863b56c nodeName:}" failed. No retries permitted until 2026-07-24 18:44:59.018997509 +0000 UTC m=+54.228369531 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/5677e339-73f3-4122-a206-4eb54863b56c-prometheus-operator-tls") pod "prometheus-operator-84d69f794d-gb6zp" (UID: "5677e339-73f3-4122-a206-4eb54863b56c") : secret "prometheus-operator-tls" not found
Jul 24 18:44:58.519343 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:58.519320    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5677e339-73f3-4122-a206-4eb54863b56c-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-gb6zp\" (UID: \"5677e339-73f3-4122-a206-4eb54863b56c\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-gb6zp"
Jul 24 18:44:58.523794 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:58.523773    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5677e339-73f3-4122-a206-4eb54863b56c-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-gb6zp\" (UID: \"5677e339-73f3-4122-a206-4eb54863b56c\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-gb6zp"
Jul 24 18:44:58.529365 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:58.529321    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sz6b8\" (UniqueName: \"kubernetes.io/projected/5677e339-73f3-4122-a206-4eb54863b56c-kube-api-access-sz6b8\") pod \"prometheus-operator-84d69f794d-gb6zp\" (UID: \"5677e339-73f3-4122-a206-4eb54863b56c\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-gb6zp"
Jul 24 18:44:58.883346 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:58.883311    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:44:59.023519 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:59.023471    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/5677e339-73f3-4122-a206-4eb54863b56c-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-gb6zp\" (UID: \"5677e339-73f3-4122-a206-4eb54863b56c\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-gb6zp"
Jul 24 18:44:59.029196 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:59.029168    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/5677e339-73f3-4122-a206-4eb54863b56c-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-gb6zp\" (UID: \"5677e339-73f3-4122-a206-4eb54863b56c\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-gb6zp"
Jul 24 18:44:59.262642 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:59.262610    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-84d69f794d-gb6zp"
Jul 24 18:44:59.442218 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:44:59.442184    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-gb6zp"]
Jul 24 18:44:59.446043 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:44:59.446014    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5677e339_73f3_4122_a206_4eb54863b56c.slice/crio-15070da36a2d3e177ca7716df43b40d640b5e80af8efe5bd6c5ec3926957ba9e WatchSource:0}: Error finding container 15070da36a2d3e177ca7716df43b40d640b5e80af8efe5bd6c5ec3926957ba9e: Status 404 returned error can't find the container with id 15070da36a2d3e177ca7716df43b40d640b5e80af8efe5bd6c5ec3926957ba9e
Jul 24 18:45:00.449757 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:00.449718    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-gb6zp" event={"ID":"5677e339-73f3-4122-a206-4eb54863b56c","Type":"ContainerStarted","Data":"15070da36a2d3e177ca7716df43b40d640b5e80af8efe5bd6c5ec3926957ba9e"}
Jul 24 18:45:00.525905 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:00.525869    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:45:00.626888 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:00.626853    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:45:00.913770 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:00.913686    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:45:00.982612 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:00.982578    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:45:03.653477 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:03.653401    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:45:04.466720 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:04.466673    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-657778b767-7tkt4" event={"ID":"7d6e53ad-4342-45bf-a64e-3c16dbe38451","Type":"ContainerStarted","Data":"53877cc77c218158ed744b656d90e6c863746b97ec966cbf2c1c0d5d5586ea4d"}
Jul 24 18:45:04.468665 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:04.468629    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dcckq" event={"ID":"0afd7f1b-febd-4ba1-aceb-b5cfd32f5ac9","Type":"ContainerStarted","Data":"9393c2a04575d33dd035bd61aaa75145b7445f5b451d4ff3436a4553d643a190"}
Jul 24 18:45:04.470578 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:04.470546    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-gb6zp" event={"ID":"5677e339-73f3-4122-a206-4eb54863b56c","Type":"ContainerStarted","Data":"faef25f34be41ba8de79b23718e526f2de1e13e4758452b70ebef355f1d2504b"}
Jul 24 18:45:04.470709 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:04.470595    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-gb6zp" event={"ID":"5677e339-73f3-4122-a206-4eb54863b56c","Type":"ContainerStarted","Data":"ff5503c265e0e3a4d16a4cefca57c9c4cd489dfea015e8f5d05e8065c31cf3ca"}
Jul 24 18:45:04.484004 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:04.483951    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-657778b767-7tkt4" podStartSLOduration=4.168800722 podStartE2EDuration="9.48393781s" totalImagesPullingTime="5.315137088s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 18:44:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:45:04.483326476 +0000 UTC m=+59.692698532" watchObservedRunningTime="2026-07-24 18:45:04.48393781 +0000 UTC m=+59.693309853"
Jul 24 18:45:04.501656 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:04.501596    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-84d69f794d-gb6zp" podStartSLOduration=2.559216584 podStartE2EDuration="6.501577312s" totalImagesPullingTime="3.942360728s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 18:44:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:45:04.500725563 +0000 UTC m=+59.710097608" watchObservedRunningTime="2026-07-24 18:45:04.501577312 +0000 UTC m=+59.710949356"
Jul 24 18:45:05.370919 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:05.370889    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-qvzgb"
Jul 24 18:45:05.540283 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:05.540250    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:45:05.638147 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:05.638048    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:45:05.664478 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:05.664409    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-657778b767-7tkt4"
Jul 24 18:45:05.664478 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:05.664486    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-657778b767-7tkt4"
Jul 24 18:45:05.671209 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:05.671181    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-657778b767-7tkt4"
Jul 24 18:45:05.748170 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:05.748141    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:45:06.418652 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:06.418613    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:45:06.485773 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:06.485738    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-657778b767-7tkt4"
Jul 24 18:45:06.676014 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:06.675936    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-v7dn9"]
Jul 24 18:45:06.686728 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:06.686688    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-v7dn9"
Jul 24 18:45:06.689426 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:06.689395    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 24 18:45:06.689590 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:06.689399    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 24 18:45:06.689590 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:06.689406    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-4qd49\""
Jul 24 18:45:06.693804 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:06.693770    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-v7dn9"]
Jul 24 18:45:06.706963 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:06.706935    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-dftc9"]
Jul 24 18:45:06.709929 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:06.709903    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-dftc9"
Jul 24 18:45:06.712408 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:06.712382    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 24 18:45:06.712774 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:06.712756    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-l828c\""
Jul 24 18:45:06.713755 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:06.713725    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 24 18:45:06.713867 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:06.713760    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 24 18:45:06.719581 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:06.719560    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-78qd9"]
Jul 24 18:45:06.721478 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:06.721455    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-78qd9"
Jul 24 18:45:06.723731 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:06.723711    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-nr68f\""
Jul 24 18:45:06.723982 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:06.723954    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 24 18:45:06.724322 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:06.724304    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 24 18:45:06.724541 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:06.724527    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 24 18:45:06.736544 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:06.736495    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-78qd9"]
Jul 24 18:45:06.772585 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:06.772534    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:45:06.785803 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:06.785763    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/593fff4b-38a9-42cc-b954-d3293c0155b0-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-v7dn9\" (UID: \"593fff4b-38a9-42cc-b954-d3293c0155b0\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-v7dn9"
Jul 24 18:45:06.785984 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:06.785863    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9ad26be1-409e-4984-bd03-27cfb042295c-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-78qd9\" (UID: \"9ad26be1-409e-4984-bd03-27cfb042295c\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-78qd9"
Jul 24 18:45:06.785984 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:06.785907    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f25db79a-9718-421d-97f4-bc040556fc3e-node-exporter-textfile\") pod \"node-exporter-dftc9\" (UID: \"f25db79a-9718-421d-97f4-bc040556fc3e\") " pod="openshift-monitoring/node-exporter-dftc9"
Jul 24 18:45:06.785984 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:06.785940    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f25db79a-9718-421d-97f4-bc040556fc3e-node-exporter-wtmp\") pod \"node-exporter-dftc9\" (UID: \"f25db79a-9718-421d-97f4-bc040556fc3e\") " pod="openshift-monitoring/node-exporter-dftc9"
Jul 24 18:45:06.785984 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:06.785965    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9ad26be1-409e-4984-bd03-27cfb042295c-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-78qd9\" (UID: \"9ad26be1-409e-4984-bd03-27cfb042295c\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-78qd9"
Jul 24 18:45:06.786236 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:06.786018    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f25db79a-9718-421d-97f4-bc040556fc3e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-dftc9\" (UID: \"f25db79a-9718-421d-97f4-bc040556fc3e\") " pod="openshift-monitoring/node-exporter-dftc9"
Jul 24 18:45:06.786236 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:06.786049    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f25db79a-9718-421d-97f4-bc040556fc3e-node-exporter-accelerators-collector-config\") pod \"node-exporter-dftc9\" (UID: \"f25db79a-9718-421d-97f4-bc040556fc3e\") " pod="openshift-monitoring/node-exporter-dftc9"
Jul 24 18:45:06.786236 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:06.786112    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9ad26be1-409e-4984-bd03-27cfb042295c-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-78qd9\" (UID: \"9ad26be1-409e-4984-bd03-27cfb042295c\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-78qd9"
Jul 24 18:45:06.786236 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:06.786176    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-spt68\" (UniqueName: \"kubernetes.io/projected/9ad26be1-409e-4984-bd03-27cfb042295c-kube-api-access-spt68\") pod \"kube-state-metrics-56d9f944b4-78qd9\" (UID: \"9ad26be1-409e-4984-bd03-27cfb042295c\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-78qd9"
Jul 24 18:45:06.786236 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:06.786226    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lx5b7\" (UniqueName: \"kubernetes.io/projected/593fff4b-38a9-42cc-b954-d3293c0155b0-kube-api-access-lx5b7\") pod \"openshift-state-metrics-b8f49f5c6-v7dn9\" (UID: \"593fff4b-38a9-42cc-b954-d3293c0155b0\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-v7dn9"
Jul 24 18:45:06.786492 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:06.786256    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f25db79a-9718-421d-97f4-bc040556fc3e-metrics-client-ca\") pod \"node-exporter-dftc9\" (UID: \"f25db79a-9718-421d-97f4-bc040556fc3e\") " pod="openshift-monitoring/node-exporter-dftc9"
Jul 24 18:45:06.786492 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:06.786286    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f25db79a-9718-421d-97f4-bc040556fc3e-root\") pod \"node-exporter-dftc9\" (UID: \"f25db79a-9718-421d-97f4-bc040556fc3e\") " pod="openshift-monitoring/node-exporter-dftc9"
Jul 24 18:45:06.786492 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:06.786312    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ttt4t\" (UniqueName: \"kubernetes.io/projected/f25db79a-9718-421d-97f4-bc040556fc3e-kube-api-access-ttt4t\") pod \"node-exporter-dftc9\" (UID: \"f25db79a-9718-421d-97f4-bc040556fc3e\") " pod="openshift-monitoring/node-exporter-dftc9"
Jul 24 18:45:06.786492 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:06.786336    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/9ad26be1-409e-4984-bd03-27cfb042295c-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-78qd9\" (UID: \"9ad26be1-409e-4984-bd03-27cfb042295c\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-78qd9"
Jul 24 18:45:06.786492 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:06.786399    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/593fff4b-38a9-42cc-b954-d3293c0155b0-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-v7dn9\" (UID: \"593fff4b-38a9-42cc-b954-d3293c0155b0\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-v7dn9"
Jul 24 18:45:06.786492 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:06.786441    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/9ad26be1-409e-4984-bd03-27cfb042295c-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-78qd9\" (UID: \"9ad26be1-409e-4984-bd03-27cfb042295c\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-78qd9"
Jul 24 18:45:06.786492 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:06.786462    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f25db79a-9718-421d-97f4-bc040556fc3e-node-exporter-tls\") pod \"node-exporter-dftc9\" (UID: \"f25db79a-9718-421d-97f4-bc040556fc3e\") " pod="openshift-monitoring/node-exporter-dftc9"
Jul 24 18:45:06.786492 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:06.786487    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/593fff4b-38a9-42cc-b954-d3293c0155b0-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-v7dn9\" (UID: \"593fff4b-38a9-42cc-b954-d3293c0155b0\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-v7dn9"
Jul 24 18:45:06.786856 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:06.786514    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f25db79a-9718-421d-97f4-bc040556fc3e-sys\") pod \"node-exporter-dftc9\" (UID: \"f25db79a-9718-421d-97f4-bc040556fc3e\") " pod="openshift-monitoring/node-exporter-dftc9"
Jul 24 18:45:06.868491 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:06.868456    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:45:06.887618 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:06.887582    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f25db79a-9718-421d-97f4-bc040556fc3e-node-exporter-tls\") pod \"node-exporter-dftc9\" (UID: \"f25db79a-9718-421d-97f4-bc040556fc3e\") " pod="openshift-monitoring/node-exporter-dftc9"
Jul 24 18:45:06.887807 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:06.887634    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/593fff4b-38a9-42cc-b954-d3293c0155b0-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-v7dn9\" (UID: \"593fff4b-38a9-42cc-b954-d3293c0155b0\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-v7dn9"
Jul 24 18:45:06.887807 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:06.887672    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f25db79a-9718-421d-97f4-bc040556fc3e-sys\") pod \"node-exporter-dftc9\" (UID: \"f25db79a-9718-421d-97f4-bc040556fc3e\") " pod="openshift-monitoring/node-exporter-dftc9"
Jul 24 18:45:06.887807 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:06.887701    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/593fff4b-38a9-42cc-b954-d3293c0155b0-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-v7dn9\" (UID: \"593fff4b-38a9-42cc-b954-d3293c0155b0\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-v7dn9"
Jul 24 18:45:06.887807 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:06.887755    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9ad26be1-409e-4984-bd03-27cfb042295c-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-78qd9\" (UID: \"9ad26be1-409e-4984-bd03-27cfb042295c\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-78qd9"
Jul 24 18:45:06.887807 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:06.887785    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f25db79a-9718-421d-97f4-bc040556fc3e-node-exporter-textfile\") pod \"node-exporter-dftc9\" (UID: \"f25db79a-9718-421d-97f4-bc040556fc3e\") " pod="openshift-monitoring/node-exporter-dftc9"
Jul 24 18:45:06.888061 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:06.887804    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f25db79a-9718-421d-97f4-bc040556fc3e-sys\") pod \"node-exporter-dftc9\" (UID: \"f25db79a-9718-421d-97f4-bc040556fc3e\") " pod="openshift-monitoring/node-exporter-dftc9"
Jul 24 18:45:06.888061 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:06.887811    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f25db79a-9718-421d-97f4-bc040556fc3e-node-exporter-wtmp\") pod \"node-exporter-dftc9\" (UID: \"f25db79a-9718-421d-97f4-bc040556fc3e\") " pod="openshift-monitoring/node-exporter-dftc9"
Jul 24 18:45:06.888061 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:06.887869    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9ad26be1-409e-4984-bd03-27cfb042295c-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-78qd9\" (UID: \"9ad26be1-409e-4984-bd03-27cfb042295c\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-78qd9"
Jul 24 18:45:06.888061 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:06.887923    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f25db79a-9718-421d-97f4-bc040556fc3e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-dftc9\" (UID: \"f25db79a-9718-421d-97f4-bc040556fc3e\") " pod="openshift-monitoring/node-exporter-dftc9"
Jul 24 18:45:06.888061 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:06.887953    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f25db79a-9718-421d-97f4-bc040556fc3e-node-exporter-accelerators-collector-config\") pod \"node-exporter-dftc9\" (UID: \"f25db79a-9718-421d-97f4-bc040556fc3e\") " pod="openshift-monitoring/node-exporter-dftc9"
Jul 24 18:45:06.888061 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:06.887935    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f25db79a-9718-421d-97f4-bc040556fc3e-node-exporter-wtmp\") pod \"node-exporter-dftc9\" (UID: \"f25db79a-9718-421d-97f4-bc040556fc3e\") " pod="openshift-monitoring/node-exporter-dftc9"
Jul 24 18:45:06.888061 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:06.887987    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9ad26be1-409e-4984-bd03-27cfb042295c-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-78qd9\" (UID: \"9ad26be1-409e-4984-bd03-27cfb042295c\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-78qd9"
Jul 24 18:45:06.888061 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:06.888017    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-spt68\" (UniqueName: \"kubernetes.io/projected/9ad26be1-409e-4984-bd03-27cfb042295c-kube-api-access-spt68\") pod \"kube-state-metrics-56d9f944b4-78qd9\" (UID: \"9ad26be1-409e-4984-bd03-27cfb042295c\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-78qd9"
Jul 24 18:45:06.888061 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:06.888064    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lx5b7\" (UniqueName: \"kubernetes.io/projected/593fff4b-38a9-42cc-b954-d3293c0155b0-kube-api-access-lx5b7\") pod \"openshift-state-metrics-b8f49f5c6-v7dn9\" (UID: \"593fff4b-38a9-42cc-b954-d3293c0155b0\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-v7dn9"
Jul 24 18:45:06.888550 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:06.888093    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f25db79a-9718-421d-97f4-bc040556fc3e-metrics-client-ca\") pod \"node-exporter-dftc9\" (UID: \"f25db79a-9718-421d-97f4-bc040556fc3e\") " pod="openshift-monitoring/node-exporter-dftc9"
Jul 24 18:45:06.888550 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:06.888140    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f25db79a-9718-421d-97f4-bc040556fc3e-root\") pod \"node-exporter-dftc9\" (UID: \"f25db79a-9718-421d-97f4-bc040556fc3e\") " pod="openshift-monitoring/node-exporter-dftc9"
Jul 24 18:45:06.888550 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:06.888165    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ttt4t\" (UniqueName: \"kubernetes.io/projected/f25db79a-9718-421d-97f4-bc040556fc3e-kube-api-access-ttt4t\") pod \"node-exporter-dftc9\" (UID: \"f25db79a-9718-421d-97f4-bc040556fc3e\") " pod="openshift-monitoring/node-exporter-dftc9"
Jul 24 18:45:06.888550 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:06.888191    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/9ad26be1-409e-4984-bd03-27cfb042295c-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-78qd9\" (UID: \"9ad26be1-409e-4984-bd03-27cfb042295c\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-78qd9"
Jul 24 18:45:06.888550 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:06.888227    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/593fff4b-38a9-42cc-b954-d3293c0155b0-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-v7dn9\" (UID: \"593fff4b-38a9-42cc-b954-d3293c0155b0\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-v7dn9"
Jul 24 18:45:06.888550 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:06.888255    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/9ad26be1-409e-4984-bd03-27cfb042295c-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-78qd9\" (UID: \"9ad26be1-409e-4984-bd03-27cfb042295c\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-78qd9"
Jul 24 18:45:06.888550 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:06.888322    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f25db79a-9718-421d-97f4-bc040556fc3e-node-exporter-textfile\") pod \"node-exporter-dftc9\" (UID: \"f25db79a-9718-421d-97f4-bc040556fc3e\") " pod="openshift-monitoring/node-exporter-dftc9"
Jul 24 18:45:06.888550 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:06.888412    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/593fff4b-38a9-42cc-b954-d3293c0155b0-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-v7dn9\" (UID: \"593fff4b-38a9-42cc-b954-d3293c0155b0\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-v7dn9"
Jul 24 18:45:06.889160 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:06.888933    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/9ad26be1-409e-4984-bd03-27cfb042295c-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-78qd9\" (UID: \"9ad26be1-409e-4984-bd03-27cfb042295c\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-78qd9"
Jul 24 18:45:06.889393 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:06.889369    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9ad26be1-409e-4984-bd03-27cfb042295c-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-78qd9\" (UID: \"9ad26be1-409e-4984-bd03-27cfb042295c\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-78qd9"
Jul 24 18:45:06.889503 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:06.889478    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/9ad26be1-409e-4984-bd03-27cfb042295c-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-78qd9\" (UID: \"9ad26be1-409e-4984-bd03-27cfb042295c\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-78qd9"
Jul 24 18:45:06.890410 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:06.889886    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f25db79a-9718-421d-97f4-bc040556fc3e-metrics-client-ca\") pod \"node-exporter-dftc9\" (UID: \"f25db79a-9718-421d-97f4-bc040556fc3e\") " pod="openshift-monitoring/node-exporter-dftc9"
Jul 24 18:45:06.890410 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:06.890114    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f25db79a-9718-421d-97f4-bc040556fc3e-root\") pod \"node-exporter-dftc9\" (UID: \"f25db79a-9718-421d-97f4-bc040556fc3e\") " pod="openshift-monitoring/node-exporter-dftc9"
Jul 24 18:45:06.890976 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:06.890929    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f25db79a-9718-421d-97f4-bc040556fc3e-node-exporter-tls\") pod \"node-exporter-dftc9\" (UID: \"f25db79a-9718-421d-97f4-bc040556fc3e\") " pod="openshift-monitoring/node-exporter-dftc9"
Jul 24 18:45:06.891257 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:06.891233    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9ad26be1-409e-4984-bd03-27cfb042295c-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-78qd9\" (UID: \"9ad26be1-409e-4984-bd03-27cfb042295c\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-78qd9"
Jul 24 18:45:06.891710 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:06.891673    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/593fff4b-38a9-42cc-b954-d3293c0155b0-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-v7dn9\" (UID: \"593fff4b-38a9-42cc-b954-d3293c0155b0\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-v7dn9"
Jul 24 18:45:06.892045 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:06.890556    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f25db79a-9718-421d-97f4-bc040556fc3e-node-exporter-accelerators-collector-config\") pod \"node-exporter-dftc9\" (UID: \"f25db79a-9718-421d-97f4-bc040556fc3e\") " pod="openshift-monitoring/node-exporter-dftc9"
Jul 24 18:45:06.892708 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:06.892685    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f25db79a-9718-421d-97f4-bc040556fc3e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-dftc9\" (UID: \"f25db79a-9718-421d-97f4-bc040556fc3e\") " pod="openshift-monitoring/node-exporter-dftc9"
Jul 24 18:45:06.892814 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:06.892725    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/593fff4b-38a9-42cc-b954-d3293c0155b0-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-v7dn9\" (UID: \"593fff4b-38a9-42cc-b954-d3293c0155b0\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-v7dn9"
Jul 24 18:45:06.893168 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:06.893151    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9ad26be1-409e-4984-bd03-27cfb042295c-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-78qd9\" (UID: \"9ad26be1-409e-4984-bd03-27cfb042295c\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-78qd9"
Jul 24 18:45:06.897413 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:06.897390    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ttt4t\" (UniqueName: \"kubernetes.io/projected/f25db79a-9718-421d-97f4-bc040556fc3e-kube-api-access-ttt4t\") pod \"node-exporter-dftc9\" (UID: \"f25db79a-9718-421d-97f4-bc040556fc3e\") " pod="openshift-monitoring/node-exporter-dftc9"
Jul 24 18:45:06.897703 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:06.897680    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-spt68\" (UniqueName: \"kubernetes.io/projected/9ad26be1-409e-4984-bd03-27cfb042295c-kube-api-access-spt68\") pod \"kube-state-metrics-56d9f944b4-78qd9\" (UID: \"9ad26be1-409e-4984-bd03-27cfb042295c\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-78qd9"
Jul 24 18:45:06.897841 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:06.897824    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lx5b7\" (UniqueName: \"kubernetes.io/projected/593fff4b-38a9-42cc-b954-d3293c0155b0-kube-api-access-lx5b7\") pod \"openshift-state-metrics-b8f49f5c6-v7dn9\" (UID: \"593fff4b-38a9-42cc-b954-d3293c0155b0\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-v7dn9"
Jul 24 18:45:06.969724 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:06.969688    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:45:06.998261 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:06.998220    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-v7dn9"
Jul 24 18:45:07.020983 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:07.020940    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-dftc9"
Jul 24 18:45:07.030844 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:07.030815    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-78qd9"
Jul 24 18:45:07.072084 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:07.072043    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:45:07.184141 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:07.184085    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:45:07.412780 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:45:07.412748    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf25db79a_9718_421d_97f4_bc040556fc3e.slice/crio-ccc07a9928316a1402f00123b94196bc6bd7298c72845e62c37a8d589e0a259e WatchSource:0}: Error finding container ccc07a9928316a1402f00123b94196bc6bd7298c72845e62c37a8d589e0a259e: Status 404 returned error can't find the container with id ccc07a9928316a1402f00123b94196bc6bd7298c72845e62c37a8d589e0a259e
Jul 24 18:45:07.485116 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:07.485085    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dftc9" event={"ID":"f25db79a-9718-421d-97f4-bc040556fc3e","Type":"ContainerStarted","Data":"ccc07a9928316a1402f00123b94196bc6bd7298c72845e62c37a8d589e0a259e"}
Jul 24 18:45:07.557534 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:07.557507    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-78qd9"]
Jul 24 18:45:07.559724 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:45:07.559700    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ad26be1_409e_4984_bd03_27cfb042295c.slice/crio-2129e3f2809c4674327e42aded85f8f4f5b52fd354093cb821e5f9c8fbb2589a WatchSource:0}: Error finding container 2129e3f2809c4674327e42aded85f8f4f5b52fd354093cb821e5f9c8fbb2589a: Status 404 returned error can't find the container with id 2129e3f2809c4674327e42aded85f8f4f5b52fd354093cb821e5f9c8fbb2589a
Jul 24 18:45:07.573664 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:07.573631    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-v7dn9"]
Jul 24 18:45:07.577592 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:45:07.577565    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod593fff4b_38a9_42cc_b954_d3293c0155b0.slice/crio-bdc081fb949065a224f83bb32d1563ddb88790fd6f3fc4f11531f0b880b4265d WatchSource:0}: Error finding container bdc081fb949065a224f83bb32d1563ddb88790fd6f3fc4f11531f0b880b4265d: Status 404 returned error can't find the container with id bdc081fb949065a224f83bb32d1563ddb88790fd6f3fc4f11531f0b880b4265d
Jul 24 18:45:07.666174 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:07.666060    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:45:07.749572 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:07.749540    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:45:07.755462 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:07.755435    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 24 18:45:07.758163 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:07.758112    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 24 18:45:07.761401 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:07.761380    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 24 18:45:07.761519 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:07.761501    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 24 18:45:07.761753 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:07.761739    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 24 18:45:07.761824 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:07.761809    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 24 18:45:07.762019 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:07.762008    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-8mvng\""
Jul 24 18:45:07.762076 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:07.762064    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 24 18:45:07.762244 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:07.762223    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 24 18:45:07.762353 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:07.762247    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 24 18:45:07.762414 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:07.762381    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 24 18:45:07.762595 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:07.762580    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 24 18:45:07.774745 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:07.774724    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 24 18:45:07.797449 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:07.797417    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a5734963-fe7d-4673-8539-3dcb1afcb68c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"a5734963-fe7d-4673-8539-3dcb1afcb68c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 18:45:07.797449 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:07.797451    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a5734963-fe7d-4673-8539-3dcb1afcb68c-config-volume\") pod \"alertmanager-main-0\" (UID: \"a5734963-fe7d-4673-8539-3dcb1afcb68c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 18:45:07.797635 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:07.797485    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a5734963-fe7d-4673-8539-3dcb1afcb68c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"a5734963-fe7d-4673-8539-3dcb1afcb68c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 18:45:07.797635 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:07.797507    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a5734963-fe7d-4673-8539-3dcb1afcb68c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"a5734963-fe7d-4673-8539-3dcb1afcb68c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 18:45:07.797635 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:07.797545    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a5734963-fe7d-4673-8539-3dcb1afcb68c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"a5734963-fe7d-4673-8539-3dcb1afcb68c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 18:45:07.797635 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:07.797563    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a5734963-fe7d-4673-8539-3dcb1afcb68c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"a5734963-fe7d-4673-8539-3dcb1afcb68c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 18:45:07.797635 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:07.797585    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a5734963-fe7d-4673-8539-3dcb1afcb68c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"a5734963-fe7d-4673-8539-3dcb1afcb68c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 18:45:07.797635 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:07.797606    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a5734963-fe7d-4673-8539-3dcb1afcb68c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"a5734963-fe7d-4673-8539-3dcb1afcb68c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 18:45:07.797848 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:07.797671    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2hqz8\" (UniqueName: \"kubernetes.io/projected/a5734963-fe7d-4673-8539-3dcb1afcb68c-kube-api-access-2hqz8\") pod \"alertmanager-main-0\" (UID: \"a5734963-fe7d-4673-8539-3dcb1afcb68c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 18:45:07.797848 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:07.797705    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a5734963-fe7d-4673-8539-3dcb1afcb68c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"a5734963-fe7d-4673-8539-3dcb1afcb68c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 18:45:07.797848 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:07.797746    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a5734963-fe7d-4673-8539-3dcb1afcb68c-config-out\") pod \"alertmanager-main-0\" (UID: \"a5734963-fe7d-4673-8539-3dcb1afcb68c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 18:45:07.797848 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:07.797760    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a5734963-fe7d-4673-8539-3dcb1afcb68c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"a5734963-fe7d-4673-8539-3dcb1afcb68c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 18:45:07.797848 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:07.797775    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a5734963-fe7d-4673-8539-3dcb1afcb68c-web-config\") pod \"alertmanager-main-0\" (UID: \"a5734963-fe7d-4673-8539-3dcb1afcb68c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 18:45:07.899112 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:07.899079    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2hqz8\" (UniqueName: \"kubernetes.io/projected/a5734963-fe7d-4673-8539-3dcb1afcb68c-kube-api-access-2hqz8\") pod \"alertmanager-main-0\" (UID: \"a5734963-fe7d-4673-8539-3dcb1afcb68c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 18:45:07.899286 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:07.899167    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a5734963-fe7d-4673-8539-3dcb1afcb68c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"a5734963-fe7d-4673-8539-3dcb1afcb68c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 18:45:07.899286 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:07.899196    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a5734963-fe7d-4673-8539-3dcb1afcb68c-config-out\") pod \"alertmanager-main-0\" (UID: \"a5734963-fe7d-4673-8539-3dcb1afcb68c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 18:45:07.899286 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:07.899219    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a5734963-fe7d-4673-8539-3dcb1afcb68c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"a5734963-fe7d-4673-8539-3dcb1afcb68c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 18:45:07.899286 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:07.899241    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a5734963-fe7d-4673-8539-3dcb1afcb68c-web-config\") pod \"alertmanager-main-0\" (UID: \"a5734963-fe7d-4673-8539-3dcb1afcb68c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 18:45:07.899286 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:07.899262    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a5734963-fe7d-4673-8539-3dcb1afcb68c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"a5734963-fe7d-4673-8539-3dcb1afcb68c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 18:45:07.899286 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:07.899284    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a5734963-fe7d-4673-8539-3dcb1afcb68c-config-volume\") pod \"alertmanager-main-0\" (UID: \"a5734963-fe7d-4673-8539-3dcb1afcb68c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 18:45:07.899561 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:07.899413    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a5734963-fe7d-4673-8539-3dcb1afcb68c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"a5734963-fe7d-4673-8539-3dcb1afcb68c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 18:45:07.899561 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:07.899454    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a5734963-fe7d-4673-8539-3dcb1afcb68c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"a5734963-fe7d-4673-8539-3dcb1afcb68c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 18:45:07.899561 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:07.899506    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a5734963-fe7d-4673-8539-3dcb1afcb68c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"a5734963-fe7d-4673-8539-3dcb1afcb68c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 18:45:07.899561 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:07.899530    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a5734963-fe7d-4673-8539-3dcb1afcb68c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"a5734963-fe7d-4673-8539-3dcb1afcb68c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 18:45:07.899770 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:07.899569    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a5734963-fe7d-4673-8539-3dcb1afcb68c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"a5734963-fe7d-4673-8539-3dcb1afcb68c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 18:45:07.899770 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:07.899620    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a5734963-fe7d-4673-8539-3dcb1afcb68c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"a5734963-fe7d-4673-8539-3dcb1afcb68c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 18:45:07.901174 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:07.900630    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a5734963-fe7d-4673-8539-3dcb1afcb68c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"a5734963-fe7d-4673-8539-3dcb1afcb68c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 18:45:07.901174 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:07.900810    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a5734963-fe7d-4673-8539-3dcb1afcb68c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"a5734963-fe7d-4673-8539-3dcb1afcb68c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 18:45:07.901589 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:07.901559    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a5734963-fe7d-4673-8539-3dcb1afcb68c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"a5734963-fe7d-4673-8539-3dcb1afcb68c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 18:45:07.902296 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:07.902273    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a5734963-fe7d-4673-8539-3dcb1afcb68c-config-out\") pod \"alertmanager-main-0\" (UID: \"a5734963-fe7d-4673-8539-3dcb1afcb68c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 18:45:07.902619 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:07.902581    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a5734963-fe7d-4673-8539-3dcb1afcb68c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"a5734963-fe7d-4673-8539-3dcb1afcb68c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 18:45:07.902866 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:07.902843    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a5734963-fe7d-4673-8539-3dcb1afcb68c-config-volume\") pod \"alertmanager-main-0\" (UID: \"a5734963-fe7d-4673-8539-3dcb1afcb68c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 18:45:07.903371 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:07.903310    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a5734963-fe7d-4673-8539-3dcb1afcb68c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"a5734963-fe7d-4673-8539-3dcb1afcb68c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 18:45:07.903924 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:07.903902    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a5734963-fe7d-4673-8539-3dcb1afcb68c-web-config\") pod \"alertmanager-main-0\" (UID: \"a5734963-fe7d-4673-8539-3dcb1afcb68c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 18:45:07.904020 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:07.904003    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a5734963-fe7d-4673-8539-3dcb1afcb68c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"a5734963-fe7d-4673-8539-3dcb1afcb68c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 18:45:07.904164 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:07.904146    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a5734963-fe7d-4673-8539-3dcb1afcb68c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"a5734963-fe7d-4673-8539-3dcb1afcb68c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 18:45:07.904295 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:07.904245    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a5734963-fe7d-4673-8539-3dcb1afcb68c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"a5734963-fe7d-4673-8539-3dcb1afcb68c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 18:45:07.904360 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:07.904341    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a5734963-fe7d-4673-8539-3dcb1afcb68c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"a5734963-fe7d-4673-8539-3dcb1afcb68c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 18:45:07.908812 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:07.908786    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2hqz8\" (UniqueName: \"kubernetes.io/projected/a5734963-fe7d-4673-8539-3dcb1afcb68c-kube-api-access-2hqz8\") pod \"alertmanager-main-0\" (UID: \"a5734963-fe7d-4673-8539-3dcb1afcb68c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 24 18:45:07.981693 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:07.981656    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:45:08.070144 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:08.070087    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 24 18:45:08.083663 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:08.083614    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:45:08.232328 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:08.232303    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 24 18:45:08.234244 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:45:08.234210    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5734963_fe7d_4673_8539_3dcb1afcb68c.slice/crio-b5b7449d7b7929a6f148064a979c5dfdc006fac9f7734b160d0785809f9bc2b5 WatchSource:0}: Error finding container b5b7449d7b7929a6f148064a979c5dfdc006fac9f7734b160d0785809f9bc2b5: Status 404 returned error can't find the container with id b5b7449d7b7929a6f148064a979c5dfdc006fac9f7734b160d0785809f9bc2b5
Jul 24 18:45:08.448230 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:08.448202    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-q7dr8"
Jul 24 18:45:08.493970 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:08.493892    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dcckq" event={"ID":"0afd7f1b-febd-4ba1-aceb-b5cfd32f5ac9","Type":"ContainerStarted","Data":"0aa9c6d097f3062bf234e98c86e7afa5c109b6de0ae2a8aef6ef7abc834ee2c9"}
Jul 24 18:45:08.495627 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:08.495594    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-78qd9" event={"ID":"9ad26be1-409e-4984-bd03-27cfb042295c","Type":"ContainerStarted","Data":"2129e3f2809c4674327e42aded85f8f4f5b52fd354093cb821e5f9c8fbb2589a"}
Jul 24 18:45:08.497726 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:08.497696    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-v7dn9" event={"ID":"593fff4b-38a9-42cc-b954-d3293c0155b0","Type":"ContainerStarted","Data":"a738f2663f3d0f15681a6c0b40cda1b616e18baeab88209d7381af8b5f2da076"}
Jul 24 18:45:08.498052 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:08.497760    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-v7dn9" event={"ID":"593fff4b-38a9-42cc-b954-d3293c0155b0","Type":"ContainerStarted","Data":"bf28dab5166b34d64043b009e759a73b8caac4c9e575c31e5a0cca384e8114ee"}
Jul 24 18:45:08.498052 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:08.497789    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-v7dn9" event={"ID":"593fff4b-38a9-42cc-b954-d3293c0155b0","Type":"ContainerStarted","Data":"bdc081fb949065a224f83bb32d1563ddb88790fd6f3fc4f11531f0b880b4265d"}
Jul 24 18:45:08.499145 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:08.499092    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a5734963-fe7d-4673-8539-3dcb1afcb68c","Type":"ContainerStarted","Data":"b5b7449d7b7929a6f148064a979c5dfdc006fac9f7734b160d0785809f9bc2b5"}
Jul 24 18:45:08.517405 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:08.517353    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-dcckq" podStartSLOduration=2.483463743 podStartE2EDuration="18.517335097s" totalImagesPullingTime="16.033871354s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 18:44:50 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:45:08.516545342 +0000 UTC m=+63.725917386" watchObservedRunningTime="2026-07-24 18:45:08.517335097 +0000 UTC m=+63.726707155"
Jul 24 18:45:09.505379 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:09.505339    2580 generic.go:356] "Generic (PLEG): container finished" podID="f25db79a-9718-421d-97f4-bc040556fc3e" containerID="47a3226ae455bd2c73f94659c9dfe160a53d53406987b64190fb80e853faff29" exitCode=0
Jul 24 18:45:09.505840 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:09.505437    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dftc9" event={"ID":"f25db79a-9718-421d-97f4-bc040556fc3e","Type":"ContainerDied","Data":"47a3226ae455bd2c73f94659c9dfe160a53d53406987b64190fb80e853faff29"}
Jul 24 18:45:09.624066 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:09.624025    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:45:09.693966 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:09.693925    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:45:09.867721 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:09.867647    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:45:10.017796 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:10.017770    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:45:10.510228 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:10.510193    2580 generic.go:356] "Generic (PLEG): container finished" podID="a5734963-fe7d-4673-8539-3dcb1afcb68c" containerID="5bd91a819655230194e8dc48489e3673fa65d4b004b9b80caccceb2a3d76d1ae" exitCode=0
Jul 24 18:45:10.510688 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:10.510283    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a5734963-fe7d-4673-8539-3dcb1afcb68c","Type":"ContainerDied","Data":"5bd91a819655230194e8dc48489e3673fa65d4b004b9b80caccceb2a3d76d1ae"}
Jul 24 18:45:10.512723 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:10.512697    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dftc9" event={"ID":"f25db79a-9718-421d-97f4-bc040556fc3e","Type":"ContainerStarted","Data":"b4c5c9916125f75881e08f9e441c1d879f6b38a2be7cd0f13f4bdfc65b74027a"}
Jul 24 18:45:10.512830 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:10.512760    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dftc9" event={"ID":"f25db79a-9718-421d-97f4-bc040556fc3e","Type":"ContainerStarted","Data":"0085c67b66c5a37b4f2c13a775e138a1873d937dccf89bea49ce258071aaa276"}
Jul 24 18:45:10.514966 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:10.514943    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-78qd9" event={"ID":"9ad26be1-409e-4984-bd03-27cfb042295c","Type":"ContainerStarted","Data":"25986f4da7468fbc551377f28fc1e324a3606570a4245a7544bbd80e6cf8b86e"}
Jul 24 18:45:10.515076 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:10.515003    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-78qd9" event={"ID":"9ad26be1-409e-4984-bd03-27cfb042295c","Type":"ContainerStarted","Data":"7bb25c9f42dd083583edaf12b2a3148857767352601c843f253ec94eb62bcf3e"}
Jul 24 18:45:10.515076 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:10.515034    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-78qd9" event={"ID":"9ad26be1-409e-4984-bd03-27cfb042295c","Type":"ContainerStarted","Data":"653714203b877d9fd25c833c6a8f14c386c07ef3ef13ecd756111ff507ef3866"}
Jul 24 18:45:10.516996 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:10.516977    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-v7dn9" event={"ID":"593fff4b-38a9-42cc-b954-d3293c0155b0","Type":"ContainerStarted","Data":"cdad524199d337285a8524676d211dbf38970a836e97c76caef0a86032e6542b"}
Jul 24 18:45:10.556623 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:10.556566    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-78qd9" podStartSLOduration=2.368153234 podStartE2EDuration="4.556549626s" totalImagesPullingTime="2.188396392s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 18:45:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:45:10.555177446 +0000 UTC m=+65.764549500" watchObservedRunningTime="2026-07-24 18:45:10.556549626 +0000 UTC m=+65.765921669"
Jul 24 18:45:10.572266 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:10.572214    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-v7dn9" podStartSLOduration=2.523120951 podStartE2EDuration="4.572200408s" totalImagesPullingTime="2.049079457s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 18:45:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:45:10.571813654 +0000 UTC m=+65.781185730" watchObservedRunningTime="2026-07-24 18:45:10.572200408 +0000 UTC m=+65.781572451"
Jul 24 18:45:10.593325 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:10.593272    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-dftc9" podStartSLOduration=3.456953511 podStartE2EDuration="4.593258146s" totalImagesPullingTime="1.062622054s" totalInitContainerRuntime="73.682581ms" isStatefulPod=true podCreationTimestamp="2026-07-24 18:45:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:45:10.592851868 +0000 UTC m=+65.802223912" watchObservedRunningTime="2026-07-24 18:45:10.593258146 +0000 UTC m=+65.802630194"
Jul 24 18:45:10.664387 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:10.664347    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-57f6d765c6-m78cf"]
Jul 24 18:45:10.670536 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:10.670499    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-57f6d765c6-m78cf"
Jul 24 18:45:10.673432 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:10.673390    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 24 18:45:10.673432 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:10.673407    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-wl8c2\""
Jul 24 18:45:10.673432 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:10.673399    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 24 18:45:10.673675 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:10.673434    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 24 18:45:10.673675 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:10.673399    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 24 18:45:10.673675 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:10.673425    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 24 18:45:10.673675 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:10.673407    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-3o8ki6uiq5kb4\""
Jul 24 18:45:10.678671 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:10.678649    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-57f6d765c6-m78cf"]
Jul 24 18:45:10.728933 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:10.728888    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4e314077-64e7-4060-8771-8be311d2c8cf-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-57f6d765c6-m78cf\" (UID: \"4e314077-64e7-4060-8771-8be311d2c8cf\") " pod="openshift-monitoring/thanos-querier-57f6d765c6-m78cf"
Jul 24 18:45:10.728933 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:10.728930    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/4e314077-64e7-4060-8771-8be311d2c8cf-secret-thanos-querier-tls\") pod \"thanos-querier-57f6d765c6-m78cf\" (UID: \"4e314077-64e7-4060-8771-8be311d2c8cf\") " pod="openshift-monitoring/thanos-querier-57f6d765c6-m78cf"
Jul 24 18:45:10.729194 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:10.728953    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/4e314077-64e7-4060-8771-8be311d2c8cf-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-57f6d765c6-m78cf\" (UID: \"4e314077-64e7-4060-8771-8be311d2c8cf\") " pod="openshift-monitoring/thanos-querier-57f6d765c6-m78cf"
Jul 24 18:45:10.729194 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:10.728976    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x4qh9\" (UniqueName: \"kubernetes.io/projected/4e314077-64e7-4060-8771-8be311d2c8cf-kube-api-access-x4qh9\") pod \"thanos-querier-57f6d765c6-m78cf\" (UID: \"4e314077-64e7-4060-8771-8be311d2c8cf\") " pod="openshift-monitoring/thanos-querier-57f6d765c6-m78cf"
Jul 24 18:45:10.729194 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:10.729064    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4e314077-64e7-4060-8771-8be311d2c8cf-metrics-client-ca\") pod \"thanos-querier-57f6d765c6-m78cf\" (UID: \"4e314077-64e7-4060-8771-8be311d2c8cf\") " pod="openshift-monitoring/thanos-querier-57f6d765c6-m78cf"
Jul 24 18:45:10.729194 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:10.729105    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4e314077-64e7-4060-8771-8be311d2c8cf-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-57f6d765c6-m78cf\" (UID: \"4e314077-64e7-4060-8771-8be311d2c8cf\") " pod="openshift-monitoring/thanos-querier-57f6d765c6-m78cf"
Jul 24 18:45:10.729194 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:10.729189    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4e314077-64e7-4060-8771-8be311d2c8cf-secret-grpc-tls\") pod \"thanos-querier-57f6d765c6-m78cf\" (UID: \"4e314077-64e7-4060-8771-8be311d2c8cf\") " pod="openshift-monitoring/thanos-querier-57f6d765c6-m78cf"
Jul 24 18:45:10.729352 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:10.729241    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/4e314077-64e7-4060-8771-8be311d2c8cf-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-57f6d765c6-m78cf\" (UID: \"4e314077-64e7-4060-8771-8be311d2c8cf\") " pod="openshift-monitoring/thanos-querier-57f6d765c6-m78cf"
Jul 24 18:45:10.830254 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:10.830167    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4e314077-64e7-4060-8771-8be311d2c8cf-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-57f6d765c6-m78cf\" (UID: \"4e314077-64e7-4060-8771-8be311d2c8cf\") " pod="openshift-monitoring/thanos-querier-57f6d765c6-m78cf"
Jul 24 18:45:10.830254 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:10.830204    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/4e314077-64e7-4060-8771-8be311d2c8cf-secret-thanos-querier-tls\") pod \"thanos-querier-57f6d765c6-m78cf\" (UID: \"4e314077-64e7-4060-8771-8be311d2c8cf\") " pod="openshift-monitoring/thanos-querier-57f6d765c6-m78cf"
Jul 24 18:45:10.830254 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:10.830239    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/4e314077-64e7-4060-8771-8be311d2c8cf-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-57f6d765c6-m78cf\" (UID: \"4e314077-64e7-4060-8771-8be311d2c8cf\") " pod="openshift-monitoring/thanos-querier-57f6d765c6-m78cf"
Jul 24 18:45:10.830539 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:10.830272    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x4qh9\" (UniqueName: \"kubernetes.io/projected/4e314077-64e7-4060-8771-8be311d2c8cf-kube-api-access-x4qh9\") pod \"thanos-querier-57f6d765c6-m78cf\" (UID: \"4e314077-64e7-4060-8771-8be311d2c8cf\") " pod="openshift-monitoring/thanos-querier-57f6d765c6-m78cf"
Jul 24 18:45:10.830539 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:10.830310    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4e314077-64e7-4060-8771-8be311d2c8cf-metrics-client-ca\") pod \"thanos-querier-57f6d765c6-m78cf\" (UID: \"4e314077-64e7-4060-8771-8be311d2c8cf\") " pod="openshift-monitoring/thanos-querier-57f6d765c6-m78cf"
Jul 24 18:45:10.830539 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:10.830336    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4e314077-64e7-4060-8771-8be311d2c8cf-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-57f6d765c6-m78cf\" (UID: \"4e314077-64e7-4060-8771-8be311d2c8cf\") " pod="openshift-monitoring/thanos-querier-57f6d765c6-m78cf"
Jul 24 18:45:10.830539 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:10.830400    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4e314077-64e7-4060-8771-8be311d2c8cf-secret-grpc-tls\") pod \"thanos-querier-57f6d765c6-m78cf\" (UID: \"4e314077-64e7-4060-8771-8be311d2c8cf\") " pod="openshift-monitoring/thanos-querier-57f6d765c6-m78cf"
Jul 24 18:45:10.830539 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:10.830444    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/4e314077-64e7-4060-8771-8be311d2c8cf-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-57f6d765c6-m78cf\" (UID: \"4e314077-64e7-4060-8771-8be311d2c8cf\") " pod="openshift-monitoring/thanos-querier-57f6d765c6-m78cf"
Jul 24 18:45:10.831302 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:10.831276    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4e314077-64e7-4060-8771-8be311d2c8cf-metrics-client-ca\") pod \"thanos-querier-57f6d765c6-m78cf\" (UID: \"4e314077-64e7-4060-8771-8be311d2c8cf\") " pod="openshift-monitoring/thanos-querier-57f6d765c6-m78cf"
Jul 24 18:45:10.833090 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:10.833068    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4e314077-64e7-4060-8771-8be311d2c8cf-secret-grpc-tls\") pod \"thanos-querier-57f6d765c6-m78cf\" (UID: \"4e314077-64e7-4060-8771-8be311d2c8cf\") " pod="openshift-monitoring/thanos-querier-57f6d765c6-m78cf"
Jul 24 18:45:10.833277 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:10.833256    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/4e314077-64e7-4060-8771-8be311d2c8cf-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-57f6d765c6-m78cf\" (UID: \"4e314077-64e7-4060-8771-8be311d2c8cf\") " pod="openshift-monitoring/thanos-querier-57f6d765c6-m78cf"
Jul 24 18:45:10.833534 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:10.833509    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/4e314077-64e7-4060-8771-8be311d2c8cf-secret-thanos-querier-tls\") pod \"thanos-querier-57f6d765c6-m78cf\" (UID: \"4e314077-64e7-4060-8771-8be311d2c8cf\") " pod="openshift-monitoring/thanos-querier-57f6d765c6-m78cf"
Jul 24 18:45:10.833619 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:10.833565    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4e314077-64e7-4060-8771-8be311d2c8cf-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-57f6d765c6-m78cf\" (UID: \"4e314077-64e7-4060-8771-8be311d2c8cf\") " pod="openshift-monitoring/thanos-querier-57f6d765c6-m78cf"
Jul 24 18:45:10.833619 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:10.833603    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4e314077-64e7-4060-8771-8be311d2c8cf-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-57f6d765c6-m78cf\" (UID: \"4e314077-64e7-4060-8771-8be311d2c8cf\") " pod="openshift-monitoring/thanos-querier-57f6d765c6-m78cf"
Jul 24 18:45:10.833770 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:10.833751    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/4e314077-64e7-4060-8771-8be311d2c8cf-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-57f6d765c6-m78cf\" (UID: \"4e314077-64e7-4060-8771-8be311d2c8cf\") " pod="openshift-monitoring/thanos-querier-57f6d765c6-m78cf"
Jul 24 18:45:10.840014 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:10.839992    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x4qh9\" (UniqueName: \"kubernetes.io/projected/4e314077-64e7-4060-8771-8be311d2c8cf-kube-api-access-x4qh9\") pod \"thanos-querier-57f6d765c6-m78cf\" (UID: \"4e314077-64e7-4060-8771-8be311d2c8cf\") " pod="openshift-monitoring/thanos-querier-57f6d765c6-m78cf"
Jul 24 18:45:10.931467 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:10.931425    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-88k69\" (UniqueName: \"kubernetes.io/projected/d0cb8d6d-2dda-4fee-89ee-c7d163e5d80d-kube-api-access-88k69\") pod \"network-check-target-4722z\" (UID: \"d0cb8d6d-2dda-4fee-89ee-c7d163e5d80d\") " pod="openshift-network-diagnostics/network-check-target-4722z"
Jul 24 18:45:10.931618 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:10.931484    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/34b58fb0-dbc2-49de-86e2-4bd31bb3250a-metrics-certs\") pod \"network-metrics-daemon-nsc2s\" (UID: \"34b58fb0-dbc2-49de-86e2-4bd31bb3250a\") " pod="openshift-multus/network-metrics-daemon-nsc2s"
Jul 24 18:45:10.934751 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:10.934727    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 24 18:45:10.934846 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:10.934739    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 24 18:45:10.944932 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:10.944896    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/34b58fb0-dbc2-49de-86e2-4bd31bb3250a-metrics-certs\") pod \"network-metrics-daemon-nsc2s\" (UID: \"34b58fb0-dbc2-49de-86e2-4bd31bb3250a\") " pod="openshift-multus/network-metrics-daemon-nsc2s"
Jul 24 18:45:10.945177 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:10.945161    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 24 18:45:10.955436 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:10.955405    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-88k69\" (UniqueName: \"kubernetes.io/projected/d0cb8d6d-2dda-4fee-89ee-c7d163e5d80d-kube-api-access-88k69\") pod \"network-check-target-4722z\" (UID: \"d0cb8d6d-2dda-4fee-89ee-c7d163e5d80d\") " pod="openshift-network-diagnostics/network-check-target-4722z"
Jul 24 18:45:10.981265 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:10.981229    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-57f6d765c6-m78cf"
Jul 24 18:45:11.032399 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:11.032364    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/84828167-a9ed-4515-9976-e266991f89fb-original-pull-secret\") pod \"global-pull-secret-syncer-phl62\" (UID: \"84828167-a9ed-4515-9976-e266991f89fb\") " pod="kube-system/global-pull-secret-syncer-phl62"
Jul 24 18:45:11.035464 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:11.035437    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 24 18:45:11.045273 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:11.045245    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/84828167-a9ed-4515-9976-e266991f89fb-original-pull-secret\") pod \"global-pull-secret-syncer-phl62\" (UID: \"84828167-a9ed-4515-9976-e266991f89fb\") " pod="kube-system/global-pull-secret-syncer-phl62"
Jul 24 18:45:11.053037 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:11.053011    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-96zrd\""
Jul 24 18:45:11.057715 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:11.057692    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-6w7xn\""
Jul 24 18:45:11.060932 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:11.060911    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nsc2s"
Jul 24 18:45:11.065170 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:11.065150    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4722z"
Jul 24 18:45:11.150161 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:11.149911    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-phl62"
Jul 24 18:45:11.170459 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:11.170432    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-57f6d765c6-m78cf"]
Jul 24 18:45:11.172916 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:45:11.172882    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e314077_64e7_4060_8771_8be311d2c8cf.slice/crio-1569852ce07277ba508cd0efe30bd72c4e03fc2f1ed37ce02091e3c14e2c9506 WatchSource:0}: Error finding container 1569852ce07277ba508cd0efe30bd72c4e03fc2f1ed37ce02091e3c14e2c9506: Status 404 returned error can't find the container with id 1569852ce07277ba508cd0efe30bd72c4e03fc2f1ed37ce02091e3c14e2c9506
Jul 24 18:45:11.196175 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:11.195653    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-75bddf7487-kzzkh"]
Jul 24 18:45:11.197997 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:11.197882    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:45:11.231179 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:11.230372    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-75bddf7487-kzzkh"]
Jul 24 18:45:11.231179 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:11.230523    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-75bddf7487-kzzkh"
Jul 24 18:45:11.235071 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:11.235045    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 24 18:45:11.235364 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:11.235345    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 24 18:45:11.235584 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:11.235350    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 24 18:45:11.236206 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:11.235790    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 24 18:45:11.236206 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:11.235805    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-qma3a667ssit\""
Jul 24 18:45:11.236206 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:11.235977    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-jxw76\""
Jul 24 18:45:11.254547 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:11.254462    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-nsc2s"]
Jul 24 18:45:11.256894 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:45:11.256855    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34b58fb0_dbc2_49de_86e2_4bd31bb3250a.slice/crio-b204cd8373d7c355419d8f0554ad262ab948e6b69262f8af3ae8dde948cc97ed WatchSource:0}: Error finding container b204cd8373d7c355419d8f0554ad262ab948e6b69262f8af3ae8dde948cc97ed: Status 404 returned error can't find the container with id b204cd8373d7c355419d8f0554ad262ab948e6b69262f8af3ae8dde948cc97ed
Jul 24 18:45:11.293234 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:11.292943    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-4722z"]
Jul 24 18:45:11.299404 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:11.297623    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:45:11.302495 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:45:11.302460    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0cb8d6d_2dda_4fee_89ee_c7d163e5d80d.slice/crio-9e190cb906d38ccad9991c958e135a61f90d9319c5950df8607801b07601a74a WatchSource:0}: Error finding container 9e190cb906d38ccad9991c958e135a61f90d9319c5950df8607801b07601a74a: Status 404 returned error can't find the container with id 9e190cb906d38ccad9991c958e135a61f90d9319c5950df8607801b07601a74a
Jul 24 18:45:11.334832 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:11.334794    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/86c3e6d3-79ba-4283-9f3a-8dafa564a1ef-metrics-server-audit-profiles\") pod \"metrics-server-75bddf7487-kzzkh\" (UID: \"86c3e6d3-79ba-4283-9f3a-8dafa564a1ef\") " pod="openshift-monitoring/metrics-server-75bddf7487-kzzkh"
Jul 24 18:45:11.334832 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:11.334839    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/86c3e6d3-79ba-4283-9f3a-8dafa564a1ef-secret-metrics-server-tls\") pod \"metrics-server-75bddf7487-kzzkh\" (UID: \"86c3e6d3-79ba-4283-9f3a-8dafa564a1ef\") " pod="openshift-monitoring/metrics-server-75bddf7487-kzzkh"
Jul 24 18:45:11.335062 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:11.334901    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/86c3e6d3-79ba-4283-9f3a-8dafa564a1ef-audit-log\") pod \"metrics-server-75bddf7487-kzzkh\" (UID: \"86c3e6d3-79ba-4283-9f3a-8dafa564a1ef\") " pod="openshift-monitoring/metrics-server-75bddf7487-kzzkh"
Jul 24 18:45:11.335062 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:11.334973    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kbfjj\" (UniqueName: \"kubernetes.io/projected/86c3e6d3-79ba-4283-9f3a-8dafa564a1ef-kube-api-access-kbfjj\") pod \"metrics-server-75bddf7487-kzzkh\" (UID: \"86c3e6d3-79ba-4283-9f3a-8dafa564a1ef\") " pod="openshift-monitoring/metrics-server-75bddf7487-kzzkh"
Jul 24 18:45:11.335181 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:11.335059    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/86c3e6d3-79ba-4283-9f3a-8dafa564a1ef-secret-metrics-server-client-certs\") pod \"metrics-server-75bddf7487-kzzkh\" (UID: \"86c3e6d3-79ba-4283-9f3a-8dafa564a1ef\") " pod="openshift-monitoring/metrics-server-75bddf7487-kzzkh"
Jul 24 18:45:11.335181 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:11.335098    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/86c3e6d3-79ba-4283-9f3a-8dafa564a1ef-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-75bddf7487-kzzkh\" (UID: \"86c3e6d3-79ba-4283-9f3a-8dafa564a1ef\") " pod="openshift-monitoring/metrics-server-75bddf7487-kzzkh"
Jul 24 18:45:11.335280 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:11.335188    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/86c3e6d3-79ba-4283-9f3a-8dafa564a1ef-client-ca-bundle\") pod \"metrics-server-75bddf7487-kzzkh\" (UID: \"86c3e6d3-79ba-4283-9f3a-8dafa564a1ef\") " pod="openshift-monitoring/metrics-server-75bddf7487-kzzkh"
Jul 24 18:45:11.359381 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:11.359283    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-phl62"]
Jul 24 18:45:11.362586 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:45:11.362551    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84828167_a9ed_4515_9976_e266991f89fb.slice/crio-32b249d01097ca961b4c8140358ee7ded251cbf0047f9cf3300084d1bf58ebf3 WatchSource:0}: Error finding container 32b249d01097ca961b4c8140358ee7ded251cbf0047f9cf3300084d1bf58ebf3: Status 404 returned error can't find the container with id 32b249d01097ca961b4c8140358ee7ded251cbf0047f9cf3300084d1bf58ebf3
Jul 24 18:45:11.436380 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:11.436341    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/86c3e6d3-79ba-4283-9f3a-8dafa564a1ef-secret-metrics-server-client-certs\") pod \"metrics-server-75bddf7487-kzzkh\" (UID: \"86c3e6d3-79ba-4283-9f3a-8dafa564a1ef\") " pod="openshift-monitoring/metrics-server-75bddf7487-kzzkh"
Jul 24 18:45:11.436579 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:11.436404    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/86c3e6d3-79ba-4283-9f3a-8dafa564a1ef-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-75bddf7487-kzzkh\" (UID: \"86c3e6d3-79ba-4283-9f3a-8dafa564a1ef\") " pod="openshift-monitoring/metrics-server-75bddf7487-kzzkh"
Jul 24 18:45:11.436579 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:11.436437    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/86c3e6d3-79ba-4283-9f3a-8dafa564a1ef-client-ca-bundle\") pod \"metrics-server-75bddf7487-kzzkh\" (UID: \"86c3e6d3-79ba-4283-9f3a-8dafa564a1ef\") " pod="openshift-monitoring/metrics-server-75bddf7487-kzzkh"
Jul 24 18:45:11.436579 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:11.436474    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/86c3e6d3-79ba-4283-9f3a-8dafa564a1ef-metrics-server-audit-profiles\") pod \"metrics-server-75bddf7487-kzzkh\" (UID: \"86c3e6d3-79ba-4283-9f3a-8dafa564a1ef\") " pod="openshift-monitoring/metrics-server-75bddf7487-kzzkh"
Jul 24 18:45:11.436579 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:11.436499    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/86c3e6d3-79ba-4283-9f3a-8dafa564a1ef-secret-metrics-server-tls\") pod \"metrics-server-75bddf7487-kzzkh\" (UID: \"86c3e6d3-79ba-4283-9f3a-8dafa564a1ef\") " pod="openshift-monitoring/metrics-server-75bddf7487-kzzkh"
Jul 24 18:45:11.436579 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:11.436559    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/86c3e6d3-79ba-4283-9f3a-8dafa564a1ef-audit-log\") pod \"metrics-server-75bddf7487-kzzkh\" (UID: \"86c3e6d3-79ba-4283-9f3a-8dafa564a1ef\") " pod="openshift-monitoring/metrics-server-75bddf7487-kzzkh"
Jul 24 18:45:11.436833 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:11.436598    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kbfjj\" (UniqueName: \"kubernetes.io/projected/86c3e6d3-79ba-4283-9f3a-8dafa564a1ef-kube-api-access-kbfjj\") pod \"metrics-server-75bddf7487-kzzkh\" (UID: \"86c3e6d3-79ba-4283-9f3a-8dafa564a1ef\") " pod="openshift-monitoring/metrics-server-75bddf7487-kzzkh"
Jul 24 18:45:11.437382 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:11.437325    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/86c3e6d3-79ba-4283-9f3a-8dafa564a1ef-audit-log\") pod \"metrics-server-75bddf7487-kzzkh\" (UID: \"86c3e6d3-79ba-4283-9f3a-8dafa564a1ef\") " pod="openshift-monitoring/metrics-server-75bddf7487-kzzkh"
Jul 24 18:45:11.437879 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:11.437828    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/86c3e6d3-79ba-4283-9f3a-8dafa564a1ef-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-75bddf7487-kzzkh\" (UID: \"86c3e6d3-79ba-4283-9f3a-8dafa564a1ef\") " pod="openshift-monitoring/metrics-server-75bddf7487-kzzkh"
Jul 24 18:45:11.438449 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:11.438423    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/86c3e6d3-79ba-4283-9f3a-8dafa564a1ef-metrics-server-audit-profiles\") pod \"metrics-server-75bddf7487-kzzkh\" (UID: \"86c3e6d3-79ba-4283-9f3a-8dafa564a1ef\") " pod="openshift-monitoring/metrics-server-75bddf7487-kzzkh"
Jul 24 18:45:11.439581 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:11.439543    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/86c3e6d3-79ba-4283-9f3a-8dafa564a1ef-secret-metrics-server-tls\") pod \"metrics-server-75bddf7487-kzzkh\" (UID: \"86c3e6d3-79ba-4283-9f3a-8dafa564a1ef\") " pod="openshift-monitoring/metrics-server-75bddf7487-kzzkh"
Jul 24 18:45:11.439725 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:11.439704    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/86c3e6d3-79ba-4283-9f3a-8dafa564a1ef-secret-metrics-server-client-certs\") pod \"metrics-server-75bddf7487-kzzkh\" (UID: \"86c3e6d3-79ba-4283-9f3a-8dafa564a1ef\") " pod="openshift-monitoring/metrics-server-75bddf7487-kzzkh"
Jul 24 18:45:11.440092 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:11.440068    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/86c3e6d3-79ba-4283-9f3a-8dafa564a1ef-client-ca-bundle\") pod \"metrics-server-75bddf7487-kzzkh\" (UID: \"86c3e6d3-79ba-4283-9f3a-8dafa564a1ef\") " pod="openshift-monitoring/metrics-server-75bddf7487-kzzkh"
Jul 24 18:45:11.450373 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:11.450333    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kbfjj\" (UniqueName: \"kubernetes.io/projected/86c3e6d3-79ba-4283-9f3a-8dafa564a1ef-kube-api-access-kbfjj\") pod \"metrics-server-75bddf7487-kzzkh\" (UID: \"86c3e6d3-79ba-4283-9f3a-8dafa564a1ef\") " pod="openshift-monitoring/metrics-server-75bddf7487-kzzkh"
Jul 24 18:45:11.489078 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:11.489045    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6c6879d947-2zswz"]
Jul 24 18:45:11.496025 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:11.495978    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:45:11.515817 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:11.512418    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-lw567"]
Jul 24 18:45:11.515817 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:11.513854    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c6879d947-2zswz"
Jul 24 18:45:11.541246 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:11.541215    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-lw567"]
Jul 24 18:45:11.541418 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:11.541259    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6c6879d947-2zswz"]
Jul 24 18:45:11.541418 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:11.541287    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-nsc2s" event={"ID":"34b58fb0-dbc2-49de-86e2-4bd31bb3250a","Type":"ContainerStarted","Data":"b204cd8373d7c355419d8f0554ad262ab948e6b69262f8af3ae8dde948cc97ed"}
Jul 24 18:45:11.541418 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:11.541315    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-lw567"
Jul 24 18:45:11.541889 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:11.541856    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-57f6d765c6-m78cf" event={"ID":"4e314077-64e7-4060-8771-8be311d2c8cf","Type":"ContainerStarted","Data":"1569852ce07277ba508cd0efe30bd72c4e03fc2f1ed37ce02091e3c14e2c9506"}
Jul 24 18:45:11.543267 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:11.543229    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-phl62" event={"ID":"84828167-a9ed-4515-9976-e266991f89fb","Type":"ContainerStarted","Data":"32b249d01097ca961b4c8140358ee7ded251cbf0047f9cf3300084d1bf58ebf3"}
Jul 24 18:45:11.544331 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:11.544062    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 24 18:45:11.544331 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:11.544111    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-75bddf7487-kzzkh"
Jul 24 18:45:11.544488 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:11.544398    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-tdh4k\""
Jul 24 18:45:11.545045 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:11.545013    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-4722z" event={"ID":"d0cb8d6d-2dda-4fee-89ee-c7d163e5d80d","Type":"ContainerStarted","Data":"9e190cb906d38ccad9991c958e135a61f90d9319c5950df8607801b07601a74a"}
Jul 24 18:45:11.589379 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:11.589327    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:45:11.638834 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:11.638669    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5d36f00d-01ab-4493-84ee-597dca0e573d-console-oauth-config\") pod \"console-6c6879d947-2zswz\" (UID: \"5d36f00d-01ab-4493-84ee-597dca0e573d\") " pod="openshift-console/console-6c6879d947-2zswz"
Jul 24 18:45:11.638834 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:11.638730    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5d36f00d-01ab-4493-84ee-597dca0e573d-oauth-serving-cert\") pod \"console-6c6879d947-2zswz\" (UID: \"5d36f00d-01ab-4493-84ee-597dca0e573d\") " pod="openshift-console/console-6c6879d947-2zswz"
Jul 24 18:45:11.640700 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:11.639876    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5342146b-438b-4f6b-a0c1-31a44b1876b3-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-lw567\" (UID: \"5342146b-438b-4f6b-a0c1-31a44b1876b3\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-lw567"
Jul 24 18:45:11.640700 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:11.639956    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5d36f00d-01ab-4493-84ee-597dca0e573d-console-serving-cert\") pod \"console-6c6879d947-2zswz\" (UID: \"5d36f00d-01ab-4493-84ee-597dca0e573d\") " pod="openshift-console/console-6c6879d947-2zswz"
Jul 24 18:45:11.651915 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:11.651843    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5d36f00d-01ab-4493-84ee-597dca0e573d-trusted-ca-bundle\") pod \"console-6c6879d947-2zswz\" (UID: \"5d36f00d-01ab-4493-84ee-597dca0e573d\") " pod="openshift-console/console-6c6879d947-2zswz"
Jul 24 18:45:11.652104 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:11.651986    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5d36f00d-01ab-4493-84ee-597dca0e573d-console-config\") pod \"console-6c6879d947-2zswz\" (UID: \"5d36f00d-01ab-4493-84ee-597dca0e573d\") " pod="openshift-console/console-6c6879d947-2zswz"
Jul 24 18:45:11.652104 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:11.652047    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g765b\" (UniqueName: \"kubernetes.io/projected/5d36f00d-01ab-4493-84ee-597dca0e573d-kube-api-access-g765b\") pod \"console-6c6879d947-2zswz\" (UID: \"5d36f00d-01ab-4493-84ee-597dca0e573d\") " pod="openshift-console/console-6c6879d947-2zswz"
Jul 24 18:45:11.652104 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:11.652080    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qhvqf\" (UniqueName: \"kubernetes.io/projected/5342146b-438b-4f6b-a0c1-31a44b1876b3-kube-api-access-qhvqf\") pod \"monitoring-plugin-68b7fc9574-lw567\" (UID: \"5342146b-438b-4f6b-a0c1-31a44b1876b3\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-lw567"
Jul 24 18:45:11.652301 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:11.652216    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5d36f00d-01ab-4493-84ee-597dca0e573d-service-ca\") pod \"console-6c6879d947-2zswz\" (UID: \"5d36f00d-01ab-4493-84ee-597dca0e573d\") " pod="openshift-console/console-6c6879d947-2zswz"
Jul 24 18:45:11.730385 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:11.730350    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-75bddf7487-kzzkh"]
Jul 24 18:45:11.733843 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:45:11.733807    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86c3e6d3_79ba_4283_9f3a_8dafa564a1ef.slice/crio-eed76a53dabd72394482e7a549555b68f9a5417e08d3d4f7f7f1dd89a26e5702 WatchSource:0}: Error finding container eed76a53dabd72394482e7a549555b68f9a5417e08d3d4f7f7f1dd89a26e5702: Status 404 returned error can't find the container with id eed76a53dabd72394482e7a549555b68f9a5417e08d3d4f7f7f1dd89a26e5702
Jul 24 18:45:11.753429 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:11.753380    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5d36f00d-01ab-4493-84ee-597dca0e573d-console-oauth-config\") pod \"console-6c6879d947-2zswz\" (UID: \"5d36f00d-01ab-4493-84ee-597dca0e573d\") " pod="openshift-console/console-6c6879d947-2zswz"
Jul 24 18:45:11.753429 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:11.753435    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5d36f00d-01ab-4493-84ee-597dca0e573d-oauth-serving-cert\") pod \"console-6c6879d947-2zswz\" (UID: \"5d36f00d-01ab-4493-84ee-597dca0e573d\") " pod="openshift-console/console-6c6879d947-2zswz"
Jul 24 18:45:11.753719 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:11.753478    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5342146b-438b-4f6b-a0c1-31a44b1876b3-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-lw567\" (UID: \"5342146b-438b-4f6b-a0c1-31a44b1876b3\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-lw567"
Jul 24 18:45:11.753719 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:11.753511    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5d36f00d-01ab-4493-84ee-597dca0e573d-console-serving-cert\") pod \"console-6c6879d947-2zswz\" (UID: \"5d36f00d-01ab-4493-84ee-597dca0e573d\") " pod="openshift-console/console-6c6879d947-2zswz"
Jul 24 18:45:11.753719 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:11.753568    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5d36f00d-01ab-4493-84ee-597dca0e573d-trusted-ca-bundle\") pod \"console-6c6879d947-2zswz\" (UID: \"5d36f00d-01ab-4493-84ee-597dca0e573d\") " pod="openshift-console/console-6c6879d947-2zswz"
Jul 24 18:45:11.753719 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:11.753595    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5d36f00d-01ab-4493-84ee-597dca0e573d-console-config\") pod \"console-6c6879d947-2zswz\" (UID: \"5d36f00d-01ab-4493-84ee-597dca0e573d\") " pod="openshift-console/console-6c6879d947-2zswz"
Jul 24 18:45:11.753719 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:11.753630    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g765b\" (UniqueName: \"kubernetes.io/projected/5d36f00d-01ab-4493-84ee-597dca0e573d-kube-api-access-g765b\") pod \"console-6c6879d947-2zswz\" (UID: \"5d36f00d-01ab-4493-84ee-597dca0e573d\") " pod="openshift-console/console-6c6879d947-2zswz"
Jul 24 18:45:11.753719 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:11.753656    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qhvqf\" (UniqueName: \"kubernetes.io/projected/5342146b-438b-4f6b-a0c1-31a44b1876b3-kube-api-access-qhvqf\") pod \"monitoring-plugin-68b7fc9574-lw567\" (UID: \"5342146b-438b-4f6b-a0c1-31a44b1876b3\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-lw567"
Jul 24 18:45:11.753719 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:11.753688    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5d36f00d-01ab-4493-84ee-597dca0e573d-service-ca\") pod \"console-6c6879d947-2zswz\" (UID: \"5d36f00d-01ab-4493-84ee-597dca0e573d\") " pod="openshift-console/console-6c6879d947-2zswz"
Jul 24 18:45:11.754539 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:11.754483    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5d36f00d-01ab-4493-84ee-597dca0e573d-service-ca\") pod \"console-6c6879d947-2zswz\" (UID: \"5d36f00d-01ab-4493-84ee-597dca0e573d\") " pod="openshift-console/console-6c6879d947-2zswz"
Jul 24 18:45:11.754797 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:11.754766    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5d36f00d-01ab-4493-84ee-597dca0e573d-trusted-ca-bundle\") pod \"console-6c6879d947-2zswz\" (UID: \"5d36f00d-01ab-4493-84ee-597dca0e573d\") " pod="openshift-console/console-6c6879d947-2zswz"
Jul 24 18:45:11.755068 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:11.755048    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5d36f00d-01ab-4493-84ee-597dca0e573d-console-config\") pod \"console-6c6879d947-2zswz\" (UID: \"5d36f00d-01ab-4493-84ee-597dca0e573d\") " pod="openshift-console/console-6c6879d947-2zswz"
Jul 24 18:45:11.755593 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:11.755572    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5d36f00d-01ab-4493-84ee-597dca0e573d-oauth-serving-cert\") pod \"console-6c6879d947-2zswz\" (UID: \"5d36f00d-01ab-4493-84ee-597dca0e573d\") " pod="openshift-console/console-6c6879d947-2zswz"
Jul 24 18:45:11.756956 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:11.756933    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5d36f00d-01ab-4493-84ee-597dca0e573d-console-oauth-config\") pod \"console-6c6879d947-2zswz\" (UID: \"5d36f00d-01ab-4493-84ee-597dca0e573d\") " pod="openshift-console/console-6c6879d947-2zswz"
Jul 24 18:45:11.757098 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:11.757074    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5d36f00d-01ab-4493-84ee-597dca0e573d-console-serving-cert\") pod \"console-6c6879d947-2zswz\" (UID: \"5d36f00d-01ab-4493-84ee-597dca0e573d\") " pod="openshift-console/console-6c6879d947-2zswz"
Jul 24 18:45:11.757331 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:11.757251    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5342146b-438b-4f6b-a0c1-31a44b1876b3-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-lw567\" (UID: \"5342146b-438b-4f6b-a0c1-31a44b1876b3\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-lw567"
Jul 24 18:45:11.765737 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:11.765449    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g765b\" (UniqueName: \"kubernetes.io/projected/5d36f00d-01ab-4493-84ee-597dca0e573d-kube-api-access-g765b\") pod \"console-6c6879d947-2zswz\" (UID: \"5d36f00d-01ab-4493-84ee-597dca0e573d\") " pod="openshift-console/console-6c6879d947-2zswz"
Jul 24 18:45:11.765737 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:11.765667    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qhvqf\" (UniqueName: \"kubernetes.io/projected/5342146b-438b-4f6b-a0c1-31a44b1876b3-kube-api-access-qhvqf\") pod \"monitoring-plugin-68b7fc9574-lw567\" (UID: \"5342146b-438b-4f6b-a0c1-31a44b1876b3\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-lw567"
Jul 24 18:45:11.834501 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:11.834468    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c6879d947-2zswz"
Jul 24 18:45:11.853364 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:11.853334    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-lw567"
Jul 24 18:45:11.887332 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:11.886358    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-df6b5d4c4-fqzxv"]
Jul 24 18:45:11.920042 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:11.919740    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-df6b5d4c4-fqzxv"]
Jul 24 18:45:11.920042 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:11.919913    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-df6b5d4c4-fqzxv"
Jul 24 18:45:11.925503 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:11.924575    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-g6mfw\""
Jul 24 18:45:11.925503 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:11.925033    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jul 24 18:45:11.925503 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:11.925373    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jul 24 18:45:11.926537 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:11.925882    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jul 24 18:45:11.926537 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:11.926222    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jul 24 18:45:11.926537 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:11.926354    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jul 24 18:45:11.930951 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:11.930923    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jul 24 18:45:12.029939 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:12.028974    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6c6879d947-2zswz"]
Jul 24 18:45:12.058273 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:12.057952    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/14efd5e5-3db7-4b0c-9806-f9c4df42225d-telemeter-trusted-ca-bundle\") pod \"telemeter-client-df6b5d4c4-fqzxv\" (UID: \"14efd5e5-3db7-4b0c-9806-f9c4df42225d\") " pod="openshift-monitoring/telemeter-client-df6b5d4c4-fqzxv"
Jul 24 18:45:12.058273 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:12.058005    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/14efd5e5-3db7-4b0c-9806-f9c4df42225d-telemeter-client-tls\") pod \"telemeter-client-df6b5d4c4-fqzxv\" (UID: \"14efd5e5-3db7-4b0c-9806-f9c4df42225d\") " pod="openshift-monitoring/telemeter-client-df6b5d4c4-fqzxv"
Jul 24 18:45:12.058273 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:12.058047    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xz2m4\" (UniqueName: \"kubernetes.io/projected/14efd5e5-3db7-4b0c-9806-f9c4df42225d-kube-api-access-xz2m4\") pod \"telemeter-client-df6b5d4c4-fqzxv\" (UID: \"14efd5e5-3db7-4b0c-9806-f9c4df42225d\") " pod="openshift-monitoring/telemeter-client-df6b5d4c4-fqzxv"
Jul 24 18:45:12.058273 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:12.058083    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/14efd5e5-3db7-4b0c-9806-f9c4df42225d-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-df6b5d4c4-fqzxv\" (UID: \"14efd5e5-3db7-4b0c-9806-f9c4df42225d\") " pod="openshift-monitoring/telemeter-client-df6b5d4c4-fqzxv"
Jul 24 18:45:12.058273 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:12.058191    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/14efd5e5-3db7-4b0c-9806-f9c4df42225d-secret-telemeter-client\") pod \"telemeter-client-df6b5d4c4-fqzxv\" (UID: \"14efd5e5-3db7-4b0c-9806-f9c4df42225d\") " pod="openshift-monitoring/telemeter-client-df6b5d4c4-fqzxv"
Jul 24 18:45:12.058273 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:12.058302    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/14efd5e5-3db7-4b0c-9806-f9c4df42225d-federate-client-tls\") pod \"telemeter-client-df6b5d4c4-fqzxv\" (UID: \"14efd5e5-3db7-4b0c-9806-f9c4df42225d\") " pod="openshift-monitoring/telemeter-client-df6b5d4c4-fqzxv"
Jul 24 18:45:12.058755 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:12.058352    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/14efd5e5-3db7-4b0c-9806-f9c4df42225d-metrics-client-ca\") pod \"telemeter-client-df6b5d4c4-fqzxv\" (UID: \"14efd5e5-3db7-4b0c-9806-f9c4df42225d\") " pod="openshift-monitoring/telemeter-client-df6b5d4c4-fqzxv"
Jul 24 18:45:12.058755 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:12.058453    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/14efd5e5-3db7-4b0c-9806-f9c4df42225d-serving-certs-ca-bundle\") pod \"telemeter-client-df6b5d4c4-fqzxv\" (UID: \"14efd5e5-3db7-4b0c-9806-f9c4df42225d\") " pod="openshift-monitoring/telemeter-client-df6b5d4c4-fqzxv"
Jul 24 18:45:12.078183 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:12.078146    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-lw567"]
Jul 24 18:45:12.159302 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:12.159210    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/14efd5e5-3db7-4b0c-9806-f9c4df42225d-federate-client-tls\") pod \"telemeter-client-df6b5d4c4-fqzxv\" (UID: \"14efd5e5-3db7-4b0c-9806-f9c4df42225d\") " pod="openshift-monitoring/telemeter-client-df6b5d4c4-fqzxv"
Jul 24 18:45:12.159302 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:12.159263    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/14efd5e5-3db7-4b0c-9806-f9c4df42225d-metrics-client-ca\") pod \"telemeter-client-df6b5d4c4-fqzxv\" (UID: \"14efd5e5-3db7-4b0c-9806-f9c4df42225d\") " pod="openshift-monitoring/telemeter-client-df6b5d4c4-fqzxv"
Jul 24 18:45:12.159541 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:12.159305    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/14efd5e5-3db7-4b0c-9806-f9c4df42225d-serving-certs-ca-bundle\") pod \"telemeter-client-df6b5d4c4-fqzxv\" (UID: \"14efd5e5-3db7-4b0c-9806-f9c4df42225d\") " pod="openshift-monitoring/telemeter-client-df6b5d4c4-fqzxv"
Jul 24 18:45:12.159541 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:12.159335    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/14efd5e5-3db7-4b0c-9806-f9c4df42225d-telemeter-trusted-ca-bundle\") pod \"telemeter-client-df6b5d4c4-fqzxv\" (UID: \"14efd5e5-3db7-4b0c-9806-f9c4df42225d\") " pod="openshift-monitoring/telemeter-client-df6b5d4c4-fqzxv"
Jul 24 18:45:12.159541 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:12.159366    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/14efd5e5-3db7-4b0c-9806-f9c4df42225d-telemeter-client-tls\") pod \"telemeter-client-df6b5d4c4-fqzxv\" (UID: \"14efd5e5-3db7-4b0c-9806-f9c4df42225d\") " pod="openshift-monitoring/telemeter-client-df6b5d4c4-fqzxv"
Jul 24 18:45:12.159541 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:12.159398    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xz2m4\" (UniqueName: \"kubernetes.io/projected/14efd5e5-3db7-4b0c-9806-f9c4df42225d-kube-api-access-xz2m4\") pod \"telemeter-client-df6b5d4c4-fqzxv\" (UID: \"14efd5e5-3db7-4b0c-9806-f9c4df42225d\") " pod="openshift-monitoring/telemeter-client-df6b5d4c4-fqzxv"
Jul 24 18:45:12.159541 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:12.159431    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/14efd5e5-3db7-4b0c-9806-f9c4df42225d-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-df6b5d4c4-fqzxv\" (UID: \"14efd5e5-3db7-4b0c-9806-f9c4df42225d\") " pod="openshift-monitoring/telemeter-client-df6b5d4c4-fqzxv"
Jul 24 18:45:12.159541 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:12.159503    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/14efd5e5-3db7-4b0c-9806-f9c4df42225d-secret-telemeter-client\") pod \"telemeter-client-df6b5d4c4-fqzxv\" (UID: \"14efd5e5-3db7-4b0c-9806-f9c4df42225d\") " pod="openshift-monitoring/telemeter-client-df6b5d4c4-fqzxv"
Jul 24 18:45:12.160103 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:12.160072    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/14efd5e5-3db7-4b0c-9806-f9c4df42225d-serving-certs-ca-bundle\") pod \"telemeter-client-df6b5d4c4-fqzxv\" (UID: \"14efd5e5-3db7-4b0c-9806-f9c4df42225d\") " pod="openshift-monitoring/telemeter-client-df6b5d4c4-fqzxv"
Jul 24 18:45:12.161259 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:12.161234    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/14efd5e5-3db7-4b0c-9806-f9c4df42225d-metrics-client-ca\") pod \"telemeter-client-df6b5d4c4-fqzxv\" (UID: \"14efd5e5-3db7-4b0c-9806-f9c4df42225d\") " pod="openshift-monitoring/telemeter-client-df6b5d4c4-fqzxv"
Jul 24 18:45:12.162023 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:12.161986    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/14efd5e5-3db7-4b0c-9806-f9c4df42225d-telemeter-trusted-ca-bundle\") pod \"telemeter-client-df6b5d4c4-fqzxv\" (UID: \"14efd5e5-3db7-4b0c-9806-f9c4df42225d\") " pod="openshift-monitoring/telemeter-client-df6b5d4c4-fqzxv"
Jul 24 18:45:12.166453 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:12.166396    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/14efd5e5-3db7-4b0c-9806-f9c4df42225d-telemeter-client-tls\") pod \"telemeter-client-df6b5d4c4-fqzxv\" (UID: \"14efd5e5-3db7-4b0c-9806-f9c4df42225d\") " pod="openshift-monitoring/telemeter-client-df6b5d4c4-fqzxv"
Jul 24 18:45:12.167110 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:12.167084    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/14efd5e5-3db7-4b0c-9806-f9c4df42225d-secret-telemeter-client\") pod \"telemeter-client-df6b5d4c4-fqzxv\" (UID: \"14efd5e5-3db7-4b0c-9806-f9c4df42225d\") " pod="openshift-monitoring/telemeter-client-df6b5d4c4-fqzxv"
Jul 24 18:45:12.167911 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:12.167862    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/14efd5e5-3db7-4b0c-9806-f9c4df42225d-federate-client-tls\") pod \"telemeter-client-df6b5d4c4-fqzxv\" (UID: \"14efd5e5-3db7-4b0c-9806-f9c4df42225d\") " pod="openshift-monitoring/telemeter-client-df6b5d4c4-fqzxv"
Jul 24 18:45:12.168987 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:12.168936    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/14efd5e5-3db7-4b0c-9806-f9c4df42225d-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-df6b5d4c4-fqzxv\" (UID: \"14efd5e5-3db7-4b0c-9806-f9c4df42225d\") " pod="openshift-monitoring/telemeter-client-df6b5d4c4-fqzxv"
Jul 24 18:45:12.170511 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:12.170471    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xz2m4\" (UniqueName: \"kubernetes.io/projected/14efd5e5-3db7-4b0c-9806-f9c4df42225d-kube-api-access-xz2m4\") pod \"telemeter-client-df6b5d4c4-fqzxv\" (UID: \"14efd5e5-3db7-4b0c-9806-f9c4df42225d\") " pod="openshift-monitoring/telemeter-client-df6b5d4c4-fqzxv"
Jul 24 18:45:12.236811 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:12.236777    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-df6b5d4c4-fqzxv"
Jul 24 18:45:12.367910 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:12.367872    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:45:12.423545 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:12.423440    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6c848b7cd9-9vxgb"
Jul 24 18:45:12.430528 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:12.430493    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:45:12.552811 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:12.552771    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-75bddf7487-kzzkh" event={"ID":"86c3e6d3-79ba-4283-9f3a-8dafa564a1ef","Type":"ContainerStarted","Data":"eed76a53dabd72394482e7a549555b68f9a5417e08d3d4f7f7f1dd89a26e5702"}
Jul 24 18:45:12.605048 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:12.605014    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:45:12.660950 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:45:12.660915    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5342146b_438b_4f6b_a0c1_31a44b1876b3.slice/crio-519b1a6dcab6b29cc0a64b972ae85b406fc02329b5cf8d18a07a4cd81f1d6b0c WatchSource:0}: Error finding container 519b1a6dcab6b29cc0a64b972ae85b406fc02329b5cf8d18a07a4cd81f1d6b0c: Status 404 returned error can't find the container with id 519b1a6dcab6b29cc0a64b972ae85b406fc02329b5cf8d18a07a4cd81f1d6b0c
Jul 24 18:45:12.812847 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:12.812808    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:45:12.935009 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:12.934928    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:45:13.064762 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:13.062645    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 24 18:45:13.069184 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:13.069158    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 18:45:13.075975 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:13.075427    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 24 18:45:13.075975 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:13.075759    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-2mtgh\""
Jul 24 18:45:13.082671 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:13.076780    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 24 18:45:13.082671 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:13.077010    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-eurnt1bot06r1\""
Jul 24 18:45:13.082671 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:13.077306    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 24 18:45:13.082671 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:13.077504    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 24 18:45:13.082671 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:13.077692    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 24 18:45:13.082671 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:13.077898    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 24 18:45:13.082671 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:13.078156    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 24 18:45:13.082671 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:13.078340    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 24 18:45:13.082671 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:13.078557    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 24 18:45:13.082671 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:13.079581    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 24 18:45:13.089336 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:13.084170    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 24 18:45:13.089336 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:13.086463    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 24 18:45:13.089336 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:13.087352    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 24 18:45:13.111512 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:13.111454    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:45:13.114823 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:13.114796    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 24 18:45:13.120792 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:13.120509    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 24 18:45:13.172890 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:13.171953    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/50400a73-3915-44f6-af79-bc9425cb863f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"50400a73-3915-44f6-af79-bc9425cb863f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 18:45:13.172890 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:13.172010    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/50400a73-3915-44f6-af79-bc9425cb863f-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"50400a73-3915-44f6-af79-bc9425cb863f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 18:45:13.172890 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:13.172048    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/50400a73-3915-44f6-af79-bc9425cb863f-config\") pod \"prometheus-k8s-0\" (UID: \"50400a73-3915-44f6-af79-bc9425cb863f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 18:45:13.172890 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:13.172073    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/50400a73-3915-44f6-af79-bc9425cb863f-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"50400a73-3915-44f6-af79-bc9425cb863f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 18:45:13.172890 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:13.172110    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/50400a73-3915-44f6-af79-bc9425cb863f-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"50400a73-3915-44f6-af79-bc9425cb863f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 18:45:13.172890 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:13.172155    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/50400a73-3915-44f6-af79-bc9425cb863f-web-config\") pod \"prometheus-k8s-0\" (UID: \"50400a73-3915-44f6-af79-bc9425cb863f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 18:45:13.172890 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:13.172180    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/50400a73-3915-44f6-af79-bc9425cb863f-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"50400a73-3915-44f6-af79-bc9425cb863f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 18:45:13.172890 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:13.172218    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/50400a73-3915-44f6-af79-bc9425cb863f-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"50400a73-3915-44f6-af79-bc9425cb863f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 18:45:13.172890 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:13.172251    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/50400a73-3915-44f6-af79-bc9425cb863f-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"50400a73-3915-44f6-af79-bc9425cb863f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 18:45:13.172890 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:13.172289    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/50400a73-3915-44f6-af79-bc9425cb863f-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"50400a73-3915-44f6-af79-bc9425cb863f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 18:45:13.172890 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:13.172311    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/50400a73-3915-44f6-af79-bc9425cb863f-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"50400a73-3915-44f6-af79-bc9425cb863f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 18:45:13.172890 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:13.172342    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/50400a73-3915-44f6-af79-bc9425cb863f-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"50400a73-3915-44f6-af79-bc9425cb863f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 18:45:13.172890 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:13.172374    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/50400a73-3915-44f6-af79-bc9425cb863f-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"50400a73-3915-44f6-af79-bc9425cb863f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 18:45:13.172890 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:13.172419    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g6wqw\" (UniqueName: \"kubernetes.io/projected/50400a73-3915-44f6-af79-bc9425cb863f-kube-api-access-g6wqw\") pod \"prometheus-k8s-0\" (UID: \"50400a73-3915-44f6-af79-bc9425cb863f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 18:45:13.172890 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:13.172454    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/50400a73-3915-44f6-af79-bc9425cb863f-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"50400a73-3915-44f6-af79-bc9425cb863f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 18:45:13.172890 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:13.172508    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/50400a73-3915-44f6-af79-bc9425cb863f-config-out\") pod \"prometheus-k8s-0\" (UID: \"50400a73-3915-44f6-af79-bc9425cb863f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 18:45:13.173801 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:13.172532    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/50400a73-3915-44f6-af79-bc9425cb863f-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"50400a73-3915-44f6-af79-bc9425cb863f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 18:45:13.173801 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:13.172589    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/50400a73-3915-44f6-af79-bc9425cb863f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"50400a73-3915-44f6-af79-bc9425cb863f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 18:45:13.173801 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:13.172613    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/50400a73-3915-44f6-af79-bc9425cb863f-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"50400a73-3915-44f6-af79-bc9425cb863f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 18:45:13.173801 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:13.172643    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/50400a73-3915-44f6-af79-bc9425cb863f-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"50400a73-3915-44f6-af79-bc9425cb863f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 18:45:13.274998 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:13.273152    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/50400a73-3915-44f6-af79-bc9425cb863f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"50400a73-3915-44f6-af79-bc9425cb863f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 18:45:13.274998 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:13.273206    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/50400a73-3915-44f6-af79-bc9425cb863f-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"50400a73-3915-44f6-af79-bc9425cb863f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 18:45:13.274998 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:13.273231    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/50400a73-3915-44f6-af79-bc9425cb863f-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"50400a73-3915-44f6-af79-bc9425cb863f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 18:45:13.274998 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:13.273267    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/50400a73-3915-44f6-af79-bc9425cb863f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"50400a73-3915-44f6-af79-bc9425cb863f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 18:45:13.274998 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:13.273299    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/50400a73-3915-44f6-af79-bc9425cb863f-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"50400a73-3915-44f6-af79-bc9425cb863f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 18:45:13.274998 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:13.273336    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/50400a73-3915-44f6-af79-bc9425cb863f-config\") pod \"prometheus-k8s-0\" (UID: \"50400a73-3915-44f6-af79-bc9425cb863f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 18:45:13.274998 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:13.273359    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/50400a73-3915-44f6-af79-bc9425cb863f-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"50400a73-3915-44f6-af79-bc9425cb863f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 18:45:13.274998 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:13.273397    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/50400a73-3915-44f6-af79-bc9425cb863f-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"50400a73-3915-44f6-af79-bc9425cb863f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 18:45:13.274998 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:13.273421    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/50400a73-3915-44f6-af79-bc9425cb863f-web-config\") pod \"prometheus-k8s-0\" (UID: \"50400a73-3915-44f6-af79-bc9425cb863f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 18:45:13.274998 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:13.273445    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/50400a73-3915-44f6-af79-bc9425cb863f-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"50400a73-3915-44f6-af79-bc9425cb863f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 18:45:13.274998 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:13.273484    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/50400a73-3915-44f6-af79-bc9425cb863f-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"50400a73-3915-44f6-af79-bc9425cb863f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 18:45:13.274998 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:13.273516    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/50400a73-3915-44f6-af79-bc9425cb863f-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"50400a73-3915-44f6-af79-bc9425cb863f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 18:45:13.274998 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:13.273553    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/50400a73-3915-44f6-af79-bc9425cb863f-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"50400a73-3915-44f6-af79-bc9425cb863f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 18:45:13.274998 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:13.273577    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/50400a73-3915-44f6-af79-bc9425cb863f-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"50400a73-3915-44f6-af79-bc9425cb863f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 18:45:13.274998 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:13.273606    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/50400a73-3915-44f6-af79-bc9425cb863f-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"50400a73-3915-44f6-af79-bc9425cb863f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 18:45:13.274998 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:13.273650    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/50400a73-3915-44f6-af79-bc9425cb863f-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"50400a73-3915-44f6-af79-bc9425cb863f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 18:45:13.274998 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:13.273695    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g6wqw\" (UniqueName: \"kubernetes.io/projected/50400a73-3915-44f6-af79-bc9425cb863f-kube-api-access-g6wqw\") pod \"prometheus-k8s-0\" (UID: \"50400a73-3915-44f6-af79-bc9425cb863f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 18:45:13.276008 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:13.273733    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/50400a73-3915-44f6-af79-bc9425cb863f-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"50400a73-3915-44f6-af79-bc9425cb863f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 18:45:13.276008 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:13.273786    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/50400a73-3915-44f6-af79-bc9425cb863f-config-out\") pod \"prometheus-k8s-0\" (UID: \"50400a73-3915-44f6-af79-bc9425cb863f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 18:45:13.276008 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:13.273809    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/50400a73-3915-44f6-af79-bc9425cb863f-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"50400a73-3915-44f6-af79-bc9425cb863f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 18:45:13.276008 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:13.274292    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/50400a73-3915-44f6-af79-bc9425cb863f-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"50400a73-3915-44f6-af79-bc9425cb863f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 18:45:13.279756 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:13.276839    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/50400a73-3915-44f6-af79-bc9425cb863f-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"50400a73-3915-44f6-af79-bc9425cb863f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 18:45:13.279756 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:13.276902    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/50400a73-3915-44f6-af79-bc9425cb863f-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"50400a73-3915-44f6-af79-bc9425cb863f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 18:45:13.279756 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:13.277727    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/50400a73-3915-44f6-af79-bc9425cb863f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"50400a73-3915-44f6-af79-bc9425cb863f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 18:45:13.279756 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:13.277799    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/50400a73-3915-44f6-af79-bc9425cb863f-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"50400a73-3915-44f6-af79-bc9425cb863f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 18:45:13.279756 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:13.278281    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/50400a73-3915-44f6-af79-bc9425cb863f-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"50400a73-3915-44f6-af79-bc9425cb863f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 18:45:13.279756 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:13.278428    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/50400a73-3915-44f6-af79-bc9425cb863f-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"50400a73-3915-44f6-af79-bc9425cb863f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 18:45:13.280214 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:13.280094    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/50400a73-3915-44f6-af79-bc9425cb863f-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"50400a73-3915-44f6-af79-bc9425cb863f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 18:45:13.281287 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:13.280819    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/50400a73-3915-44f6-af79-bc9425cb863f-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"50400a73-3915-44f6-af79-bc9425cb863f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 18:45:13.281287 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:13.281236    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/50400a73-3915-44f6-af79-bc9425cb863f-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"50400a73-3915-44f6-af79-bc9425cb863f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 18:45:13.282999 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:13.282947    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/50400a73-3915-44f6-af79-bc9425cb863f-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"50400a73-3915-44f6-af79-bc9425cb863f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 18:45:13.289151 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:13.289058    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/50400a73-3915-44f6-af79-bc9425cb863f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"50400a73-3915-44f6-af79-bc9425cb863f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 18:45:13.291786 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:13.291241    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/50400a73-3915-44f6-af79-bc9425cb863f-config-out\") pod \"prometheus-k8s-0\" (UID: \"50400a73-3915-44f6-af79-bc9425cb863f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 18:45:13.291786 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:13.291686    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/50400a73-3915-44f6-af79-bc9425cb863f-config\") pod \"prometheus-k8s-0\" (UID: \"50400a73-3915-44f6-af79-bc9425cb863f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 18:45:13.291786 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:13.291739    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g6wqw\" (UniqueName: \"kubernetes.io/projected/50400a73-3915-44f6-af79-bc9425cb863f-kube-api-access-g6wqw\") pod \"prometheus-k8s-0\" (UID: \"50400a73-3915-44f6-af79-bc9425cb863f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 18:45:13.298266 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:13.298202    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/50400a73-3915-44f6-af79-bc9425cb863f-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"50400a73-3915-44f6-af79-bc9425cb863f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 18:45:13.298575 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:13.298553    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/50400a73-3915-44f6-af79-bc9425cb863f-web-config\") pod \"prometheus-k8s-0\" (UID: \"50400a73-3915-44f6-af79-bc9425cb863f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 18:45:13.299181 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:13.299109    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/50400a73-3915-44f6-af79-bc9425cb863f-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"50400a73-3915-44f6-af79-bc9425cb863f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 18:45:13.299371 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:13.299315    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/50400a73-3915-44f6-af79-bc9425cb863f-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"50400a73-3915-44f6-af79-bc9425cb863f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 18:45:13.304405 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:13.304330    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/50400a73-3915-44f6-af79-bc9425cb863f-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"50400a73-3915-44f6-af79-bc9425cb863f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 18:45:13.328350 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:13.328209    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:45:13.372488 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:13.371136    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-df6b5d4c4-fqzxv"]
Jul 24 18:45:13.406921 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:13.406885    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 18:45:13.409106 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:13.409061    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:45:13.560597 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:13.560511    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-lw567" event={"ID":"5342146b-438b-4f6b-a0c1-31a44b1876b3","Type":"ContainerStarted","Data":"519b1a6dcab6b29cc0a64b972ae85b406fc02329b5cf8d18a07a4cd81f1d6b0c"}
Jul 24 18:45:13.562998 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:13.562958    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c6879d947-2zswz" event={"ID":"5d36f00d-01ab-4493-84ee-597dca0e573d","Type":"ContainerStarted","Data":"b03172e8579ddeb5ca1bf2aebb2943f644b28eb40f11c6b063724e5b689b52e1"}
Jul 24 18:45:14.202490 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:45:14.202452    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14efd5e5_3db7_4b0c_9806_f9c4df42225d.slice/crio-6f4f186290c740a86ebc44e5c33c48667d484f2349f3be8fcd97b648d531e0ce WatchSource:0}: Error finding container 6f4f186290c740a86ebc44e5c33c48667d484f2349f3be8fcd97b648d531e0ce: Status 404 returned error can't find the container with id 6f4f186290c740a86ebc44e5c33c48667d484f2349f3be8fcd97b648d531e0ce
Jul 24 18:45:14.570621 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:14.570467    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-df6b5d4c4-fqzxv" event={"ID":"14efd5e5-3db7-4b0c-9806-f9c4df42225d","Type":"ContainerStarted","Data":"6f4f186290c740a86ebc44e5c33c48667d484f2349f3be8fcd97b648d531e0ce"}
Jul 24 18:45:15.511718 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:15.511675    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:45:15.588248 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:15.588212    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:45:15.688286 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:15.688247    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:45:16.534536 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:16.534494    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:45:16.609882 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:16.609833    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:45:16.710535 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:16.710496    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:45:17.570557 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:17.570521    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:45:18.131622 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:18.131577    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:45:18.231984 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:18.231952    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:45:18.334776 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:18.334733    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:45:18.390300 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:18.387550    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 24 18:45:18.596595 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:18.596559    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-nsc2s" event={"ID":"34b58fb0-dbc2-49de-86e2-4bd31bb3250a","Type":"ContainerStarted","Data":"df0cb5571d4a50389b9be68b829dab46d8687ed7b2e5fbaba1c26322f37a7cb0"}
Jul 24 18:45:18.596691 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:18.596663    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-nsc2s" event={"ID":"34b58fb0-dbc2-49de-86e2-4bd31bb3250a","Type":"ContainerStarted","Data":"45340e8c7b26beef6e0cca8e0d9aee2d55444aae88986274b4bf546dc8ca9858"}
Jul 24 18:45:18.598751 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:18.598723    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-57f6d765c6-m78cf" event={"ID":"4e314077-64e7-4060-8771-8be311d2c8cf","Type":"ContainerStarted","Data":"d80e6d2017e6fdd558e5dc96ef84db78655a0054d94ff5b97400844c4d546717"}
Jul 24 18:45:18.598837 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:18.598801    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-57f6d765c6-m78cf" event={"ID":"4e314077-64e7-4060-8771-8be311d2c8cf","Type":"ContainerStarted","Data":"3e2b115801fad15f9fb37adfa0139fe02798ba6db5f53ead1f575cb90d6a0cb4"}
Jul 24 18:45:18.600756 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:18.600698    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-lw567" event={"ID":"5342146b-438b-4f6b-a0c1-31a44b1876b3","Type":"ContainerStarted","Data":"d43add4c878a886223b2c90ba1eab27396c58aae95df48ec5ad4c042e426402d"}
Jul 24 18:45:18.601107 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:18.601074    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-lw567"
Jul 24 18:45:18.602789 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:18.602579    2580 generic.go:356] "Generic (PLEG): container finished" podID="50400a73-3915-44f6-af79-bc9425cb863f" containerID="f1af4d3a66b412bf49090ec6ff61203254802ee5417138fd3e9d02ae334ef01f" exitCode=0
Jul 24 18:45:18.602789 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:18.602667    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"50400a73-3915-44f6-af79-bc9425cb863f","Type":"ContainerDied","Data":"f1af4d3a66b412bf49090ec6ff61203254802ee5417138fd3e9d02ae334ef01f"}
Jul 24 18:45:18.602789 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:18.602725    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"50400a73-3915-44f6-af79-bc9425cb863f","Type":"ContainerStarted","Data":"0382284c5cbff34c29019af0dc6bf19b25c16f4630ec65f44df1c78412356002"}
Jul 24 18:45:18.608053 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:18.607432    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c6879d947-2zswz" event={"ID":"5d36f00d-01ab-4493-84ee-597dca0e573d","Type":"ContainerStarted","Data":"7ca82773a4d91bb1cf6e7d8af382c25d751bc642a72a1b150d03711d6fe333d7"}
Jul 24 18:45:18.609661 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:18.608872    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-lw567"
Jul 24 18:45:18.613810 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:18.613790    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a5734963-fe7d-4673-8539-3dcb1afcb68c","Type":"ContainerStarted","Data":"2dc61923b7fcace29b52521d7064b74c85c57ec5e489eeff27b8654fa259ef2b"}
Jul 24 18:45:18.614335 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:18.614318    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a5734963-fe7d-4673-8539-3dcb1afcb68c","Type":"ContainerStarted","Data":"bd9587476dc30346522fc78b0282ea22431ef61923b1e53e7a3b21ea7664f419"}
Jul 24 18:45:18.615931 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:18.615908    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-75bddf7487-kzzkh" event={"ID":"86c3e6d3-79ba-4283-9f3a-8dafa564a1ef","Type":"ContainerStarted","Data":"4a3d3b4b574d5abcb91e56529b0c54834b188d0bc3ff6bc9b280dcd34283c7b4"}
Jul 24 18:45:18.618431 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:18.618315    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-nsc2s" podStartSLOduration=67.545208946 podStartE2EDuration="1m13.618298543s" totalImagesPullingTime="6.073089597s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 18:44:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:45:18.617025697 +0000 UTC m=+73.826397742" watchObservedRunningTime="2026-07-24 18:45:18.618298543 +0000 UTC m=+73.827670588"
Jul 24 18:45:18.621558 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:18.621527    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-phl62" event={"ID":"84828167-a9ed-4515-9976-e266991f89fb","Type":"ContainerStarted","Data":"da83020655885463e2ffa548ec6a2647b54c11d5b4ccae00d9b495781e8d1580"}
Jul 24 18:45:18.631227 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:18.631187    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-4722z" event={"ID":"d0cb8d6d-2dda-4fee-89ee-c7d163e5d80d","Type":"ContainerStarted","Data":"ccdf2cd00a69cb8c3f4d225ec758d0954ab810cff0a9c798bf7b756270b3e5a4"}
Jul 24 18:45:18.631398 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:18.631350    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-4722z"
Jul 24 18:45:18.634980 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:18.634928    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-lw567" podStartSLOduration=2.090480461 podStartE2EDuration="7.634891049s" totalImagesPullingTime="5.544410588s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 18:45:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:45:18.633670899 +0000 UTC m=+73.843042940" watchObservedRunningTime="2026-07-24 18:45:18.634891049 +0000 UTC m=+73.844263093"
Jul 24 18:45:18.635930 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:18.635899    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-df6b5d4c4-fqzxv" event={"ID":"14efd5e5-3db7-4b0c-9806-f9c4df42225d","Type":"ContainerStarted","Data":"e89ec358285d78632d1b32efc5b92493fbeb63884c46dce064a2288ae2012bfb"}
Jul 24 18:45:18.657100 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:18.656904    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-75bddf7487-kzzkh" podStartSLOduration=1.244512791 podStartE2EDuration="7.656883142s" totalImagesPullingTime="6.412370351s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 18:45:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:45:18.656326407 +0000 UTC m=+73.865698451" watchObservedRunningTime="2026-07-24 18:45:18.656883142 +0000 UTC m=+73.866255186"
Jul 24 18:45:18.684471 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:18.683018    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6c6879d947-2zswz" podStartSLOduration=7.682995726 podStartE2EDuration="7.682995726s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 18:45:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:45:18.681487263 +0000 UTC m=+73.890859307" watchObservedRunningTime="2026-07-24 18:45:18.682995726 +0000 UTC m=+73.892367770"
Jul 24 18:45:18.740950 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:18.740889    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-4722z" podStartSLOduration=66.897160774 podStartE2EDuration="1m13.740868444s" totalImagesPullingTime="6.84370767s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 18:44:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:45:18.738494911 +0000 UTC m=+73.947866990" watchObservedRunningTime="2026-07-24 18:45:18.740868444 +0000 UTC m=+73.950240485"
Jul 24 18:45:18.743825 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:18.743798    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:45:18.774808 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:18.774730    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-phl62" podStartSLOduration=66.930028747 podStartE2EDuration="1m13.77471201s" totalImagesPullingTime="6.844683263s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 18:44:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:45:18.7739598 +0000 UTC m=+73.983331860" watchObservedRunningTime="2026-07-24 18:45:18.77471201 +0000 UTC m=+73.984084052"
Jul 24 18:45:18.845797 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:18.845734    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:45:19.651278 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:19.648260    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-df6b5d4c4-fqzxv" event={"ID":"14efd5e5-3db7-4b0c-9806-f9c4df42225d","Type":"ContainerStarted","Data":"e411fc3163452777766c90859fa022e634905fa17d9f40b01d6c0c531d9e4157"}
Jul 24 18:45:19.651278 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:19.648363    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-df6b5d4c4-fqzxv" event={"ID":"14efd5e5-3db7-4b0c-9806-f9c4df42225d","Type":"ContainerStarted","Data":"ed27661820253f78dcd34c506cae2889f9e8d5e00dde4e177691284946094081"}
Jul 24 18:45:19.657787 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:19.657745    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-57f6d765c6-m78cf" event={"ID":"4e314077-64e7-4060-8771-8be311d2c8cf","Type":"ContainerStarted","Data":"a0145541ce4d6ee23dad0b984242a304feec0a9ef83740fd558d9d49d7c521a9"}
Jul 24 18:45:19.670309 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:19.669784    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a5734963-fe7d-4673-8539-3dcb1afcb68c","Type":"ContainerStarted","Data":"2afa43dbd3f4e1a73c1deec9319426757ab0af0180f933c07c3cc523d8125abf"}
Jul 24 18:45:19.670309 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:19.669864    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a5734963-fe7d-4673-8539-3dcb1afcb68c","Type":"ContainerStarted","Data":"50101f88060c6b98baf45ff9f960e32f050813eb421431d41996218bce9599bd"}
Jul 24 18:45:19.670309 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:19.669904    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a5734963-fe7d-4673-8539-3dcb1afcb68c","Type":"ContainerStarted","Data":"eac27c3b90486b85cf8dfe41fcc0a2624ccb9c4ae5724575f9e13ce9a5529739"}
Jul 24 18:45:19.742835 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:19.742781    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-df6b5d4c4-fqzxv" podStartSLOduration=4.737821181 podStartE2EDuration="8.742763493s" totalImagesPullingTime="4.004942312s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 18:45:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:45:19.679779879 +0000 UTC m=+74.889151926" watchObservedRunningTime="2026-07-24 18:45:19.742763493 +0000 UTC m=+74.952135535"
Jul 24 18:45:19.744285 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:19.744241    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.635567543 podStartE2EDuration="12.744228085s" totalImagesPullingTime="9.082775734s" totalInitContainerRuntime="25.884808ms" isStatefulPod=false podCreationTimestamp="2026-07-24 18:45:07 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:45:19.737676657 +0000 UTC m=+74.947048700" watchObservedRunningTime="2026-07-24 18:45:19.744228085 +0000 UTC m=+74.953600129"
Jul 24 18:45:20.589031 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:20.588989    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6c6879d947-2zswz"]
Jul 24 18:45:20.624284 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:20.624244    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-c96bfbddd-xxb46"]
Jul 24 18:45:20.628066 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:20.628041    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c96bfbddd-xxb46"
Jul 24 18:45:20.638163 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:20.638136    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-c96bfbddd-xxb46"]
Jul 24 18:45:20.677272 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:20.677236    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-57f6d765c6-m78cf" event={"ID":"4e314077-64e7-4060-8771-8be311d2c8cf","Type":"ContainerStarted","Data":"47b6e4540b0d074e7b9d382f3a320471dacf7b30499508e7891be72ab1949f41"}
Jul 24 18:45:20.677711 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:20.677306    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-57f6d765c6-m78cf" event={"ID":"4e314077-64e7-4060-8771-8be311d2c8cf","Type":"ContainerStarted","Data":"d5b01ff54a5a714e4c12ea2e152c776dd0a10a2c59376b51e021fc8e77b93a2f"}
Jul 24 18:45:20.677711 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:20.677350    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-57f6d765c6-m78cf" event={"ID":"4e314077-64e7-4060-8771-8be311d2c8cf","Type":"ContainerStarted","Data":"65b9bc73ef775b3efa6c44676e34fdacd38853e2f1629760334c99a0a694fb89"}
Jul 24 18:45:20.677711 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:20.677393    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-57f6d765c6-m78cf"
Jul 24 18:45:20.680684 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:20.680656    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a5734963-fe7d-4673-8539-3dcb1afcb68c","Type":"ContainerStarted","Data":"852cd2bb8a7880fb83eda645cb9a54114773f4db3175514fb711af7d7389c626"}
Jul 24 18:45:20.707430 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:20.707372    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-57f6d765c6-m78cf" podStartSLOduration=3.307298582 podStartE2EDuration="10.707356382s" totalImagesPullingTime="7.4000578s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 18:45:10 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:45:20.705746496 +0000 UTC m=+75.915118542" watchObservedRunningTime="2026-07-24 18:45:20.707356382 +0000 UTC m=+75.916728440"
Jul 24 18:45:20.762220 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:20.762172    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a16f1fb5-5d78-46c5-a7c3-f4d90bf87a82-oauth-serving-cert\") pod \"console-c96bfbddd-xxb46\" (UID: \"a16f1fb5-5d78-46c5-a7c3-f4d90bf87a82\") " pod="openshift-console/console-c96bfbddd-xxb46"
Jul 24 18:45:20.762383 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:20.762242    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cvdlk\" (UniqueName: \"kubernetes.io/projected/a16f1fb5-5d78-46c5-a7c3-f4d90bf87a82-kube-api-access-cvdlk\") pod \"console-c96bfbddd-xxb46\" (UID: \"a16f1fb5-5d78-46c5-a7c3-f4d90bf87a82\") " pod="openshift-console/console-c96bfbddd-xxb46"
Jul 24 18:45:20.762383 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:20.762302    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a16f1fb5-5d78-46c5-a7c3-f4d90bf87a82-console-oauth-config\") pod \"console-c96bfbddd-xxb46\" (UID: \"a16f1fb5-5d78-46c5-a7c3-f4d90bf87a82\") " pod="openshift-console/console-c96bfbddd-xxb46"
Jul 24 18:45:20.762383 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:20.762360    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a16f1fb5-5d78-46c5-a7c3-f4d90bf87a82-console-config\") pod \"console-c96bfbddd-xxb46\" (UID: \"a16f1fb5-5d78-46c5-a7c3-f4d90bf87a82\") " pod="openshift-console/console-c96bfbddd-xxb46"
Jul 24 18:45:20.762551 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:20.762455    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a16f1fb5-5d78-46c5-a7c3-f4d90bf87a82-console-serving-cert\") pod \"console-c96bfbddd-xxb46\" (UID: \"a16f1fb5-5d78-46c5-a7c3-f4d90bf87a82\") " pod="openshift-console/console-c96bfbddd-xxb46"
Jul 24 18:45:20.762551 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:20.762490    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a16f1fb5-5d78-46c5-a7c3-f4d90bf87a82-trusted-ca-bundle\") pod \"console-c96bfbddd-xxb46\" (UID: \"a16f1fb5-5d78-46c5-a7c3-f4d90bf87a82\") " pod="openshift-console/console-c96bfbddd-xxb46"
Jul 24 18:45:20.762551 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:20.762526    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a16f1fb5-5d78-46c5-a7c3-f4d90bf87a82-service-ca\") pod \"console-c96bfbddd-xxb46\" (UID: \"a16f1fb5-5d78-46c5-a7c3-f4d90bf87a82\") " pod="openshift-console/console-c96bfbddd-xxb46"
Jul 24 18:45:20.863699 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:20.863605    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a16f1fb5-5d78-46c5-a7c3-f4d90bf87a82-console-config\") pod \"console-c96bfbddd-xxb46\" (UID: \"a16f1fb5-5d78-46c5-a7c3-f4d90bf87a82\") " pod="openshift-console/console-c96bfbddd-xxb46"
Jul 24 18:45:20.864022 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:20.863997    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a16f1fb5-5d78-46c5-a7c3-f4d90bf87a82-console-serving-cert\") pod \"console-c96bfbddd-xxb46\" (UID: \"a16f1fb5-5d78-46c5-a7c3-f4d90bf87a82\") " pod="openshift-console/console-c96bfbddd-xxb46"
Jul 24 18:45:20.864113 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:20.864050    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a16f1fb5-5d78-46c5-a7c3-f4d90bf87a82-trusted-ca-bundle\") pod \"console-c96bfbddd-xxb46\" (UID: \"a16f1fb5-5d78-46c5-a7c3-f4d90bf87a82\") " pod="openshift-console/console-c96bfbddd-xxb46"
Jul 24 18:45:20.864430 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:20.864407    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a16f1fb5-5d78-46c5-a7c3-f4d90bf87a82-console-config\") pod \"console-c96bfbddd-xxb46\" (UID: \"a16f1fb5-5d78-46c5-a7c3-f4d90bf87a82\") " pod="openshift-console/console-c96bfbddd-xxb46"
Jul 24 18:45:20.865250 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:20.864580    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a16f1fb5-5d78-46c5-a7c3-f4d90bf87a82-service-ca\") pod \"console-c96bfbddd-xxb46\" (UID: \"a16f1fb5-5d78-46c5-a7c3-f4d90bf87a82\") " pod="openshift-console/console-c96bfbddd-xxb46"
Jul 24 18:45:20.865250 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:20.864718    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a16f1fb5-5d78-46c5-a7c3-f4d90bf87a82-oauth-serving-cert\") pod \"console-c96bfbddd-xxb46\" (UID: \"a16f1fb5-5d78-46c5-a7c3-f4d90bf87a82\") " pod="openshift-console/console-c96bfbddd-xxb46"
Jul 24 18:45:20.865250 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:20.864746    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cvdlk\" (UniqueName: \"kubernetes.io/projected/a16f1fb5-5d78-46c5-a7c3-f4d90bf87a82-kube-api-access-cvdlk\") pod \"console-c96bfbddd-xxb46\" (UID: \"a16f1fb5-5d78-46c5-a7c3-f4d90bf87a82\") " pod="openshift-console/console-c96bfbddd-xxb46"
Jul 24 18:45:20.865250 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:20.864885    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a16f1fb5-5d78-46c5-a7c3-f4d90bf87a82-console-oauth-config\") pod \"console-c96bfbddd-xxb46\" (UID: \"a16f1fb5-5d78-46c5-a7c3-f4d90bf87a82\") " pod="openshift-console/console-c96bfbddd-xxb46"
Jul 24 18:45:20.865250 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:20.865002    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a16f1fb5-5d78-46c5-a7c3-f4d90bf87a82-trusted-ca-bundle\") pod \"console-c96bfbddd-xxb46\" (UID: \"a16f1fb5-5d78-46c5-a7c3-f4d90bf87a82\") " pod="openshift-console/console-c96bfbddd-xxb46"
Jul 24 18:45:20.865563 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:20.865393    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a16f1fb5-5d78-46c5-a7c3-f4d90bf87a82-service-ca\") pod \"console-c96bfbddd-xxb46\" (UID: \"a16f1fb5-5d78-46c5-a7c3-f4d90bf87a82\") " pod="openshift-console/console-c96bfbddd-xxb46"
Jul 24 18:45:20.865563 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:20.865542    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a16f1fb5-5d78-46c5-a7c3-f4d90bf87a82-oauth-serving-cert\") pod \"console-c96bfbddd-xxb46\" (UID: \"a16f1fb5-5d78-46c5-a7c3-f4d90bf87a82\") " pod="openshift-console/console-c96bfbddd-xxb46"
Jul 24 18:45:20.867240 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:20.867219    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a16f1fb5-5d78-46c5-a7c3-f4d90bf87a82-console-serving-cert\") pod \"console-c96bfbddd-xxb46\" (UID: \"a16f1fb5-5d78-46c5-a7c3-f4d90bf87a82\") " pod="openshift-console/console-c96bfbddd-xxb46"
Jul 24 18:45:20.867802 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:20.867780    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a16f1fb5-5d78-46c5-a7c3-f4d90bf87a82-console-oauth-config\") pod \"console-c96bfbddd-xxb46\" (UID: \"a16f1fb5-5d78-46c5-a7c3-f4d90bf87a82\") " pod="openshift-console/console-c96bfbddd-xxb46"
Jul 24 18:45:20.874095 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:20.874075    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cvdlk\" (UniqueName: \"kubernetes.io/projected/a16f1fb5-5d78-46c5-a7c3-f4d90bf87a82-kube-api-access-cvdlk\") pod \"console-c96bfbddd-xxb46\" (UID: \"a16f1fb5-5d78-46c5-a7c3-f4d90bf87a82\") " pod="openshift-console/console-c96bfbddd-xxb46"
Jul 24 18:45:20.937720 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:20.937682    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c96bfbddd-xxb46"
Jul 24 18:45:21.099017 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:21.098978    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-c96bfbddd-xxb46"]
Jul 24 18:45:21.102875 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:45:21.102829    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda16f1fb5_5d78_46c5_a7c3_f4d90bf87a82.slice/crio-59f5c937570e3a52b2bd5dfb7b9500dbc6992f32d940fb7395139e0a734b18aa WatchSource:0}: Error finding container 59f5c937570e3a52b2bd5dfb7b9500dbc6992f32d940fb7395139e0a734b18aa: Status 404 returned error can't find the container with id 59f5c937570e3a52b2bd5dfb7b9500dbc6992f32d940fb7395139e0a734b18aa
Jul 24 18:45:21.687250 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:21.687212    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c96bfbddd-xxb46" event={"ID":"a16f1fb5-5d78-46c5-a7c3-f4d90bf87a82","Type":"ContainerStarted","Data":"59f5c937570e3a52b2bd5dfb7b9500dbc6992f32d940fb7395139e0a734b18aa"}
Jul 24 18:45:21.835032 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:21.834994    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6c6879d947-2zswz"
Jul 24 18:45:22.693945 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:22.693913    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c96bfbddd-xxb46" event={"ID":"a16f1fb5-5d78-46c5-a7c3-f4d90bf87a82","Type":"ContainerStarted","Data":"2f9fd4e47d3f455603c1b54029e24a82d91662874c17171387476fa909406978"}
Jul 24 18:45:22.698182 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:22.698066    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"50400a73-3915-44f6-af79-bc9425cb863f","Type":"ContainerStarted","Data":"04022a52896f2e2ae7bd44b920db6752bcd96e2bc6a6e4df8a8a4f756d0737db"}
Jul 24 18:45:22.698388 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:22.698365    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"50400a73-3915-44f6-af79-bc9425cb863f","Type":"ContainerStarted","Data":"f3bbd9b435324112501cc66eebfd66ad7bf10f5d17c253925452b426e8699e70"}
Jul 24 18:45:22.698456 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:22.698424    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"50400a73-3915-44f6-af79-bc9425cb863f","Type":"ContainerStarted","Data":"d2773c38de8166993facef2f67d4b51785bfb472aad56a793c050372d77599fa"}
Jul 24 18:45:22.698514 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:22.698463    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"50400a73-3915-44f6-af79-bc9425cb863f","Type":"ContainerStarted","Data":"e288cdfdcd9a5a2032a09eda636d6007015ca109d7c95dc1178ae64f9ce8848e"}
Jul 24 18:45:22.698514 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:22.698499    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"50400a73-3915-44f6-af79-bc9425cb863f","Type":"ContainerStarted","Data":"2496b934daa188c265c6abe7182c0bd8f12a441ee5c8f382eea54f9fb27a2b26"}
Jul 24 18:45:22.698588 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:22.698537    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"50400a73-3915-44f6-af79-bc9425cb863f","Type":"ContainerStarted","Data":"a9c8a3b2e06a51aaf98e667886be98545375eee0a7311c0ebf3f496ae2ac459b"}
Jul 24 18:45:22.715646 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:22.715596    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-c96bfbddd-xxb46" podStartSLOduration=2.715580892 podStartE2EDuration="2.715580892s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 18:45:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:45:22.714768156 +0000 UTC m=+77.924140222" watchObservedRunningTime="2026-07-24 18:45:22.715580892 +0000 UTC m=+77.924952935"
Jul 24 18:45:22.750191 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:22.750060    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=6.0755329 podStartE2EDuration="9.75004541s" totalImagesPullingTime="3.649644149s" totalInitContainerRuntime="24.868361ms" isStatefulPod=false podCreationTimestamp="2026-07-24 18:45:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:45:22.747812609 +0000 UTC m=+77.957184716" watchObservedRunningTime="2026-07-24 18:45:22.75004541 +0000 UTC m=+77.959417452"
Jul 24 18:45:23.407703 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:23.407659    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 18:45:26.165768 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:26.165633    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:45:26.268008 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:26.267968    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:45:26.693643 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:26.693618    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-57f6d765c6-m78cf"
Jul 24 18:45:30.938182 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:30.938146    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-c96bfbddd-xxb46"
Jul 24 18:45:30.938702 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:30.938202    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-c96bfbddd-xxb46"
Jul 24 18:45:30.942890 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:30.942868    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-c96bfbddd-xxb46"
Jul 24 18:45:31.544899 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:31.544860    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-75bddf7487-kzzkh"
Jul 24 18:45:31.545078 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:31.544933    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-75bddf7487-kzzkh"
Jul 24 18:45:31.673911 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:31.673865    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:45:31.743149 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:31.743106    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-c96bfbddd-xxb46"
Jul 24 18:45:31.752970 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:31.752931    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:45:31.794685 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:31.794651    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-657778b767-7tkt4"]
Jul 24 18:45:31.909574 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:31.909492    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:45:32.011381 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:32.011344    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:45:32.095369 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:32.095322    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:45:32.237471 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:32.237436    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:45:32.337295 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:32.337259    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:45:45.699799 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:45.699730    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6c6879d947-2zswz" podUID="5d36f00d-01ab-4493-84ee-597dca0e573d" containerName="console" containerID="cri-o://7ca82773a4d91bb1cf6e7d8af382c25d751bc642a72a1b150d03711d6fe333d7" gracePeriod=15
Jul 24 18:45:46.500479 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:46.500442    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c6879d947-2zswz"
Jul 24 18:45:46.619732 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:46.619692    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5d36f00d-01ab-4493-84ee-597dca0e573d-oauth-serving-cert\") pod \"5d36f00d-01ab-4493-84ee-597dca0e573d\" (UID: \"5d36f00d-01ab-4493-84ee-597dca0e573d\") "
Jul 24 18:45:46.619923 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:46.619748    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5d36f00d-01ab-4493-84ee-597dca0e573d-console-config\") pod \"5d36f00d-01ab-4493-84ee-597dca0e573d\" (UID: \"5d36f00d-01ab-4493-84ee-597dca0e573d\") "
Jul 24 18:45:46.619923 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:46.619783    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5d36f00d-01ab-4493-84ee-597dca0e573d-trusted-ca-bundle\") pod \"5d36f00d-01ab-4493-84ee-597dca0e573d\" (UID: \"5d36f00d-01ab-4493-84ee-597dca0e573d\") "
Jul 24 18:45:46.619923 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:46.619860    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5d36f00d-01ab-4493-84ee-597dca0e573d-console-oauth-config\") pod \"5d36f00d-01ab-4493-84ee-597dca0e573d\" (UID: \"5d36f00d-01ab-4493-84ee-597dca0e573d\") "
Jul 24 18:45:46.619923 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:46.619896    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5d36f00d-01ab-4493-84ee-597dca0e573d-service-ca\") pod \"5d36f00d-01ab-4493-84ee-597dca0e573d\" (UID: \"5d36f00d-01ab-4493-84ee-597dca0e573d\") "
Jul 24 18:45:46.620177 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:46.619932    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5d36f00d-01ab-4493-84ee-597dca0e573d-console-serving-cert\") pod \"5d36f00d-01ab-4493-84ee-597dca0e573d\" (UID: \"5d36f00d-01ab-4493-84ee-597dca0e573d\") "
Jul 24 18:45:46.620177 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:46.619979    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g765b\" (UniqueName: \"kubernetes.io/projected/5d36f00d-01ab-4493-84ee-597dca0e573d-kube-api-access-g765b\") pod \"5d36f00d-01ab-4493-84ee-597dca0e573d\" (UID: \"5d36f00d-01ab-4493-84ee-597dca0e573d\") "
Jul 24 18:45:46.620356 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:46.620108    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5d36f00d-01ab-4493-84ee-597dca0e573d-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "5d36f00d-01ab-4493-84ee-597dca0e573d" (UID: "5d36f00d-01ab-4493-84ee-597dca0e573d"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 18:45:46.620356 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:46.620240    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5d36f00d-01ab-4493-84ee-597dca0e573d-console-config" (OuterVolumeSpecName: "console-config") pod "5d36f00d-01ab-4493-84ee-597dca0e573d" (UID: "5d36f00d-01ab-4493-84ee-597dca0e573d"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 18:45:46.620356 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:46.620279    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5d36f00d-01ab-4493-84ee-597dca0e573d-service-ca" (OuterVolumeSpecName: "service-ca") pod "5d36f00d-01ab-4493-84ee-597dca0e573d" (UID: "5d36f00d-01ab-4493-84ee-597dca0e573d"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 18:45:46.620356 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:46.620342    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5d36f00d-01ab-4493-84ee-597dca0e573d-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "5d36f00d-01ab-4493-84ee-597dca0e573d" (UID: "5d36f00d-01ab-4493-84ee-597dca0e573d"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 18:45:46.620538 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:46.620493    2580 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5d36f00d-01ab-4493-84ee-597dca0e573d-console-config\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 24 18:45:46.620538 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:46.620512    2580 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5d36f00d-01ab-4493-84ee-597dca0e573d-trusted-ca-bundle\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 24 18:45:46.620538 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:46.620527    2580 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5d36f00d-01ab-4493-84ee-597dca0e573d-service-ca\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 24 18:45:46.620847 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:46.620567    2580 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5d36f00d-01ab-4493-84ee-597dca0e573d-oauth-serving-cert\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 24 18:45:46.622650 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:46.622622    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5d36f00d-01ab-4493-84ee-597dca0e573d-kube-api-access-g765b" (OuterVolumeSpecName: "kube-api-access-g765b") pod "5d36f00d-01ab-4493-84ee-597dca0e573d" (UID: "5d36f00d-01ab-4493-84ee-597dca0e573d"). InnerVolumeSpecName "kube-api-access-g765b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 18:45:46.622650 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:46.622636    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5d36f00d-01ab-4493-84ee-597dca0e573d-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "5d36f00d-01ab-4493-84ee-597dca0e573d" (UID: "5d36f00d-01ab-4493-84ee-597dca0e573d"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 18:45:46.622787 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:46.622685    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5d36f00d-01ab-4493-84ee-597dca0e573d-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "5d36f00d-01ab-4493-84ee-597dca0e573d" (UID: "5d36f00d-01ab-4493-84ee-597dca0e573d"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 18:45:46.721933 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:46.721894    2580 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5d36f00d-01ab-4493-84ee-597dca0e573d-console-oauth-config\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 24 18:45:46.721933 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:46.721926    2580 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5d36f00d-01ab-4493-84ee-597dca0e573d-console-serving-cert\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 24 18:45:46.721933 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:46.721936    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g765b\" (UniqueName: \"kubernetes.io/projected/5d36f00d-01ab-4493-84ee-597dca0e573d-kube-api-access-g765b\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 24 18:45:46.802918 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:46.802877    2580 generic.go:356] "Generic (PLEG): container finished" podID="5d36f00d-01ab-4493-84ee-597dca0e573d" containerID="7ca82773a4d91bb1cf6e7d8af382c25d751bc642a72a1b150d03711d6fe333d7" exitCode=0
Jul 24 18:45:46.803092 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:46.802924    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c6879d947-2zswz"
Jul 24 18:45:46.803092 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:46.802964    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c6879d947-2zswz" event={"ID":"5d36f00d-01ab-4493-84ee-597dca0e573d","Type":"ContainerDied","Data":"7ca82773a4d91bb1cf6e7d8af382c25d751bc642a72a1b150d03711d6fe333d7"}
Jul 24 18:45:46.803092 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:46.803029    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c6879d947-2zswz" event={"ID":"5d36f00d-01ab-4493-84ee-597dca0e573d","Type":"ContainerDied","Data":"b03172e8579ddeb5ca1bf2aebb2943f644b28eb40f11c6b063724e5b689b52e1"}
Jul 24 18:45:46.803092 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:46.803059    2580 scope.go:117] "RemoveContainer" containerID="7ca82773a4d91bb1cf6e7d8af382c25d751bc642a72a1b150d03711d6fe333d7"
Jul 24 18:45:46.813346 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:46.813320    2580 scope.go:117] "RemoveContainer" containerID="7ca82773a4d91bb1cf6e7d8af382c25d751bc642a72a1b150d03711d6fe333d7"
Jul 24 18:45:46.813669 ip-10-0-141-146 kubenswrapper[2580]: E0724 18:45:46.813648    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7ca82773a4d91bb1cf6e7d8af382c25d751bc642a72a1b150d03711d6fe333d7\": container with ID starting with 7ca82773a4d91bb1cf6e7d8af382c25d751bc642a72a1b150d03711d6fe333d7 not found: ID does not exist" containerID="7ca82773a4d91bb1cf6e7d8af382c25d751bc642a72a1b150d03711d6fe333d7"
Jul 24 18:45:46.813734 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:46.813678    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7ca82773a4d91bb1cf6e7d8af382c25d751bc642a72a1b150d03711d6fe333d7"} err="failed to get container status \"7ca82773a4d91bb1cf6e7d8af382c25d751bc642a72a1b150d03711d6fe333d7\": rpc error: code = NotFound desc = could not find container \"7ca82773a4d91bb1cf6e7d8af382c25d751bc642a72a1b150d03711d6fe333d7\": container with ID starting with 7ca82773a4d91bb1cf6e7d8af382c25d751bc642a72a1b150d03711d6fe333d7 not found: ID does not exist"
Jul 24 18:45:46.833842 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:46.833773    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6c6879d947-2zswz"]
Jul 24 18:45:46.836288 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:46.836258    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6c6879d947-2zswz"]
Jul 24 18:45:47.240753 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:47.240708    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5d36f00d-01ab-4493-84ee-597dca0e573d" path="/var/lib/kubelet/pods/5d36f00d-01ab-4493-84ee-597dca0e573d/volumes"
Jul 24 18:45:49.672420 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:49.672393    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-4722z"
Jul 24 18:45:51.550868 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:51.550836    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-75bddf7487-kzzkh"
Jul 24 18:45:51.554907 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:51.554881    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-75bddf7487-kzzkh"
Jul 24 18:45:53.609539 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:53.609507    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:45:53.711292 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:53.711229    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:45:56.814265 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:56.814214    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-657778b767-7tkt4" podUID="7d6e53ad-4342-45bf-a64e-3c16dbe38451" containerName="console" containerID="cri-o://53877cc77c218158ed744b656d90e6c863746b97ec966cbf2c1c0d5d5586ea4d" gracePeriod=15
Jul 24 18:45:57.059052 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:57.059025    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-657778b767-7tkt4"
Jul 24 18:45:57.133894 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:57.133858    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7d6e53ad-4342-45bf-a64e-3c16dbe38451-console-config\") pod \"7d6e53ad-4342-45bf-a64e-3c16dbe38451\" (UID: \"7d6e53ad-4342-45bf-a64e-3c16dbe38451\") "
Jul 24 18:45:57.134059 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:57.133928    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pl26g\" (UniqueName: \"kubernetes.io/projected/7d6e53ad-4342-45bf-a64e-3c16dbe38451-kube-api-access-pl26g\") pod \"7d6e53ad-4342-45bf-a64e-3c16dbe38451\" (UID: \"7d6e53ad-4342-45bf-a64e-3c16dbe38451\") "
Jul 24 18:45:57.134059 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:57.133964    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7d6e53ad-4342-45bf-a64e-3c16dbe38451-trusted-ca-bundle\") pod \"7d6e53ad-4342-45bf-a64e-3c16dbe38451\" (UID: \"7d6e53ad-4342-45bf-a64e-3c16dbe38451\") "
Jul 24 18:45:57.134059 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:57.134015    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7d6e53ad-4342-45bf-a64e-3c16dbe38451-service-ca\") pod \"7d6e53ad-4342-45bf-a64e-3c16dbe38451\" (UID: \"7d6e53ad-4342-45bf-a64e-3c16dbe38451\") "
Jul 24 18:45:57.134249 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:57.134178    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7d6e53ad-4342-45bf-a64e-3c16dbe38451-console-oauth-config\") pod \"7d6e53ad-4342-45bf-a64e-3c16dbe38451\" (UID: \"7d6e53ad-4342-45bf-a64e-3c16dbe38451\") "
Jul 24 18:45:57.134311 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:57.134264    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7d6e53ad-4342-45bf-a64e-3c16dbe38451-console-serving-cert\") pod \"7d6e53ad-4342-45bf-a64e-3c16dbe38451\" (UID: \"7d6e53ad-4342-45bf-a64e-3c16dbe38451\") "
Jul 24 18:45:57.134364 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:57.134308    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7d6e53ad-4342-45bf-a64e-3c16dbe38451-console-config" (OuterVolumeSpecName: "console-config") pod "7d6e53ad-4342-45bf-a64e-3c16dbe38451" (UID: "7d6e53ad-4342-45bf-a64e-3c16dbe38451"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 18:45:57.134364 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:57.134339    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7d6e53ad-4342-45bf-a64e-3c16dbe38451-oauth-serving-cert\") pod \"7d6e53ad-4342-45bf-a64e-3c16dbe38451\" (UID: \"7d6e53ad-4342-45bf-a64e-3c16dbe38451\") "
Jul 24 18:45:57.134458 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:57.134356    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7d6e53ad-4342-45bf-a64e-3c16dbe38451-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "7d6e53ad-4342-45bf-a64e-3c16dbe38451" (UID: "7d6e53ad-4342-45bf-a64e-3c16dbe38451"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 18:45:57.134458 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:57.134391    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7d6e53ad-4342-45bf-a64e-3c16dbe38451-service-ca" (OuterVolumeSpecName: "service-ca") pod "7d6e53ad-4342-45bf-a64e-3c16dbe38451" (UID: "7d6e53ad-4342-45bf-a64e-3c16dbe38451"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 18:45:57.134652 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:57.134628    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7d6e53ad-4342-45bf-a64e-3c16dbe38451-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "7d6e53ad-4342-45bf-a64e-3c16dbe38451" (UID: "7d6e53ad-4342-45bf-a64e-3c16dbe38451"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 18:45:57.134652 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:57.134639    2580 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7d6e53ad-4342-45bf-a64e-3c16dbe38451-trusted-ca-bundle\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 24 18:45:57.134795 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:57.134670    2580 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7d6e53ad-4342-45bf-a64e-3c16dbe38451-service-ca\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 24 18:45:57.134795 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:57.134686    2580 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7d6e53ad-4342-45bf-a64e-3c16dbe38451-console-config\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 24 18:45:57.136378 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:57.136352    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7d6e53ad-4342-45bf-a64e-3c16dbe38451-kube-api-access-pl26g" (OuterVolumeSpecName: "kube-api-access-pl26g") pod "7d6e53ad-4342-45bf-a64e-3c16dbe38451" (UID: "7d6e53ad-4342-45bf-a64e-3c16dbe38451"). InnerVolumeSpecName "kube-api-access-pl26g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 18:45:57.136501 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:57.136478    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7d6e53ad-4342-45bf-a64e-3c16dbe38451-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "7d6e53ad-4342-45bf-a64e-3c16dbe38451" (UID: "7d6e53ad-4342-45bf-a64e-3c16dbe38451"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 18:45:57.136581 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:57.136564    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7d6e53ad-4342-45bf-a64e-3c16dbe38451-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "7d6e53ad-4342-45bf-a64e-3c16dbe38451" (UID: "7d6e53ad-4342-45bf-a64e-3c16dbe38451"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 18:45:57.235389 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:57.235337    2580 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7d6e53ad-4342-45bf-a64e-3c16dbe38451-console-oauth-config\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 24 18:45:57.235389 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:57.235385    2580 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7d6e53ad-4342-45bf-a64e-3c16dbe38451-console-serving-cert\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 24 18:45:57.235389 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:57.235399    2580 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7d6e53ad-4342-45bf-a64e-3c16dbe38451-oauth-serving-cert\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 24 18:45:57.235698 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:57.235411    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pl26g\" (UniqueName: \"kubernetes.io/projected/7d6e53ad-4342-45bf-a64e-3c16dbe38451-kube-api-access-pl26g\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 24 18:45:57.859186 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:57.859154    2580 generic.go:356] "Generic (PLEG): container finished" podID="7d6e53ad-4342-45bf-a64e-3c16dbe38451" containerID="53877cc77c218158ed744b656d90e6c863746b97ec966cbf2c1c0d5d5586ea4d" exitCode=0
Jul 24 18:45:57.859609 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:57.859237    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-657778b767-7tkt4" event={"ID":"7d6e53ad-4342-45bf-a64e-3c16dbe38451","Type":"ContainerDied","Data":"53877cc77c218158ed744b656d90e6c863746b97ec966cbf2c1c0d5d5586ea4d"}
Jul 24 18:45:57.859609 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:57.859254    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-657778b767-7tkt4"
Jul 24 18:45:57.859609 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:57.859274    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-657778b767-7tkt4" event={"ID":"7d6e53ad-4342-45bf-a64e-3c16dbe38451","Type":"ContainerDied","Data":"ef98c90bc77037c5aa1b93f04aaa05abea1c3e6416e6588adbbb2d957d824c3c"}
Jul 24 18:45:57.859609 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:57.859292    2580 scope.go:117] "RemoveContainer" containerID="53877cc77c218158ed744b656d90e6c863746b97ec966cbf2c1c0d5d5586ea4d"
Jul 24 18:45:57.867935 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:57.867916    2580 scope.go:117] "RemoveContainer" containerID="53877cc77c218158ed744b656d90e6c863746b97ec966cbf2c1c0d5d5586ea4d"
Jul 24 18:45:57.868237 ip-10-0-141-146 kubenswrapper[2580]: E0724 18:45:57.868217    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"53877cc77c218158ed744b656d90e6c863746b97ec966cbf2c1c0d5d5586ea4d\": container with ID starting with 53877cc77c218158ed744b656d90e6c863746b97ec966cbf2c1c0d5d5586ea4d not found: ID does not exist" containerID="53877cc77c218158ed744b656d90e6c863746b97ec966cbf2c1c0d5d5586ea4d"
Jul 24 18:45:57.868303 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:57.868249    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"53877cc77c218158ed744b656d90e6c863746b97ec966cbf2c1c0d5d5586ea4d"} err="failed to get container status \"53877cc77c218158ed744b656d90e6c863746b97ec966cbf2c1c0d5d5586ea4d\": rpc error: code = NotFound desc = could not find container \"53877cc77c218158ed744b656d90e6c863746b97ec966cbf2c1c0d5d5586ea4d\": container with ID starting with 53877cc77c218158ed744b656d90e6c863746b97ec966cbf2c1c0d5d5586ea4d not found: ID does not exist"
Jul 24 18:45:57.876100 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:57.876077    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-657778b767-7tkt4"]
Jul 24 18:45:57.879673 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:57.879647    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-657778b767-7tkt4"]
Jul 24 18:45:59.241220 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:45:59.241183    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7d6e53ad-4342-45bf-a64e-3c16dbe38451" path="/var/lib/kubelet/pods/7d6e53ad-4342-45bf-a64e-3c16dbe38451/volumes"
Jul 24 18:46:02.749825 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:02.749790    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:46:02.812585 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:02.812552    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:46:05.886948 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:05.886907    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:46:05.944910 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:05.944873    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:46:13.408040 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:13.408001    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 18:46:13.427606 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:13.427565    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 18:46:13.942795 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:13.942770    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 18:46:22.817234 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:22.817186    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:46:22.874305 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:22.874268    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:46:27.102145 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:27.102083    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 24 18:46:27.102570 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:27.102376    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="a5734963-fe7d-4673-8539-3dcb1afcb68c" containerName="alertmanager" containerID="cri-o://bd9587476dc30346522fc78b0282ea22431ef61923b1e53e7a3b21ea7664f419" gracePeriod=120
Jul 24 18:46:27.102570 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:27.102422    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="a5734963-fe7d-4673-8539-3dcb1afcb68c" containerName="kube-rbac-proxy-metric" containerID="cri-o://2afa43dbd3f4e1a73c1deec9319426757ab0af0180f933c07c3cc523d8125abf" gracePeriod=120
Jul 24 18:46:27.102570 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:27.102457    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="a5734963-fe7d-4673-8539-3dcb1afcb68c" containerName="prom-label-proxy" containerID="cri-o://852cd2bb8a7880fb83eda645cb9a54114773f4db3175514fb711af7d7389c626" gracePeriod=120
Jul 24 18:46:27.102737 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:27.102574    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="a5734963-fe7d-4673-8539-3dcb1afcb68c" containerName="kube-rbac-proxy-web" containerID="cri-o://eac27c3b90486b85cf8dfe41fcc0a2624ccb9c4ae5724575f9e13ce9a5529739" gracePeriod=120
Jul 24 18:46:27.102795 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:27.102759    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="a5734963-fe7d-4673-8539-3dcb1afcb68c" containerName="config-reloader" containerID="cri-o://2dc61923b7fcace29b52521d7064b74c85c57ec5e489eeff27b8654fa259ef2b" gracePeriod=120
Jul 24 18:46:27.102847 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:27.102800    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="a5734963-fe7d-4673-8539-3dcb1afcb68c" containerName="kube-rbac-proxy" containerID="cri-o://50101f88060c6b98baf45ff9f960e32f050813eb421431d41996218bce9599bd" gracePeriod=120
Jul 24 18:46:27.983511 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:27.983476    2580 generic.go:356] "Generic (PLEG): container finished" podID="a5734963-fe7d-4673-8539-3dcb1afcb68c" containerID="852cd2bb8a7880fb83eda645cb9a54114773f4db3175514fb711af7d7389c626" exitCode=0
Jul 24 18:46:27.983511 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:27.983502    2580 generic.go:356] "Generic (PLEG): container finished" podID="a5734963-fe7d-4673-8539-3dcb1afcb68c" containerID="2afa43dbd3f4e1a73c1deec9319426757ab0af0180f933c07c3cc523d8125abf" exitCode=0
Jul 24 18:46:27.983511 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:27.983508    2580 generic.go:356] "Generic (PLEG): container finished" podID="a5734963-fe7d-4673-8539-3dcb1afcb68c" containerID="50101f88060c6b98baf45ff9f960e32f050813eb421431d41996218bce9599bd" exitCode=0
Jul 24 18:46:27.983511 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:27.983514    2580 generic.go:356] "Generic (PLEG): container finished" podID="a5734963-fe7d-4673-8539-3dcb1afcb68c" containerID="2dc61923b7fcace29b52521d7064b74c85c57ec5e489eeff27b8654fa259ef2b" exitCode=0
Jul 24 18:46:27.983511 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:27.983521    2580 generic.go:356] "Generic (PLEG): container finished" podID="a5734963-fe7d-4673-8539-3dcb1afcb68c" containerID="bd9587476dc30346522fc78b0282ea22431ef61923b1e53e7a3b21ea7664f419" exitCode=0
Jul 24 18:46:27.983824 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:27.983552    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a5734963-fe7d-4673-8539-3dcb1afcb68c","Type":"ContainerDied","Data":"852cd2bb8a7880fb83eda645cb9a54114773f4db3175514fb711af7d7389c626"}
Jul 24 18:46:27.983824 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:27.983619    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a5734963-fe7d-4673-8539-3dcb1afcb68c","Type":"ContainerDied","Data":"2afa43dbd3f4e1a73c1deec9319426757ab0af0180f933c07c3cc523d8125abf"}
Jul 24 18:46:27.983824 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:27.983645    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a5734963-fe7d-4673-8539-3dcb1afcb68c","Type":"ContainerDied","Data":"50101f88060c6b98baf45ff9f960e32f050813eb421431d41996218bce9599bd"}
Jul 24 18:46:27.983824 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:27.983668    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a5734963-fe7d-4673-8539-3dcb1afcb68c","Type":"ContainerDied","Data":"2dc61923b7fcace29b52521d7064b74c85c57ec5e489eeff27b8654fa259ef2b"}
Jul 24 18:46:27.983824 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:27.983692    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a5734963-fe7d-4673-8539-3dcb1afcb68c","Type":"ContainerDied","Data":"bd9587476dc30346522fc78b0282ea22431ef61923b1e53e7a3b21ea7664f419"}
Jul 24 18:46:28.354503 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:28.354481    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 24 18:46:28.509623 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:28.509596    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2hqz8\" (UniqueName: \"kubernetes.io/projected/a5734963-fe7d-4673-8539-3dcb1afcb68c-kube-api-access-2hqz8\") pod \"a5734963-fe7d-4673-8539-3dcb1afcb68c\" (UID: \"a5734963-fe7d-4673-8539-3dcb1afcb68c\") "
Jul 24 18:46:28.509828 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:28.509631    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a5734963-fe7d-4673-8539-3dcb1afcb68c-metrics-client-ca\") pod \"a5734963-fe7d-4673-8539-3dcb1afcb68c\" (UID: \"a5734963-fe7d-4673-8539-3dcb1afcb68c\") "
Jul 24 18:46:28.509828 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:28.509657    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a5734963-fe7d-4673-8539-3dcb1afcb68c-alertmanager-trusted-ca-bundle\") pod \"a5734963-fe7d-4673-8539-3dcb1afcb68c\" (UID: \"a5734963-fe7d-4673-8539-3dcb1afcb68c\") "
Jul 24 18:46:28.509828 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:28.509693    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a5734963-fe7d-4673-8539-3dcb1afcb68c-alertmanager-main-db\") pod \"a5734963-fe7d-4673-8539-3dcb1afcb68c\" (UID: \"a5734963-fe7d-4673-8539-3dcb1afcb68c\") "
Jul 24 18:46:28.509828 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:28.509723    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a5734963-fe7d-4673-8539-3dcb1afcb68c-cluster-tls-config\") pod \"a5734963-fe7d-4673-8539-3dcb1afcb68c\" (UID: \"a5734963-fe7d-4673-8539-3dcb1afcb68c\") "
Jul 24 18:46:28.509828 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:28.509773    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a5734963-fe7d-4673-8539-3dcb1afcb68c-secret-alertmanager-kube-rbac-proxy\") pod \"a5734963-fe7d-4673-8539-3dcb1afcb68c\" (UID: \"a5734963-fe7d-4673-8539-3dcb1afcb68c\") "
Jul 24 18:46:28.509828 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:28.509825    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a5734963-fe7d-4673-8539-3dcb1afcb68c-tls-assets\") pod \"a5734963-fe7d-4673-8539-3dcb1afcb68c\" (UID: \"a5734963-fe7d-4673-8539-3dcb1afcb68c\") "
Jul 24 18:46:28.510187 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:28.509855    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a5734963-fe7d-4673-8539-3dcb1afcb68c-secret-alertmanager-kube-rbac-proxy-web\") pod \"a5734963-fe7d-4673-8539-3dcb1afcb68c\" (UID: \"a5734963-fe7d-4673-8539-3dcb1afcb68c\") "
Jul 24 18:46:28.510187 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:28.509878    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a5734963-fe7d-4673-8539-3dcb1afcb68c-config-volume\") pod \"a5734963-fe7d-4673-8539-3dcb1afcb68c\" (UID: \"a5734963-fe7d-4673-8539-3dcb1afcb68c\") "
Jul 24 18:46:28.510187 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:28.509904    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a5734963-fe7d-4673-8539-3dcb1afcb68c-config-out\") pod \"a5734963-fe7d-4673-8539-3dcb1afcb68c\" (UID: \"a5734963-fe7d-4673-8539-3dcb1afcb68c\") "
Jul 24 18:46:28.510187 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:28.509947    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a5734963-fe7d-4673-8539-3dcb1afcb68c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"a5734963-fe7d-4673-8539-3dcb1afcb68c\" (UID: \"a5734963-fe7d-4673-8539-3dcb1afcb68c\") "
Jul 24 18:46:28.510187 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:28.509983    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a5734963-fe7d-4673-8539-3dcb1afcb68c-web-config\") pod \"a5734963-fe7d-4673-8539-3dcb1afcb68c\" (UID: \"a5734963-fe7d-4673-8539-3dcb1afcb68c\") "
Jul 24 18:46:28.510187 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:28.510010    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a5734963-fe7d-4673-8539-3dcb1afcb68c-secret-alertmanager-main-tls\") pod \"a5734963-fe7d-4673-8539-3dcb1afcb68c\" (UID: \"a5734963-fe7d-4673-8539-3dcb1afcb68c\") "
Jul 24 18:46:28.510187 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:28.510045    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a5734963-fe7d-4673-8539-3dcb1afcb68c-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "a5734963-fe7d-4673-8539-3dcb1afcb68c" (UID: "a5734963-fe7d-4673-8539-3dcb1afcb68c"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 18:46:28.510187 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:28.510052    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a5734963-fe7d-4673-8539-3dcb1afcb68c-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "a5734963-fe7d-4673-8539-3dcb1afcb68c" (UID: "a5734963-fe7d-4673-8539-3dcb1afcb68c"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 18:46:28.510187 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:28.510081    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a5734963-fe7d-4673-8539-3dcb1afcb68c-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "a5734963-fe7d-4673-8539-3dcb1afcb68c" (UID: "a5734963-fe7d-4673-8539-3dcb1afcb68c"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 18:46:28.510819 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:28.510332    2580 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a5734963-fe7d-4673-8539-3dcb1afcb68c-alertmanager-main-db\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 24 18:46:28.510819 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:28.510353    2580 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a5734963-fe7d-4673-8539-3dcb1afcb68c-metrics-client-ca\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 24 18:46:28.510819 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:28.510366    2580 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a5734963-fe7d-4673-8539-3dcb1afcb68c-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 24 18:46:28.513386 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:28.513279    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a5734963-fe7d-4673-8539-3dcb1afcb68c-config-out" (OuterVolumeSpecName: "config-out") pod "a5734963-fe7d-4673-8539-3dcb1afcb68c" (UID: "a5734963-fe7d-4673-8539-3dcb1afcb68c"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 18:46:28.513386 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:28.513296    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a5734963-fe7d-4673-8539-3dcb1afcb68c-kube-api-access-2hqz8" (OuterVolumeSpecName: "kube-api-access-2hqz8") pod "a5734963-fe7d-4673-8539-3dcb1afcb68c" (UID: "a5734963-fe7d-4673-8539-3dcb1afcb68c"). InnerVolumeSpecName "kube-api-access-2hqz8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 18:46:28.513911 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:28.513806    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a5734963-fe7d-4673-8539-3dcb1afcb68c-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "a5734963-fe7d-4673-8539-3dcb1afcb68c" (UID: "a5734963-fe7d-4673-8539-3dcb1afcb68c"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 18:46:28.513911 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:28.513820    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a5734963-fe7d-4673-8539-3dcb1afcb68c-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "a5734963-fe7d-4673-8539-3dcb1afcb68c" (UID: "a5734963-fe7d-4673-8539-3dcb1afcb68c"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 18:46:28.514051 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:28.513959    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a5734963-fe7d-4673-8539-3dcb1afcb68c-config-volume" (OuterVolumeSpecName: "config-volume") pod "a5734963-fe7d-4673-8539-3dcb1afcb68c" (UID: "a5734963-fe7d-4673-8539-3dcb1afcb68c"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 18:46:28.514235 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:28.514209    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a5734963-fe7d-4673-8539-3dcb1afcb68c-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "a5734963-fe7d-4673-8539-3dcb1afcb68c" (UID: "a5734963-fe7d-4673-8539-3dcb1afcb68c"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 18:46:28.514339 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:28.514314    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a5734963-fe7d-4673-8539-3dcb1afcb68c-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "a5734963-fe7d-4673-8539-3dcb1afcb68c" (UID: "a5734963-fe7d-4673-8539-3dcb1afcb68c"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 18:46:28.514626 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:28.514609    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a5734963-fe7d-4673-8539-3dcb1afcb68c-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "a5734963-fe7d-4673-8539-3dcb1afcb68c" (UID: "a5734963-fe7d-4673-8539-3dcb1afcb68c"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 18:46:28.519205 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:28.519179    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a5734963-fe7d-4673-8539-3dcb1afcb68c-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "a5734963-fe7d-4673-8539-3dcb1afcb68c" (UID: "a5734963-fe7d-4673-8539-3dcb1afcb68c"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 18:46:28.526668 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:28.526646    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a5734963-fe7d-4673-8539-3dcb1afcb68c-web-config" (OuterVolumeSpecName: "web-config") pod "a5734963-fe7d-4673-8539-3dcb1afcb68c" (UID: "a5734963-fe7d-4673-8539-3dcb1afcb68c"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 18:46:28.611506 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:28.611471    2580 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a5734963-fe7d-4673-8539-3dcb1afcb68c-cluster-tls-config\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 24 18:46:28.611506 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:28.611497    2580 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a5734963-fe7d-4673-8539-3dcb1afcb68c-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 24 18:46:28.611506 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:28.611507    2580 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a5734963-fe7d-4673-8539-3dcb1afcb68c-tls-assets\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 24 18:46:28.611735 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:28.611516    2580 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a5734963-fe7d-4673-8539-3dcb1afcb68c-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 24 18:46:28.611735 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:28.611525    2580 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a5734963-fe7d-4673-8539-3dcb1afcb68c-config-volume\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 24 18:46:28.611735 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:28.611533    2580 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a5734963-fe7d-4673-8539-3dcb1afcb68c-config-out\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 24 18:46:28.611735 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:28.611541    2580 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a5734963-fe7d-4673-8539-3dcb1afcb68c-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 24 18:46:28.611735 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:28.611550    2580 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a5734963-fe7d-4673-8539-3dcb1afcb68c-web-config\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 24 18:46:28.611735 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:28.611557    2580 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a5734963-fe7d-4673-8539-3dcb1afcb68c-secret-alertmanager-main-tls\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 24 18:46:28.611735 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:28.611565    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2hqz8\" (UniqueName: \"kubernetes.io/projected/a5734963-fe7d-4673-8539-3dcb1afcb68c-kube-api-access-2hqz8\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 24 18:46:28.991229 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:28.991197    2580 generic.go:356] "Generic (PLEG): container finished" podID="a5734963-fe7d-4673-8539-3dcb1afcb68c" containerID="eac27c3b90486b85cf8dfe41fcc0a2624ccb9c4ae5724575f9e13ce9a5529739" exitCode=0
Jul 24 18:46:28.991398 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:28.991235    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a5734963-fe7d-4673-8539-3dcb1afcb68c","Type":"ContainerDied","Data":"eac27c3b90486b85cf8dfe41fcc0a2624ccb9c4ae5724575f9e13ce9a5529739"}
Jul 24 18:46:28.991398 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:28.991291    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a5734963-fe7d-4673-8539-3dcb1afcb68c","Type":"ContainerDied","Data":"b5b7449d7b7929a6f148064a979c5dfdc006fac9f7734b160d0785809f9bc2b5"}
Jul 24 18:46:28.991398 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:28.991303    2580 scope.go:117] "RemoveContainer" containerID="852cd2bb8a7880fb83eda645cb9a54114773f4db3175514fb711af7d7389c626"
Jul 24 18:46:28.991398 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:28.991287    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 24 18:46:28.999688 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:28.999567    2580 scope.go:117] "RemoveContainer" containerID="2afa43dbd3f4e1a73c1deec9319426757ab0af0180f933c07c3cc523d8125abf"
Jul 24 18:46:29.007063 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:29.007042    2580 scope.go:117] "RemoveContainer" containerID="50101f88060c6b98baf45ff9f960e32f050813eb421431d41996218bce9599bd"
Jul 24 18:46:29.014541 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:29.014505    2580 scope.go:117] "RemoveContainer" containerID="eac27c3b90486b85cf8dfe41fcc0a2624ccb9c4ae5724575f9e13ce9a5529739"
Jul 24 18:46:29.015225 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:29.015202    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 24 18:46:29.019912 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:29.019893    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 24 18:46:29.022459 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:29.022445    2580 scope.go:117] "RemoveContainer" containerID="2dc61923b7fcace29b52521d7064b74c85c57ec5e489eeff27b8654fa259ef2b"
Jul 24 18:46:29.029746 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:29.029722    2580 scope.go:117] "RemoveContainer" containerID="bd9587476dc30346522fc78b0282ea22431ef61923b1e53e7a3b21ea7664f419"
Jul 24 18:46:29.037403 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:29.037386    2580 scope.go:117] "RemoveContainer" containerID="5bd91a819655230194e8dc48489e3673fa65d4b004b9b80caccceb2a3d76d1ae"
Jul 24 18:46:29.044879 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:29.044862    2580 scope.go:117] "RemoveContainer" containerID="852cd2bb8a7880fb83eda645cb9a54114773f4db3175514fb711af7d7389c626"
Jul 24 18:46:29.045162 ip-10-0-141-146 kubenswrapper[2580]: E0724 18:46:29.045116    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"852cd2bb8a7880fb83eda645cb9a54114773f4db3175514fb711af7d7389c626\": container with ID starting with 852cd2bb8a7880fb83eda645cb9a54114773f4db3175514fb711af7d7389c626 not found: ID does not exist" containerID="852cd2bb8a7880fb83eda645cb9a54114773f4db3175514fb711af7d7389c626"
Jul 24 18:46:29.045246 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:29.045170    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"852cd2bb8a7880fb83eda645cb9a54114773f4db3175514fb711af7d7389c626"} err="failed to get container status \"852cd2bb8a7880fb83eda645cb9a54114773f4db3175514fb711af7d7389c626\": rpc error: code = NotFound desc = could not find container \"852cd2bb8a7880fb83eda645cb9a54114773f4db3175514fb711af7d7389c626\": container with ID starting with 852cd2bb8a7880fb83eda645cb9a54114773f4db3175514fb711af7d7389c626 not found: ID does not exist"
Jul 24 18:46:29.045246 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:29.045190    2580 scope.go:117] "RemoveContainer" containerID="2afa43dbd3f4e1a73c1deec9319426757ab0af0180f933c07c3cc523d8125abf"
Jul 24 18:46:29.045442 ip-10-0-141-146 kubenswrapper[2580]: E0724 18:46:29.045426    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2afa43dbd3f4e1a73c1deec9319426757ab0af0180f933c07c3cc523d8125abf\": container with ID starting with 2afa43dbd3f4e1a73c1deec9319426757ab0af0180f933c07c3cc523d8125abf not found: ID does not exist" containerID="2afa43dbd3f4e1a73c1deec9319426757ab0af0180f933c07c3cc523d8125abf"
Jul 24 18:46:29.045486 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:29.045450    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2afa43dbd3f4e1a73c1deec9319426757ab0af0180f933c07c3cc523d8125abf"} err="failed to get container status \"2afa43dbd3f4e1a73c1deec9319426757ab0af0180f933c07c3cc523d8125abf\": rpc error: code = NotFound desc = could not find container \"2afa43dbd3f4e1a73c1deec9319426757ab0af0180f933c07c3cc523d8125abf\": container with ID starting with 2afa43dbd3f4e1a73c1deec9319426757ab0af0180f933c07c3cc523d8125abf not found: ID does not exist"
Jul 24 18:46:29.045486 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:29.045465    2580 scope.go:117] "RemoveContainer" containerID="50101f88060c6b98baf45ff9f960e32f050813eb421431d41996218bce9599bd"
Jul 24 18:46:29.045712 ip-10-0-141-146 kubenswrapper[2580]: E0724 18:46:29.045694    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"50101f88060c6b98baf45ff9f960e32f050813eb421431d41996218bce9599bd\": container with ID starting with 50101f88060c6b98baf45ff9f960e32f050813eb421431d41996218bce9599bd not found: ID does not exist" containerID="50101f88060c6b98baf45ff9f960e32f050813eb421431d41996218bce9599bd"
Jul 24 18:46:29.045773 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:29.045722    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"50101f88060c6b98baf45ff9f960e32f050813eb421431d41996218bce9599bd"} err="failed to get container status \"50101f88060c6b98baf45ff9f960e32f050813eb421431d41996218bce9599bd\": rpc error: code = NotFound desc = could not find container \"50101f88060c6b98baf45ff9f960e32f050813eb421431d41996218bce9599bd\": container with ID starting with 50101f88060c6b98baf45ff9f960e32f050813eb421431d41996218bce9599bd not found: ID does not exist"
Jul 24 18:46:29.045773 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:29.045743    2580 scope.go:117] "RemoveContainer" containerID="eac27c3b90486b85cf8dfe41fcc0a2624ccb9c4ae5724575f9e13ce9a5529739"
Jul 24 18:46:29.045969 ip-10-0-141-146 kubenswrapper[2580]: E0724 18:46:29.045955    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eac27c3b90486b85cf8dfe41fcc0a2624ccb9c4ae5724575f9e13ce9a5529739\": container with ID starting with eac27c3b90486b85cf8dfe41fcc0a2624ccb9c4ae5724575f9e13ce9a5529739 not found: ID does not exist" containerID="eac27c3b90486b85cf8dfe41fcc0a2624ccb9c4ae5724575f9e13ce9a5529739"
Jul 24 18:46:29.046007 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:29.045974    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eac27c3b90486b85cf8dfe41fcc0a2624ccb9c4ae5724575f9e13ce9a5529739"} err="failed to get container status \"eac27c3b90486b85cf8dfe41fcc0a2624ccb9c4ae5724575f9e13ce9a5529739\": rpc error: code = NotFound desc = could not find container \"eac27c3b90486b85cf8dfe41fcc0a2624ccb9c4ae5724575f9e13ce9a5529739\": container with ID starting with eac27c3b90486b85cf8dfe41fcc0a2624ccb9c4ae5724575f9e13ce9a5529739 not found: ID does not exist"
Jul 24 18:46:29.046007 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:29.045986    2580 scope.go:117] "RemoveContainer" containerID="2dc61923b7fcace29b52521d7064b74c85c57ec5e489eeff27b8654fa259ef2b"
Jul 24 18:46:29.046200 ip-10-0-141-146 kubenswrapper[2580]: E0724 18:46:29.046182    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2dc61923b7fcace29b52521d7064b74c85c57ec5e489eeff27b8654fa259ef2b\": container with ID starting with 2dc61923b7fcace29b52521d7064b74c85c57ec5e489eeff27b8654fa259ef2b not found: ID does not exist" containerID="2dc61923b7fcace29b52521d7064b74c85c57ec5e489eeff27b8654fa259ef2b"
Jul 24 18:46:29.046349 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:29.046207    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2dc61923b7fcace29b52521d7064b74c85c57ec5e489eeff27b8654fa259ef2b"} err="failed to get container status \"2dc61923b7fcace29b52521d7064b74c85c57ec5e489eeff27b8654fa259ef2b\": rpc error: code = NotFound desc = could not find container \"2dc61923b7fcace29b52521d7064b74c85c57ec5e489eeff27b8654fa259ef2b\": container with ID starting with 2dc61923b7fcace29b52521d7064b74c85c57ec5e489eeff27b8654fa259ef2b not found: ID does not exist"
Jul 24 18:46:29.046349 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:29.046223    2580 scope.go:117] "RemoveContainer" containerID="bd9587476dc30346522fc78b0282ea22431ef61923b1e53e7a3b21ea7664f419"
Jul 24 18:46:29.046676 ip-10-0-141-146 kubenswrapper[2580]: E0724 18:46:29.046659    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bd9587476dc30346522fc78b0282ea22431ef61923b1e53e7a3b21ea7664f419\": container with ID starting with bd9587476dc30346522fc78b0282ea22431ef61923b1e53e7a3b21ea7664f419 not found: ID does not exist" containerID="bd9587476dc30346522fc78b0282ea22431ef61923b1e53e7a3b21ea7664f419"
Jul 24 18:46:29.046743 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:29.046680    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bd9587476dc30346522fc78b0282ea22431ef61923b1e53e7a3b21ea7664f419"} err="failed to get container status \"bd9587476dc30346522fc78b0282ea22431ef61923b1e53e7a3b21ea7664f419\": rpc error: code = NotFound desc = could not find container \"bd9587476dc30346522fc78b0282ea22431ef61923b1e53e7a3b21ea7664f419\": container with ID starting with bd9587476dc30346522fc78b0282ea22431ef61923b1e53e7a3b21ea7664f419 not found: ID does not exist"
Jul 24 18:46:29.046743 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:29.046695    2580 scope.go:117] "RemoveContainer" containerID="5bd91a819655230194e8dc48489e3673fa65d4b004b9b80caccceb2a3d76d1ae"
Jul 24 18:46:29.046942 ip-10-0-141-146 kubenswrapper[2580]: E0724 18:46:29.046923    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5bd91a819655230194e8dc48489e3673fa65d4b004b9b80caccceb2a3d76d1ae\": container with ID starting with 5bd91a819655230194e8dc48489e3673fa65d4b004b9b80caccceb2a3d76d1ae not found: ID does not exist" containerID="5bd91a819655230194e8dc48489e3673fa65d4b004b9b80caccceb2a3d76d1ae"
Jul 24 18:46:29.046995 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:29.046953    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5bd91a819655230194e8dc48489e3673fa65d4b004b9b80caccceb2a3d76d1ae"} err="failed to get container status \"5bd91a819655230194e8dc48489e3673fa65d4b004b9b80caccceb2a3d76d1ae\": rpc error: code = NotFound desc = could not find container \"5bd91a819655230194e8dc48489e3673fa65d4b004b9b80caccceb2a3d76d1ae\": container with ID starting with 5bd91a819655230194e8dc48489e3673fa65d4b004b9b80caccceb2a3d76d1ae not found: ID does not exist"
Jul 24 18:46:29.240964 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:29.240933    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a5734963-fe7d-4673-8539-3dcb1afcb68c" path="/var/lib/kubelet/pods/a5734963-fe7d-4673-8539-3dcb1afcb68c/volumes"
Jul 24 18:46:31.300516 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:31.300471    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7775fcdd7d-wvsn2"]
Jul 24 18:46:31.300950 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:31.300932    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a5734963-fe7d-4673-8539-3dcb1afcb68c" containerName="alertmanager"
Jul 24 18:46:31.300999 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:31.300955    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="a5734963-fe7d-4673-8539-3dcb1afcb68c" containerName="alertmanager"
Jul 24 18:46:31.300999 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:31.300978    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d36f00d-01ab-4493-84ee-597dca0e573d" containerName="console"
Jul 24 18:46:31.300999 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:31.300986    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d36f00d-01ab-4493-84ee-597dca0e573d" containerName="console"
Jul 24 18:46:31.301083 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:31.301003    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d6e53ad-4342-45bf-a64e-3c16dbe38451" containerName="console"
Jul 24 18:46:31.301083 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:31.301012    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d6e53ad-4342-45bf-a64e-3c16dbe38451" containerName="console"
Jul 24 18:46:31.301083 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:31.301025    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a5734963-fe7d-4673-8539-3dcb1afcb68c" containerName="kube-rbac-proxy-metric"
Jul 24 18:46:31.301083 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:31.301034    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="a5734963-fe7d-4673-8539-3dcb1afcb68c" containerName="kube-rbac-proxy-metric"
Jul 24 18:46:31.301083 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:31.301046    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a5734963-fe7d-4673-8539-3dcb1afcb68c" containerName="kube-rbac-proxy-web"
Jul 24 18:46:31.301083 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:31.301055    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="a5734963-fe7d-4673-8539-3dcb1afcb68c" containerName="kube-rbac-proxy-web"
Jul 24 18:46:31.301083 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:31.301068    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a5734963-fe7d-4673-8539-3dcb1afcb68c" containerName="kube-rbac-proxy"
Jul 24 18:46:31.301083 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:31.301076    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="a5734963-fe7d-4673-8539-3dcb1afcb68c" containerName="kube-rbac-proxy"
Jul 24 18:46:31.301347 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:31.301085    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a5734963-fe7d-4673-8539-3dcb1afcb68c" containerName="config-reloader"
Jul 24 18:46:31.301347 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:31.301094    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="a5734963-fe7d-4673-8539-3dcb1afcb68c" containerName="config-reloader"
Jul 24 18:46:31.301347 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:31.301110    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a5734963-fe7d-4673-8539-3dcb1afcb68c" containerName="prom-label-proxy"
Jul 24 18:46:31.301347 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:31.301138    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="a5734963-fe7d-4673-8539-3dcb1afcb68c" containerName="prom-label-proxy"
Jul 24 18:46:31.301347 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:31.301148    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a5734963-fe7d-4673-8539-3dcb1afcb68c" containerName="init-config-reloader"
Jul 24 18:46:31.301347 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:31.301156    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="a5734963-fe7d-4673-8539-3dcb1afcb68c" containerName="init-config-reloader"
Jul 24 18:46:31.301347 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:31.301230    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="7d6e53ad-4342-45bf-a64e-3c16dbe38451" containerName="console"
Jul 24 18:46:31.301347 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:31.301240    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="a5734963-fe7d-4673-8539-3dcb1afcb68c" containerName="alertmanager"
Jul 24 18:46:31.301347 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:31.301254    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="5d36f00d-01ab-4493-84ee-597dca0e573d" containerName="console"
Jul 24 18:46:31.301347 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:31.301264    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="a5734963-fe7d-4673-8539-3dcb1afcb68c" containerName="kube-rbac-proxy"
Jul 24 18:46:31.301347 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:31.301274    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="a5734963-fe7d-4673-8539-3dcb1afcb68c" containerName="kube-rbac-proxy-web"
Jul 24 18:46:31.301347 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:31.301283    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="a5734963-fe7d-4673-8539-3dcb1afcb68c" containerName="config-reloader"
Jul 24 18:46:31.301347 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:31.301293    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="a5734963-fe7d-4673-8539-3dcb1afcb68c" containerName="prom-label-proxy"
Jul 24 18:46:31.301347 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:31.301302    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="a5734963-fe7d-4673-8539-3dcb1afcb68c" containerName="kube-rbac-proxy-metric"
Jul 24 18:46:31.306882 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:31.306854    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7775fcdd7d-wvsn2"
Jul 24 18:46:31.320241 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:31.320212    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 24 18:46:31.320518 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:31.320493    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="50400a73-3915-44f6-af79-bc9425cb863f" containerName="prometheus" containerID="cri-o://a9c8a3b2e06a51aaf98e667886be98545375eee0a7311c0ebf3f496ae2ac459b" gracePeriod=600
Jul 24 18:46:31.320584 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:31.320528    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="50400a73-3915-44f6-af79-bc9425cb863f" containerName="kube-rbac-proxy-thanos" containerID="cri-o://04022a52896f2e2ae7bd44b920db6752bcd96e2bc6a6e4df8a8a4f756d0737db" gracePeriod=600
Jul 24 18:46:31.320584 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:31.320493    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="50400a73-3915-44f6-af79-bc9425cb863f" containerName="kube-rbac-proxy" containerID="cri-o://f3bbd9b435324112501cc66eebfd66ad7bf10f5d17c253925452b426e8699e70" gracePeriod=600
Jul 24 18:46:31.320694 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:31.320595    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="50400a73-3915-44f6-af79-bc9425cb863f" containerName="config-reloader" containerID="cri-o://2496b934daa188c265c6abe7182c0bd8f12a441ee5c8f382eea54f9fb27a2b26" gracePeriod=600
Jul 24 18:46:31.320694 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:31.320569    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="50400a73-3915-44f6-af79-bc9425cb863f" containerName="thanos-sidecar" containerID="cri-o://e288cdfdcd9a5a2032a09eda636d6007015ca109d7c95dc1178ae64f9ce8848e" gracePeriod=600
Jul 24 18:46:31.320815 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:31.320569    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="50400a73-3915-44f6-af79-bc9425cb863f" containerName="kube-rbac-proxy-web" containerID="cri-o://d2773c38de8166993facef2f67d4b51785bfb472aad56a793c050372d77599fa" gracePeriod=600
Jul 24 18:46:31.328295 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:31.328259    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7775fcdd7d-wvsn2"]
Jul 24 18:46:31.372452 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:31.372422    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:46:31.430150 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:31.430097    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:46:31.436582 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:31.436546    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/98827dd6-0458-4403-a047-e77a123383ea-console-oauth-config\") pod \"console-7775fcdd7d-wvsn2\" (UID: \"98827dd6-0458-4403-a047-e77a123383ea\") " pod="openshift-console/console-7775fcdd7d-wvsn2"
Jul 24 18:46:31.436766 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:31.436598    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/98827dd6-0458-4403-a047-e77a123383ea-oauth-serving-cert\") pod \"console-7775fcdd7d-wvsn2\" (UID: \"98827dd6-0458-4403-a047-e77a123383ea\") " pod="openshift-console/console-7775fcdd7d-wvsn2"
Jul 24 18:46:31.436766 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:31.436641    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hn5cl\" (UniqueName: \"kubernetes.io/projected/98827dd6-0458-4403-a047-e77a123383ea-kube-api-access-hn5cl\") pod \"console-7775fcdd7d-wvsn2\" (UID: \"98827dd6-0458-4403-a047-e77a123383ea\") " pod="openshift-console/console-7775fcdd7d-wvsn2"
Jul 24 18:46:31.436766 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:31.436672    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/98827dd6-0458-4403-a047-e77a123383ea-console-serving-cert\") pod \"console-7775fcdd7d-wvsn2\" (UID: \"98827dd6-0458-4403-a047-e77a123383ea\") " pod="openshift-console/console-7775fcdd7d-wvsn2"
Jul 24 18:46:31.436766 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:31.436704    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/98827dd6-0458-4403-a047-e77a123383ea-trusted-ca-bundle\") pod \"console-7775fcdd7d-wvsn2\" (UID: \"98827dd6-0458-4403-a047-e77a123383ea\") " pod="openshift-console/console-7775fcdd7d-wvsn2"
Jul 24 18:46:31.436766 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:31.436732    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/98827dd6-0458-4403-a047-e77a123383ea-service-ca\") pod \"console-7775fcdd7d-wvsn2\" (UID: \"98827dd6-0458-4403-a047-e77a123383ea\") " pod="openshift-console/console-7775fcdd7d-wvsn2"
Jul 24 18:46:31.437043 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:31.436877    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/98827dd6-0458-4403-a047-e77a123383ea-console-config\") pod \"console-7775fcdd7d-wvsn2\" (UID: \"98827dd6-0458-4403-a047-e77a123383ea\") " pod="openshift-console/console-7775fcdd7d-wvsn2"
Jul 24 18:46:31.501102 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:31.500835    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:46:31.538189 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:31.538156    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/98827dd6-0458-4403-a047-e77a123383ea-console-oauth-config\") pod \"console-7775fcdd7d-wvsn2\" (UID: \"98827dd6-0458-4403-a047-e77a123383ea\") " pod="openshift-console/console-7775fcdd7d-wvsn2"
Jul 24 18:46:31.538386 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:31.538204    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/98827dd6-0458-4403-a047-e77a123383ea-oauth-serving-cert\") pod \"console-7775fcdd7d-wvsn2\" (UID: \"98827dd6-0458-4403-a047-e77a123383ea\") " pod="openshift-console/console-7775fcdd7d-wvsn2"
Jul 24 18:46:31.538386 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:31.538239    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hn5cl\" (UniqueName: \"kubernetes.io/projected/98827dd6-0458-4403-a047-e77a123383ea-kube-api-access-hn5cl\") pod \"console-7775fcdd7d-wvsn2\" (UID: \"98827dd6-0458-4403-a047-e77a123383ea\") " pod="openshift-console/console-7775fcdd7d-wvsn2"
Jul 24 18:46:31.538386 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:31.538273    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/98827dd6-0458-4403-a047-e77a123383ea-console-serving-cert\") pod \"console-7775fcdd7d-wvsn2\" (UID: \"98827dd6-0458-4403-a047-e77a123383ea\") " pod="openshift-console/console-7775fcdd7d-wvsn2"
Jul 24 18:46:31.538386 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:31.538308    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/98827dd6-0458-4403-a047-e77a123383ea-trusted-ca-bundle\") pod \"console-7775fcdd7d-wvsn2\" (UID: \"98827dd6-0458-4403-a047-e77a123383ea\") " pod="openshift-console/console-7775fcdd7d-wvsn2"
Jul 24 18:46:31.538386 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:31.538339    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/98827dd6-0458-4403-a047-e77a123383ea-service-ca\") pod \"console-7775fcdd7d-wvsn2\" (UID: \"98827dd6-0458-4403-a047-e77a123383ea\") " pod="openshift-console/console-7775fcdd7d-wvsn2"
Jul 24 18:46:31.538386 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:31.538381    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/98827dd6-0458-4403-a047-e77a123383ea-console-config\") pod \"console-7775fcdd7d-wvsn2\" (UID: \"98827dd6-0458-4403-a047-e77a123383ea\") " pod="openshift-console/console-7775fcdd7d-wvsn2"
Jul 24 18:46:31.541000 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:31.539116    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/98827dd6-0458-4403-a047-e77a123383ea-console-config\") pod \"console-7775fcdd7d-wvsn2\" (UID: \"98827dd6-0458-4403-a047-e77a123383ea\") " pod="openshift-console/console-7775fcdd7d-wvsn2"
Jul 24 18:46:31.541000 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:31.540171    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/98827dd6-0458-4403-a047-e77a123383ea-trusted-ca-bundle\") pod \"console-7775fcdd7d-wvsn2\" (UID: \"98827dd6-0458-4403-a047-e77a123383ea\") " pod="openshift-console/console-7775fcdd7d-wvsn2"
Jul 24 18:46:31.541000 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:31.540675    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/98827dd6-0458-4403-a047-e77a123383ea-service-ca\") pod \"console-7775fcdd7d-wvsn2\" (UID: \"98827dd6-0458-4403-a047-e77a123383ea\") " pod="openshift-console/console-7775fcdd7d-wvsn2"
Jul 24 18:46:31.541287 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:31.541254    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/98827dd6-0458-4403-a047-e77a123383ea-oauth-serving-cert\") pod \"console-7775fcdd7d-wvsn2\" (UID: \"98827dd6-0458-4403-a047-e77a123383ea\") " pod="openshift-console/console-7775fcdd7d-wvsn2"
Jul 24 18:46:31.541910 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:31.541885    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/98827dd6-0458-4403-a047-e77a123383ea-console-oauth-config\") pod \"console-7775fcdd7d-wvsn2\" (UID: \"98827dd6-0458-4403-a047-e77a123383ea\") " pod="openshift-console/console-7775fcdd7d-wvsn2"
Jul 24 18:46:31.543187 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:31.543167    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/98827dd6-0458-4403-a047-e77a123383ea-console-serving-cert\") pod \"console-7775fcdd7d-wvsn2\" (UID: \"98827dd6-0458-4403-a047-e77a123383ea\") " pod="openshift-console/console-7775fcdd7d-wvsn2"
Jul 24 18:46:31.552632 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:31.552572    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hn5cl\" (UniqueName: \"kubernetes.io/projected/98827dd6-0458-4403-a047-e77a123383ea-kube-api-access-hn5cl\") pod \"console-7775fcdd7d-wvsn2\" (UID: \"98827dd6-0458-4403-a047-e77a123383ea\") " pod="openshift-console/console-7775fcdd7d-wvsn2"
Jul 24 18:46:31.560971 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:31.560946    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:46:31.586744 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:31.586716    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 18:46:31.618861 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:31.618826    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7775fcdd7d-wvsn2"
Jul 24 18:46:31.740608 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:31.740585    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/50400a73-3915-44f6-af79-bc9425cb863f-config-out\") pod \"50400a73-3915-44f6-af79-bc9425cb863f\" (UID: \"50400a73-3915-44f6-af79-bc9425cb863f\") "
Jul 24 18:46:31.740778 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:31.740623    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/50400a73-3915-44f6-af79-bc9425cb863f-configmap-serving-certs-ca-bundle\") pod \"50400a73-3915-44f6-af79-bc9425cb863f\" (UID: \"50400a73-3915-44f6-af79-bc9425cb863f\") "
Jul 24 18:46:31.740778 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:31.740649    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/50400a73-3915-44f6-af79-bc9425cb863f-config\") pod \"50400a73-3915-44f6-af79-bc9425cb863f\" (UID: \"50400a73-3915-44f6-af79-bc9425cb863f\") "
Jul 24 18:46:31.740778 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:31.740681    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/50400a73-3915-44f6-af79-bc9425cb863f-secret-grpc-tls\") pod \"50400a73-3915-44f6-af79-bc9425cb863f\" (UID: \"50400a73-3915-44f6-af79-bc9425cb863f\") "
Jul 24 18:46:31.740936 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:31.740802    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/50400a73-3915-44f6-af79-bc9425cb863f-secret-metrics-client-certs\") pod \"50400a73-3915-44f6-af79-bc9425cb863f\" (UID: \"50400a73-3915-44f6-af79-bc9425cb863f\") "
Jul 24 18:46:31.741040 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:31.741009    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/50400a73-3915-44f6-af79-bc9425cb863f-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "50400a73-3915-44f6-af79-bc9425cb863f" (UID: "50400a73-3915-44f6-af79-bc9425cb863f"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 18:46:31.741146 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:31.741071    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/50400a73-3915-44f6-af79-bc9425cb863f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"50400a73-3915-44f6-af79-bc9425cb863f\" (UID: \"50400a73-3915-44f6-af79-bc9425cb863f\") "
Jul 24 18:46:31.741146 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:31.741133    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/50400a73-3915-44f6-af79-bc9425cb863f-thanos-prometheus-http-client-file\") pod \"50400a73-3915-44f6-af79-bc9425cb863f\" (UID: \"50400a73-3915-44f6-af79-bc9425cb863f\") "
Jul 24 18:46:31.741246 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:31.741166    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/50400a73-3915-44f6-af79-bc9425cb863f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"50400a73-3915-44f6-af79-bc9425cb863f\" (UID: \"50400a73-3915-44f6-af79-bc9425cb863f\") "
Jul 24 18:46:31.741246 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:31.741193    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/50400a73-3915-44f6-af79-bc9425cb863f-secret-prometheus-k8s-tls\") pod \"50400a73-3915-44f6-af79-bc9425cb863f\" (UID: \"50400a73-3915-44f6-af79-bc9425cb863f\") "
Jul 24 18:46:31.741246 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:31.741225    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/50400a73-3915-44f6-af79-bc9425cb863f-web-config\") pod \"50400a73-3915-44f6-af79-bc9425cb863f\" (UID: \"50400a73-3915-44f6-af79-bc9425cb863f\") "
Jul 24 18:46:31.741442 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:31.741251    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/50400a73-3915-44f6-af79-bc9425cb863f-configmap-metrics-client-ca\") pod \"50400a73-3915-44f6-af79-bc9425cb863f\" (UID: \"50400a73-3915-44f6-af79-bc9425cb863f\") "
Jul 24 18:46:31.741561 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:31.741496    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/50400a73-3915-44f6-af79-bc9425cb863f-secret-kube-rbac-proxy\") pod \"50400a73-3915-44f6-af79-bc9425cb863f\" (UID: \"50400a73-3915-44f6-af79-bc9425cb863f\") "
Jul 24 18:46:31.741561 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:31.741547    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g6wqw\" (UniqueName: \"kubernetes.io/projected/50400a73-3915-44f6-af79-bc9425cb863f-kube-api-access-g6wqw\") pod \"50400a73-3915-44f6-af79-bc9425cb863f\" (UID: \"50400a73-3915-44f6-af79-bc9425cb863f\") "
Jul 24 18:46:31.741683 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:31.741577    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/50400a73-3915-44f6-af79-bc9425cb863f-configmap-kubelet-serving-ca-bundle\") pod \"50400a73-3915-44f6-af79-bc9425cb863f\" (UID: \"50400a73-3915-44f6-af79-bc9425cb863f\") "
Jul 24 18:46:31.741683 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:31.741605    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/50400a73-3915-44f6-af79-bc9425cb863f-prometheus-k8s-rulefiles-1\") pod \"50400a73-3915-44f6-af79-bc9425cb863f\" (UID: \"50400a73-3915-44f6-af79-bc9425cb863f\") "
Jul 24 18:46:31.741683 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:31.741629    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/50400a73-3915-44f6-af79-bc9425cb863f-prometheus-k8s-db\") pod \"50400a73-3915-44f6-af79-bc9425cb863f\" (UID: \"50400a73-3915-44f6-af79-bc9425cb863f\") "
Jul 24 18:46:31.741683 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:31.741662    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/50400a73-3915-44f6-af79-bc9425cb863f-tls-assets\") pod \"50400a73-3915-44f6-af79-bc9425cb863f\" (UID: \"50400a73-3915-44f6-af79-bc9425cb863f\") "
Jul 24 18:46:31.741862 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:31.741693    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/50400a73-3915-44f6-af79-bc9425cb863f-prometheus-trusted-ca-bundle\") pod \"50400a73-3915-44f6-af79-bc9425cb863f\" (UID: \"50400a73-3915-44f6-af79-bc9425cb863f\") "
Jul 24 18:46:31.741862 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:31.741718    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/50400a73-3915-44f6-af79-bc9425cb863f-prometheus-k8s-rulefiles-2\") pod \"50400a73-3915-44f6-af79-bc9425cb863f\" (UID: \"50400a73-3915-44f6-af79-bc9425cb863f\") "
Jul 24 18:46:31.741862 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:31.741757    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/50400a73-3915-44f6-af79-bc9425cb863f-prometheus-k8s-rulefiles-0\") pod \"50400a73-3915-44f6-af79-bc9425cb863f\" (UID: \"50400a73-3915-44f6-af79-bc9425cb863f\") "
Jul 24 18:46:31.742098 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:31.742078    2580 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/50400a73-3915-44f6-af79-bc9425cb863f-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 24 18:46:31.743865 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:31.742615    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/50400a73-3915-44f6-af79-bc9425cb863f-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "50400a73-3915-44f6-af79-bc9425cb863f" (UID: "50400a73-3915-44f6-af79-bc9425cb863f"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 18:46:31.743865 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:31.742725    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/50400a73-3915-44f6-af79-bc9425cb863f-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "50400a73-3915-44f6-af79-bc9425cb863f" (UID: "50400a73-3915-44f6-af79-bc9425cb863f"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 18:46:31.744426 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:31.744398    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/50400a73-3915-44f6-af79-bc9425cb863f-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "50400a73-3915-44f6-af79-bc9425cb863f" (UID: "50400a73-3915-44f6-af79-bc9425cb863f"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 18:46:31.745148 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:31.744905    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/50400a73-3915-44f6-af79-bc9425cb863f-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "50400a73-3915-44f6-af79-bc9425cb863f" (UID: "50400a73-3915-44f6-af79-bc9425cb863f"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 18:46:31.745345 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:31.745299    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/50400a73-3915-44f6-af79-bc9425cb863f-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "50400a73-3915-44f6-af79-bc9425cb863f" (UID: "50400a73-3915-44f6-af79-bc9425cb863f"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 18:46:31.745345 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:31.745321    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/50400a73-3915-44f6-af79-bc9425cb863f-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "50400a73-3915-44f6-af79-bc9425cb863f" (UID: "50400a73-3915-44f6-af79-bc9425cb863f"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 18:46:31.745683 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:31.745656    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/50400a73-3915-44f6-af79-bc9425cb863f-config" (OuterVolumeSpecName: "config") pod "50400a73-3915-44f6-af79-bc9425cb863f" (UID: "50400a73-3915-44f6-af79-bc9425cb863f"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 18:46:31.745863 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:31.745836    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/50400a73-3915-44f6-af79-bc9425cb863f-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "50400a73-3915-44f6-af79-bc9425cb863f" (UID: "50400a73-3915-44f6-af79-bc9425cb863f"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 18:46:31.746026 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:31.745985    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/50400a73-3915-44f6-af79-bc9425cb863f-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "50400a73-3915-44f6-af79-bc9425cb863f" (UID: "50400a73-3915-44f6-af79-bc9425cb863f"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 18:46:31.746607 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:31.746560    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/50400a73-3915-44f6-af79-bc9425cb863f-kube-api-access-g6wqw" (OuterVolumeSpecName: "kube-api-access-g6wqw") pod "50400a73-3915-44f6-af79-bc9425cb863f" (UID: "50400a73-3915-44f6-af79-bc9425cb863f"). InnerVolumeSpecName "kube-api-access-g6wqw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 18:46:31.748575 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:31.748542    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/50400a73-3915-44f6-af79-bc9425cb863f-config-out" (OuterVolumeSpecName: "config-out") pod "50400a73-3915-44f6-af79-bc9425cb863f" (UID: "50400a73-3915-44f6-af79-bc9425cb863f"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 18:46:31.748821 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:31.748792    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/50400a73-3915-44f6-af79-bc9425cb863f-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "50400a73-3915-44f6-af79-bc9425cb863f" (UID: "50400a73-3915-44f6-af79-bc9425cb863f"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 18:46:31.749265 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:31.749227    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/50400a73-3915-44f6-af79-bc9425cb863f-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "50400a73-3915-44f6-af79-bc9425cb863f" (UID: "50400a73-3915-44f6-af79-bc9425cb863f"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 18:46:31.749366 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:31.749319    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/50400a73-3915-44f6-af79-bc9425cb863f-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "50400a73-3915-44f6-af79-bc9425cb863f" (UID: "50400a73-3915-44f6-af79-bc9425cb863f"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 18:46:31.749466 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:31.749441    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/50400a73-3915-44f6-af79-bc9425cb863f-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "50400a73-3915-44f6-af79-bc9425cb863f" (UID: "50400a73-3915-44f6-af79-bc9425cb863f"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 18:46:31.749466 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:31.749457    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/50400a73-3915-44f6-af79-bc9425cb863f-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "50400a73-3915-44f6-af79-bc9425cb863f" (UID: "50400a73-3915-44f6-af79-bc9425cb863f"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 18:46:31.749597 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:31.749576    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/50400a73-3915-44f6-af79-bc9425cb863f-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "50400a73-3915-44f6-af79-bc9425cb863f" (UID: "50400a73-3915-44f6-af79-bc9425cb863f"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 18:46:31.750256 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:31.750240    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/50400a73-3915-44f6-af79-bc9425cb863f-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "50400a73-3915-44f6-af79-bc9425cb863f" (UID: "50400a73-3915-44f6-af79-bc9425cb863f"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 18:46:31.758356 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:31.758337    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/50400a73-3915-44f6-af79-bc9425cb863f-web-config" (OuterVolumeSpecName: "web-config") pod "50400a73-3915-44f6-af79-bc9425cb863f" (UID: "50400a73-3915-44f6-af79-bc9425cb863f"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 18:46:31.761578 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:31.761554    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7775fcdd7d-wvsn2"]
Jul 24 18:46:31.764945 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:46:31.764921    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98827dd6_0458_4403_a047_e77a123383ea.slice/crio-5d0e0e13f9573294e94cf5f934afdf7477354a259dbbd02de82df0f358f5e2c3 WatchSource:0}: Error finding container 5d0e0e13f9573294e94cf5f934afdf7477354a259dbbd02de82df0f358f5e2c3: Status 404 returned error can't find the container with id 5d0e0e13f9573294e94cf5f934afdf7477354a259dbbd02de82df0f358f5e2c3
Jul 24 18:46:31.843109 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:31.843086    2580 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/50400a73-3915-44f6-af79-bc9425cb863f-config\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 24 18:46:31.843109 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:31.843110    2580 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/50400a73-3915-44f6-af79-bc9425cb863f-secret-grpc-tls\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 24 18:46:31.843249 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:31.843138    2580 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/50400a73-3915-44f6-af79-bc9425cb863f-secret-metrics-client-certs\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 24 18:46:31.843249 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:31.843153    2580 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/50400a73-3915-44f6-af79-bc9425cb863f-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 24 18:46:31.843249 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:31.843166    2580 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/50400a73-3915-44f6-af79-bc9425cb863f-thanos-prometheus-http-client-file\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 24 18:46:31.843249 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:31.843179    2580 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/50400a73-3915-44f6-af79-bc9425cb863f-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 24 18:46:31.843249 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:31.843188    2580 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/50400a73-3915-44f6-af79-bc9425cb863f-secret-prometheus-k8s-tls\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 24 18:46:31.843249 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:31.843196    2580 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/50400a73-3915-44f6-af79-bc9425cb863f-web-config\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 24 18:46:31.843249 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:31.843205    2580 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/50400a73-3915-44f6-af79-bc9425cb863f-configmap-metrics-client-ca\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 24 18:46:31.843249 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:31.843215    2580 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/50400a73-3915-44f6-af79-bc9425cb863f-secret-kube-rbac-proxy\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 24 18:46:31.843249 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:31.843223    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g6wqw\" (UniqueName: \"kubernetes.io/projected/50400a73-3915-44f6-af79-bc9425cb863f-kube-api-access-g6wqw\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 24 18:46:31.843249 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:31.843232    2580 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/50400a73-3915-44f6-af79-bc9425cb863f-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 24 18:46:31.843560 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:31.843242    2580 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/50400a73-3915-44f6-af79-bc9425cb863f-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 24 18:46:31.843560 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:31.843265    2580 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/50400a73-3915-44f6-af79-bc9425cb863f-prometheus-k8s-db\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 24 18:46:31.843560 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:31.843273    2580 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/50400a73-3915-44f6-af79-bc9425cb863f-tls-assets\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 24 18:46:31.843560 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:31.843281    2580 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/50400a73-3915-44f6-af79-bc9425cb863f-prometheus-trusted-ca-bundle\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 24 18:46:31.843560 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:31.843289    2580 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/50400a73-3915-44f6-af79-bc9425cb863f-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 24 18:46:31.843560 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:31.843298    2580 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/50400a73-3915-44f6-af79-bc9425cb863f-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 24 18:46:31.843560 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:31.843306    2580 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/50400a73-3915-44f6-af79-bc9425cb863f-config-out\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 24 18:46:32.006723 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.006685    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7775fcdd7d-wvsn2" event={"ID":"98827dd6-0458-4403-a047-e77a123383ea","Type":"ContainerStarted","Data":"75225c99574fb6afc76014179166a198e7be3d22377a157b67fe01a42c0c68f2"}
Jul 24 18:46:32.006908 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.006744    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7775fcdd7d-wvsn2" event={"ID":"98827dd6-0458-4403-a047-e77a123383ea","Type":"ContainerStarted","Data":"5d0e0e13f9573294e94cf5f934afdf7477354a259dbbd02de82df0f358f5e2c3"}
Jul 24 18:46:32.009739 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.009700    2580 generic.go:356] "Generic (PLEG): container finished" podID="50400a73-3915-44f6-af79-bc9425cb863f" containerID="04022a52896f2e2ae7bd44b920db6752bcd96e2bc6a6e4df8a8a4f756d0737db" exitCode=0
Jul 24 18:46:32.009739 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.009725    2580 generic.go:356] "Generic (PLEG): container finished" podID="50400a73-3915-44f6-af79-bc9425cb863f" containerID="f3bbd9b435324112501cc66eebfd66ad7bf10f5d17c253925452b426e8699e70" exitCode=0
Jul 24 18:46:32.009739 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.009734    2580 generic.go:356] "Generic (PLEG): container finished" podID="50400a73-3915-44f6-af79-bc9425cb863f" containerID="d2773c38de8166993facef2f67d4b51785bfb472aad56a793c050372d77599fa" exitCode=0
Jul 24 18:46:32.009739 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.009742    2580 generic.go:356] "Generic (PLEG): container finished" podID="50400a73-3915-44f6-af79-bc9425cb863f" containerID="e288cdfdcd9a5a2032a09eda636d6007015ca109d7c95dc1178ae64f9ce8848e" exitCode=0
Jul 24 18:46:32.009994 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.009749    2580 generic.go:356] "Generic (PLEG): container finished" podID="50400a73-3915-44f6-af79-bc9425cb863f" containerID="2496b934daa188c265c6abe7182c0bd8f12a441ee5c8f382eea54f9fb27a2b26" exitCode=0
Jul 24 18:46:32.009994 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.009757    2580 generic.go:356] "Generic (PLEG): container finished" podID="50400a73-3915-44f6-af79-bc9425cb863f" containerID="a9c8a3b2e06a51aaf98e667886be98545375eee0a7311c0ebf3f496ae2ac459b" exitCode=0
Jul 24 18:46:32.009994 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.009780    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"50400a73-3915-44f6-af79-bc9425cb863f","Type":"ContainerDied","Data":"04022a52896f2e2ae7bd44b920db6752bcd96e2bc6a6e4df8a8a4f756d0737db"}
Jul 24 18:46:32.009994 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.009845    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 18:46:32.009994 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.009861    2580 scope.go:117] "RemoveContainer" containerID="04022a52896f2e2ae7bd44b920db6752bcd96e2bc6a6e4df8a8a4f756d0737db"
Jul 24 18:46:32.010233 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.009849    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"50400a73-3915-44f6-af79-bc9425cb863f","Type":"ContainerDied","Data":"f3bbd9b435324112501cc66eebfd66ad7bf10f5d17c253925452b426e8699e70"}
Jul 24 18:46:32.010233 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.010099    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"50400a73-3915-44f6-af79-bc9425cb863f","Type":"ContainerDied","Data":"d2773c38de8166993facef2f67d4b51785bfb472aad56a793c050372d77599fa"}
Jul 24 18:46:32.010233 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.010170    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"50400a73-3915-44f6-af79-bc9425cb863f","Type":"ContainerDied","Data":"e288cdfdcd9a5a2032a09eda636d6007015ca109d7c95dc1178ae64f9ce8848e"}
Jul 24 18:46:32.010233 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.010205    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"50400a73-3915-44f6-af79-bc9425cb863f","Type":"ContainerDied","Data":"2496b934daa188c265c6abe7182c0bd8f12a441ee5c8f382eea54f9fb27a2b26"}
Jul 24 18:46:32.010365 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.010243    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"50400a73-3915-44f6-af79-bc9425cb863f","Type":"ContainerDied","Data":"a9c8a3b2e06a51aaf98e667886be98545375eee0a7311c0ebf3f496ae2ac459b"}
Jul 24 18:46:32.010365 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.010275    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"50400a73-3915-44f6-af79-bc9425cb863f","Type":"ContainerDied","Data":"0382284c5cbff34c29019af0dc6bf19b25c16f4630ec65f44df1c78412356002"}
Jul 24 18:46:32.018113 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.018095    2580 scope.go:117] "RemoveContainer" containerID="f3bbd9b435324112501cc66eebfd66ad7bf10f5d17c253925452b426e8699e70"
Jul 24 18:46:32.024449 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.024399    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7775fcdd7d-wvsn2" podStartSLOduration=1.024379745 podStartE2EDuration="1.024379745s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 18:46:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:46:32.023253942 +0000 UTC m=+147.232625986" watchObservedRunningTime="2026-07-24 18:46:32.024379745 +0000 UTC m=+147.233751789"
Jul 24 18:46:32.026001 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.025988    2580 scope.go:117] "RemoveContainer" containerID="d2773c38de8166993facef2f67d4b51785bfb472aad56a793c050372d77599fa"
Jul 24 18:46:32.033723 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.033703    2580 scope.go:117] "RemoveContainer" containerID="e288cdfdcd9a5a2032a09eda636d6007015ca109d7c95dc1178ae64f9ce8848e"
Jul 24 18:46:32.039050 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.039030    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 24 18:46:32.041073 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.041060    2580 scope.go:117] "RemoveContainer" containerID="2496b934daa188c265c6abe7182c0bd8f12a441ee5c8f382eea54f9fb27a2b26"
Jul 24 18:46:32.047967 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.047929    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 24 18:46:32.052653 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.052623    2580 scope.go:117] "RemoveContainer" containerID="a9c8a3b2e06a51aaf98e667886be98545375eee0a7311c0ebf3f496ae2ac459b"
Jul 24 18:46:32.060236 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.060203    2580 scope.go:117] "RemoveContainer" containerID="f1af4d3a66b412bf49090ec6ff61203254802ee5417138fd3e9d02ae334ef01f"
Jul 24 18:46:32.067252 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.067236    2580 scope.go:117] "RemoveContainer" containerID="04022a52896f2e2ae7bd44b920db6752bcd96e2bc6a6e4df8a8a4f756d0737db"
Jul 24 18:46:32.067521 ip-10-0-141-146 kubenswrapper[2580]: E0724 18:46:32.067502    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"04022a52896f2e2ae7bd44b920db6752bcd96e2bc6a6e4df8a8a4f756d0737db\": container with ID starting with 04022a52896f2e2ae7bd44b920db6752bcd96e2bc6a6e4df8a8a4f756d0737db not found: ID does not exist" containerID="04022a52896f2e2ae7bd44b920db6752bcd96e2bc6a6e4df8a8a4f756d0737db"
Jul 24 18:46:32.067558 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.067531    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"04022a52896f2e2ae7bd44b920db6752bcd96e2bc6a6e4df8a8a4f756d0737db"} err="failed to get container status \"04022a52896f2e2ae7bd44b920db6752bcd96e2bc6a6e4df8a8a4f756d0737db\": rpc error: code = NotFound desc = could not find container \"04022a52896f2e2ae7bd44b920db6752bcd96e2bc6a6e4df8a8a4f756d0737db\": container with ID starting with 04022a52896f2e2ae7bd44b920db6752bcd96e2bc6a6e4df8a8a4f756d0737db not found: ID does not exist"
Jul 24 18:46:32.067558 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.067552    2580 scope.go:117] "RemoveContainer" containerID="f3bbd9b435324112501cc66eebfd66ad7bf10f5d17c253925452b426e8699e70"
Jul 24 18:46:32.067809 ip-10-0-141-146 kubenswrapper[2580]: E0724 18:46:32.067792    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f3bbd9b435324112501cc66eebfd66ad7bf10f5d17c253925452b426e8699e70\": container with ID starting with f3bbd9b435324112501cc66eebfd66ad7bf10f5d17c253925452b426e8699e70 not found: ID does not exist" containerID="f3bbd9b435324112501cc66eebfd66ad7bf10f5d17c253925452b426e8699e70"
Jul 24 18:46:32.067844 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.067815    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f3bbd9b435324112501cc66eebfd66ad7bf10f5d17c253925452b426e8699e70"} err="failed to get container status \"f3bbd9b435324112501cc66eebfd66ad7bf10f5d17c253925452b426e8699e70\": rpc error: code = NotFound desc = could not find container \"f3bbd9b435324112501cc66eebfd66ad7bf10f5d17c253925452b426e8699e70\": container with ID starting with f3bbd9b435324112501cc66eebfd66ad7bf10f5d17c253925452b426e8699e70 not found: ID does not exist"
Jul 24 18:46:32.067844 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.067832    2580 scope.go:117] "RemoveContainer" containerID="d2773c38de8166993facef2f67d4b51785bfb472aad56a793c050372d77599fa"
Jul 24 18:46:32.068046 ip-10-0-141-146 kubenswrapper[2580]: E0724 18:46:32.068028    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d2773c38de8166993facef2f67d4b51785bfb472aad56a793c050372d77599fa\": container with ID starting with d2773c38de8166993facef2f67d4b51785bfb472aad56a793c050372d77599fa not found: ID does not exist" containerID="d2773c38de8166993facef2f67d4b51785bfb472aad56a793c050372d77599fa"
Jul 24 18:46:32.068089 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.068051    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d2773c38de8166993facef2f67d4b51785bfb472aad56a793c050372d77599fa"} err="failed to get container status \"d2773c38de8166993facef2f67d4b51785bfb472aad56a793c050372d77599fa\": rpc error: code = NotFound desc = could not find container \"d2773c38de8166993facef2f67d4b51785bfb472aad56a793c050372d77599fa\": container with ID starting with d2773c38de8166993facef2f67d4b51785bfb472aad56a793c050372d77599fa not found: ID does not exist"
Jul 24 18:46:32.068089 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.068066    2580 scope.go:117] "RemoveContainer" containerID="e288cdfdcd9a5a2032a09eda636d6007015ca109d7c95dc1178ae64f9ce8848e"
Jul 24 18:46:32.068342 ip-10-0-141-146 kubenswrapper[2580]: E0724 18:46:32.068327    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e288cdfdcd9a5a2032a09eda636d6007015ca109d7c95dc1178ae64f9ce8848e\": container with ID starting with e288cdfdcd9a5a2032a09eda636d6007015ca109d7c95dc1178ae64f9ce8848e not found: ID does not exist" containerID="e288cdfdcd9a5a2032a09eda636d6007015ca109d7c95dc1178ae64f9ce8848e"
Jul 24 18:46:32.068382 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.068345    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e288cdfdcd9a5a2032a09eda636d6007015ca109d7c95dc1178ae64f9ce8848e"} err="failed to get container status \"e288cdfdcd9a5a2032a09eda636d6007015ca109d7c95dc1178ae64f9ce8848e\": rpc error: code = NotFound desc = could not find container \"e288cdfdcd9a5a2032a09eda636d6007015ca109d7c95dc1178ae64f9ce8848e\": container with ID starting with e288cdfdcd9a5a2032a09eda636d6007015ca109d7c95dc1178ae64f9ce8848e not found: ID does not exist"
Jul 24 18:46:32.068382 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.068359    2580 scope.go:117] "RemoveContainer" containerID="2496b934daa188c265c6abe7182c0bd8f12a441ee5c8f382eea54f9fb27a2b26"
Jul 24 18:46:32.068597 ip-10-0-141-146 kubenswrapper[2580]: E0724 18:46:32.068580    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2496b934daa188c265c6abe7182c0bd8f12a441ee5c8f382eea54f9fb27a2b26\": container with ID starting with 2496b934daa188c265c6abe7182c0bd8f12a441ee5c8f382eea54f9fb27a2b26 not found: ID does not exist" containerID="2496b934daa188c265c6abe7182c0bd8f12a441ee5c8f382eea54f9fb27a2b26"
Jul 24 18:46:32.068644 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.068602    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2496b934daa188c265c6abe7182c0bd8f12a441ee5c8f382eea54f9fb27a2b26"} err="failed to get container status \"2496b934daa188c265c6abe7182c0bd8f12a441ee5c8f382eea54f9fb27a2b26\": rpc error: code = NotFound desc = could not find container \"2496b934daa188c265c6abe7182c0bd8f12a441ee5c8f382eea54f9fb27a2b26\": container with ID starting with 2496b934daa188c265c6abe7182c0bd8f12a441ee5c8f382eea54f9fb27a2b26 not found: ID does not exist"
Jul 24 18:46:32.068644 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.068617    2580 scope.go:117] "RemoveContainer" containerID="a9c8a3b2e06a51aaf98e667886be98545375eee0a7311c0ebf3f496ae2ac459b"
Jul 24 18:46:32.068863 ip-10-0-141-146 kubenswrapper[2580]: E0724 18:46:32.068845    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a9c8a3b2e06a51aaf98e667886be98545375eee0a7311c0ebf3f496ae2ac459b\": container with ID starting with a9c8a3b2e06a51aaf98e667886be98545375eee0a7311c0ebf3f496ae2ac459b not found: ID does not exist" containerID="a9c8a3b2e06a51aaf98e667886be98545375eee0a7311c0ebf3f496ae2ac459b"
Jul 24 18:46:32.068949 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.068866    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a9c8a3b2e06a51aaf98e667886be98545375eee0a7311c0ebf3f496ae2ac459b"} err="failed to get container status \"a9c8a3b2e06a51aaf98e667886be98545375eee0a7311c0ebf3f496ae2ac459b\": rpc error: code = NotFound desc = could not find container \"a9c8a3b2e06a51aaf98e667886be98545375eee0a7311c0ebf3f496ae2ac459b\": container with ID starting with a9c8a3b2e06a51aaf98e667886be98545375eee0a7311c0ebf3f496ae2ac459b not found: ID does not exist"
Jul 24 18:46:32.068949 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.068880    2580 scope.go:117] "RemoveContainer" containerID="f1af4d3a66b412bf49090ec6ff61203254802ee5417138fd3e9d02ae334ef01f"
Jul 24 18:46:32.069218 ip-10-0-141-146 kubenswrapper[2580]: E0724 18:46:32.069199    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f1af4d3a66b412bf49090ec6ff61203254802ee5417138fd3e9d02ae334ef01f\": container with ID starting with f1af4d3a66b412bf49090ec6ff61203254802ee5417138fd3e9d02ae334ef01f not found: ID does not exist" containerID="f1af4d3a66b412bf49090ec6ff61203254802ee5417138fd3e9d02ae334ef01f"
Jul 24 18:46:32.069270 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.069221    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f1af4d3a66b412bf49090ec6ff61203254802ee5417138fd3e9d02ae334ef01f"} err="failed to get container status \"f1af4d3a66b412bf49090ec6ff61203254802ee5417138fd3e9d02ae334ef01f\": rpc error: code = NotFound desc = could not find container \"f1af4d3a66b412bf49090ec6ff61203254802ee5417138fd3e9d02ae334ef01f\": container with ID starting with f1af4d3a66b412bf49090ec6ff61203254802ee5417138fd3e9d02ae334ef01f not found: ID does not exist"
Jul 24 18:46:32.069270 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.069234    2580 scope.go:117] "RemoveContainer" containerID="04022a52896f2e2ae7bd44b920db6752bcd96e2bc6a6e4df8a8a4f756d0737db"
Jul 24 18:46:32.069454 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.069439    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"04022a52896f2e2ae7bd44b920db6752bcd96e2bc6a6e4df8a8a4f756d0737db"} err="failed to get container status \"04022a52896f2e2ae7bd44b920db6752bcd96e2bc6a6e4df8a8a4f756d0737db\": rpc error: code = NotFound desc = could not find container \"04022a52896f2e2ae7bd44b920db6752bcd96e2bc6a6e4df8a8a4f756d0737db\": container with ID starting with 04022a52896f2e2ae7bd44b920db6752bcd96e2bc6a6e4df8a8a4f756d0737db not found: ID does not exist"
Jul 24 18:46:32.069500 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.069454    2580 scope.go:117] "RemoveContainer" containerID="f3bbd9b435324112501cc66eebfd66ad7bf10f5d17c253925452b426e8699e70"
Jul 24 18:46:32.069647 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.069632    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f3bbd9b435324112501cc66eebfd66ad7bf10f5d17c253925452b426e8699e70"} err="failed to get container status \"f3bbd9b435324112501cc66eebfd66ad7bf10f5d17c253925452b426e8699e70\": rpc error: code = NotFound desc = could not find container \"f3bbd9b435324112501cc66eebfd66ad7bf10f5d17c253925452b426e8699e70\": container with ID starting with f3bbd9b435324112501cc66eebfd66ad7bf10f5d17c253925452b426e8699e70 not found: ID does not exist"
Jul 24 18:46:32.069691 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.069648    2580 scope.go:117] "RemoveContainer" containerID="d2773c38de8166993facef2f67d4b51785bfb472aad56a793c050372d77599fa"
Jul 24 18:46:32.069861 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.069837    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d2773c38de8166993facef2f67d4b51785bfb472aad56a793c050372d77599fa"} err="failed to get container status \"d2773c38de8166993facef2f67d4b51785bfb472aad56a793c050372d77599fa\": rpc error: code = NotFound desc = could not find container \"d2773c38de8166993facef2f67d4b51785bfb472aad56a793c050372d77599fa\": container with ID starting with d2773c38de8166993facef2f67d4b51785bfb472aad56a793c050372d77599fa not found: ID does not exist"
Jul 24 18:46:32.069932 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.069863    2580 scope.go:117] "RemoveContainer" containerID="e288cdfdcd9a5a2032a09eda636d6007015ca109d7c95dc1178ae64f9ce8848e"
Jul 24 18:46:32.070085 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.070070    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e288cdfdcd9a5a2032a09eda636d6007015ca109d7c95dc1178ae64f9ce8848e"} err="failed to get container status \"e288cdfdcd9a5a2032a09eda636d6007015ca109d7c95dc1178ae64f9ce8848e\": rpc error: code = NotFound desc = could not find container \"e288cdfdcd9a5a2032a09eda636d6007015ca109d7c95dc1178ae64f9ce8848e\": container with ID starting with e288cdfdcd9a5a2032a09eda636d6007015ca109d7c95dc1178ae64f9ce8848e not found: ID does not exist"
Jul 24 18:46:32.070153 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.070085    2580 scope.go:117] "RemoveContainer" containerID="2496b934daa188c265c6abe7182c0bd8f12a441ee5c8f382eea54f9fb27a2b26"
Jul 24 18:46:32.070340 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.070322    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2496b934daa188c265c6abe7182c0bd8f12a441ee5c8f382eea54f9fb27a2b26"} err="failed to get container status \"2496b934daa188c265c6abe7182c0bd8f12a441ee5c8f382eea54f9fb27a2b26\": rpc error: code = NotFound desc = could not find container \"2496b934daa188c265c6abe7182c0bd8f12a441ee5c8f382eea54f9fb27a2b26\": container with ID starting with 2496b934daa188c265c6abe7182c0bd8f12a441ee5c8f382eea54f9fb27a2b26 not found: ID does not exist"
Jul 24 18:46:32.070385 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.070341    2580 scope.go:117] "RemoveContainer" containerID="a9c8a3b2e06a51aaf98e667886be98545375eee0a7311c0ebf3f496ae2ac459b"
Jul 24 18:46:32.070601 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.070583    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a9c8a3b2e06a51aaf98e667886be98545375eee0a7311c0ebf3f496ae2ac459b"} err="failed to get container status \"a9c8a3b2e06a51aaf98e667886be98545375eee0a7311c0ebf3f496ae2ac459b\": rpc error: code = NotFound desc = could not find container \"a9c8a3b2e06a51aaf98e667886be98545375eee0a7311c0ebf3f496ae2ac459b\": container with ID starting with a9c8a3b2e06a51aaf98e667886be98545375eee0a7311c0ebf3f496ae2ac459b not found: ID does not exist"
Jul 24 18:46:32.070601 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.070601    2580 scope.go:117] "RemoveContainer" containerID="f1af4d3a66b412bf49090ec6ff61203254802ee5417138fd3e9d02ae334ef01f"
Jul 24 18:46:32.070852 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.070832    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f1af4d3a66b412bf49090ec6ff61203254802ee5417138fd3e9d02ae334ef01f"} err="failed to get container status \"f1af4d3a66b412bf49090ec6ff61203254802ee5417138fd3e9d02ae334ef01f\": rpc error: code = NotFound desc = could not find container \"f1af4d3a66b412bf49090ec6ff61203254802ee5417138fd3e9d02ae334ef01f\": container with ID starting with f1af4d3a66b412bf49090ec6ff61203254802ee5417138fd3e9d02ae334ef01f not found: ID does not exist"
Jul 24 18:46:32.070938 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.070853    2580 scope.go:117] "RemoveContainer" containerID="04022a52896f2e2ae7bd44b920db6752bcd96e2bc6a6e4df8a8a4f756d0737db"
Jul 24 18:46:32.071339 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.071285    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"04022a52896f2e2ae7bd44b920db6752bcd96e2bc6a6e4df8a8a4f756d0737db"} err="failed to get container status \"04022a52896f2e2ae7bd44b920db6752bcd96e2bc6a6e4df8a8a4f756d0737db\": rpc error: code = NotFound desc = could not find container \"04022a52896f2e2ae7bd44b920db6752bcd96e2bc6a6e4df8a8a4f756d0737db\": container with ID starting with 04022a52896f2e2ae7bd44b920db6752bcd96e2bc6a6e4df8a8a4f756d0737db not found: ID does not exist"
Jul 24 18:46:32.071339 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.071321    2580 scope.go:117] "RemoveContainer" containerID="f3bbd9b435324112501cc66eebfd66ad7bf10f5d17c253925452b426e8699e70"
Jul 24 18:46:32.071780 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.071753    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f3bbd9b435324112501cc66eebfd66ad7bf10f5d17c253925452b426e8699e70"} err="failed to get container status \"f3bbd9b435324112501cc66eebfd66ad7bf10f5d17c253925452b426e8699e70\": rpc error: code = NotFound desc = could not find container \"f3bbd9b435324112501cc66eebfd66ad7bf10f5d17c253925452b426e8699e70\": container with ID starting with f3bbd9b435324112501cc66eebfd66ad7bf10f5d17c253925452b426e8699e70 not found: ID does not exist"
Jul 24 18:46:32.071780 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.071781    2580 scope.go:117] "RemoveContainer" containerID="d2773c38de8166993facef2f67d4b51785bfb472aad56a793c050372d77599fa"
Jul 24 18:46:32.072045 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.072020    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d2773c38de8166993facef2f67d4b51785bfb472aad56a793c050372d77599fa"} err="failed to get container status \"d2773c38de8166993facef2f67d4b51785bfb472aad56a793c050372d77599fa\": rpc error: code = NotFound desc = could not find container \"d2773c38de8166993facef2f67d4b51785bfb472aad56a793c050372d77599fa\": container with ID starting with d2773c38de8166993facef2f67d4b51785bfb472aad56a793c050372d77599fa not found: ID does not exist"
Jul 24 18:46:32.072103 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.072046    2580 scope.go:117] "RemoveContainer" containerID="e288cdfdcd9a5a2032a09eda636d6007015ca109d7c95dc1178ae64f9ce8848e"
Jul 24 18:46:32.072301 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.072281    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e288cdfdcd9a5a2032a09eda636d6007015ca109d7c95dc1178ae64f9ce8848e"} err="failed to get container status \"e288cdfdcd9a5a2032a09eda636d6007015ca109d7c95dc1178ae64f9ce8848e\": rpc error: code = NotFound desc = could not find container \"e288cdfdcd9a5a2032a09eda636d6007015ca109d7c95dc1178ae64f9ce8848e\": container with ID starting with e288cdfdcd9a5a2032a09eda636d6007015ca109d7c95dc1178ae64f9ce8848e not found: ID does not exist"
Jul 24 18:46:32.072361 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.072302    2580 scope.go:117] "RemoveContainer" containerID="2496b934daa188c265c6abe7182c0bd8f12a441ee5c8f382eea54f9fb27a2b26"
Jul 24 18:46:32.072527 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.072509    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2496b934daa188c265c6abe7182c0bd8f12a441ee5c8f382eea54f9fb27a2b26"} err="failed to get container status \"2496b934daa188c265c6abe7182c0bd8f12a441ee5c8f382eea54f9fb27a2b26\": rpc error: code = NotFound desc = could not find container \"2496b934daa188c265c6abe7182c0bd8f12a441ee5c8f382eea54f9fb27a2b26\": container with ID starting with 2496b934daa188c265c6abe7182c0bd8f12a441ee5c8f382eea54f9fb27a2b26 not found: ID does not exist"
Jul 24 18:46:32.072570 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.072529    2580 scope.go:117] "RemoveContainer" containerID="a9c8a3b2e06a51aaf98e667886be98545375eee0a7311c0ebf3f496ae2ac459b"
Jul 24 18:46:32.072741 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.072726    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a9c8a3b2e06a51aaf98e667886be98545375eee0a7311c0ebf3f496ae2ac459b"} err="failed to get container status \"a9c8a3b2e06a51aaf98e667886be98545375eee0a7311c0ebf3f496ae2ac459b\": rpc error: code = NotFound desc = could not find container \"a9c8a3b2e06a51aaf98e667886be98545375eee0a7311c0ebf3f496ae2ac459b\": container with ID starting with a9c8a3b2e06a51aaf98e667886be98545375eee0a7311c0ebf3f496ae2ac459b not found: ID does not exist"
Jul 24 18:46:32.072741 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.072741    2580 scope.go:117] "RemoveContainer" containerID="f1af4d3a66b412bf49090ec6ff61203254802ee5417138fd3e9d02ae334ef01f"
Jul 24 18:46:32.072965 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.072948    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f1af4d3a66b412bf49090ec6ff61203254802ee5417138fd3e9d02ae334ef01f"} err="failed to get container status \"f1af4d3a66b412bf49090ec6ff61203254802ee5417138fd3e9d02ae334ef01f\": rpc error: code = NotFound desc = could not find container \"f1af4d3a66b412bf49090ec6ff61203254802ee5417138fd3e9d02ae334ef01f\": container with ID starting with f1af4d3a66b412bf49090ec6ff61203254802ee5417138fd3e9d02ae334ef01f not found: ID does not exist"
Jul 24 18:46:32.073005 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.072966    2580 scope.go:117] "RemoveContainer" containerID="04022a52896f2e2ae7bd44b920db6752bcd96e2bc6a6e4df8a8a4f756d0737db"
Jul 24 18:46:32.073219 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.073203    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"04022a52896f2e2ae7bd44b920db6752bcd96e2bc6a6e4df8a8a4f756d0737db"} err="failed to get container status \"04022a52896f2e2ae7bd44b920db6752bcd96e2bc6a6e4df8a8a4f756d0737db\": rpc error: code = NotFound desc = could not find container \"04022a52896f2e2ae7bd44b920db6752bcd96e2bc6a6e4df8a8a4f756d0737db\": container with ID starting with 04022a52896f2e2ae7bd44b920db6752bcd96e2bc6a6e4df8a8a4f756d0737db not found: ID does not exist"
Jul 24 18:46:32.073256 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.073220    2580 scope.go:117] "RemoveContainer" containerID="f3bbd9b435324112501cc66eebfd66ad7bf10f5d17c253925452b426e8699e70"
Jul 24 18:46:32.073313 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.073298    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 24 18:46:32.073436 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.073420    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f3bbd9b435324112501cc66eebfd66ad7bf10f5d17c253925452b426e8699e70"} err="failed to get container status \"f3bbd9b435324112501cc66eebfd66ad7bf10f5d17c253925452b426e8699e70\": rpc error: code = NotFound desc = could not find container \"f3bbd9b435324112501cc66eebfd66ad7bf10f5d17c253925452b426e8699e70\": container with ID starting with f3bbd9b435324112501cc66eebfd66ad7bf10f5d17c253925452b426e8699e70 not found: ID does not exist"
Jul 24 18:46:32.073488 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.073437    2580 scope.go:117] "RemoveContainer" containerID="d2773c38de8166993facef2f67d4b51785bfb472aad56a793c050372d77599fa"
Jul 24 18:46:32.073655 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.073639    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="50400a73-3915-44f6-af79-bc9425cb863f" containerName="kube-rbac-proxy"
Jul 24 18:46:32.073655 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.073643    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d2773c38de8166993facef2f67d4b51785bfb472aad56a793c050372d77599fa"} err="failed to get container status \"d2773c38de8166993facef2f67d4b51785bfb472aad56a793c050372d77599fa\": rpc error: code = NotFound desc = could not find container \"d2773c38de8166993facef2f67d4b51785bfb472aad56a793c050372d77599fa\": container with ID starting with d2773c38de8166993facef2f67d4b51785bfb472aad56a793c050372d77599fa not found: ID does not exist"
Jul 24 18:46:32.073742 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.073659    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="50400a73-3915-44f6-af79-bc9425cb863f" containerName="kube-rbac-proxy"
Jul 24 18:46:32.073742 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.073663    2580 scope.go:117] "RemoveContainer" containerID="e288cdfdcd9a5a2032a09eda636d6007015ca109d7c95dc1178ae64f9ce8848e"
Jul 24 18:46:32.073742 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.073675    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="50400a73-3915-44f6-af79-bc9425cb863f" containerName="thanos-sidecar"
Jul 24 18:46:32.073742 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.073684    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="50400a73-3915-44f6-af79-bc9425cb863f" containerName="thanos-sidecar"
Jul 24 18:46:32.073742 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.073698    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="50400a73-3915-44f6-af79-bc9425cb863f" containerName="init-config-reloader"
Jul 24 18:46:32.073742 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.073706    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="50400a73-3915-44f6-af79-bc9425cb863f" containerName="init-config-reloader"
Jul 24 18:46:32.073742 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.073730    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="50400a73-3915-44f6-af79-bc9425cb863f" containerName="kube-rbac-proxy-web"
Jul 24 18:46:32.073742 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.073737    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="50400a73-3915-44f6-af79-bc9425cb863f" containerName="kube-rbac-proxy-web"
Jul 24 18:46:32.073742 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.073743    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="50400a73-3915-44f6-af79-bc9425cb863f" containerName="kube-rbac-proxy-thanos"
Jul 24 18:46:32.074067 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.073749    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="50400a73-3915-44f6-af79-bc9425cb863f" containerName="kube-rbac-proxy-thanos"
Jul 24 18:46:32.074067 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.073756    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="50400a73-3915-44f6-af79-bc9425cb863f" containerName="prometheus"
Jul 24 18:46:32.074067 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.073761    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="50400a73-3915-44f6-af79-bc9425cb863f" containerName="prometheus"
Jul 24 18:46:32.074067 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.073769    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="50400a73-3915-44f6-af79-bc9425cb863f" containerName="config-reloader"
Jul 24 18:46:32.074067 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.073774    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="50400a73-3915-44f6-af79-bc9425cb863f" containerName="config-reloader"
Jul 24 18:46:32.074067 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.073842    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="50400a73-3915-44f6-af79-bc9425cb863f" containerName="kube-rbac-proxy-web"
Jul 24 18:46:32.074067 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.073854    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="50400a73-3915-44f6-af79-bc9425cb863f" containerName="kube-rbac-proxy"
Jul 24 18:46:32.074067 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.073860    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="50400a73-3915-44f6-af79-bc9425cb863f" containerName="thanos-sidecar"
Jul 24 18:46:32.074067 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.073869    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="50400a73-3915-44f6-af79-bc9425cb863f" containerName="prometheus"
Jul 24 18:46:32.074067 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.073876    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="50400a73-3915-44f6-af79-bc9425cb863f" containerName="config-reloader"
Jul 24 18:46:32.074067 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.073884    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="50400a73-3915-44f6-af79-bc9425cb863f" containerName="kube-rbac-proxy-thanos"
Jul 24 18:46:32.074067 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.073894    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e288cdfdcd9a5a2032a09eda636d6007015ca109d7c95dc1178ae64f9ce8848e"} err="failed to get container status \"e288cdfdcd9a5a2032a09eda636d6007015ca109d7c95dc1178ae64f9ce8848e\": rpc error: code = NotFound desc = could not find container \"e288cdfdcd9a5a2032a09eda636d6007015ca109d7c95dc1178ae64f9ce8848e\": container with ID starting with e288cdfdcd9a5a2032a09eda636d6007015ca109d7c95dc1178ae64f9ce8848e not found: ID does not exist"
Jul 24 18:46:32.074067 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.073911    2580 scope.go:117] "RemoveContainer" containerID="2496b934daa188c265c6abe7182c0bd8f12a441ee5c8f382eea54f9fb27a2b26"
Jul 24 18:46:32.074646 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.074148    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2496b934daa188c265c6abe7182c0bd8f12a441ee5c8f382eea54f9fb27a2b26"} err="failed to get container status \"2496b934daa188c265c6abe7182c0bd8f12a441ee5c8f382eea54f9fb27a2b26\": rpc error: code = NotFound desc = could not find container \"2496b934daa188c265c6abe7182c0bd8f12a441ee5c8f382eea54f9fb27a2b26\": container with ID starting with 2496b934daa188c265c6abe7182c0bd8f12a441ee5c8f382eea54f9fb27a2b26 not found: ID does not exist"
Jul 24 18:46:32.074646 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.074170    2580 scope.go:117] "RemoveContainer" containerID="a9c8a3b2e06a51aaf98e667886be98545375eee0a7311c0ebf3f496ae2ac459b"
Jul 24 18:46:32.074646 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.074498    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a9c8a3b2e06a51aaf98e667886be98545375eee0a7311c0ebf3f496ae2ac459b"} err="failed to get container status \"a9c8a3b2e06a51aaf98e667886be98545375eee0a7311c0ebf3f496ae2ac459b\": rpc error: code = NotFound desc = could not find container \"a9c8a3b2e06a51aaf98e667886be98545375eee0a7311c0ebf3f496ae2ac459b\": container with ID starting with a9c8a3b2e06a51aaf98e667886be98545375eee0a7311c0ebf3f496ae2ac459b not found: ID does not exist"
Jul 24 18:46:32.074646 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.074522    2580 scope.go:117] "RemoveContainer" containerID="f1af4d3a66b412bf49090ec6ff61203254802ee5417138fd3e9d02ae334ef01f"
Jul 24 18:46:32.074858 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.074837    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f1af4d3a66b412bf49090ec6ff61203254802ee5417138fd3e9d02ae334ef01f"} err="failed to get container status \"f1af4d3a66b412bf49090ec6ff61203254802ee5417138fd3e9d02ae334ef01f\": rpc error: code = NotFound desc = could not find container \"f1af4d3a66b412bf49090ec6ff61203254802ee5417138fd3e9d02ae334ef01f\": container with ID starting with f1af4d3a66b412bf49090ec6ff61203254802ee5417138fd3e9d02ae334ef01f not found: ID does not exist"
Jul 24 18:46:32.074924 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.074859    2580 scope.go:117] "RemoveContainer" containerID="04022a52896f2e2ae7bd44b920db6752bcd96e2bc6a6e4df8a8a4f756d0737db"
Jul 24 18:46:32.075157 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.075110    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"04022a52896f2e2ae7bd44b920db6752bcd96e2bc6a6e4df8a8a4f756d0737db"} err="failed to get container status \"04022a52896f2e2ae7bd44b920db6752bcd96e2bc6a6e4df8a8a4f756d0737db\": rpc error: code = NotFound desc = could not find container \"04022a52896f2e2ae7bd44b920db6752bcd96e2bc6a6e4df8a8a4f756d0737db\": container with ID starting with 04022a52896f2e2ae7bd44b920db6752bcd96e2bc6a6e4df8a8a4f756d0737db not found: ID does not exist"
Jul 24 18:46:32.075157 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.075156    2580 scope.go:117] "RemoveContainer" containerID="f3bbd9b435324112501cc66eebfd66ad7bf10f5d17c253925452b426e8699e70"
Jul 24 18:46:32.075386 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.075366    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f3bbd9b435324112501cc66eebfd66ad7bf10f5d17c253925452b426e8699e70"} err="failed to get container status \"f3bbd9b435324112501cc66eebfd66ad7bf10f5d17c253925452b426e8699e70\": rpc error: code = NotFound desc = could not find container \"f3bbd9b435324112501cc66eebfd66ad7bf10f5d17c253925452b426e8699e70\": container with ID starting with f3bbd9b435324112501cc66eebfd66ad7bf10f5d17c253925452b426e8699e70 not found: ID does not exist"
Jul 24 18:46:32.075386 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.075386    2580 scope.go:117] "RemoveContainer" containerID="d2773c38de8166993facef2f67d4b51785bfb472aad56a793c050372d77599fa"
Jul 24 18:46:32.075644 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.075626    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d2773c38de8166993facef2f67d4b51785bfb472aad56a793c050372d77599fa"} err="failed to get container status \"d2773c38de8166993facef2f67d4b51785bfb472aad56a793c050372d77599fa\": rpc error: code = NotFound desc = could not find container \"d2773c38de8166993facef2f67d4b51785bfb472aad56a793c050372d77599fa\": container with ID starting with d2773c38de8166993facef2f67d4b51785bfb472aad56a793c050372d77599fa not found: ID does not exist"
Jul 24 18:46:32.075710 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.075646    2580 scope.go:117] "RemoveContainer" containerID="e288cdfdcd9a5a2032a09eda636d6007015ca109d7c95dc1178ae64f9ce8848e"
Jul 24 18:46:32.075882 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.075863    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e288cdfdcd9a5a2032a09eda636d6007015ca109d7c95dc1178ae64f9ce8848e"} err="failed to get container status \"e288cdfdcd9a5a2032a09eda636d6007015ca109d7c95dc1178ae64f9ce8848e\": rpc error: code = NotFound desc = could not find container \"e288cdfdcd9a5a2032a09eda636d6007015ca109d7c95dc1178ae64f9ce8848e\": container with ID starting with e288cdfdcd9a5a2032a09eda636d6007015ca109d7c95dc1178ae64f9ce8848e not found: ID does not exist"
Jul 24 18:46:32.075948 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.075884    2580 scope.go:117] "RemoveContainer" containerID="2496b934daa188c265c6abe7182c0bd8f12a441ee5c8f382eea54f9fb27a2b26"
Jul 24 18:46:32.076137 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.076103    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2496b934daa188c265c6abe7182c0bd8f12a441ee5c8f382eea54f9fb27a2b26"} err="failed to get container status \"2496b934daa188c265c6abe7182c0bd8f12a441ee5c8f382eea54f9fb27a2b26\": rpc error: code = NotFound desc = could not find container \"2496b934daa188c265c6abe7182c0bd8f12a441ee5c8f382eea54f9fb27a2b26\": container with ID starting with 2496b934daa188c265c6abe7182c0bd8f12a441ee5c8f382eea54f9fb27a2b26 not found: ID does not exist"
Jul 24 18:46:32.076195 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.076138    2580 scope.go:117] "RemoveContainer" containerID="a9c8a3b2e06a51aaf98e667886be98545375eee0a7311c0ebf3f496ae2ac459b"
Jul 24 18:46:32.076344 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.076326    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a9c8a3b2e06a51aaf98e667886be98545375eee0a7311c0ebf3f496ae2ac459b"} err="failed to get container status \"a9c8a3b2e06a51aaf98e667886be98545375eee0a7311c0ebf3f496ae2ac459b\": rpc error: code = NotFound desc = could not find container \"a9c8a3b2e06a51aaf98e667886be98545375eee0a7311c0ebf3f496ae2ac459b\": container with ID starting with a9c8a3b2e06a51aaf98e667886be98545375eee0a7311c0ebf3f496ae2ac459b not found: ID does not exist"
Jul 24 18:46:32.076383 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.076346    2580 scope.go:117] "RemoveContainer" containerID="f1af4d3a66b412bf49090ec6ff61203254802ee5417138fd3e9d02ae334ef01f"
Jul 24 18:46:32.076573 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.076546    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f1af4d3a66b412bf49090ec6ff61203254802ee5417138fd3e9d02ae334ef01f"} err="failed to get container status \"f1af4d3a66b412bf49090ec6ff61203254802ee5417138fd3e9d02ae334ef01f\": rpc error: code = NotFound desc = could not find container \"f1af4d3a66b412bf49090ec6ff61203254802ee5417138fd3e9d02ae334ef01f\": container with ID starting with f1af4d3a66b412bf49090ec6ff61203254802ee5417138fd3e9d02ae334ef01f not found: ID does not exist"
Jul 24 18:46:32.076622 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.076574    2580 scope.go:117] "RemoveContainer" containerID="04022a52896f2e2ae7bd44b920db6752bcd96e2bc6a6e4df8a8a4f756d0737db"
Jul 24 18:46:32.076767 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.076749    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"04022a52896f2e2ae7bd44b920db6752bcd96e2bc6a6e4df8a8a4f756d0737db"} err="failed to get container status \"04022a52896f2e2ae7bd44b920db6752bcd96e2bc6a6e4df8a8a4f756d0737db\": rpc error: code = NotFound desc = could not find container \"04022a52896f2e2ae7bd44b920db6752bcd96e2bc6a6e4df8a8a4f756d0737db\": container with ID starting with 04022a52896f2e2ae7bd44b920db6752bcd96e2bc6a6e4df8a8a4f756d0737db not found: ID does not exist"
Jul 24 18:46:32.076829 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.076767    2580 scope.go:117] "RemoveContainer" containerID="f3bbd9b435324112501cc66eebfd66ad7bf10f5d17c253925452b426e8699e70"
Jul 24 18:46:32.076957 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.076939    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f3bbd9b435324112501cc66eebfd66ad7bf10f5d17c253925452b426e8699e70"} err="failed to get container status \"f3bbd9b435324112501cc66eebfd66ad7bf10f5d17c253925452b426e8699e70\": rpc error: code = NotFound desc = could not find container \"f3bbd9b435324112501cc66eebfd66ad7bf10f5d17c253925452b426e8699e70\": container with ID starting with f3bbd9b435324112501cc66eebfd66ad7bf10f5d17c253925452b426e8699e70 not found: ID does not exist"
Jul 24 18:46:32.077022 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.076959    2580 scope.go:117] "RemoveContainer" containerID="d2773c38de8166993facef2f67d4b51785bfb472aad56a793c050372d77599fa"
Jul 24 18:46:32.077177 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.077160    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d2773c38de8166993facef2f67d4b51785bfb472aad56a793c050372d77599fa"} err="failed to get container status \"d2773c38de8166993facef2f67d4b51785bfb472aad56a793c050372d77599fa\": rpc error: code = NotFound desc = could not find container \"d2773c38de8166993facef2f67d4b51785bfb472aad56a793c050372d77599fa\": container with ID starting with d2773c38de8166993facef2f67d4b51785bfb472aad56a793c050372d77599fa not found: ID does not exist"
Jul 24 18:46:32.077230 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.077179    2580 scope.go:117] "RemoveContainer" containerID="e288cdfdcd9a5a2032a09eda636d6007015ca109d7c95dc1178ae64f9ce8848e"
Jul 24 18:46:32.077365 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.077350    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e288cdfdcd9a5a2032a09eda636d6007015ca109d7c95dc1178ae64f9ce8848e"} err="failed to get container status \"e288cdfdcd9a5a2032a09eda636d6007015ca109d7c95dc1178ae64f9ce8848e\": rpc error: code = NotFound desc = could not find container \"e288cdfdcd9a5a2032a09eda636d6007015ca109d7c95dc1178ae64f9ce8848e\": container with ID starting with e288cdfdcd9a5a2032a09eda636d6007015ca109d7c95dc1178ae64f9ce8848e not found: ID does not exist"
Jul 24 18:46:32.077404 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.077366    2580 scope.go:117] "RemoveContainer" containerID="2496b934daa188c265c6abe7182c0bd8f12a441ee5c8f382eea54f9fb27a2b26"
Jul 24 18:46:32.077551 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.077533    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2496b934daa188c265c6abe7182c0bd8f12a441ee5c8f382eea54f9fb27a2b26"} err="failed to get container status \"2496b934daa188c265c6abe7182c0bd8f12a441ee5c8f382eea54f9fb27a2b26\": rpc error: code = NotFound desc = could not find container \"2496b934daa188c265c6abe7182c0bd8f12a441ee5c8f382eea54f9fb27a2b26\": container with ID starting with 2496b934daa188c265c6abe7182c0bd8f12a441ee5c8f382eea54f9fb27a2b26 not found: ID does not exist"
Jul 24 18:46:32.077609 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.077552    2580 scope.go:117] "RemoveContainer" containerID="a9c8a3b2e06a51aaf98e667886be98545375eee0a7311c0ebf3f496ae2ac459b"
Jul 24 18:46:32.077739 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.077721    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a9c8a3b2e06a51aaf98e667886be98545375eee0a7311c0ebf3f496ae2ac459b"} err="failed to get container status \"a9c8a3b2e06a51aaf98e667886be98545375eee0a7311c0ebf3f496ae2ac459b\": rpc error: code = NotFound desc = could not find container \"a9c8a3b2e06a51aaf98e667886be98545375eee0a7311c0ebf3f496ae2ac459b\": container with ID starting with a9c8a3b2e06a51aaf98e667886be98545375eee0a7311c0ebf3f496ae2ac459b not found: ID does not exist"
Jul 24 18:46:32.077802 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.077741    2580 scope.go:117] "RemoveContainer" containerID="f1af4d3a66b412bf49090ec6ff61203254802ee5417138fd3e9d02ae334ef01f"
Jul 24 18:46:32.077978 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.077962    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f1af4d3a66b412bf49090ec6ff61203254802ee5417138fd3e9d02ae334ef01f"} err="failed to get container status \"f1af4d3a66b412bf49090ec6ff61203254802ee5417138fd3e9d02ae334ef01f\": rpc error: code = NotFound desc = could not find container \"f1af4d3a66b412bf49090ec6ff61203254802ee5417138fd3e9d02ae334ef01f\": container with ID starting with f1af4d3a66b412bf49090ec6ff61203254802ee5417138fd3e9d02ae334ef01f not found: ID does not exist"
Jul 24 18:46:32.079485 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.079468    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 18:46:32.082034 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.082018    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 24 18:46:32.082134 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.082059    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 24 18:46:32.082189 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.082136    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 24 18:46:32.082337 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.082323    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 24 18:46:32.082430 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.082413    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 24 18:46:32.082492 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.082476    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 24 18:46:32.082721 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.082676    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-2mtgh\""
Jul 24 18:46:32.082796 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.082783    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-eurnt1bot06r1\""
Jul 24 18:46:32.082848 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.082838    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 24 18:46:32.082903 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.082864    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 24 18:46:32.083263 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.083245    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 24 18:46:32.083337 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.083298    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 24 18:46:32.083337 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.083308    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 24 18:46:32.083435 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.083351    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 24 18:46:32.085037 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.085014    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 24 18:46:32.090072 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.090055    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 24 18:46:32.096600 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.096579    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 24 18:46:32.128324 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.128281    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:46:32.196714 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.196673    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:46:32.248245 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.248217    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/18a9406a-d22c-4623-a52a-8fa5518572d8-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"18a9406a-d22c-4623-a52a-8fa5518572d8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 18:46:32.248422 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.248252    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/18a9406a-d22c-4623-a52a-8fa5518572d8-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"18a9406a-d22c-4623-a52a-8fa5518572d8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 18:46:32.248422 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.248288    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/18a9406a-d22c-4623-a52a-8fa5518572d8-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"18a9406a-d22c-4623-a52a-8fa5518572d8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 18:46:32.248422 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.248344    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/18a9406a-d22c-4623-a52a-8fa5518572d8-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"18a9406a-d22c-4623-a52a-8fa5518572d8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 18:46:32.248422 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.248400    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/18a9406a-d22c-4623-a52a-8fa5518572d8-web-config\") pod \"prometheus-k8s-0\" (UID: \"18a9406a-d22c-4623-a52a-8fa5518572d8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 18:46:32.248627 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.248435    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/18a9406a-d22c-4623-a52a-8fa5518572d8-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"18a9406a-d22c-4623-a52a-8fa5518572d8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 18:46:32.248627 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.248464    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/18a9406a-d22c-4623-a52a-8fa5518572d8-config\") pod \"prometheus-k8s-0\" (UID: \"18a9406a-d22c-4623-a52a-8fa5518572d8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 18:46:32.248627 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.248488    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/18a9406a-d22c-4623-a52a-8fa5518572d8-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"18a9406a-d22c-4623-a52a-8fa5518572d8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 18:46:32.248627 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.248514    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/18a9406a-d22c-4623-a52a-8fa5518572d8-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"18a9406a-d22c-4623-a52a-8fa5518572d8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 18:46:32.248627 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.248537    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/18a9406a-d22c-4623-a52a-8fa5518572d8-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"18a9406a-d22c-4623-a52a-8fa5518572d8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 18:46:32.248627 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.248567    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/18a9406a-d22c-4623-a52a-8fa5518572d8-config-out\") pod \"prometheus-k8s-0\" (UID: \"18a9406a-d22c-4623-a52a-8fa5518572d8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 18:46:32.248627 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.248597    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/18a9406a-d22c-4623-a52a-8fa5518572d8-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"18a9406a-d22c-4623-a52a-8fa5518572d8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 18:46:32.248928 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.248633    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/18a9406a-d22c-4623-a52a-8fa5518572d8-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"18a9406a-d22c-4623-a52a-8fa5518572d8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 18:46:32.248928 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.248660    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/18a9406a-d22c-4623-a52a-8fa5518572d8-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"18a9406a-d22c-4623-a52a-8fa5518572d8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 18:46:32.248928 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.248695    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/18a9406a-d22c-4623-a52a-8fa5518572d8-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"18a9406a-d22c-4623-a52a-8fa5518572d8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 18:46:32.248928 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.248713    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/18a9406a-d22c-4623-a52a-8fa5518572d8-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"18a9406a-d22c-4623-a52a-8fa5518572d8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 18:46:32.248928 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.248729    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/18a9406a-d22c-4623-a52a-8fa5518572d8-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"18a9406a-d22c-4623-a52a-8fa5518572d8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 18:46:32.248928 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.248799    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/18a9406a-d22c-4623-a52a-8fa5518572d8-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"18a9406a-d22c-4623-a52a-8fa5518572d8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 18:46:32.248928 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.248833    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/18a9406a-d22c-4623-a52a-8fa5518572d8-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"18a9406a-d22c-4623-a52a-8fa5518572d8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 18:46:32.248928 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.248878    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h8mkk\" (UniqueName: \"kubernetes.io/projected/18a9406a-d22c-4623-a52a-8fa5518572d8-kube-api-access-h8mkk\") pod \"prometheus-k8s-0\" (UID: \"18a9406a-d22c-4623-a52a-8fa5518572d8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 18:46:32.349725 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.349700    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/18a9406a-d22c-4623-a52a-8fa5518572d8-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"18a9406a-d22c-4623-a52a-8fa5518572d8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 18:46:32.350152 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.349736    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/18a9406a-d22c-4623-a52a-8fa5518572d8-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"18a9406a-d22c-4623-a52a-8fa5518572d8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 18:46:32.350152 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.349766    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/18a9406a-d22c-4623-a52a-8fa5518572d8-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"18a9406a-d22c-4623-a52a-8fa5518572d8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 18:46:32.350152 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.349809    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/18a9406a-d22c-4623-a52a-8fa5518572d8-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"18a9406a-d22c-4623-a52a-8fa5518572d8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 18:46:32.350152 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.349836    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/18a9406a-d22c-4623-a52a-8fa5518572d8-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"18a9406a-d22c-4623-a52a-8fa5518572d8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 18:46:32.350152 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.349864    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/18a9406a-d22c-4623-a52a-8fa5518572d8-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"18a9406a-d22c-4623-a52a-8fa5518572d8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 18:46:32.350152 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.349903    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/18a9406a-d22c-4623-a52a-8fa5518572d8-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"18a9406a-d22c-4623-a52a-8fa5518572d8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 18:46:32.350152 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.349929    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/18a9406a-d22c-4623-a52a-8fa5518572d8-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"18a9406a-d22c-4623-a52a-8fa5518572d8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 18:46:32.350152 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.349975    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h8mkk\" (UniqueName: \"kubernetes.io/projected/18a9406a-d22c-4623-a52a-8fa5518572d8-kube-api-access-h8mkk\") pod \"prometheus-k8s-0\" (UID: \"18a9406a-d22c-4623-a52a-8fa5518572d8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 18:46:32.350152 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.350009    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/18a9406a-d22c-4623-a52a-8fa5518572d8-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"18a9406a-d22c-4623-a52a-8fa5518572d8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 18:46:32.350152 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.350034    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/18a9406a-d22c-4623-a52a-8fa5518572d8-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"18a9406a-d22c-4623-a52a-8fa5518572d8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 18:46:32.350152 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.350077    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/18a9406a-d22c-4623-a52a-8fa5518572d8-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"18a9406a-d22c-4623-a52a-8fa5518572d8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 18:46:32.350152 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.350097    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/18a9406a-d22c-4623-a52a-8fa5518572d8-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"18a9406a-d22c-4623-a52a-8fa5518572d8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 18:46:32.350152 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.350138    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/18a9406a-d22c-4623-a52a-8fa5518572d8-web-config\") pod \"prometheus-k8s-0\" (UID: \"18a9406a-d22c-4623-a52a-8fa5518572d8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 18:46:32.350767 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.350171    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/18a9406a-d22c-4623-a52a-8fa5518572d8-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"18a9406a-d22c-4623-a52a-8fa5518572d8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 18:46:32.350767 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.350199    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/18a9406a-d22c-4623-a52a-8fa5518572d8-config\") pod \"prometheus-k8s-0\" (UID: \"18a9406a-d22c-4623-a52a-8fa5518572d8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 18:46:32.350767 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.350223    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/18a9406a-d22c-4623-a52a-8fa5518572d8-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"18a9406a-d22c-4623-a52a-8fa5518572d8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 18:46:32.350767 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.350246    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/18a9406a-d22c-4623-a52a-8fa5518572d8-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"18a9406a-d22c-4623-a52a-8fa5518572d8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 18:46:32.350767 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.350272    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/18a9406a-d22c-4623-a52a-8fa5518572d8-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"18a9406a-d22c-4623-a52a-8fa5518572d8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 18:46:32.350767 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.350299    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/18a9406a-d22c-4623-a52a-8fa5518572d8-config-out\") pod \"prometheus-k8s-0\" (UID: \"18a9406a-d22c-4623-a52a-8fa5518572d8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 18:46:32.351061 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.350853    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/18a9406a-d22c-4623-a52a-8fa5518572d8-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"18a9406a-d22c-4623-a52a-8fa5518572d8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 18:46:32.351061 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.350943    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/18a9406a-d22c-4623-a52a-8fa5518572d8-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"18a9406a-d22c-4623-a52a-8fa5518572d8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 18:46:32.351535 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.351437    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/18a9406a-d22c-4623-a52a-8fa5518572d8-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"18a9406a-d22c-4623-a52a-8fa5518572d8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 18:46:32.353399 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.353373    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/18a9406a-d22c-4623-a52a-8fa5518572d8-config-out\") pod \"prometheus-k8s-0\" (UID: \"18a9406a-d22c-4623-a52a-8fa5518572d8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 18:46:32.354315 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.353942    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/18a9406a-d22c-4623-a52a-8fa5518572d8-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"18a9406a-d22c-4623-a52a-8fa5518572d8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 18:46:32.354315 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.354257    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/18a9406a-d22c-4623-a52a-8fa5518572d8-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"18a9406a-d22c-4623-a52a-8fa5518572d8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 18:46:32.354315 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.354295    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/18a9406a-d22c-4623-a52a-8fa5518572d8-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"18a9406a-d22c-4623-a52a-8fa5518572d8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 18:46:32.355151 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.354904    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/18a9406a-d22c-4623-a52a-8fa5518572d8-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"18a9406a-d22c-4623-a52a-8fa5518572d8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 18:46:32.355812 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.355518    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/18a9406a-d22c-4623-a52a-8fa5518572d8-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"18a9406a-d22c-4623-a52a-8fa5518572d8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 18:46:32.357274 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.356162    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/18a9406a-d22c-4623-a52a-8fa5518572d8-config\") pod \"prometheus-k8s-0\" (UID: \"18a9406a-d22c-4623-a52a-8fa5518572d8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 18:46:32.357274 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.356530    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/18a9406a-d22c-4623-a52a-8fa5518572d8-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"18a9406a-d22c-4623-a52a-8fa5518572d8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 18:46:32.357274 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.357075    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/18a9406a-d22c-4623-a52a-8fa5518572d8-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"18a9406a-d22c-4623-a52a-8fa5518572d8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 18:46:32.357618 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.357596    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/18a9406a-d22c-4623-a52a-8fa5518572d8-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"18a9406a-d22c-4623-a52a-8fa5518572d8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 18:46:32.358397 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.358219    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/18a9406a-d22c-4623-a52a-8fa5518572d8-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"18a9406a-d22c-4623-a52a-8fa5518572d8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 18:46:32.358397 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.358360    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/18a9406a-d22c-4623-a52a-8fa5518572d8-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"18a9406a-d22c-4623-a52a-8fa5518572d8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 18:46:32.358653 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.358632    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/18a9406a-d22c-4623-a52a-8fa5518572d8-web-config\") pod \"prometheus-k8s-0\" (UID: \"18a9406a-d22c-4623-a52a-8fa5518572d8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 18:46:32.359163 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.359097    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/18a9406a-d22c-4623-a52a-8fa5518572d8-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"18a9406a-d22c-4623-a52a-8fa5518572d8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 18:46:32.360031 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.360010    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/18a9406a-d22c-4623-a52a-8fa5518572d8-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"18a9406a-d22c-4623-a52a-8fa5518572d8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 18:46:32.360859 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.360843    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/18a9406a-d22c-4623-a52a-8fa5518572d8-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"18a9406a-d22c-4623-a52a-8fa5518572d8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 18:46:32.364486 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.364468    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h8mkk\" (UniqueName: \"kubernetes.io/projected/18a9406a-d22c-4623-a52a-8fa5518572d8-kube-api-access-h8mkk\") pod \"prometheus-k8s-0\" (UID: \"18a9406a-d22c-4623-a52a-8fa5518572d8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 18:46:32.388846 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.388821    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 18:46:32.528980 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:32.528949    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 24 18:46:32.531675 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:46:32.531646    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18a9406a_d22c_4623_a52a_8fa5518572d8.slice/crio-d82efa6a23269ba8003a08a203fe986b1f183ad2323f29b3a9d1cb6d8c8f12a0 WatchSource:0}: Error finding container d82efa6a23269ba8003a08a203fe986b1f183ad2323f29b3a9d1cb6d8c8f12a0: Status 404 returned error can't find the container with id d82efa6a23269ba8003a08a203fe986b1f183ad2323f29b3a9d1cb6d8c8f12a0
Jul 24 18:46:33.018553 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:33.018513    2580 generic.go:356] "Generic (PLEG): container finished" podID="18a9406a-d22c-4623-a52a-8fa5518572d8" containerID="04c6a2129a8ec2c25b0bcf7d6dd79c98d55c3d9dabaf7826709cdce97121c459" exitCode=0
Jul 24 18:46:33.018757 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:33.018609    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"18a9406a-d22c-4623-a52a-8fa5518572d8","Type":"ContainerDied","Data":"04c6a2129a8ec2c25b0bcf7d6dd79c98d55c3d9dabaf7826709cdce97121c459"}
Jul 24 18:46:33.018757 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:33.018683    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"18a9406a-d22c-4623-a52a-8fa5518572d8","Type":"ContainerStarted","Data":"d82efa6a23269ba8003a08a203fe986b1f183ad2323f29b3a9d1cb6d8c8f12a0"}
Jul 24 18:46:33.248545 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:33.248508    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="50400a73-3915-44f6-af79-bc9425cb863f" path="/var/lib/kubelet/pods/50400a73-3915-44f6-af79-bc9425cb863f/volumes"
Jul 24 18:46:34.026951 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:34.026913    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"18a9406a-d22c-4623-a52a-8fa5518572d8","Type":"ContainerStarted","Data":"8237d38b271438b8f5833bf40caf4c7a4fd113e229c999b8a0c95f8b37452b0a"}
Jul 24 18:46:34.027449 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:34.027028    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"18a9406a-d22c-4623-a52a-8fa5518572d8","Type":"ContainerStarted","Data":"0799f0e79762c99ba3dd34a418a3abf0f190b15ec794b64fe8038a2533c191c1"}
Jul 24 18:46:34.027449 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:34.027072    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"18a9406a-d22c-4623-a52a-8fa5518572d8","Type":"ContainerStarted","Data":"fbf5eecde75c5b69fb0cfe0bfe86a6b935d303f55e9babf9a0a6c42df97f9970"}
Jul 24 18:46:34.027449 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:34.027106    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"18a9406a-d22c-4623-a52a-8fa5518572d8","Type":"ContainerStarted","Data":"1d7d9cf12ef6feb700b70a43667784924c1f70ddbd703e552e1c5518b276b087"}
Jul 24 18:46:34.027449 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:34.027168    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"18a9406a-d22c-4623-a52a-8fa5518572d8","Type":"ContainerStarted","Data":"14b354ec9fc984a586b47bf565395446742ad4560a14251cd3c93e089aa4843d"}
Jul 24 18:46:34.027449 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:34.027206    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"18a9406a-d22c-4623-a52a-8fa5518572d8","Type":"ContainerStarted","Data":"0e050ea7e954554d29a64958eed03a94d07fe6c8b8a3edc4d12c4cc5526e5555"}
Jul 24 18:46:34.057822 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:34.057767    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.039860497 podStartE2EDuration="2.057751345s" totalImagesPullingTime="0s" totalInitContainerRuntime="17.890848ms" isStatefulPod=false podCreationTimestamp="2026-07-24 18:46:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:46:34.055209279 +0000 UTC m=+149.264581324" watchObservedRunningTime="2026-07-24 18:46:34.057751345 +0000 UTC m=+149.267123388"
Jul 24 18:46:34.832797 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:34.832768    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:46:34.933515 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:34.933483    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:46:37.389292 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:37.389260    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 18:46:41.240168 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:41.240113    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:46:41.341210 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:41.341174    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:46:41.619171 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:41.619054    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7775fcdd7d-wvsn2"
Jul 24 18:46:41.619171 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:41.619140    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7775fcdd7d-wvsn2"
Jul 24 18:46:41.624077 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:41.624049    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7775fcdd7d-wvsn2"
Jul 24 18:46:42.062986 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:42.062960    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7775fcdd7d-wvsn2"
Jul 24 18:46:42.111375 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:42.111345    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-c96bfbddd-xxb46"]
Jul 24 18:46:42.227007 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:42.226976    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:46:42.327483 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:42.327393    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:46:42.385975 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:46:42.385943    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:47:07.134337 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:47:07.134267    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-c96bfbddd-xxb46" podUID="a16f1fb5-5d78-46c5-a7c3-f4d90bf87a82" containerName="console" containerID="cri-o://2f9fd4e47d3f455603c1b54029e24a82d91662874c17171387476fa909406978" gracePeriod=15
Jul 24 18:47:07.394930 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:47:07.394877    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c96bfbddd-xxb46"
Jul 24 18:47:07.563237 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:47:07.563199    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a16f1fb5-5d78-46c5-a7c3-f4d90bf87a82-console-config\") pod \"a16f1fb5-5d78-46c5-a7c3-f4d90bf87a82\" (UID: \"a16f1fb5-5d78-46c5-a7c3-f4d90bf87a82\") "
Jul 24 18:47:07.563411 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:47:07.563248    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cvdlk\" (UniqueName: \"kubernetes.io/projected/a16f1fb5-5d78-46c5-a7c3-f4d90bf87a82-kube-api-access-cvdlk\") pod \"a16f1fb5-5d78-46c5-a7c3-f4d90bf87a82\" (UID: \"a16f1fb5-5d78-46c5-a7c3-f4d90bf87a82\") "
Jul 24 18:47:07.563411 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:47:07.563264    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a16f1fb5-5d78-46c5-a7c3-f4d90bf87a82-trusted-ca-bundle\") pod \"a16f1fb5-5d78-46c5-a7c3-f4d90bf87a82\" (UID: \"a16f1fb5-5d78-46c5-a7c3-f4d90bf87a82\") "
Jul 24 18:47:07.563411 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:47:07.563348    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a16f1fb5-5d78-46c5-a7c3-f4d90bf87a82-console-oauth-config\") pod \"a16f1fb5-5d78-46c5-a7c3-f4d90bf87a82\" (UID: \"a16f1fb5-5d78-46c5-a7c3-f4d90bf87a82\") "
Jul 24 18:47:07.563411 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:47:07.563383    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a16f1fb5-5d78-46c5-a7c3-f4d90bf87a82-console-serving-cert\") pod \"a16f1fb5-5d78-46c5-a7c3-f4d90bf87a82\" (UID: \"a16f1fb5-5d78-46c5-a7c3-f4d90bf87a82\") "
Jul 24 18:47:07.563411 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:47:07.563408    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a16f1fb5-5d78-46c5-a7c3-f4d90bf87a82-oauth-serving-cert\") pod \"a16f1fb5-5d78-46c5-a7c3-f4d90bf87a82\" (UID: \"a16f1fb5-5d78-46c5-a7c3-f4d90bf87a82\") "
Jul 24 18:47:07.563653 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:47:07.563430    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a16f1fb5-5d78-46c5-a7c3-f4d90bf87a82-service-ca\") pod \"a16f1fb5-5d78-46c5-a7c3-f4d90bf87a82\" (UID: \"a16f1fb5-5d78-46c5-a7c3-f4d90bf87a82\") "
Jul 24 18:47:07.563706 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:47:07.563654    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a16f1fb5-5d78-46c5-a7c3-f4d90bf87a82-console-config" (OuterVolumeSpecName: "console-config") pod "a16f1fb5-5d78-46c5-a7c3-f4d90bf87a82" (UID: "a16f1fb5-5d78-46c5-a7c3-f4d90bf87a82"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 18:47:07.563808 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:47:07.563769    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a16f1fb5-5d78-46c5-a7c3-f4d90bf87a82-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "a16f1fb5-5d78-46c5-a7c3-f4d90bf87a82" (UID: "a16f1fb5-5d78-46c5-a7c3-f4d90bf87a82"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 18:47:07.563868 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:47:07.563841    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a16f1fb5-5d78-46c5-a7c3-f4d90bf87a82-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "a16f1fb5-5d78-46c5-a7c3-f4d90bf87a82" (UID: "a16f1fb5-5d78-46c5-a7c3-f4d90bf87a82"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 18:47:07.563868 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:47:07.563852    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a16f1fb5-5d78-46c5-a7c3-f4d90bf87a82-service-ca" (OuterVolumeSpecName: "service-ca") pod "a16f1fb5-5d78-46c5-a7c3-f4d90bf87a82" (UID: "a16f1fb5-5d78-46c5-a7c3-f4d90bf87a82"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 18:47:07.564302 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:47:07.564285    2580 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a16f1fb5-5d78-46c5-a7c3-f4d90bf87a82-oauth-serving-cert\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 24 18:47:07.564374 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:47:07.564310    2580 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a16f1fb5-5d78-46c5-a7c3-f4d90bf87a82-service-ca\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 24 18:47:07.564374 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:47:07.564323    2580 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a16f1fb5-5d78-46c5-a7c3-f4d90bf87a82-console-config\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 24 18:47:07.564374 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:47:07.564337    2580 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a16f1fb5-5d78-46c5-a7c3-f4d90bf87a82-trusted-ca-bundle\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 24 18:47:07.565603 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:47:07.565571    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a16f1fb5-5d78-46c5-a7c3-f4d90bf87a82-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "a16f1fb5-5d78-46c5-a7c3-f4d90bf87a82" (UID: "a16f1fb5-5d78-46c5-a7c3-f4d90bf87a82"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 18:47:07.565702 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:47:07.565635    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a16f1fb5-5d78-46c5-a7c3-f4d90bf87a82-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "a16f1fb5-5d78-46c5-a7c3-f4d90bf87a82" (UID: "a16f1fb5-5d78-46c5-a7c3-f4d90bf87a82"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 18:47:07.565702 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:47:07.565680    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a16f1fb5-5d78-46c5-a7c3-f4d90bf87a82-kube-api-access-cvdlk" (OuterVolumeSpecName: "kube-api-access-cvdlk") pod "a16f1fb5-5d78-46c5-a7c3-f4d90bf87a82" (UID: "a16f1fb5-5d78-46c5-a7c3-f4d90bf87a82"). InnerVolumeSpecName "kube-api-access-cvdlk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 18:47:07.665716 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:47:07.665625    2580 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a16f1fb5-5d78-46c5-a7c3-f4d90bf87a82-console-oauth-config\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 24 18:47:07.665716 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:47:07.665655    2580 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a16f1fb5-5d78-46c5-a7c3-f4d90bf87a82-console-serving-cert\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 24 18:47:07.665716 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:47:07.665670    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cvdlk\" (UniqueName: \"kubernetes.io/projected/a16f1fb5-5d78-46c5-a7c3-f4d90bf87a82-kube-api-access-cvdlk\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 24 18:47:08.169468 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:47:08.169429    2580 generic.go:356] "Generic (PLEG): container finished" podID="a16f1fb5-5d78-46c5-a7c3-f4d90bf87a82" containerID="2f9fd4e47d3f455603c1b54029e24a82d91662874c17171387476fa909406978" exitCode=0
Jul 24 18:47:08.169952 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:47:08.169490    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c96bfbddd-xxb46"
Jul 24 18:47:08.169952 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:47:08.169518    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c96bfbddd-xxb46" event={"ID":"a16f1fb5-5d78-46c5-a7c3-f4d90bf87a82","Type":"ContainerDied","Data":"2f9fd4e47d3f455603c1b54029e24a82d91662874c17171387476fa909406978"}
Jul 24 18:47:08.169952 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:47:08.169571    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c96bfbddd-xxb46" event={"ID":"a16f1fb5-5d78-46c5-a7c3-f4d90bf87a82","Type":"ContainerDied","Data":"59f5c937570e3a52b2bd5dfb7b9500dbc6992f32d940fb7395139e0a734b18aa"}
Jul 24 18:47:08.169952 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:47:08.169591    2580 scope.go:117] "RemoveContainer" containerID="2f9fd4e47d3f455603c1b54029e24a82d91662874c17171387476fa909406978"
Jul 24 18:47:08.178585 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:47:08.178570    2580 scope.go:117] "RemoveContainer" containerID="2f9fd4e47d3f455603c1b54029e24a82d91662874c17171387476fa909406978"
Jul 24 18:47:08.178822 ip-10-0-141-146 kubenswrapper[2580]: E0724 18:47:08.178807    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2f9fd4e47d3f455603c1b54029e24a82d91662874c17171387476fa909406978\": container with ID starting with 2f9fd4e47d3f455603c1b54029e24a82d91662874c17171387476fa909406978 not found: ID does not exist" containerID="2f9fd4e47d3f455603c1b54029e24a82d91662874c17171387476fa909406978"
Jul 24 18:47:08.178859 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:47:08.178834    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2f9fd4e47d3f455603c1b54029e24a82d91662874c17171387476fa909406978"} err="failed to get container status \"2f9fd4e47d3f455603c1b54029e24a82d91662874c17171387476fa909406978\": rpc error: code = NotFound desc = could not find container \"2f9fd4e47d3f455603c1b54029e24a82d91662874c17171387476fa909406978\": container with ID starting with 2f9fd4e47d3f455603c1b54029e24a82d91662874c17171387476fa909406978 not found: ID does not exist"
Jul 24 18:47:08.190626 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:47:08.190600    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-c96bfbddd-xxb46"]
Jul 24 18:47:08.195784 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:47:08.195760    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-c96bfbddd-xxb46"]
Jul 24 18:47:09.240756 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:47:09.240720    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a16f1fb5-5d78-46c5-a7c3-f4d90bf87a82" path="/var/lib/kubelet/pods/a16f1fb5-5d78-46c5-a7c3-f4d90bf87a82/volumes"
Jul 24 18:47:10.340285 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:47:10.340252    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:47:10.466141 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:47:10.466087    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:47:21.524638 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:47:21.524594    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:47:21.623229 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:47:21.623134    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:47:32.389801 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:47:32.389758    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 18:47:32.405593 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:47:32.405568    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 18:47:33.279253 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:47:33.279225    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 18:47:43.417387 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:47:43.417353    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:47:44.277399 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:47:44.277362    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:47:47.259621 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:47:47.259585    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:47:47.359287 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:47:47.359259    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:47:49.221156 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:47:49.221103    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:47:49.393560 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:47:49.393528    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:47:49.531256 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:47:49.531178    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:47:51.214133 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:47:51.214100    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:47:51.603581 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:47:51.603489    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:47:54.023802 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:47:54.023767    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:47:54.085068 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:47:54.085036    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:47:59.204657 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:47:59.204618    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:48:03.742959 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:48:03.742908    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:48:05.465603 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:48:05.465572    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:48:05.565858 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:48:05.565817    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:48:10.809395 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:48:10.809356    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:48:10.910377 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:48:10.910341    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:48:11.662528 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:48:11.662495    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:48:11.815438 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:48:11.815405    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:48:12.858965 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:48:12.858923    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:48:27.127420 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:48:27.127325    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:48:27.192795 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:48:27.192751    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-594d74945-6c6dl"]
Jul 24 18:48:27.193114 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:48:27.193100    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a16f1fb5-5d78-46c5-a7c3-f4d90bf87a82" containerName="console"
Jul 24 18:48:27.193181 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:48:27.193117    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="a16f1fb5-5d78-46c5-a7c3-f4d90bf87a82" containerName="console"
Jul 24 18:48:27.193216 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:48:27.193193    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="a16f1fb5-5d78-46c5-a7c3-f4d90bf87a82" containerName="console"
Jul 24 18:48:27.196064 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:48:27.196049    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-594d74945-6c6dl"
Jul 24 18:48:27.200922 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:48:27.200899    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 24 18:48:27.202296 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:48:27.202229    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 24 18:48:27.202417 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:48:27.202301    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 24 18:48:27.202417 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:48:27.202410    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 24 18:48:27.202541 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:48:27.202424    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-4gzxp\""
Jul 24 18:48:27.202596 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:48:27.202550    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 24 18:48:27.207755 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:48:27.207734    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-594d74945-6c6dl"]
Jul 24 18:48:27.232362 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:48:27.232331    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/01d4642b-4d62-4a18-8887-2d19fbcd020c-cert\") pod \"lws-controller-manager-594d74945-6c6dl\" (UID: \"01d4642b-4d62-4a18-8887-2d19fbcd020c\") " pod="openshift-lws-operator/lws-controller-manager-594d74945-6c6dl"
Jul 24 18:48:27.232362 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:48:27.232362    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/01d4642b-4d62-4a18-8887-2d19fbcd020c-metrics-cert\") pod \"lws-controller-manager-594d74945-6c6dl\" (UID: \"01d4642b-4d62-4a18-8887-2d19fbcd020c\") " pod="openshift-lws-operator/lws-controller-manager-594d74945-6c6dl"
Jul 24 18:48:27.232554 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:48:27.232418    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/01d4642b-4d62-4a18-8887-2d19fbcd020c-manager-config\") pod \"lws-controller-manager-594d74945-6c6dl\" (UID: \"01d4642b-4d62-4a18-8887-2d19fbcd020c\") " pod="openshift-lws-operator/lws-controller-manager-594d74945-6c6dl"
Jul 24 18:48:27.232554 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:48:27.232449    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fk6dd\" (UniqueName: \"kubernetes.io/projected/01d4642b-4d62-4a18-8887-2d19fbcd020c-kube-api-access-fk6dd\") pod \"lws-controller-manager-594d74945-6c6dl\" (UID: \"01d4642b-4d62-4a18-8887-2d19fbcd020c\") " pod="openshift-lws-operator/lws-controller-manager-594d74945-6c6dl"
Jul 24 18:48:27.234393 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:48:27.234368    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:48:27.333544 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:48:27.333508    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/01d4642b-4d62-4a18-8887-2d19fbcd020c-manager-config\") pod \"lws-controller-manager-594d74945-6c6dl\" (UID: \"01d4642b-4d62-4a18-8887-2d19fbcd020c\") " pod="openshift-lws-operator/lws-controller-manager-594d74945-6c6dl"
Jul 24 18:48:27.333750 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:48:27.333571    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fk6dd\" (UniqueName: \"kubernetes.io/projected/01d4642b-4d62-4a18-8887-2d19fbcd020c-kube-api-access-fk6dd\") pod \"lws-controller-manager-594d74945-6c6dl\" (UID: \"01d4642b-4d62-4a18-8887-2d19fbcd020c\") " pod="openshift-lws-operator/lws-controller-manager-594d74945-6c6dl"
Jul 24 18:48:27.333750 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:48:27.333608    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/01d4642b-4d62-4a18-8887-2d19fbcd020c-cert\") pod \"lws-controller-manager-594d74945-6c6dl\" (UID: \"01d4642b-4d62-4a18-8887-2d19fbcd020c\") " pod="openshift-lws-operator/lws-controller-manager-594d74945-6c6dl"
Jul 24 18:48:27.333750 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:48:27.333628    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/01d4642b-4d62-4a18-8887-2d19fbcd020c-metrics-cert\") pod \"lws-controller-manager-594d74945-6c6dl\" (UID: \"01d4642b-4d62-4a18-8887-2d19fbcd020c\") " pod="openshift-lws-operator/lws-controller-manager-594d74945-6c6dl"
Jul 24 18:48:27.334317 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:48:27.334293    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/01d4642b-4d62-4a18-8887-2d19fbcd020c-manager-config\") pod \"lws-controller-manager-594d74945-6c6dl\" (UID: \"01d4642b-4d62-4a18-8887-2d19fbcd020c\") " pod="openshift-lws-operator/lws-controller-manager-594d74945-6c6dl"
Jul 24 18:48:27.336110 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:48:27.336081    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/01d4642b-4d62-4a18-8887-2d19fbcd020c-metrics-cert\") pod \"lws-controller-manager-594d74945-6c6dl\" (UID: \"01d4642b-4d62-4a18-8887-2d19fbcd020c\") " pod="openshift-lws-operator/lws-controller-manager-594d74945-6c6dl"
Jul 24 18:48:27.336317 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:48:27.336298    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/01d4642b-4d62-4a18-8887-2d19fbcd020c-cert\") pod \"lws-controller-manager-594d74945-6c6dl\" (UID: \"01d4642b-4d62-4a18-8887-2d19fbcd020c\") " pod="openshift-lws-operator/lws-controller-manager-594d74945-6c6dl"
Jul 24 18:48:27.347002 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:48:27.346981    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fk6dd\" (UniqueName: \"kubernetes.io/projected/01d4642b-4d62-4a18-8887-2d19fbcd020c-kube-api-access-fk6dd\") pod \"lws-controller-manager-594d74945-6c6dl\" (UID: \"01d4642b-4d62-4a18-8887-2d19fbcd020c\") " pod="openshift-lws-operator/lws-controller-manager-594d74945-6c6dl"
Jul 24 18:48:27.505996 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:48:27.505968    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-594d74945-6c6dl"
Jul 24 18:48:27.682924 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:48:27.682893    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-594d74945-6c6dl"]
Jul 24 18:48:27.688536 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:48:27.686543    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01d4642b_4d62_4a18_8887_2d19fbcd020c.slice/crio-b12722fe2ef88089d5c23526623fa451012dc3d9e2227369849aac799c052937 WatchSource:0}: Error finding container b12722fe2ef88089d5c23526623fa451012dc3d9e2227369849aac799c052937: Status 404 returned error can't find the container with id b12722fe2ef88089d5c23526623fa451012dc3d9e2227369849aac799c052937
Jul 24 18:48:28.481991 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:48:28.481959    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-594d74945-6c6dl" event={"ID":"01d4642b-4d62-4a18-8887-2d19fbcd020c","Type":"ContainerStarted","Data":"b12722fe2ef88089d5c23526623fa451012dc3d9e2227369849aac799c052937"}
Jul 24 18:48:28.648050 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:48:28.648013    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:48:28.780431 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:48:28.780357    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:48:29.268601 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:48:29.268566    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:48:29.467867 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:48:29.467830    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:48:29.555539 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:48:29.555403    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:48:29.657856 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:48:29.657823    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6559d49d8b-kt7hq"]
Jul 24 18:48:29.665321 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:48:29.665294    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6559d49d8b-kt7hq"
Jul 24 18:48:29.670585 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:48:29.670372    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 24 18:48:29.670585 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:48:29.670457    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-7rgj8\""
Jul 24 18:48:29.671385 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:48:29.671355    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 24 18:48:29.671544 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:48:29.671432    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 24 18:48:29.671806 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:48:29.671789    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 24 18:48:29.686608 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:48:29.686578    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6559d49d8b-kt7hq"]
Jul 24 18:48:29.756449 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:48:29.756418    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/35d74943-4e45-4265-9897-7c9c44077378-manifests\") pod \"opendatahub-operator-controller-manager-6559d49d8b-kt7hq\" (UID: \"35d74943-4e45-4265-9897-7c9c44077378\") " pod="opendatahub/opendatahub-operator-controller-manager-6559d49d8b-kt7hq"
Jul 24 18:48:29.756646 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:48:29.756472    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9f6z5\" (UniqueName: \"kubernetes.io/projected/35d74943-4e45-4265-9897-7c9c44077378-kube-api-access-9f6z5\") pod \"opendatahub-operator-controller-manager-6559d49d8b-kt7hq\" (UID: \"35d74943-4e45-4265-9897-7c9c44077378\") " pod="opendatahub/opendatahub-operator-controller-manager-6559d49d8b-kt7hq"
Jul 24 18:48:29.756646 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:48:29.756601    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/35d74943-4e45-4265-9897-7c9c44077378-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6559d49d8b-kt7hq\" (UID: \"35d74943-4e45-4265-9897-7c9c44077378\") " pod="opendatahub/opendatahub-operator-controller-manager-6559d49d8b-kt7hq"
Jul 24 18:48:29.756646 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:48:29.756631    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/35d74943-4e45-4265-9897-7c9c44077378-tmp\") pod \"opendatahub-operator-controller-manager-6559d49d8b-kt7hq\" (UID: \"35d74943-4e45-4265-9897-7c9c44077378\") " pod="opendatahub/opendatahub-operator-controller-manager-6559d49d8b-kt7hq"
Jul 24 18:48:29.756812 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:48:29.756657    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/35d74943-4e45-4265-9897-7c9c44077378-webhook-cert\") pod \"opendatahub-operator-controller-manager-6559d49d8b-kt7hq\" (UID: \"35d74943-4e45-4265-9897-7c9c44077378\") " pod="opendatahub/opendatahub-operator-controller-manager-6559d49d8b-kt7hq"
Jul 24 18:48:29.857921 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:48:29.857833    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/35d74943-4e45-4265-9897-7c9c44077378-manifests\") pod \"opendatahub-operator-controller-manager-6559d49d8b-kt7hq\" (UID: \"35d74943-4e45-4265-9897-7c9c44077378\") " pod="opendatahub/opendatahub-operator-controller-manager-6559d49d8b-kt7hq"
Jul 24 18:48:29.857921 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:48:29.857883    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9f6z5\" (UniqueName: \"kubernetes.io/projected/35d74943-4e45-4265-9897-7c9c44077378-kube-api-access-9f6z5\") pod \"opendatahub-operator-controller-manager-6559d49d8b-kt7hq\" (UID: \"35d74943-4e45-4265-9897-7c9c44077378\") " pod="opendatahub/opendatahub-operator-controller-manager-6559d49d8b-kt7hq"
Jul 24 18:48:29.858216 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:48:29.857937    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/35d74943-4e45-4265-9897-7c9c44077378-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6559d49d8b-kt7hq\" (UID: \"35d74943-4e45-4265-9897-7c9c44077378\") " pod="opendatahub/opendatahub-operator-controller-manager-6559d49d8b-kt7hq"
Jul 24 18:48:29.858216 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:48:29.857961    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/35d74943-4e45-4265-9897-7c9c44077378-tmp\") pod \"opendatahub-operator-controller-manager-6559d49d8b-kt7hq\" (UID: \"35d74943-4e45-4265-9897-7c9c44077378\") " pod="opendatahub/opendatahub-operator-controller-manager-6559d49d8b-kt7hq"
Jul 24 18:48:29.858216 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:48:29.857985    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/35d74943-4e45-4265-9897-7c9c44077378-webhook-cert\") pod \"opendatahub-operator-controller-manager-6559d49d8b-kt7hq\" (UID: \"35d74943-4e45-4265-9897-7c9c44077378\") " pod="opendatahub/opendatahub-operator-controller-manager-6559d49d8b-kt7hq"
Jul 24 18:48:29.858570 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:48:29.858538    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/35d74943-4e45-4265-9897-7c9c44077378-manifests\") pod \"opendatahub-operator-controller-manager-6559d49d8b-kt7hq\" (UID: \"35d74943-4e45-4265-9897-7c9c44077378\") " pod="opendatahub/opendatahub-operator-controller-manager-6559d49d8b-kt7hq"
Jul 24 18:48:29.860857 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:48:29.860830    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/35d74943-4e45-4265-9897-7c9c44077378-tmp\") pod \"opendatahub-operator-controller-manager-6559d49d8b-kt7hq\" (UID: \"35d74943-4e45-4265-9897-7c9c44077378\") " pod="opendatahub/opendatahub-operator-controller-manager-6559d49d8b-kt7hq"
Jul 24 18:48:29.860972 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:48:29.860903    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/35d74943-4e45-4265-9897-7c9c44077378-webhook-cert\") pod \"opendatahub-operator-controller-manager-6559d49d8b-kt7hq\" (UID: \"35d74943-4e45-4265-9897-7c9c44077378\") " pod="opendatahub/opendatahub-operator-controller-manager-6559d49d8b-kt7hq"
Jul 24 18:48:29.861032 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:48:29.861018    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/35d74943-4e45-4265-9897-7c9c44077378-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6559d49d8b-kt7hq\" (UID: \"35d74943-4e45-4265-9897-7c9c44077378\") " pod="opendatahub/opendatahub-operator-controller-manager-6559d49d8b-kt7hq"
Jul 24 18:48:29.867950 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:48:29.867924    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9f6z5\" (UniqueName: \"kubernetes.io/projected/35d74943-4e45-4265-9897-7c9c44077378-kube-api-access-9f6z5\") pod \"opendatahub-operator-controller-manager-6559d49d8b-kt7hq\" (UID: \"35d74943-4e45-4265-9897-7c9c44077378\") " pod="opendatahub/opendatahub-operator-controller-manager-6559d49d8b-kt7hq"
Jul 24 18:48:29.927980 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:48:29.927934    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:48:29.977484 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:48:29.977435    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6559d49d8b-kt7hq"
Jul 24 18:48:30.032813 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:48:30.032780    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:48:30.128626 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:48:30.128545    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:48:30.228286 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:48:30.228256    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:48:30.334036 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:48:30.333996    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:48:30.431305 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:48:30.431226    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:48:30.649858 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:48:30.649829    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6559d49d8b-kt7hq"]
Jul 24 18:48:30.652024 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:48:30.652003    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35d74943_4e45_4265_9897_7c9c44077378.slice/crio-b049c89f5a9713356ce9703967642232bea7558a740ff53858d9f2d0e22540e5 WatchSource:0}: Error finding container b049c89f5a9713356ce9703967642232bea7558a740ff53858d9f2d0e22540e5: Status 404 returned error can't find the container with id b049c89f5a9713356ce9703967642232bea7558a740ff53858d9f2d0e22540e5
Jul 24 18:48:31.499366 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:48:31.499317    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-594d74945-6c6dl" event={"ID":"01d4642b-4d62-4a18-8887-2d19fbcd020c","Type":"ContainerStarted","Data":"4e0e2c7a0e960788d22064fb3659d3acc65fd933af45d38ef37b160976f9507c"}
Jul 24 18:48:31.499786 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:48:31.499761    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-594d74945-6c6dl"
Jul 24 18:48:31.502176 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:48:31.502077    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6559d49d8b-kt7hq" event={"ID":"35d74943-4e45-4265-9897-7c9c44077378","Type":"ContainerStarted","Data":"b049c89f5a9713356ce9703967642232bea7558a740ff53858d9f2d0e22540e5"}
Jul 24 18:48:31.519515 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:48:31.519453    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-594d74945-6c6dl" podStartSLOduration=1.637493966 podStartE2EDuration="4.519432503s" totalImagesPullingTime="2.881938537s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 18:48:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:48:31.517147345 +0000 UTC m=+266.726519389" watchObservedRunningTime="2026-07-24 18:48:31.519432503 +0000 UTC m=+266.728804547"
Jul 24 18:48:33.513331 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:48:33.513295    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6559d49d8b-kt7hq" event={"ID":"35d74943-4e45-4265-9897-7c9c44077378","Type":"ContainerStarted","Data":"399a84dc83b08391ae93ec2a96c1555040ac578ec97cf561e4e5ed3e895fa26f"}
Jul 24 18:48:34.519088 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:48:34.519056    2580 generic.go:356] "Generic (PLEG): container finished" podID="35d74943-4e45-4265-9897-7c9c44077378" containerID="399a84dc83b08391ae93ec2a96c1555040ac578ec97cf561e4e5ed3e895fa26f" exitCode=0
Jul 24 18:48:34.519540 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:48:34.519098    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6559d49d8b-kt7hq" event={"ID":"35d74943-4e45-4265-9897-7c9c44077378","Type":"ContainerDied","Data":"399a84dc83b08391ae93ec2a96c1555040ac578ec97cf561e4e5ed3e895fa26f"}
Jul 24 18:48:35.532015 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:48:35.531967    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6559d49d8b-kt7hq" event={"ID":"35d74943-4e45-4265-9897-7c9c44077378","Type":"ContainerStarted","Data":"621de50f198ca5f946b2b9316b1b1c97cf9b22b9cbc6828130a1cb783e337fa4"}
Jul 24 18:48:35.532488 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:48:35.532091    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6559d49d8b-kt7hq"
Jul 24 18:48:35.558138 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:48:35.558056    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6559d49d8b-kt7hq" podStartSLOduration=2.325374616 podStartE2EDuration="6.558039016s" totalImagesPullingTime="3.212136758s" totalInitContainerRuntime="1.020527642s" isStatefulPod=false podCreationTimestamp="2026-07-24 18:48:29 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:48:35.555529096 +0000 UTC m=+270.764901152" watchObservedRunningTime="2026-07-24 18:48:35.558039016 +0000 UTC m=+270.767411058"
Jul 24 18:48:42.510005 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:48:42.509975    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-594d74945-6c6dl"
Jul 24 18:48:46.538261 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:48:46.538230    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6559d49d8b-kt7hq"
Jul 24 18:48:48.608849 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:48:48.608815    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:48:49.258491 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:48:49.258453    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-7d65fbd68-ll8gb"]
Jul 24 18:48:49.269570 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:48:49.269547    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7d65fbd68-ll8gb"
Jul 24 18:48:49.272314 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:48:49.272292    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 24 18:48:49.272483 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:48:49.272467    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 24 18:48:49.275333 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:48:49.275153    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 24 18:48:49.275333 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:48:49.274614    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-z2vvb\""
Jul 24 18:48:49.275333 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:48:49.275231    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 24 18:48:49.276707 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:48:49.276687    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7d65fbd68-ll8gb"]
Jul 24 18:48:49.441486 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:48:49.441453    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/32039b11-c36a-44ae-8bc0-879886c976ae-tmp\") pod \"kube-auth-proxy-7d65fbd68-ll8gb\" (UID: \"32039b11-c36a-44ae-8bc0-879886c976ae\") " pod="openshift-ingress/kube-auth-proxy-7d65fbd68-ll8gb"
Jul 24 18:48:49.441665 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:48:49.441530    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5r2s5\" (UniqueName: \"kubernetes.io/projected/32039b11-c36a-44ae-8bc0-879886c976ae-kube-api-access-5r2s5\") pod \"kube-auth-proxy-7d65fbd68-ll8gb\" (UID: \"32039b11-c36a-44ae-8bc0-879886c976ae\") " pod="openshift-ingress/kube-auth-proxy-7d65fbd68-ll8gb"
Jul 24 18:48:49.441665 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:48:49.441587    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/32039b11-c36a-44ae-8bc0-879886c976ae-tls-certs\") pod \"kube-auth-proxy-7d65fbd68-ll8gb\" (UID: \"32039b11-c36a-44ae-8bc0-879886c976ae\") " pod="openshift-ingress/kube-auth-proxy-7d65fbd68-ll8gb"
Jul 24 18:48:49.542484 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:48:49.542390    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/32039b11-c36a-44ae-8bc0-879886c976ae-tmp\") pod \"kube-auth-proxy-7d65fbd68-ll8gb\" (UID: \"32039b11-c36a-44ae-8bc0-879886c976ae\") " pod="openshift-ingress/kube-auth-proxy-7d65fbd68-ll8gb"
Jul 24 18:48:49.542484 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:48:49.542457    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5r2s5\" (UniqueName: \"kubernetes.io/projected/32039b11-c36a-44ae-8bc0-879886c976ae-kube-api-access-5r2s5\") pod \"kube-auth-proxy-7d65fbd68-ll8gb\" (UID: \"32039b11-c36a-44ae-8bc0-879886c976ae\") " pod="openshift-ingress/kube-auth-proxy-7d65fbd68-ll8gb"
Jul 24 18:48:49.542723 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:48:49.542513    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/32039b11-c36a-44ae-8bc0-879886c976ae-tls-certs\") pod \"kube-auth-proxy-7d65fbd68-ll8gb\" (UID: \"32039b11-c36a-44ae-8bc0-879886c976ae\") " pod="openshift-ingress/kube-auth-proxy-7d65fbd68-ll8gb"
Jul 24 18:48:49.544785 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:48:49.544763    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/32039b11-c36a-44ae-8bc0-879886c976ae-tmp\") pod \"kube-auth-proxy-7d65fbd68-ll8gb\" (UID: \"32039b11-c36a-44ae-8bc0-879886c976ae\") " pod="openshift-ingress/kube-auth-proxy-7d65fbd68-ll8gb"
Jul 24 18:48:49.545031 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:48:49.545013    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/32039b11-c36a-44ae-8bc0-879886c976ae-tls-certs\") pod \"kube-auth-proxy-7d65fbd68-ll8gb\" (UID: \"32039b11-c36a-44ae-8bc0-879886c976ae\") " pod="openshift-ingress/kube-auth-proxy-7d65fbd68-ll8gb"
Jul 24 18:48:49.558895 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:48:49.558873    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5r2s5\" (UniqueName: \"kubernetes.io/projected/32039b11-c36a-44ae-8bc0-879886c976ae-kube-api-access-5r2s5\") pod \"kube-auth-proxy-7d65fbd68-ll8gb\" (UID: \"32039b11-c36a-44ae-8bc0-879886c976ae\") " pod="openshift-ingress/kube-auth-proxy-7d65fbd68-ll8gb"
Jul 24 18:48:49.581769 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:48:49.581739    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7d65fbd68-ll8gb"
Jul 24 18:48:49.721741 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:48:49.721560    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7d65fbd68-ll8gb"]
Jul 24 18:48:49.724561 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:48:49.724531    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32039b11_c36a_44ae_8bc0_879886c976ae.slice/crio-9d1a31e0b93d42d84585d65e1ec52697057dc161328f22fbba0baf58999b9863 WatchSource:0}: Error finding container 9d1a31e0b93d42d84585d65e1ec52697057dc161328f22fbba0baf58999b9863: Status 404 returned error can't find the container with id 9d1a31e0b93d42d84585d65e1ec52697057dc161328f22fbba0baf58999b9863
Jul 24 18:48:49.870979 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:48:49.870892    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:48:50.189464 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:48:50.189432    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:48:50.599250 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:48:50.599162    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7d65fbd68-ll8gb" event={"ID":"32039b11-c36a-44ae-8bc0-879886c976ae","Type":"ContainerStarted","Data":"9d1a31e0b93d42d84585d65e1ec52697057dc161328f22fbba0baf58999b9863"}
Jul 24 18:48:50.641717 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:48:50.641678    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:48:50.789735 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:48:50.789701    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:48:51.021673 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:48:51.021634    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:48:51.126098 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:48:51.126063    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:48:52.164966 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:48:52.164929    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:48:52.609539 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:48:52.609488    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7d65fbd68-ll8gb" event={"ID":"32039b11-c36a-44ae-8bc0-879886c976ae","Type":"ContainerStarted","Data":"541c093fc7a75d40f8d6dc1e4270de569e4b46780767e23b5f6a2f67c02b8573"}
Jul 24 18:48:52.627717 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:48:52.627649    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-7d65fbd68-ll8gb" podStartSLOduration=0.865446538 podStartE2EDuration="3.627632724s" totalImagesPullingTime="2.762186186s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 18:48:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:48:52.626621836 +0000 UTC m=+287.835993880" watchObservedRunningTime="2026-07-24 18:48:52.627632724 +0000 UTC m=+287.837004766"
Jul 24 18:48:57.945496 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:48:57.945446    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:48:58.104438 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:48:58.104350    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:48:58.840477 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:48:58.840438    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6dmlx"]
Jul 24 18:48:58.843648 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:48:58.843625    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6dmlx"
Jul 24 18:48:58.851240 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:48:58.851221    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 24 18:48:58.874890 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:48:58.874866    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6dmlx"]
Jul 24 18:48:58.888392 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:48:58.888369    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-6pxvv\""
Jul 24 18:48:58.920408 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:48:58.920379    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:48:58.930780 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:48:58.930754    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c38843e5-8c70-412b-a4d6-1ca77c080c8c-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-6dmlx\" (UID: \"c38843e5-8c70-412b-a4d6-1ca77c080c8c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6dmlx"
Jul 24 18:48:58.930905 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:48:58.930792    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c38843e5-8c70-412b-a4d6-1ca77c080c8c-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-6dmlx\" (UID: \"c38843e5-8c70-412b-a4d6-1ca77c080c8c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6dmlx"
Jul 24 18:48:58.930905 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:48:58.930814    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c38843e5-8c70-412b-a4d6-1ca77c080c8c-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-6dmlx\" (UID: \"c38843e5-8c70-412b-a4d6-1ca77c080c8c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6dmlx"
Jul 24 18:48:58.930905 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:48:58.930834    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9k5xp\" (UniqueName: \"kubernetes.io/projected/c38843e5-8c70-412b-a4d6-1ca77c080c8c-kube-api-access-9k5xp\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-6dmlx\" (UID: \"c38843e5-8c70-412b-a4d6-1ca77c080c8c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6dmlx"
Jul 24 18:48:58.930905 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:48:58.930873    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c38843e5-8c70-412b-a4d6-1ca77c080c8c-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-6dmlx\" (UID: \"c38843e5-8c70-412b-a4d6-1ca77c080c8c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6dmlx"
Jul 24 18:48:58.931059 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:48:58.930910    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c38843e5-8c70-412b-a4d6-1ca77c080c8c-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-6dmlx\" (UID: \"c38843e5-8c70-412b-a4d6-1ca77c080c8c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6dmlx"
Jul 24 18:48:58.931059 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:48:58.930943    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c38843e5-8c70-412b-a4d6-1ca77c080c8c-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-6dmlx\" (UID: \"c38843e5-8c70-412b-a4d6-1ca77c080c8c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6dmlx"
Jul 24 18:48:58.931059 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:48:58.930961    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c38843e5-8c70-412b-a4d6-1ca77c080c8c-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-6dmlx\" (UID: \"c38843e5-8c70-412b-a4d6-1ca77c080c8c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6dmlx"
Jul 24 18:48:58.931059 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:48:58.930993    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c38843e5-8c70-412b-a4d6-1ca77c080c8c-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-6dmlx\" (UID: \"c38843e5-8c70-412b-a4d6-1ca77c080c8c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6dmlx"
Jul 24 18:48:59.031438 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:48:59.031405    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c38843e5-8c70-412b-a4d6-1ca77c080c8c-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-6dmlx\" (UID: \"c38843e5-8c70-412b-a4d6-1ca77c080c8c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6dmlx"
Jul 24 18:48:59.031438 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:48:59.031442    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c38843e5-8c70-412b-a4d6-1ca77c080c8c-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-6dmlx\" (UID: \"c38843e5-8c70-412b-a4d6-1ca77c080c8c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6dmlx"
Jul 24 18:48:59.031991 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:48:59.031464    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c38843e5-8c70-412b-a4d6-1ca77c080c8c-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-6dmlx\" (UID: \"c38843e5-8c70-412b-a4d6-1ca77c080c8c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6dmlx"
Jul 24 18:48:59.031991 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:48:59.031513    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c38843e5-8c70-412b-a4d6-1ca77c080c8c-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-6dmlx\" (UID: \"c38843e5-8c70-412b-a4d6-1ca77c080c8c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6dmlx"
Jul 24 18:48:59.031991 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:48:59.031543    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c38843e5-8c70-412b-a4d6-1ca77c080c8c-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-6dmlx\" (UID: \"c38843e5-8c70-412b-a4d6-1ca77c080c8c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6dmlx"
Jul 24 18:48:59.031991 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:48:59.031563    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c38843e5-8c70-412b-a4d6-1ca77c080c8c-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-6dmlx\" (UID: \"c38843e5-8c70-412b-a4d6-1ca77c080c8c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6dmlx"
Jul 24 18:48:59.031991 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:48:59.031587    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9k5xp\" (UniqueName: \"kubernetes.io/projected/c38843e5-8c70-412b-a4d6-1ca77c080c8c-kube-api-access-9k5xp\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-6dmlx\" (UID: \"c38843e5-8c70-412b-a4d6-1ca77c080c8c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6dmlx"
Jul 24 18:48:59.031991 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:48:59.031613    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c38843e5-8c70-412b-a4d6-1ca77c080c8c-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-6dmlx\" (UID: \"c38843e5-8c70-412b-a4d6-1ca77c080c8c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6dmlx"
Jul 24 18:48:59.031991 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:48:59.031657    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c38843e5-8c70-412b-a4d6-1ca77c080c8c-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-6dmlx\" (UID: \"c38843e5-8c70-412b-a4d6-1ca77c080c8c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6dmlx"
Jul 24 18:48:59.031991 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:48:59.031858    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c38843e5-8c70-412b-a4d6-1ca77c080c8c-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-6dmlx\" (UID: \"c38843e5-8c70-412b-a4d6-1ca77c080c8c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6dmlx"
Jul 24 18:48:59.031991 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:48:59.031941    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c38843e5-8c70-412b-a4d6-1ca77c080c8c-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-6dmlx\" (UID: \"c38843e5-8c70-412b-a4d6-1ca77c080c8c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6dmlx"
Jul 24 18:48:59.032396 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:48:59.032102    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c38843e5-8c70-412b-a4d6-1ca77c080c8c-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-6dmlx\" (UID: \"c38843e5-8c70-412b-a4d6-1ca77c080c8c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6dmlx"
Jul 24 18:48:59.032396 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:48:59.032192    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c38843e5-8c70-412b-a4d6-1ca77c080c8c-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-6dmlx\" (UID: \"c38843e5-8c70-412b-a4d6-1ca77c080c8c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6dmlx"
Jul 24 18:48:59.032396 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:48:59.032306    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c38843e5-8c70-412b-a4d6-1ca77c080c8c-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-6dmlx\" (UID: \"c38843e5-8c70-412b-a4d6-1ca77c080c8c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6dmlx"
Jul 24 18:48:59.034166 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:48:59.034147    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c38843e5-8c70-412b-a4d6-1ca77c080c8c-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-6dmlx\" (UID: \"c38843e5-8c70-412b-a4d6-1ca77c080c8c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6dmlx"
Jul 24 18:48:59.034501 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:48:59.034481    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c38843e5-8c70-412b-a4d6-1ca77c080c8c-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-6dmlx\" (UID: \"c38843e5-8c70-412b-a4d6-1ca77c080c8c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6dmlx"
Jul 24 18:48:59.044632 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:48:59.044603    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9k5xp\" (UniqueName: \"kubernetes.io/projected/c38843e5-8c70-412b-a4d6-1ca77c080c8c-kube-api-access-9k5xp\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-6dmlx\" (UID: \"c38843e5-8c70-412b-a4d6-1ca77c080c8c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6dmlx"
Jul 24 18:48:59.044738 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:48:59.044668    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c38843e5-8c70-412b-a4d6-1ca77c080c8c-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-6dmlx\" (UID: \"c38843e5-8c70-412b-a4d6-1ca77c080c8c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6dmlx"
Jul 24 18:48:59.062480 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:48:59.062446    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:48:59.153956 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:48:59.153873    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6dmlx"
Jul 24 18:48:59.319881 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:48:59.319196    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6dmlx"]
Jul 24 18:48:59.320836 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:48:59.320776    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc38843e5_8c70_412b_a4d6_1ca77c080c8c.slice/crio-2f967840fe412fb42f316146669472b1bed83c04168c1dbfa720c46aa4d6a2a0 WatchSource:0}: Error finding container 2f967840fe412fb42f316146669472b1bed83c04168c1dbfa720c46aa4d6a2a0: Status 404 returned error can't find the container with id 2f967840fe412fb42f316146669472b1bed83c04168c1dbfa720c46aa4d6a2a0
Jul 24 18:48:59.533555 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:48:59.533520    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:48:59.643268 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:48:59.643231    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6dmlx" event={"ID":"c38843e5-8c70-412b-a4d6-1ca77c080c8c","Type":"ContainerStarted","Data":"2f967840fe412fb42f316146669472b1bed83c04168c1dbfa720c46aa4d6a2a0"}
Jul 24 18:49:00.362805 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:49:00.362774    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:49:00.518652 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:49:00.518621    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:49:00.728437 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:49:00.728402    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:49:00.861727 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:49:00.861693    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:49:01.767645 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:49:01.767614    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:49:01.893468 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:49:01.893427    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:49:02.021243 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:49:02.021154    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:49:06.044917 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:49:06.044891    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qvzgb_dd21fc27-5a24-4f3a-a912-043af27a4342/ovn-acl-logging/0.log"
Jul 24 18:49:06.046283 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:49:06.045083    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qvzgb_dd21fc27-5a24-4f3a-a912-043af27a4342/ovn-acl-logging/0.log"
Jul 24 18:49:06.047634 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:49:06.047618    2580 kubelet.go:1648] "Image garbage collection succeeded"
Jul 24 18:49:06.081400 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:49:06.081368    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 24 18:49:06.081497 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:49:06.081439    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 24 18:49:06.081497 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:49:06.081466    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 24 18:49:06.677189 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:49:06.677149    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6dmlx" event={"ID":"c38843e5-8c70-412b-a4d6-1ca77c080c8c","Type":"ContainerStarted","Data":"bc50cf9cbb4bc6da38e30ef60f645061d9e10c80535c217a42bc4a9b6147abb3"}
Jul 24 18:49:06.700178 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:49:06.700108    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6dmlx" podStartSLOduration=1.942718556 podStartE2EDuration="8.700094292s" totalImagesPullingTime="6.757375736s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 18:48:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:49:06.69893023 +0000 UTC m=+301.908302285" watchObservedRunningTime="2026-07-24 18:49:06.700094292 +0000 UTC m=+301.909466335"
Jul 24 18:49:07.154711 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:49:07.154673    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6dmlx"
Jul 24 18:49:07.159292 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:49:07.159267    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6dmlx"
Jul 24 18:49:07.681991 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:49:07.681961    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6dmlx"
Jul 24 18:49:07.682947 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:49:07.682927    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6dmlx"
Jul 24 18:49:50.084364 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:49:50.084308    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:49:50.170763 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:49:50.170709    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:49:50.247754 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:49:50.247720    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:49:55.341064 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:49:55.341030    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:49:55.441059 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:49:55.441009    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:50:00.614751 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:50:00.614710    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:50:19.078999 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:50:19.078954    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:50:22.674491 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:50:22.674449    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:50:24.042557 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:50:24.042524    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:50:24.166095 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:50:24.166059    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:50:25.699825 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:50:25.699777    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:50:27.243486 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:50:27.243448    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:50:27.473510 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:50:27.473460    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:50:28.078462 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:50:28.078430    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:50:30.543327 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:50:30.543291    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:50:31.468514 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:50:31.468478    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:50:33.379351 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:50:33.379322    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:50:34.618913 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:50:34.618874    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7775fcdd7d-wvsn2"]
Jul 24 18:50:34.737619 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:50:34.737590    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:50:34.841452 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:50:34.841412    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:50:34.938194 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:50:34.938166    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:50:35.527237 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:50:35.527206    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-85f9m"]
Jul 24 18:50:35.530569 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:50:35.530551    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-85f9m"
Jul 24 18:50:35.533284 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:50:35.533254    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 24 18:50:35.533417 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:50:35.533265    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 24 18:50:35.533417 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:50:35.533325    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 24 18:50:35.533417 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:50:35.533334    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 24 18:50:35.534354 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:50:35.534325    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-jwg7r\""
Jul 24 18:50:35.539895 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:50:35.539864    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:50:35.541542 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:50:35.541511    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-85f9m"]
Jul 24 18:50:35.619697 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:50:35.619656    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p5t55\" (UniqueName: \"kubernetes.io/projected/a379bea3-1952-43ac-ae0a-9f9e83070628-kube-api-access-p5t55\") pod \"kuadrant-console-plugin-66b5774985-85f9m\" (UID: \"a379bea3-1952-43ac-ae0a-9f9e83070628\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-85f9m"
Jul 24 18:50:35.620096 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:50:35.619716    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/a379bea3-1952-43ac-ae0a-9f9e83070628-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-85f9m\" (UID: \"a379bea3-1952-43ac-ae0a-9f9e83070628\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-85f9m"
Jul 24 18:50:35.620096 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:50:35.619751    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/a379bea3-1952-43ac-ae0a-9f9e83070628-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-85f9m\" (UID: \"a379bea3-1952-43ac-ae0a-9f9e83070628\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-85f9m"
Jul 24 18:50:35.651902 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:50:35.651870    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:50:35.721274 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:50:35.721239    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p5t55\" (UniqueName: \"kubernetes.io/projected/a379bea3-1952-43ac-ae0a-9f9e83070628-kube-api-access-p5t55\") pod \"kuadrant-console-plugin-66b5774985-85f9m\" (UID: \"a379bea3-1952-43ac-ae0a-9f9e83070628\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-85f9m"
Jul 24 18:50:35.721438 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:50:35.721288    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/a379bea3-1952-43ac-ae0a-9f9e83070628-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-85f9m\" (UID: \"a379bea3-1952-43ac-ae0a-9f9e83070628\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-85f9m"
Jul 24 18:50:35.721438 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:50:35.721318    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/a379bea3-1952-43ac-ae0a-9f9e83070628-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-85f9m\" (UID: \"a379bea3-1952-43ac-ae0a-9f9e83070628\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-85f9m"
Jul 24 18:50:35.721941 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:50:35.721914    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/a379bea3-1952-43ac-ae0a-9f9e83070628-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-85f9m\" (UID: \"a379bea3-1952-43ac-ae0a-9f9e83070628\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-85f9m"
Jul 24 18:50:35.723846 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:50:35.723824    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/a379bea3-1952-43ac-ae0a-9f9e83070628-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-85f9m\" (UID: \"a379bea3-1952-43ac-ae0a-9f9e83070628\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-85f9m"
Jul 24 18:50:35.732923 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:50:35.732894    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p5t55\" (UniqueName: \"kubernetes.io/projected/a379bea3-1952-43ac-ae0a-9f9e83070628-kube-api-access-p5t55\") pod \"kuadrant-console-plugin-66b5774985-85f9m\" (UID: \"a379bea3-1952-43ac-ae0a-9f9e83070628\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-85f9m"
Jul 24 18:50:35.851404 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:50:35.851315    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-85f9m"
Jul 24 18:50:36.002920 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:50:36.002883    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-85f9m"]
Jul 24 18:50:36.006061 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:50:36.006026    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda379bea3_1952_43ac_ae0a_9f9e83070628.slice/crio-70ba22bab508ed0a7be80bb4446f80694ba933b55c2d02bc32cf23eeaa05cfbb WatchSource:0}: Error finding container 70ba22bab508ed0a7be80bb4446f80694ba933b55c2d02bc32cf23eeaa05cfbb: Status 404 returned error can't find the container with id 70ba22bab508ed0a7be80bb4446f80694ba933b55c2d02bc32cf23eeaa05cfbb
Jul 24 18:50:36.007456 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:50:36.007440    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 24 18:50:36.090420 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:50:36.090388    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-85f9m" event={"ID":"a379bea3-1952-43ac-ae0a-9f9e83070628","Type":"ContainerStarted","Data":"70ba22bab508ed0a7be80bb4446f80694ba933b55c2d02bc32cf23eeaa05cfbb"}
Jul 24 18:50:38.473880 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:50:38.473847    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:50:38.544945 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:50:38.544906    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:50:47.722920 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:50:47.722885    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:50:47.842719 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:50:47.842673    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:50:50.695477 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:50:50.695448    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:50:50.797681 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:50:50.797645    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:50:53.288707 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:50:53.288665    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:50:53.393157 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:50:53.393103    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:50:57.112556 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:50:57.112507    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:50:57.212392 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:50:57.212344    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:50:59.212067 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:50:59.212035    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-85f9m" event={"ID":"a379bea3-1952-43ac-ae0a-9f9e83070628","Type":"ContainerStarted","Data":"f37cffbcd1095871d654c4c153b486c6c5119bb58885c73fac0c64d1f5df0421"}
Jul 24 18:50:59.228356 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:50:59.228310    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-85f9m" podStartSLOduration=1.7951750450000001 podStartE2EDuration="24.228296851s" totalImagesPullingTime="22.433121806s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 18:50:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:50:59.227021945 +0000 UTC m=+414.436393989" watchObservedRunningTime="2026-07-24 18:50:59.228296851 +0000 UTC m=+414.437668943"
Jul 24 18:50:59.638750 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:50:59.638655    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7775fcdd7d-wvsn2" podUID="98827dd6-0458-4403-a047-e77a123383ea" containerName="console" containerID="cri-o://75225c99574fb6afc76014179166a198e7be3d22377a157b67fe01a42c0c68f2" gracePeriod=15
Jul 24 18:50:59.884259 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:50:59.884227    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7775fcdd7d-wvsn2"
Jul 24 18:51:00.057201 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:00.057160    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/98827dd6-0458-4403-a047-e77a123383ea-console-oauth-config\") pod \"98827dd6-0458-4403-a047-e77a123383ea\" (UID: \"98827dd6-0458-4403-a047-e77a123383ea\") "
Jul 24 18:51:00.057201 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:00.057205    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/98827dd6-0458-4403-a047-e77a123383ea-service-ca\") pod \"98827dd6-0458-4403-a047-e77a123383ea\" (UID: \"98827dd6-0458-4403-a047-e77a123383ea\") "
Jul 24 18:51:00.057451 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:00.057224    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/98827dd6-0458-4403-a047-e77a123383ea-console-config\") pod \"98827dd6-0458-4403-a047-e77a123383ea\" (UID: \"98827dd6-0458-4403-a047-e77a123383ea\") "
Jul 24 18:51:00.057451 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:00.057320    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/98827dd6-0458-4403-a047-e77a123383ea-console-serving-cert\") pod \"98827dd6-0458-4403-a047-e77a123383ea\" (UID: \"98827dd6-0458-4403-a047-e77a123383ea\") "
Jul 24 18:51:00.057451 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:00.057339    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/98827dd6-0458-4403-a047-e77a123383ea-oauth-serving-cert\") pod \"98827dd6-0458-4403-a047-e77a123383ea\" (UID: \"98827dd6-0458-4403-a047-e77a123383ea\") "
Jul 24 18:51:00.057451 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:00.057353    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/98827dd6-0458-4403-a047-e77a123383ea-trusted-ca-bundle\") pod \"98827dd6-0458-4403-a047-e77a123383ea\" (UID: \"98827dd6-0458-4403-a047-e77a123383ea\") "
Jul 24 18:51:00.057660 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:00.057530    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hn5cl\" (UniqueName: \"kubernetes.io/projected/98827dd6-0458-4403-a047-e77a123383ea-kube-api-access-hn5cl\") pod \"98827dd6-0458-4403-a047-e77a123383ea\" (UID: \"98827dd6-0458-4403-a047-e77a123383ea\") "
Jul 24 18:51:00.057719 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:00.057691    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/98827dd6-0458-4403-a047-e77a123383ea-service-ca" (OuterVolumeSpecName: "service-ca") pod "98827dd6-0458-4403-a047-e77a123383ea" (UID: "98827dd6-0458-4403-a047-e77a123383ea"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 18:51:00.057791 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:00.057726    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/98827dd6-0458-4403-a047-e77a123383ea-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "98827dd6-0458-4403-a047-e77a123383ea" (UID: "98827dd6-0458-4403-a047-e77a123383ea"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 18:51:00.057791 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:00.057740    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/98827dd6-0458-4403-a047-e77a123383ea-console-config" (OuterVolumeSpecName: "console-config") pod "98827dd6-0458-4403-a047-e77a123383ea" (UID: "98827dd6-0458-4403-a047-e77a123383ea"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 18:51:00.057791 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:00.057750    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/98827dd6-0458-4403-a047-e77a123383ea-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "98827dd6-0458-4403-a047-e77a123383ea" (UID: "98827dd6-0458-4403-a047-e77a123383ea"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 18:51:00.057939 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:00.057869    2580 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/98827dd6-0458-4403-a047-e77a123383ea-oauth-serving-cert\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 24 18:51:00.057939 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:00.057887    2580 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/98827dd6-0458-4403-a047-e77a123383ea-trusted-ca-bundle\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 24 18:51:00.057939 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:00.057897    2580 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/98827dd6-0458-4403-a047-e77a123383ea-service-ca\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 24 18:51:00.057939 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:00.057905    2580 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/98827dd6-0458-4403-a047-e77a123383ea-console-config\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 24 18:51:00.059566 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:00.059538    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/98827dd6-0458-4403-a047-e77a123383ea-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "98827dd6-0458-4403-a047-e77a123383ea" (UID: "98827dd6-0458-4403-a047-e77a123383ea"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 18:51:00.059683 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:00.059666    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/98827dd6-0458-4403-a047-e77a123383ea-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "98827dd6-0458-4403-a047-e77a123383ea" (UID: "98827dd6-0458-4403-a047-e77a123383ea"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 18:51:00.059801 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:00.059779    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/98827dd6-0458-4403-a047-e77a123383ea-kube-api-access-hn5cl" (OuterVolumeSpecName: "kube-api-access-hn5cl") pod "98827dd6-0458-4403-a047-e77a123383ea" (UID: "98827dd6-0458-4403-a047-e77a123383ea"). InnerVolumeSpecName "kube-api-access-hn5cl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 18:51:00.159148 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:00.159085    2580 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/98827dd6-0458-4403-a047-e77a123383ea-console-serving-cert\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 24 18:51:00.159148 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:00.159116    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hn5cl\" (UniqueName: \"kubernetes.io/projected/98827dd6-0458-4403-a047-e77a123383ea-kube-api-access-hn5cl\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 24 18:51:00.159148 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:00.159151    2580 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/98827dd6-0458-4403-a047-e77a123383ea-console-oauth-config\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 24 18:51:00.219428 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:00.219393    2580 generic.go:356] "Generic (PLEG): container finished" podID="98827dd6-0458-4403-a047-e77a123383ea" containerID="75225c99574fb6afc76014179166a198e7be3d22377a157b67fe01a42c0c68f2" exitCode=0
Jul 24 18:51:00.219830 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:00.219434    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7775fcdd7d-wvsn2"
Jul 24 18:51:00.219830 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:00.219468    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7775fcdd7d-wvsn2" event={"ID":"98827dd6-0458-4403-a047-e77a123383ea","Type":"ContainerDied","Data":"75225c99574fb6afc76014179166a198e7be3d22377a157b67fe01a42c0c68f2"}
Jul 24 18:51:00.219830 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:00.219514    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7775fcdd7d-wvsn2" event={"ID":"98827dd6-0458-4403-a047-e77a123383ea","Type":"ContainerDied","Data":"5d0e0e13f9573294e94cf5f934afdf7477354a259dbbd02de82df0f358f5e2c3"}
Jul 24 18:51:00.219830 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:00.219533    2580 scope.go:117] "RemoveContainer" containerID="75225c99574fb6afc76014179166a198e7be3d22377a157b67fe01a42c0c68f2"
Jul 24 18:51:00.230613 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:00.230593    2580 scope.go:117] "RemoveContainer" containerID="75225c99574fb6afc76014179166a198e7be3d22377a157b67fe01a42c0c68f2"
Jul 24 18:51:00.230886 ip-10-0-141-146 kubenswrapper[2580]: E0724 18:51:00.230865    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"75225c99574fb6afc76014179166a198e7be3d22377a157b67fe01a42c0c68f2\": container with ID starting with 75225c99574fb6afc76014179166a198e7be3d22377a157b67fe01a42c0c68f2 not found: ID does not exist" containerID="75225c99574fb6afc76014179166a198e7be3d22377a157b67fe01a42c0c68f2"
Jul 24 18:51:00.230938 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:00.230896    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"75225c99574fb6afc76014179166a198e7be3d22377a157b67fe01a42c0c68f2"} err="failed to get container status \"75225c99574fb6afc76014179166a198e7be3d22377a157b67fe01a42c0c68f2\": rpc error: code = NotFound desc = could not find container \"75225c99574fb6afc76014179166a198e7be3d22377a157b67fe01a42c0c68f2\": container with ID starting with 75225c99574fb6afc76014179166a198e7be3d22377a157b67fe01a42c0c68f2 not found: ID does not exist"
Jul 24 18:51:00.243328 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:00.243302    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7775fcdd7d-wvsn2"]
Jul 24 18:51:00.247926 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:00.247901    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7775fcdd7d-wvsn2"]
Jul 24 18:51:01.241434 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:01.241400    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="98827dd6-0458-4403-a047-e77a123383ea" path="/var/lib/kubelet/pods/98827dd6-0458-4403-a047-e77a123383ea/volumes"
Jul 24 18:51:07.295250 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:07.295212    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:51:07.393010 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:07.392981    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:51:10.296492 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:10.296456    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:51:10.396992 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:10.396953    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:51:14.977206 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:14.977174    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-ltr4p"]
Jul 24 18:51:14.977649 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:14.977560    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="98827dd6-0458-4403-a047-e77a123383ea" containerName="console"
Jul 24 18:51:14.977649 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:14.977572    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="98827dd6-0458-4403-a047-e77a123383ea" containerName="console"
Jul 24 18:51:14.977649 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:14.977635    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="98827dd6-0458-4403-a047-e77a123383ea" containerName="console"
Jul 24 18:51:15.006505 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:15.006469    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-ltr4p"]
Jul 24 18:51:15.006668 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:15.006574    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-ltr4p"
Jul 24 18:51:15.009237 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:15.009212    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-lgwxn\""
Jul 24 18:51:15.010153 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:15.010107    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:51:15.094905 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:15.094868    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7aa274dc-a001-42aa-915c-7f71cdb098ed-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-ltr4p\" (UID: \"7aa274dc-a001-42aa-915c-7f71cdb098ed\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-ltr4p"
Jul 24 18:51:15.095078 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:15.094913    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7aa274dc-a001-42aa-915c-7f71cdb098ed-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-ltr4p\" (UID: \"7aa274dc-a001-42aa-915c-7f71cdb098ed\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-ltr4p"
Jul 24 18:51:15.095078 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:15.094939    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7aa274dc-a001-42aa-915c-7f71cdb098ed-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-ltr4p\" (UID: \"7aa274dc-a001-42aa-915c-7f71cdb098ed\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-ltr4p"
Jul 24 18:51:15.095078 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:15.095039    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7aa274dc-a001-42aa-915c-7f71cdb098ed-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-ltr4p\" (UID: \"7aa274dc-a001-42aa-915c-7f71cdb098ed\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-ltr4p"
Jul 24 18:51:15.095078 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:15.095060    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7aa274dc-a001-42aa-915c-7f71cdb098ed-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-ltr4p\" (UID: \"7aa274dc-a001-42aa-915c-7f71cdb098ed\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-ltr4p"
Jul 24 18:51:15.095259 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:15.095079    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7aa274dc-a001-42aa-915c-7f71cdb098ed-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-ltr4p\" (UID: \"7aa274dc-a001-42aa-915c-7f71cdb098ed\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-ltr4p"
Jul 24 18:51:15.095259 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:15.095098    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7aa274dc-a001-42aa-915c-7f71cdb098ed-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-ltr4p\" (UID: \"7aa274dc-a001-42aa-915c-7f71cdb098ed\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-ltr4p"
Jul 24 18:51:15.095259 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:15.095213    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7aa274dc-a001-42aa-915c-7f71cdb098ed-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-ltr4p\" (UID: \"7aa274dc-a001-42aa-915c-7f71cdb098ed\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-ltr4p"
Jul 24 18:51:15.095353 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:15.095268    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4cwh5\" (UniqueName: \"kubernetes.io/projected/7aa274dc-a001-42aa-915c-7f71cdb098ed-kube-api-access-4cwh5\") pod \"maas-default-gateway-openshift-default-78bb78ff78-ltr4p\" (UID: \"7aa274dc-a001-42aa-915c-7f71cdb098ed\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-ltr4p"
Jul 24 18:51:15.147422 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:15.147385    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:51:15.196607 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:15.196509    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7aa274dc-a001-42aa-915c-7f71cdb098ed-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-ltr4p\" (UID: \"7aa274dc-a001-42aa-915c-7f71cdb098ed\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-ltr4p"
Jul 24 18:51:15.196803 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:15.196633    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7aa274dc-a001-42aa-915c-7f71cdb098ed-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-ltr4p\" (UID: \"7aa274dc-a001-42aa-915c-7f71cdb098ed\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-ltr4p"
Jul 24 18:51:15.196803 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:15.196669    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7aa274dc-a001-42aa-915c-7f71cdb098ed-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-ltr4p\" (UID: \"7aa274dc-a001-42aa-915c-7f71cdb098ed\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-ltr4p"
Jul 24 18:51:15.196803 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:15.196695    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7aa274dc-a001-42aa-915c-7f71cdb098ed-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-ltr4p\" (UID: \"7aa274dc-a001-42aa-915c-7f71cdb098ed\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-ltr4p"
Jul 24 18:51:15.196803 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:15.196731    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7aa274dc-a001-42aa-915c-7f71cdb098ed-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-ltr4p\" (UID: \"7aa274dc-a001-42aa-915c-7f71cdb098ed\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-ltr4p"
Jul 24 18:51:15.196803 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:15.196789    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4cwh5\" (UniqueName: \"kubernetes.io/projected/7aa274dc-a001-42aa-915c-7f71cdb098ed-kube-api-access-4cwh5\") pod \"maas-default-gateway-openshift-default-78bb78ff78-ltr4p\" (UID: \"7aa274dc-a001-42aa-915c-7f71cdb098ed\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-ltr4p"
Jul 24 18:51:15.197079 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:15.196826    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7aa274dc-a001-42aa-915c-7f71cdb098ed-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-ltr4p\" (UID: \"7aa274dc-a001-42aa-915c-7f71cdb098ed\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-ltr4p"
Jul 24 18:51:15.197079 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:15.196868    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7aa274dc-a001-42aa-915c-7f71cdb098ed-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-ltr4p\" (UID: \"7aa274dc-a001-42aa-915c-7f71cdb098ed\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-ltr4p"
Jul 24 18:51:15.197079 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:15.196911    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7aa274dc-a001-42aa-915c-7f71cdb098ed-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-ltr4p\" (UID: \"7aa274dc-a001-42aa-915c-7f71cdb098ed\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-ltr4p"
Jul 24 18:51:15.197079 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:15.196922    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7aa274dc-a001-42aa-915c-7f71cdb098ed-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-ltr4p\" (UID: \"7aa274dc-a001-42aa-915c-7f71cdb098ed\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-ltr4p"
Jul 24 18:51:15.197079 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:15.196976    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7aa274dc-a001-42aa-915c-7f71cdb098ed-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-ltr4p\" (UID: \"7aa274dc-a001-42aa-915c-7f71cdb098ed\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-ltr4p"
Jul 24 18:51:15.197079 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:15.197052    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7aa274dc-a001-42aa-915c-7f71cdb098ed-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-ltr4p\" (UID: \"7aa274dc-a001-42aa-915c-7f71cdb098ed\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-ltr4p"
Jul 24 18:51:15.197364 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:15.197260    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7aa274dc-a001-42aa-915c-7f71cdb098ed-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-ltr4p\" (UID: \"7aa274dc-a001-42aa-915c-7f71cdb098ed\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-ltr4p"
Jul 24 18:51:15.197540 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:15.197523    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7aa274dc-a001-42aa-915c-7f71cdb098ed-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-ltr4p\" (UID: \"7aa274dc-a001-42aa-915c-7f71cdb098ed\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-ltr4p"
Jul 24 18:51:15.199220 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:15.199201    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7aa274dc-a001-42aa-915c-7f71cdb098ed-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-ltr4p\" (UID: \"7aa274dc-a001-42aa-915c-7f71cdb098ed\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-ltr4p"
Jul 24 18:51:15.199381 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:15.199361    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7aa274dc-a001-42aa-915c-7f71cdb098ed-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-ltr4p\" (UID: \"7aa274dc-a001-42aa-915c-7f71cdb098ed\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-ltr4p"
Jul 24 18:51:15.205343 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:15.205314    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7aa274dc-a001-42aa-915c-7f71cdb098ed-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-ltr4p\" (UID: \"7aa274dc-a001-42aa-915c-7f71cdb098ed\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-ltr4p"
Jul 24 18:51:15.205471 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:15.205419    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4cwh5\" (UniqueName: \"kubernetes.io/projected/7aa274dc-a001-42aa-915c-7f71cdb098ed-kube-api-access-4cwh5\") pod \"maas-default-gateway-openshift-default-78bb78ff78-ltr4p\" (UID: \"7aa274dc-a001-42aa-915c-7f71cdb098ed\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-ltr4p"
Jul 24 18:51:15.323064 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:15.322967    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-ltr4p"
Jul 24 18:51:15.459915 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:15.459889    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-ltr4p"]
Jul 24 18:51:15.462156 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:51:15.462111    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7aa274dc_a001_42aa_915c_7f71cdb098ed.slice/crio-8b167acaaf6282d1ba29b9e1945d4a4f738d95ed5db78c4ed599f73b134d484d WatchSource:0}: Error finding container 8b167acaaf6282d1ba29b9e1945d4a4f738d95ed5db78c4ed599f73b134d484d: Status 404 returned error can't find the container with id 8b167acaaf6282d1ba29b9e1945d4a4f738d95ed5db78c4ed599f73b134d484d
Jul 24 18:51:15.464312 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:15.464281    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 24 18:51:15.464392 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:15.464344    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 24 18:51:15.464392 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:15.464382    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 24 18:51:16.293141 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:16.293086    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-ltr4p" event={"ID":"7aa274dc-a001-42aa-915c-7f71cdb098ed","Type":"ContainerStarted","Data":"cab956336d8a807bc70bed7ade28d8b0936e6290edb000abe1df360d1a9bdc6a"}
Jul 24 18:51:16.293526 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:16.293155    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-ltr4p" event={"ID":"7aa274dc-a001-42aa-915c-7f71cdb098ed","Type":"ContainerStarted","Data":"8b167acaaf6282d1ba29b9e1945d4a4f738d95ed5db78c4ed599f73b134d484d"}
Jul 24 18:51:16.317375 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:16.317322    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-ltr4p" podStartSLOduration=2.317307585 podStartE2EDuration="2.317307585s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 18:51:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:51:16.316352625 +0000 UTC m=+431.525724668" watchObservedRunningTime="2026-07-24 18:51:16.317307585 +0000 UTC m=+431.526679629"
Jul 24 18:51:16.323736 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:16.323714    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-ltr4p"
Jul 24 18:51:16.328680 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:16.328661    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-ltr4p"
Jul 24 18:51:17.297733 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:17.297707    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-ltr4p"
Jul 24 18:51:17.298665 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:17.298645    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-ltr4p"
Jul 24 18:51:17.373693 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:17.373662    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:51:17.486640 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:17.486596    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:51:17.586656 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:17.586564    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:51:18.185964 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:18.185933    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-r87bk"]
Jul 24 18:51:18.189086 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:18.189066    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-r87bk"
Jul 24 18:51:18.192540 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:18.192517    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-469ql\""
Jul 24 18:51:18.197783 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:18.197761    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-r87bk"]
Jul 24 18:51:18.218537 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:18.218505    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:51:18.226691 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:18.226665    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hbt89\" (UniqueName: \"kubernetes.io/projected/4cef8124-793e-4e8d-89ad-ead0a10e67ef-kube-api-access-hbt89\") pod \"authorino-58cd955675-r87bk\" (UID: \"4cef8124-793e-4e8d-89ad-ead0a10e67ef\") " pod="kuadrant-system/authorino-58cd955675-r87bk"
Jul 24 18:51:18.306490 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:18.306458    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:51:18.310488 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:18.310462    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-pd2fw"]
Jul 24 18:51:18.313592 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:18.313574    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-pd2fw"
Jul 24 18:51:18.319504 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:18.319482    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-pd2fw"]
Jul 24 18:51:18.327483 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:18.327459    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hbt89\" (UniqueName: \"kubernetes.io/projected/4cef8124-793e-4e8d-89ad-ead0a10e67ef-kube-api-access-hbt89\") pod \"authorino-58cd955675-r87bk\" (UID: \"4cef8124-793e-4e8d-89ad-ead0a10e67ef\") " pod="kuadrant-system/authorino-58cd955675-r87bk"
Jul 24 18:51:18.337250 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:18.337222    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hbt89\" (UniqueName: \"kubernetes.io/projected/4cef8124-793e-4e8d-89ad-ead0a10e67ef-kube-api-access-hbt89\") pod \"authorino-58cd955675-r87bk\" (UID: \"4cef8124-793e-4e8d-89ad-ead0a10e67ef\") " pod="kuadrant-system/authorino-58cd955675-r87bk"
Jul 24 18:51:18.428778 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:18.428742    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-69jq5\" (UniqueName: \"kubernetes.io/projected/fc5c0eb1-04e8-4593-aedf-e6002ff039dc-kube-api-access-69jq5\") pod \"authorino-75d556bd77-pd2fw\" (UID: \"fc5c0eb1-04e8-4593-aedf-e6002ff039dc\") " pod="kuadrant-system/authorino-75d556bd77-pd2fw"
Jul 24 18:51:18.499197 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:18.499163    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-r87bk"
Jul 24 18:51:18.529897 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:18.529852    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-69jq5\" (UniqueName: \"kubernetes.io/projected/fc5c0eb1-04e8-4593-aedf-e6002ff039dc-kube-api-access-69jq5\") pod \"authorino-75d556bd77-pd2fw\" (UID: \"fc5c0eb1-04e8-4593-aedf-e6002ff039dc\") " pod="kuadrant-system/authorino-75d556bd77-pd2fw"
Jul 24 18:51:18.539887 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:18.539825    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-69jq5\" (UniqueName: \"kubernetes.io/projected/fc5c0eb1-04e8-4593-aedf-e6002ff039dc-kube-api-access-69jq5\") pod \"authorino-75d556bd77-pd2fw\" (UID: \"fc5c0eb1-04e8-4593-aedf-e6002ff039dc\") " pod="kuadrant-system/authorino-75d556bd77-pd2fw"
Jul 24 18:51:18.623422 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:18.623395    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-pd2fw"
Jul 24 18:51:18.633861 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:18.633839    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-r87bk"]
Jul 24 18:51:18.637024 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:51:18.636999    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4cef8124_793e_4e8d_89ad_ead0a10e67ef.slice/crio-6eb4d556f26b850dabfcfec3682ba495e68fab2bfdc767c6becb0fd3231cda23 WatchSource:0}: Error finding container 6eb4d556f26b850dabfcfec3682ba495e68fab2bfdc767c6becb0fd3231cda23: Status 404 returned error can't find the container with id 6eb4d556f26b850dabfcfec3682ba495e68fab2bfdc767c6becb0fd3231cda23
Jul 24 18:51:18.757716 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:18.757597    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-pd2fw"]
Jul 24 18:51:18.760332 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:51:18.760306    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfc5c0eb1_04e8_4593_aedf_e6002ff039dc.slice/crio-fa77b7765d37fe68947212d3646422d161cfd60f954dd97a9d8b0b5f604b19af WatchSource:0}: Error finding container fa77b7765d37fe68947212d3646422d161cfd60f954dd97a9d8b0b5f604b19af: Status 404 returned error can't find the container with id fa77b7765d37fe68947212d3646422d161cfd60f954dd97a9d8b0b5f604b19af
Jul 24 18:51:19.307202 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:19.307167    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-pd2fw" event={"ID":"fc5c0eb1-04e8-4593-aedf-e6002ff039dc","Type":"ContainerStarted","Data":"fa77b7765d37fe68947212d3646422d161cfd60f954dd97a9d8b0b5f604b19af"}
Jul 24 18:51:19.308252 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:19.308228    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-r87bk" event={"ID":"4cef8124-793e-4e8d-89ad-ead0a10e67ef","Type":"ContainerStarted","Data":"6eb4d556f26b850dabfcfec3682ba495e68fab2bfdc767c6becb0fd3231cda23"}
Jul 24 18:51:23.330354 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:23.330318    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-r87bk" event={"ID":"4cef8124-793e-4e8d-89ad-ead0a10e67ef","Type":"ContainerStarted","Data":"9cd883972e32c1e2ab9da93b77b762724f8a49981c01fdcd9ed4fbce145baba8"}
Jul 24 18:51:23.331740 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:23.331715    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-pd2fw" event={"ID":"fc5c0eb1-04e8-4593-aedf-e6002ff039dc","Type":"ContainerStarted","Data":"4d9c6f64d2ab1feb98a1e77aefa5ba148e750309b65e6558d297b988b4bd3990"}
Jul 24 18:51:23.344788 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:23.344748    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-r87bk" podStartSLOduration=1.700403597 podStartE2EDuration="5.344733539s" totalImagesPullingTime="3.644329942s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 18:51:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:51:23.344447807 +0000 UTC m=+438.553819851" watchObservedRunningTime="2026-07-24 18:51:23.344733539 +0000 UTC m=+438.554105615"
Jul 24 18:51:23.359880 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:23.359824    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-pd2fw" podStartSLOduration=1.849844453 podStartE2EDuration="5.359808416s" totalImagesPullingTime="3.509963963s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 18:51:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:51:23.358971673 +0000 UTC m=+438.568343716" watchObservedRunningTime="2026-07-24 18:51:23.359808416 +0000 UTC m=+438.569180458"
Jul 24 18:51:23.384231 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:23.384197    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-r87bk"]
Jul 24 18:51:25.340033 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:25.339967    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-r87bk" podUID="4cef8124-793e-4e8d-89ad-ead0a10e67ef" containerName="authorino" containerID="cri-o://9cd883972e32c1e2ab9da93b77b762724f8a49981c01fdcd9ed4fbce145baba8" gracePeriod=30
Jul 24 18:51:25.592281 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:25.592220    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-r87bk"
Jul 24 18:51:25.693815 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:25.693741    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hbt89\" (UniqueName: \"kubernetes.io/projected/4cef8124-793e-4e8d-89ad-ead0a10e67ef-kube-api-access-hbt89\") pod \"4cef8124-793e-4e8d-89ad-ead0a10e67ef\" (UID: \"4cef8124-793e-4e8d-89ad-ead0a10e67ef\") "
Jul 24 18:51:25.696026 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:25.696007    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4cef8124-793e-4e8d-89ad-ead0a10e67ef-kube-api-access-hbt89" (OuterVolumeSpecName: "kube-api-access-hbt89") pod "4cef8124-793e-4e8d-89ad-ead0a10e67ef" (UID: "4cef8124-793e-4e8d-89ad-ead0a10e67ef"). InnerVolumeSpecName "kube-api-access-hbt89". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 18:51:25.795224 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:25.795188    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hbt89\" (UniqueName: \"kubernetes.io/projected/4cef8124-793e-4e8d-89ad-ead0a10e67ef-kube-api-access-hbt89\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 24 18:51:26.345180 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:26.345142    2580 generic.go:356] "Generic (PLEG): container finished" podID="4cef8124-793e-4e8d-89ad-ead0a10e67ef" containerID="9cd883972e32c1e2ab9da93b77b762724f8a49981c01fdcd9ed4fbce145baba8" exitCode=0
Jul 24 18:51:26.345180 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:26.345187    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-r87bk"
Jul 24 18:51:26.345650 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:26.345220    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-r87bk" event={"ID":"4cef8124-793e-4e8d-89ad-ead0a10e67ef","Type":"ContainerDied","Data":"9cd883972e32c1e2ab9da93b77b762724f8a49981c01fdcd9ed4fbce145baba8"}
Jul 24 18:51:26.345650 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:26.345266    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-r87bk" event={"ID":"4cef8124-793e-4e8d-89ad-ead0a10e67ef","Type":"ContainerDied","Data":"6eb4d556f26b850dabfcfec3682ba495e68fab2bfdc767c6becb0fd3231cda23"}
Jul 24 18:51:26.345650 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:26.345284    2580 scope.go:117] "RemoveContainer" containerID="9cd883972e32c1e2ab9da93b77b762724f8a49981c01fdcd9ed4fbce145baba8"
Jul 24 18:51:26.354078 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:26.354062    2580 scope.go:117] "RemoveContainer" containerID="9cd883972e32c1e2ab9da93b77b762724f8a49981c01fdcd9ed4fbce145baba8"
Jul 24 18:51:26.354368 ip-10-0-141-146 kubenswrapper[2580]: E0724 18:51:26.354349    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9cd883972e32c1e2ab9da93b77b762724f8a49981c01fdcd9ed4fbce145baba8\": container with ID starting with 9cd883972e32c1e2ab9da93b77b762724f8a49981c01fdcd9ed4fbce145baba8 not found: ID does not exist" containerID="9cd883972e32c1e2ab9da93b77b762724f8a49981c01fdcd9ed4fbce145baba8"
Jul 24 18:51:26.354417 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:26.354378    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9cd883972e32c1e2ab9da93b77b762724f8a49981c01fdcd9ed4fbce145baba8"} err="failed to get container status \"9cd883972e32c1e2ab9da93b77b762724f8a49981c01fdcd9ed4fbce145baba8\": rpc error: code = NotFound desc = could not find container \"9cd883972e32c1e2ab9da93b77b762724f8a49981c01fdcd9ed4fbce145baba8\": container with ID starting with 9cd883972e32c1e2ab9da93b77b762724f8a49981c01fdcd9ed4fbce145baba8 not found: ID does not exist"
Jul 24 18:51:26.365955 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:26.365909    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-r87bk"]
Jul 24 18:51:26.367621 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:26.367595    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-r87bk"]
Jul 24 18:51:27.240949 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:27.240903    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4cef8124-793e-4e8d-89ad-ead0a10e67ef" path="/var/lib/kubelet/pods/4cef8124-793e-4e8d-89ad-ead0a10e67ef/volumes"
Jul 24 18:51:33.121834 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:33.121802    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:51:33.172867 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:33.172836    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:51:33.378688 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:33.378596    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:51:33.471295 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:33.471263    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:51:33.836826 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:33.836796    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:51:46.249502 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:46.249462    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:51:46.479248 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:46.479210    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-9mqls"]
Jul 24 18:51:46.479666 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:46.479647    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4cef8124-793e-4e8d-89ad-ead0a10e67ef" containerName="authorino"
Jul 24 18:51:46.479756 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:46.479669    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="4cef8124-793e-4e8d-89ad-ead0a10e67ef" containerName="authorino"
Jul 24 18:51:46.479847 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:46.479833    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="4cef8124-793e-4e8d-89ad-ead0a10e67ef" containerName="authorino"
Jul 24 18:51:46.505383 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:46.505306    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-9mqls"]
Jul 24 18:51:46.505524 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:46.505431    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-9mqls"
Jul 24 18:51:46.686403 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:46.686362    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s7lv5\" (UniqueName: \"kubernetes.io/projected/7b4b4bd9-551a-4178-b139-5d1e97ce81c7-kube-api-access-s7lv5\") pod \"authorino-5d4b67c446-9mqls\" (UID: \"7b4b4bd9-551a-4178-b139-5d1e97ce81c7\") " pod="kuadrant-system/authorino-5d4b67c446-9mqls"
Jul 24 18:51:46.705266 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:46.705236    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-9mqls"]
Jul 24 18:51:46.705556 ip-10-0-141-146 kubenswrapper[2580]: E0724 18:51:46.705528    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-s7lv5], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-5d4b67c446-9mqls" podUID="7b4b4bd9-551a-4178-b139-5d1e97ce81c7"
Jul 24 18:51:46.731828 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:46.731792    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-f69498dc5-wvbwn"]
Jul 24 18:51:46.735280 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:46.735262    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f69498dc5-wvbwn"
Jul 24 18:51:46.742384 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:46.742234    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-f69498dc5-wvbwn"]
Jul 24 18:51:46.787027 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:46.786940    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s7lv5\" (UniqueName: \"kubernetes.io/projected/7b4b4bd9-551a-4178-b139-5d1e97ce81c7-kube-api-access-s7lv5\") pod \"authorino-5d4b67c446-9mqls\" (UID: \"7b4b4bd9-551a-4178-b139-5d1e97ce81c7\") " pod="kuadrant-system/authorino-5d4b67c446-9mqls"
Jul 24 18:51:46.795290 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:46.795261    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s7lv5\" (UniqueName: \"kubernetes.io/projected/7b4b4bd9-551a-4178-b139-5d1e97ce81c7-kube-api-access-s7lv5\") pod \"authorino-5d4b67c446-9mqls\" (UID: \"7b4b4bd9-551a-4178-b139-5d1e97ce81c7\") " pod="kuadrant-system/authorino-5d4b67c446-9mqls"
Jul 24 18:51:46.888535 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:46.888494    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j7vlh\" (UniqueName: \"kubernetes.io/projected/ea24da16-672c-487d-9a47-33b5cfe700d4-kube-api-access-j7vlh\") pod \"authorino-f69498dc5-wvbwn\" (UID: \"ea24da16-672c-487d-9a47-33b5cfe700d4\") " pod="kuadrant-system/authorino-f69498dc5-wvbwn"
Jul 24 18:51:46.895973 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:46.895941    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:51:46.989610 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:46.989573    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j7vlh\" (UniqueName: \"kubernetes.io/projected/ea24da16-672c-487d-9a47-33b5cfe700d4-kube-api-access-j7vlh\") pod \"authorino-f69498dc5-wvbwn\" (UID: \"ea24da16-672c-487d-9a47-33b5cfe700d4\") " pod="kuadrant-system/authorino-f69498dc5-wvbwn"
Jul 24 18:51:46.998434 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:46.998402    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j7vlh\" (UniqueName: \"kubernetes.io/projected/ea24da16-672c-487d-9a47-33b5cfe700d4-kube-api-access-j7vlh\") pod \"authorino-f69498dc5-wvbwn\" (UID: \"ea24da16-672c-487d-9a47-33b5cfe700d4\") " pod="kuadrant-system/authorino-f69498dc5-wvbwn"
Jul 24 18:51:47.045301 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:47.045213    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f69498dc5-wvbwn"
Jul 24 18:51:47.187328 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:47.187305    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-f69498dc5-wvbwn"]
Jul 24 18:51:47.190299 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:51:47.190269    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podea24da16_672c_487d_9a47_33b5cfe700d4.slice/crio-709023b03762a3006ab0491a287dbd7b5a52425f557c092b55ccba4e52f8fa6a WatchSource:0}: Error finding container 709023b03762a3006ab0491a287dbd7b5a52425f557c092b55ccba4e52f8fa6a: Status 404 returned error can't find the container with id 709023b03762a3006ab0491a287dbd7b5a52425f557c092b55ccba4e52f8fa6a
Jul 24 18:51:47.441538 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:47.441514    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-9mqls"
Jul 24 18:51:47.441971 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:47.441511    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f69498dc5-wvbwn" event={"ID":"ea24da16-672c-487d-9a47-33b5cfe700d4","Type":"ContainerStarted","Data":"709023b03762a3006ab0491a287dbd7b5a52425f557c092b55ccba4e52f8fa6a"}
Jul 24 18:51:47.450355 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:47.450332    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-9mqls"
Jul 24 18:51:47.483921 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:47.483887    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-f69498dc5-wvbwn"]
Jul 24 18:51:47.516351 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:47.516314    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-689fb694cf-6jqnk"]
Jul 24 18:51:47.520019 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:47.519997    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-689fb694cf-6jqnk"
Jul 24 18:51:47.522664 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:47.522644    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 24 18:51:47.530285 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:47.530251    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-689fb694cf-6jqnk"]
Jul 24 18:51:47.595064 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:47.595039    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s7lv5\" (UniqueName: \"kubernetes.io/projected/7b4b4bd9-551a-4178-b139-5d1e97ce81c7-kube-api-access-s7lv5\") pod \"7b4b4bd9-551a-4178-b139-5d1e97ce81c7\" (UID: \"7b4b4bd9-551a-4178-b139-5d1e97ce81c7\") "
Jul 24 18:51:47.597174 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:47.597148    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7b4b4bd9-551a-4178-b139-5d1e97ce81c7-kube-api-access-s7lv5" (OuterVolumeSpecName: "kube-api-access-s7lv5") pod "7b4b4bd9-551a-4178-b139-5d1e97ce81c7" (UID: "7b4b4bd9-551a-4178-b139-5d1e97ce81c7"). InnerVolumeSpecName "kube-api-access-s7lv5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 18:51:47.695893 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:47.695808    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kfbsc\" (UniqueName: \"kubernetes.io/projected/dad42308-de9c-440d-bc61-fe67043cb840-kube-api-access-kfbsc\") pod \"authorino-689fb694cf-6jqnk\" (UID: \"dad42308-de9c-440d-bc61-fe67043cb840\") " pod="kuadrant-system/authorino-689fb694cf-6jqnk"
Jul 24 18:51:47.695893 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:47.695856    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/dad42308-de9c-440d-bc61-fe67043cb840-tls-cert\") pod \"authorino-689fb694cf-6jqnk\" (UID: \"dad42308-de9c-440d-bc61-fe67043cb840\") " pod="kuadrant-system/authorino-689fb694cf-6jqnk"
Jul 24 18:51:47.696084 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:47.695952    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s7lv5\" (UniqueName: \"kubernetes.io/projected/7b4b4bd9-551a-4178-b139-5d1e97ce81c7-kube-api-access-s7lv5\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 24 18:51:47.797169 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:47.797105    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kfbsc\" (UniqueName: \"kubernetes.io/projected/dad42308-de9c-440d-bc61-fe67043cb840-kube-api-access-kfbsc\") pod \"authorino-689fb694cf-6jqnk\" (UID: \"dad42308-de9c-440d-bc61-fe67043cb840\") " pod="kuadrant-system/authorino-689fb694cf-6jqnk"
Jul 24 18:51:47.797343 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:47.797175    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/dad42308-de9c-440d-bc61-fe67043cb840-tls-cert\") pod \"authorino-689fb694cf-6jqnk\" (UID: \"dad42308-de9c-440d-bc61-fe67043cb840\") " pod="kuadrant-system/authorino-689fb694cf-6jqnk"
Jul 24 18:51:47.800072 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:47.800047    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/dad42308-de9c-440d-bc61-fe67043cb840-tls-cert\") pod \"authorino-689fb694cf-6jqnk\" (UID: \"dad42308-de9c-440d-bc61-fe67043cb840\") " pod="kuadrant-system/authorino-689fb694cf-6jqnk"
Jul 24 18:51:47.804986 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:47.804961    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kfbsc\" (UniqueName: \"kubernetes.io/projected/dad42308-de9c-440d-bc61-fe67043cb840-kube-api-access-kfbsc\") pod \"authorino-689fb694cf-6jqnk\" (UID: \"dad42308-de9c-440d-bc61-fe67043cb840\") " pod="kuadrant-system/authorino-689fb694cf-6jqnk"
Jul 24 18:51:47.830813 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:47.830783    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-689fb694cf-6jqnk"
Jul 24 18:51:47.964534 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:47.964514    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-689fb694cf-6jqnk"]
Jul 24 18:51:47.966696 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:51:47.966671    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddad42308_de9c_440d_bc61_fe67043cb840.slice/crio-cfd952498c052b0949138ff64386b08df4417124d6c8d740a932899152dd0d34 WatchSource:0}: Error finding container cfd952498c052b0949138ff64386b08df4417124d6c8d740a932899152dd0d34: Status 404 returned error can't find the container with id cfd952498c052b0949138ff64386b08df4417124d6c8d740a932899152dd0d34
Jul 24 18:51:48.446982 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:48.446951    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f69498dc5-wvbwn" event={"ID":"ea24da16-672c-487d-9a47-33b5cfe700d4","Type":"ContainerStarted","Data":"dbfe50cb46d087e057f9f4edda1ba01b964fc92e84f30c01ce75845144de1ea9"}
Jul 24 18:51:48.447374 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:48.446956    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-f69498dc5-wvbwn" podUID="ea24da16-672c-487d-9a47-33b5cfe700d4" containerName="authorino" containerID="cri-o://dbfe50cb46d087e057f9f4edda1ba01b964fc92e84f30c01ce75845144de1ea9" gracePeriod=30
Jul 24 18:51:48.448160 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:48.448138    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-689fb694cf-6jqnk" event={"ID":"dad42308-de9c-440d-bc61-fe67043cb840","Type":"ContainerStarted","Data":"cfd952498c052b0949138ff64386b08df4417124d6c8d740a932899152dd0d34"}
Jul 24 18:51:48.448223 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:48.448161    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-9mqls"
Jul 24 18:51:48.466607 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:48.465216    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-f69498dc5-wvbwn" podStartSLOduration=2.128160218 podStartE2EDuration="2.465178673s" totalImagesPullingTime="337.018455ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 18:51:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:51:48.461584734 +0000 UTC m=+463.670956769" watchObservedRunningTime="2026-07-24 18:51:48.465178673 +0000 UTC m=+463.674550717"
Jul 24 18:51:48.537857 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:48.537824    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-9mqls"]
Jul 24 18:51:48.542405 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:48.542376    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-9mqls"]
Jul 24 18:51:48.688606 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:48.688582    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f69498dc5-wvbwn"
Jul 24 18:51:48.806063 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:48.806037    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j7vlh\" (UniqueName: \"kubernetes.io/projected/ea24da16-672c-487d-9a47-33b5cfe700d4-kube-api-access-j7vlh\") pod \"ea24da16-672c-487d-9a47-33b5cfe700d4\" (UID: \"ea24da16-672c-487d-9a47-33b5cfe700d4\") "
Jul 24 18:51:48.808471 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:48.808443    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ea24da16-672c-487d-9a47-33b5cfe700d4-kube-api-access-j7vlh" (OuterVolumeSpecName: "kube-api-access-j7vlh") pod "ea24da16-672c-487d-9a47-33b5cfe700d4" (UID: "ea24da16-672c-487d-9a47-33b5cfe700d4"). InnerVolumeSpecName "kube-api-access-j7vlh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 18:51:48.907093 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:48.907049    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j7vlh\" (UniqueName: \"kubernetes.io/projected/ea24da16-672c-487d-9a47-33b5cfe700d4-kube-api-access-j7vlh\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 24 18:51:49.242410 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:49.242371    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7b4b4bd9-551a-4178-b139-5d1e97ce81c7" path="/var/lib/kubelet/pods/7b4b4bd9-551a-4178-b139-5d1e97ce81c7/volumes"
Jul 24 18:51:49.454729 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:49.454686    2580 generic.go:356] "Generic (PLEG): container finished" podID="ea24da16-672c-487d-9a47-33b5cfe700d4" containerID="dbfe50cb46d087e057f9f4edda1ba01b964fc92e84f30c01ce75845144de1ea9" exitCode=0
Jul 24 18:51:49.454729 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:49.454732    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f69498dc5-wvbwn"
Jul 24 18:51:49.455297 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:49.454776    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f69498dc5-wvbwn" event={"ID":"ea24da16-672c-487d-9a47-33b5cfe700d4","Type":"ContainerDied","Data":"dbfe50cb46d087e057f9f4edda1ba01b964fc92e84f30c01ce75845144de1ea9"}
Jul 24 18:51:49.455297 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:49.454818    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f69498dc5-wvbwn" event={"ID":"ea24da16-672c-487d-9a47-33b5cfe700d4","Type":"ContainerDied","Data":"709023b03762a3006ab0491a287dbd7b5a52425f557c092b55ccba4e52f8fa6a"}
Jul 24 18:51:49.455297 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:49.454836    2580 scope.go:117] "RemoveContainer" containerID="dbfe50cb46d087e057f9f4edda1ba01b964fc92e84f30c01ce75845144de1ea9"
Jul 24 18:51:49.456463 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:49.456441    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-689fb694cf-6jqnk" event={"ID":"dad42308-de9c-440d-bc61-fe67043cb840","Type":"ContainerStarted","Data":"0da1a9259686d85466b6ff6b6e497d809b399d9827dc261836294cf0d8be7215"}
Jul 24 18:51:49.463700 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:49.463682    2580 scope.go:117] "RemoveContainer" containerID="dbfe50cb46d087e057f9f4edda1ba01b964fc92e84f30c01ce75845144de1ea9"
Jul 24 18:51:49.464007 ip-10-0-141-146 kubenswrapper[2580]: E0724 18:51:49.463988    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dbfe50cb46d087e057f9f4edda1ba01b964fc92e84f30c01ce75845144de1ea9\": container with ID starting with dbfe50cb46d087e057f9f4edda1ba01b964fc92e84f30c01ce75845144de1ea9 not found: ID does not exist" containerID="dbfe50cb46d087e057f9f4edda1ba01b964fc92e84f30c01ce75845144de1ea9"
Jul 24 18:51:49.464053 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:49.464017    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dbfe50cb46d087e057f9f4edda1ba01b964fc92e84f30c01ce75845144de1ea9"} err="failed to get container status \"dbfe50cb46d087e057f9f4edda1ba01b964fc92e84f30c01ce75845144de1ea9\": rpc error: code = NotFound desc = could not find container \"dbfe50cb46d087e057f9f4edda1ba01b964fc92e84f30c01ce75845144de1ea9\": container with ID starting with dbfe50cb46d087e057f9f4edda1ba01b964fc92e84f30c01ce75845144de1ea9 not found: ID does not exist"
Jul 24 18:51:49.472758 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:49.472727    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-f69498dc5-wvbwn"]
Jul 24 18:51:49.476948 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:49.476918    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-f69498dc5-wvbwn"]
Jul 24 18:51:49.491872 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:49.491819    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-689fb694cf-6jqnk" podStartSLOduration=2.041449808 podStartE2EDuration="2.491801057s" totalImagesPullingTime="450.351249ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 18:51:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:51:49.49053691 +0000 UTC m=+464.699908954" watchObservedRunningTime="2026-07-24 18:51:49.491801057 +0000 UTC m=+464.701173101"
Jul 24 18:51:49.516761 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:49.516676    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-pd2fw"]
Jul 24 18:51:49.516927 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:49.516848    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-pd2fw" podUID="fc5c0eb1-04e8-4593-aedf-e6002ff039dc" containerName="authorino" containerID="cri-o://4d9c6f64d2ab1feb98a1e77aefa5ba148e750309b65e6558d297b988b4bd3990" gracePeriod=30
Jul 24 18:51:49.774432 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:49.774364    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-pd2fw"
Jul 24 18:51:49.917194 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:49.917161    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-69jq5\" (UniqueName: \"kubernetes.io/projected/fc5c0eb1-04e8-4593-aedf-e6002ff039dc-kube-api-access-69jq5\") pod \"fc5c0eb1-04e8-4593-aedf-e6002ff039dc\" (UID: \"fc5c0eb1-04e8-4593-aedf-e6002ff039dc\") "
Jul 24 18:51:49.919360 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:49.919332    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fc5c0eb1-04e8-4593-aedf-e6002ff039dc-kube-api-access-69jq5" (OuterVolumeSpecName: "kube-api-access-69jq5") pod "fc5c0eb1-04e8-4593-aedf-e6002ff039dc" (UID: "fc5c0eb1-04e8-4593-aedf-e6002ff039dc"). InnerVolumeSpecName "kube-api-access-69jq5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 18:51:50.018011 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:50.017977    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-69jq5\" (UniqueName: \"kubernetes.io/projected/fc5c0eb1-04e8-4593-aedf-e6002ff039dc-kube-api-access-69jq5\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 24 18:51:50.463252 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:50.463213    2580 generic.go:356] "Generic (PLEG): container finished" podID="fc5c0eb1-04e8-4593-aedf-e6002ff039dc" containerID="4d9c6f64d2ab1feb98a1e77aefa5ba148e750309b65e6558d297b988b4bd3990" exitCode=0
Jul 24 18:51:50.463700 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:50.463264    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-pd2fw"
Jul 24 18:51:50.463700 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:50.463296    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-pd2fw" event={"ID":"fc5c0eb1-04e8-4593-aedf-e6002ff039dc","Type":"ContainerDied","Data":"4d9c6f64d2ab1feb98a1e77aefa5ba148e750309b65e6558d297b988b4bd3990"}
Jul 24 18:51:50.463700 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:50.463333    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-pd2fw" event={"ID":"fc5c0eb1-04e8-4593-aedf-e6002ff039dc","Type":"ContainerDied","Data":"fa77b7765d37fe68947212d3646422d161cfd60f954dd97a9d8b0b5f604b19af"}
Jul 24 18:51:50.463700 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:50.463351    2580 scope.go:117] "RemoveContainer" containerID="4d9c6f64d2ab1feb98a1e77aefa5ba148e750309b65e6558d297b988b4bd3990"
Jul 24 18:51:50.471557 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:50.471536    2580 scope.go:117] "RemoveContainer" containerID="4d9c6f64d2ab1feb98a1e77aefa5ba148e750309b65e6558d297b988b4bd3990"
Jul 24 18:51:50.471832 ip-10-0-141-146 kubenswrapper[2580]: E0724 18:51:50.471812    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4d9c6f64d2ab1feb98a1e77aefa5ba148e750309b65e6558d297b988b4bd3990\": container with ID starting with 4d9c6f64d2ab1feb98a1e77aefa5ba148e750309b65e6558d297b988b4bd3990 not found: ID does not exist" containerID="4d9c6f64d2ab1feb98a1e77aefa5ba148e750309b65e6558d297b988b4bd3990"
Jul 24 18:51:50.471915 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:50.471839    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4d9c6f64d2ab1feb98a1e77aefa5ba148e750309b65e6558d297b988b4bd3990"} err="failed to get container status \"4d9c6f64d2ab1feb98a1e77aefa5ba148e750309b65e6558d297b988b4bd3990\": rpc error: code = NotFound desc = could not find container \"4d9c6f64d2ab1feb98a1e77aefa5ba148e750309b65e6558d297b988b4bd3990\": container with ID starting with 4d9c6f64d2ab1feb98a1e77aefa5ba148e750309b65e6558d297b988b4bd3990 not found: ID does not exist"
Jul 24 18:51:50.483058 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:50.483035    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-pd2fw"]
Jul 24 18:51:50.486723 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:50.486703    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-pd2fw"]
Jul 24 18:51:51.242694 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:51.242659    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ea24da16-672c-487d-9a47-33b5cfe700d4" path="/var/lib/kubelet/pods/ea24da16-672c-487d-9a47-33b5cfe700d4/volumes"
Jul 24 18:51:51.242984 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:51.242971    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fc5c0eb1-04e8-4593-aedf-e6002ff039dc" path="/var/lib/kubelet/pods/fc5c0eb1-04e8-4593-aedf-e6002ff039dc/volumes"
Jul 24 18:51:54.093335 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:54.093301    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:51:54.167088 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:54.167052    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:51:54.225575 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:54.225508    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:51:57.086962 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:57.086930    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:51:57.187328 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:51:57.187297    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:52:05.804376 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:52:05.804343    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:52:26.474933 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:52:26.474894    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:52:26.573967 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:52:26.573927    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:52:27.001399 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:52:27.001366    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:52:27.193679 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:52:27.193646    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:52:27.561528 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:52:27.561497    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:52:27.661214 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:52:27.661182    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:52:35.672583 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:52:35.672496    2580 generic.go:356] "Generic (PLEG): container finished" podID="7aa274dc-a001-42aa-915c-7f71cdb098ed" containerID="cab956336d8a807bc70bed7ade28d8b0936e6290edb000abe1df360d1a9bdc6a" exitCode=0
Jul 24 18:52:35.672583 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:52:35.672538    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-ltr4p" event={"ID":"7aa274dc-a001-42aa-915c-7f71cdb098ed","Type":"ContainerDied","Data":"cab956336d8a807bc70bed7ade28d8b0936e6290edb000abe1df360d1a9bdc6a"}
Jul 24 18:52:35.673096 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:52:35.672887    2580 scope.go:117] "RemoveContainer" containerID="cab956336d8a807bc70bed7ade28d8b0936e6290edb000abe1df360d1a9bdc6a"
Jul 24 18:52:35.673889 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:52:35.673862    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 24 18:52:35.673999 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:52:35.673932    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 24 18:52:35.673999 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:52:35.673963    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 24 18:52:36.678990 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:52:36.678960    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-ltr4p" event={"ID":"7aa274dc-a001-42aa-915c-7f71cdb098ed","Type":"ContainerStarted","Data":"55ecd55f7a0e0f27ce7c631618fe7dd5536e094a59fe9dd1f17bf7cba84c8ed1"}
Jul 24 18:52:37.189849 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:52:37.189813    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:52:37.288474 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:52:37.288428    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:52:37.323770 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:52:37.323728    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-ltr4p"
Jul 24 18:52:37.323970 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:52:37.323944    2580 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-ltr4p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused" start-of-body=
Jul 24 18:52:37.324026 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:52:37.324002    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-ltr4p" podUID="7aa274dc-a001-42aa-915c-7f71cdb098ed" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused"
Jul 24 18:52:38.323618 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:52:38.323570    2580 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-ltr4p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused" start-of-body=
Jul 24 18:52:38.324008 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:52:38.323639    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-ltr4p" podUID="7aa274dc-a001-42aa-915c-7f71cdb098ed" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused"
Jul 24 18:52:39.324301 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:52:39.324262    2580 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-ltr4p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused" start-of-body=
Jul 24 18:52:39.324704 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:52:39.324331    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-ltr4p" podUID="7aa274dc-a001-42aa-915c-7f71cdb098ed" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused"
Jul 24 18:52:40.225498 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:52:40.225465    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:52:40.324409 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:52:40.324369    2580 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-ltr4p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused" start-of-body=
Jul 24 18:52:40.324816 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:52:40.324428    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-ltr4p" podUID="7aa274dc-a001-42aa-915c-7f71cdb098ed" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused"
Jul 24 18:52:41.327422 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:52:41.327387    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-ltr4p"
Jul 24 18:52:41.327926 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:52:41.327738    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-ltr4p"
Jul 24 18:52:41.328402 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:52:41.328382    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-ltr4p"
Jul 24 18:52:44.490937 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:52:44.490891    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:52:52.163983 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:52:52.163945    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-nzp2v"]
Jul 24 18:52:52.164544 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:52:52.164523    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ea24da16-672c-487d-9a47-33b5cfe700d4" containerName="authorino"
Jul 24 18:52:52.164632 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:52:52.164549    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="ea24da16-672c-487d-9a47-33b5cfe700d4" containerName="authorino"
Jul 24 18:52:52.164632 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:52:52.164567    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc5c0eb1-04e8-4593-aedf-e6002ff039dc" containerName="authorino"
Jul 24 18:52:52.164632 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:52:52.164575    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc5c0eb1-04e8-4593-aedf-e6002ff039dc" containerName="authorino"
Jul 24 18:52:52.164797 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:52:52.164665    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="ea24da16-672c-487d-9a47-33b5cfe700d4" containerName="authorino"
Jul 24 18:52:52.164797 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:52:52.164683    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="fc5c0eb1-04e8-4593-aedf-e6002ff039dc" containerName="authorino"
Jul 24 18:52:52.166873 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:52:52.166853    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-nzp2v"
Jul 24 18:52:52.169535 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:52:52.169515    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 24 18:52:52.170527 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:52:52.170504    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 24 18:52:52.170647 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:52:52.170510    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-tnr97\""
Jul 24 18:52:52.170709 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:52:52.170642    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Jul 24 18:52:52.181216 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:52:52.181183    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-nzp2v"]
Jul 24 18:52:52.201783 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:52:52.201751    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:52:52.289515 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:52:52.289475    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7f951fa9-c1c9-491b-8e88-b653b56a3e63-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-nzp2v\" (UID: \"7f951fa9-c1c9-491b-8e88-b653b56a3e63\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-nzp2v"
Jul 24 18:52:52.289698 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:52:52.289525    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7f951fa9-c1c9-491b-8e88-b653b56a3e63-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-nzp2v\" (UID: \"7f951fa9-c1c9-491b-8e88-b653b56a3e63\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-nzp2v"
Jul 24 18:52:52.289698 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:52:52.289566    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7f951fa9-c1c9-491b-8e88-b653b56a3e63-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-nzp2v\" (UID: \"7f951fa9-c1c9-491b-8e88-b653b56a3e63\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-nzp2v"
Jul 24 18:52:52.289698 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:52:52.289617    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t8g4v\" (UniqueName: \"kubernetes.io/projected/7f951fa9-c1c9-491b-8e88-b653b56a3e63-kube-api-access-t8g4v\") pod \"e2e-distinct-simulated-kserve-59975d69f9-nzp2v\" (UID: \"7f951fa9-c1c9-491b-8e88-b653b56a3e63\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-nzp2v"
Jul 24 18:52:52.289698 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:52:52.289680    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7f951fa9-c1c9-491b-8e88-b653b56a3e63-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-nzp2v\" (UID: \"7f951fa9-c1c9-491b-8e88-b653b56a3e63\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-nzp2v"
Jul 24 18:52:52.289844 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:52:52.289720    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7f951fa9-c1c9-491b-8e88-b653b56a3e63-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-nzp2v\" (UID: \"7f951fa9-c1c9-491b-8e88-b653b56a3e63\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-nzp2v"
Jul 24 18:52:52.391009 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:52:52.390968    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t8g4v\" (UniqueName: \"kubernetes.io/projected/7f951fa9-c1c9-491b-8e88-b653b56a3e63-kube-api-access-t8g4v\") pod \"e2e-distinct-simulated-kserve-59975d69f9-nzp2v\" (UID: \"7f951fa9-c1c9-491b-8e88-b653b56a3e63\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-nzp2v"
Jul 24 18:52:52.391234 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:52:52.391036    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7f951fa9-c1c9-491b-8e88-b653b56a3e63-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-nzp2v\" (UID: \"7f951fa9-c1c9-491b-8e88-b653b56a3e63\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-nzp2v"
Jul 24 18:52:52.391234 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:52:52.391072    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7f951fa9-c1c9-491b-8e88-b653b56a3e63-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-nzp2v\" (UID: \"7f951fa9-c1c9-491b-8e88-b653b56a3e63\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-nzp2v"
Jul 24 18:52:52.391234 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:52:52.391160    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7f951fa9-c1c9-491b-8e88-b653b56a3e63-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-nzp2v\" (UID: \"7f951fa9-c1c9-491b-8e88-b653b56a3e63\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-nzp2v"
Jul 24 18:52:52.391234 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:52:52.391198    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7f951fa9-c1c9-491b-8e88-b653b56a3e63-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-nzp2v\" (UID: \"7f951fa9-c1c9-491b-8e88-b653b56a3e63\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-nzp2v"
Jul 24 18:52:52.391476 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:52:52.391242    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7f951fa9-c1c9-491b-8e88-b653b56a3e63-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-nzp2v\" (UID: \"7f951fa9-c1c9-491b-8e88-b653b56a3e63\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-nzp2v"
Jul 24 18:52:52.391533 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:52:52.391478    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7f951fa9-c1c9-491b-8e88-b653b56a3e63-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-nzp2v\" (UID: \"7f951fa9-c1c9-491b-8e88-b653b56a3e63\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-nzp2v"
Jul 24 18:52:52.391589 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:52:52.391542    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7f951fa9-c1c9-491b-8e88-b653b56a3e63-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-nzp2v\" (UID: \"7f951fa9-c1c9-491b-8e88-b653b56a3e63\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-nzp2v"
Jul 24 18:52:52.391641 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:52:52.391595    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7f951fa9-c1c9-491b-8e88-b653b56a3e63-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-nzp2v\" (UID: \"7f951fa9-c1c9-491b-8e88-b653b56a3e63\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-nzp2v"
Jul 24 18:52:52.393545 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:52:52.393520    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7f951fa9-c1c9-491b-8e88-b653b56a3e63-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-nzp2v\" (UID: \"7f951fa9-c1c9-491b-8e88-b653b56a3e63\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-nzp2v"
Jul 24 18:52:52.393823 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:52:52.393808    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7f951fa9-c1c9-491b-8e88-b653b56a3e63-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-nzp2v\" (UID: \"7f951fa9-c1c9-491b-8e88-b653b56a3e63\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-nzp2v"
Jul 24 18:52:52.399401 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:52:52.399365    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t8g4v\" (UniqueName: \"kubernetes.io/projected/7f951fa9-c1c9-491b-8e88-b653b56a3e63-kube-api-access-t8g4v\") pod \"e2e-distinct-simulated-kserve-59975d69f9-nzp2v\" (UID: \"7f951fa9-c1c9-491b-8e88-b653b56a3e63\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-nzp2v"
Jul 24 18:52:52.481302 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:52:52.481257    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-nzp2v"
Jul 24 18:52:52.619391 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:52:52.619367    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-nzp2v"]
Jul 24 18:52:52.621612 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:52:52.621579    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f951fa9_c1c9_491b_8e88_b653b56a3e63.slice/crio-b8f6b8265a78eac5243550bcc096417931dfa7c74e365b99a462e16a1b9448d1 WatchSource:0}: Error finding container b8f6b8265a78eac5243550bcc096417931dfa7c74e365b99a462e16a1b9448d1: Status 404 returned error can't find the container with id b8f6b8265a78eac5243550bcc096417931dfa7c74e365b99a462e16a1b9448d1
Jul 24 18:52:52.753457 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:52:52.753366    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-nzp2v" event={"ID":"7f951fa9-c1c9-491b-8e88-b653b56a3e63","Type":"ContainerStarted","Data":"b8f6b8265a78eac5243550bcc096417931dfa7c74e365b99a462e16a1b9448d1"}
Jul 24 18:52:54.765091 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:52:54.765047    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-nzp2v" event={"ID":"7f951fa9-c1c9-491b-8e88-b653b56a3e63","Type":"ContainerStarted","Data":"5994bdac5ccad805b6ba8eab96486e120ba3a2f2514197341a1e2b96bacd2086"}
Jul 24 18:52:54.783810 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:52:54.783753    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-nzp2v" podStartSLOduration=1.520057346 podStartE2EDuration="2.783735893s" totalImagesPullingTime="1.263678547s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 18:52:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:52:54.781498943 +0000 UTC m=+529.990871008" watchObservedRunningTime="2026-07-24 18:52:54.783735893 +0000 UTC m=+529.993107935"
Jul 24 18:52:58.496323 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:52:58.496265    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:53:02.482196 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:53:02.482148    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-nzp2v"
Jul 24 18:53:02.482678 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:53:02.482229    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-nzp2v"
Jul 24 18:53:02.495085 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:53:02.495056    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-nzp2v"
Jul 24 18:53:02.813808 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:53:02.813728    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-nzp2v"
Jul 24 18:53:05.151342 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:53:05.151305    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4nkj6"]
Jul 24 18:53:05.153924 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:53:05.153907    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4nkj6"
Jul 24 18:53:05.157004 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:53:05.156985    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jul 24 18:53:05.167372 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:53:05.167348    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4nkj6"]
Jul 24 18:53:05.196877 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:53:05.196848    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:53:05.315677 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:53:05.315639    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ed3c90aa-0ddf-49c8-bc25-3e24233eab31-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4nkj6\" (UID: \"ed3c90aa-0ddf-49c8-bc25-3e24233eab31\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4nkj6"
Jul 24 18:53:05.315859 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:53:05.315700    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ed3c90aa-0ddf-49c8-bc25-3e24233eab31-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4nkj6\" (UID: \"ed3c90aa-0ddf-49c8-bc25-3e24233eab31\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4nkj6"
Jul 24 18:53:05.315859 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:53:05.315749    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ed3c90aa-0ddf-49c8-bc25-3e24233eab31-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4nkj6\" (UID: \"ed3c90aa-0ddf-49c8-bc25-3e24233eab31\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4nkj6"
Jul 24 18:53:05.315859 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:53:05.315774    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ed3c90aa-0ddf-49c8-bc25-3e24233eab31-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4nkj6\" (UID: \"ed3c90aa-0ddf-49c8-bc25-3e24233eab31\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4nkj6"
Jul 24 18:53:05.316002 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:53:05.315872    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wdvv2\" (UniqueName: \"kubernetes.io/projected/ed3c90aa-0ddf-49c8-bc25-3e24233eab31-kube-api-access-wdvv2\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4nkj6\" (UID: \"ed3c90aa-0ddf-49c8-bc25-3e24233eab31\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4nkj6"
Jul 24 18:53:05.316002 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:53:05.315931    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ed3c90aa-0ddf-49c8-bc25-3e24233eab31-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4nkj6\" (UID: \"ed3c90aa-0ddf-49c8-bc25-3e24233eab31\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4nkj6"
Jul 24 18:53:05.417485 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:53:05.417395    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ed3c90aa-0ddf-49c8-bc25-3e24233eab31-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4nkj6\" (UID: \"ed3c90aa-0ddf-49c8-bc25-3e24233eab31\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4nkj6"
Jul 24 18:53:05.417485 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:53:05.417435    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ed3c90aa-0ddf-49c8-bc25-3e24233eab31-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4nkj6\" (UID: \"ed3c90aa-0ddf-49c8-bc25-3e24233eab31\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4nkj6"
Jul 24 18:53:05.417485 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:53:05.417468    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wdvv2\" (UniqueName: \"kubernetes.io/projected/ed3c90aa-0ddf-49c8-bc25-3e24233eab31-kube-api-access-wdvv2\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4nkj6\" (UID: \"ed3c90aa-0ddf-49c8-bc25-3e24233eab31\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4nkj6"
Jul 24 18:53:05.417793 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:53:05.417505    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ed3c90aa-0ddf-49c8-bc25-3e24233eab31-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4nkj6\" (UID: \"ed3c90aa-0ddf-49c8-bc25-3e24233eab31\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4nkj6"
Jul 24 18:53:05.417793 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:53:05.417525    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ed3c90aa-0ddf-49c8-bc25-3e24233eab31-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4nkj6\" (UID: \"ed3c90aa-0ddf-49c8-bc25-3e24233eab31\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4nkj6"
Jul 24 18:53:05.417793 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:53:05.417559    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ed3c90aa-0ddf-49c8-bc25-3e24233eab31-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4nkj6\" (UID: \"ed3c90aa-0ddf-49c8-bc25-3e24233eab31\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4nkj6"
Jul 24 18:53:05.417948 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:53:05.417876    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ed3c90aa-0ddf-49c8-bc25-3e24233eab31-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4nkj6\" (UID: \"ed3c90aa-0ddf-49c8-bc25-3e24233eab31\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4nkj6"
Jul 24 18:53:05.417987 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:53:05.417951    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ed3c90aa-0ddf-49c8-bc25-3e24233eab31-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4nkj6\" (UID: \"ed3c90aa-0ddf-49c8-bc25-3e24233eab31\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4nkj6"
Jul 24 18:53:05.418050 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:53:05.418031    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ed3c90aa-0ddf-49c8-bc25-3e24233eab31-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4nkj6\" (UID: \"ed3c90aa-0ddf-49c8-bc25-3e24233eab31\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4nkj6"
Jul 24 18:53:05.419953 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:53:05.419933    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ed3c90aa-0ddf-49c8-bc25-3e24233eab31-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4nkj6\" (UID: \"ed3c90aa-0ddf-49c8-bc25-3e24233eab31\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4nkj6"
Jul 24 18:53:05.420148 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:53:05.420112    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ed3c90aa-0ddf-49c8-bc25-3e24233eab31-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4nkj6\" (UID: \"ed3c90aa-0ddf-49c8-bc25-3e24233eab31\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4nkj6"
Jul 24 18:53:05.425875 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:53:05.425848    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wdvv2\" (UniqueName: \"kubernetes.io/projected/ed3c90aa-0ddf-49c8-bc25-3e24233eab31-kube-api-access-wdvv2\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4nkj6\" (UID: \"ed3c90aa-0ddf-49c8-bc25-3e24233eab31\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4nkj6"
Jul 24 18:53:05.465376 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:53:05.465332    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4nkj6"
Jul 24 18:53:05.605982 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:53:05.605955    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4nkj6"]
Jul 24 18:53:05.607987 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:53:05.607954    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded3c90aa_0ddf_49c8_bc25_3e24233eab31.slice/crio-4d6a72bdcdf447b5b8f0832a673c1d5b91bdab1df50d577c9fd26a3722ecd6e2 WatchSource:0}: Error finding container 4d6a72bdcdf447b5b8f0832a673c1d5b91bdab1df50d577c9fd26a3722ecd6e2: Status 404 returned error can't find the container with id 4d6a72bdcdf447b5b8f0832a673c1d5b91bdab1df50d577c9fd26a3722ecd6e2
Jul 24 18:53:05.816750 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:53:05.816705    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4nkj6" event={"ID":"ed3c90aa-0ddf-49c8-bc25-3e24233eab31","Type":"ContainerStarted","Data":"4d6a72bdcdf447b5b8f0832a673c1d5b91bdab1df50d577c9fd26a3722ecd6e2"}
Jul 24 18:53:06.823717 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:53:06.823677    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4nkj6" event={"ID":"ed3c90aa-0ddf-49c8-bc25-3e24233eab31","Type":"ContainerStarted","Data":"a7f5205adc12291c0e922a7494ecf8fb2b458c62b85a6d7ed7240607632070df"}
Jul 24 18:53:06.843099 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:53:06.843031    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4nkj6" podStartSLOduration=1.575565622 podStartE2EDuration="1.84301082s" totalImagesPullingTime="267.445198ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 18:53:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:53:06.841825505 +0000 UTC m=+542.051197547" watchObservedRunningTime="2026-07-24 18:53:06.84301082 +0000 UTC m=+542.052382864"
Jul 24 18:53:11.478615 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:53:11.478578    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:53:15.465997 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:53:15.465964    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4nkj6"
Jul 24 18:53:15.466512 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:53:15.466028    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4nkj6"
Jul 24 18:53:15.479350 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:53:15.479322    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4nkj6"
Jul 24 18:53:15.878167 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:53:15.878061    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4nkj6"
Jul 24 18:53:19.870937 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:53:19.870905    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-4gwbg"]
Jul 24 18:53:19.874544 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:53:19.874520    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-4gwbg"
Jul 24 18:53:19.877320 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:53:19.877292    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 24 18:53:19.882211 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:53:19.882189    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-4gwbg"]
Jul 24 18:53:19.897213 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:53:19.897175    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:53:19.957639 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:53:19.957604    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f2a2c9af-f736-4082-bb46-e23666647314-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-4gwbg\" (UID: \"f2a2c9af-f736-4082-bb46-e23666647314\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-4gwbg"
Jul 24 18:53:19.957639 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:53:19.957640    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f2a2c9af-f736-4082-bb46-e23666647314-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-4gwbg\" (UID: \"f2a2c9af-f736-4082-bb46-e23666647314\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-4gwbg"
Jul 24 18:53:19.957882 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:53:19.957660    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mbpjq\" (UniqueName: \"kubernetes.io/projected/f2a2c9af-f736-4082-bb46-e23666647314-kube-api-access-mbpjq\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-4gwbg\" (UID: \"f2a2c9af-f736-4082-bb46-e23666647314\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-4gwbg"
Jul 24 18:53:19.957882 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:53:19.957799    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f2a2c9af-f736-4082-bb46-e23666647314-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-4gwbg\" (UID: \"f2a2c9af-f736-4082-bb46-e23666647314\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-4gwbg"
Jul 24 18:53:19.957882 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:53:19.957857    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f2a2c9af-f736-4082-bb46-e23666647314-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-4gwbg\" (UID: \"f2a2c9af-f736-4082-bb46-e23666647314\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-4gwbg"
Jul 24 18:53:19.957882 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:53:19.957875    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f2a2c9af-f736-4082-bb46-e23666647314-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-4gwbg\" (UID: \"f2a2c9af-f736-4082-bb46-e23666647314\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-4gwbg"
Jul 24 18:53:20.059167 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:53:20.059106    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f2a2c9af-f736-4082-bb46-e23666647314-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-4gwbg\" (UID: \"f2a2c9af-f736-4082-bb46-e23666647314\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-4gwbg"
Jul 24 18:53:20.059167 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:53:20.059171    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f2a2c9af-f736-4082-bb46-e23666647314-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-4gwbg\" (UID: \"f2a2c9af-f736-4082-bb46-e23666647314\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-4gwbg"
Jul 24 18:53:20.059444 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:53:20.059208    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f2a2c9af-f736-4082-bb46-e23666647314-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-4gwbg\" (UID: \"f2a2c9af-f736-4082-bb46-e23666647314\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-4gwbg"
Jul 24 18:53:20.059444 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:53:20.059250    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f2a2c9af-f736-4082-bb46-e23666647314-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-4gwbg\" (UID: \"f2a2c9af-f736-4082-bb46-e23666647314\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-4gwbg"
Jul 24 18:53:20.059444 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:53:20.059281    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mbpjq\" (UniqueName: \"kubernetes.io/projected/f2a2c9af-f736-4082-bb46-e23666647314-kube-api-access-mbpjq\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-4gwbg\" (UID: \"f2a2c9af-f736-4082-bb46-e23666647314\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-4gwbg"
Jul 24 18:53:20.059444 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:53:20.059369    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f2a2c9af-f736-4082-bb46-e23666647314-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-4gwbg\" (UID: \"f2a2c9af-f736-4082-bb46-e23666647314\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-4gwbg"
Jul 24 18:53:20.059628 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:53:20.059548    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f2a2c9af-f736-4082-bb46-e23666647314-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-4gwbg\" (UID: \"f2a2c9af-f736-4082-bb46-e23666647314\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-4gwbg"
Jul 24 18:53:20.059628 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:53:20.059588    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f2a2c9af-f736-4082-bb46-e23666647314-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-4gwbg\" (UID: \"f2a2c9af-f736-4082-bb46-e23666647314\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-4gwbg"
Jul 24 18:53:20.059708 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:53:20.059680    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f2a2c9af-f736-4082-bb46-e23666647314-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-4gwbg\" (UID: \"f2a2c9af-f736-4082-bb46-e23666647314\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-4gwbg"
Jul 24 18:53:20.061706 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:53:20.061683    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f2a2c9af-f736-4082-bb46-e23666647314-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-4gwbg\" (UID: \"f2a2c9af-f736-4082-bb46-e23666647314\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-4gwbg"
Jul 24 18:53:20.061837 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:53:20.061820    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f2a2c9af-f736-4082-bb46-e23666647314-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-4gwbg\" (UID: \"f2a2c9af-f736-4082-bb46-e23666647314\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-4gwbg"
Jul 24 18:53:20.067289 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:53:20.067258    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mbpjq\" (UniqueName: \"kubernetes.io/projected/f2a2c9af-f736-4082-bb46-e23666647314-kube-api-access-mbpjq\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-4gwbg\" (UID: \"f2a2c9af-f736-4082-bb46-e23666647314\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-4gwbg"
Jul 24 18:53:20.186328 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:53:20.186238    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-4gwbg"
Jul 24 18:53:20.320588 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:53:20.320565    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-4gwbg"]
Jul 24 18:53:20.322695 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:53:20.322668    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf2a2c9af_f736_4082_bb46_e23666647314.slice/crio-36809eb53334850f3ad0467844f883d042439db23b9ed61f13de9188fda987e8 WatchSource:0}: Error finding container 36809eb53334850f3ad0467844f883d042439db23b9ed61f13de9188fda987e8: Status 404 returned error can't find the container with id 36809eb53334850f3ad0467844f883d042439db23b9ed61f13de9188fda987e8
Jul 24 18:53:20.892038 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:53:20.891954    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-4gwbg" event={"ID":"f2a2c9af-f736-4082-bb46-e23666647314","Type":"ContainerStarted","Data":"cd5883ea78e3650643f24c2f1b6018cad146ddac5279b77bdba8f7b335e59eda"}
Jul 24 18:53:20.892038 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:53:20.891993    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-4gwbg" event={"ID":"f2a2c9af-f736-4082-bb46-e23666647314","Type":"ContainerStarted","Data":"36809eb53334850f3ad0467844f883d042439db23b9ed61f13de9188fda987e8"}
Jul 24 18:53:20.910275 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:53:20.910220    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-4gwbg" podStartSLOduration=1.6801465370000002 podStartE2EDuration="1.910203254s" totalImagesPullingTime="230.056717ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 18:53:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:53:20.90871415 +0000 UTC m=+556.118086219" watchObservedRunningTime="2026-07-24 18:53:20.910203254 +0000 UTC m=+556.119575296"
Jul 24 18:53:30.187252 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:53:30.187214    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-4gwbg"
Jul 24 18:53:30.187252 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:53:30.187264    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-4gwbg"
Jul 24 18:53:30.199962 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:53:30.199928    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-4gwbg"
Jul 24 18:53:30.948698 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:53:30.948666    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-4gwbg"
Jul 24 18:53:35.688647 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:53:35.688612    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:53:35.745338 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:53:35.745309    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:54:04.415941 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:54:04.415901    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5674d54b-xj9cr"]
Jul 24 18:54:04.419591 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:54:04.419575    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5674d54b-xj9cr"
Jul 24 18:54:04.427884 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:54:04.427855    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5674d54b-xj9cr"]
Jul 24 18:54:04.472325 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:54:04.472276    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nh6qx\" (UniqueName: \"kubernetes.io/projected/3263be87-2868-4473-a163-9c01b3afbe5b-kube-api-access-nh6qx\") pod \"authorino-5674d54b-xj9cr\" (UID: \"3263be87-2868-4473-a163-9c01b3afbe5b\") " pod="kuadrant-system/authorino-5674d54b-xj9cr"
Jul 24 18:54:04.472532 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:54:04.472344    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/3263be87-2868-4473-a163-9c01b3afbe5b-tls-cert\") pod \"authorino-5674d54b-xj9cr\" (UID: \"3263be87-2868-4473-a163-9c01b3afbe5b\") " pod="kuadrant-system/authorino-5674d54b-xj9cr"
Jul 24 18:54:04.573044 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:54:04.572995    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/3263be87-2868-4473-a163-9c01b3afbe5b-tls-cert\") pod \"authorino-5674d54b-xj9cr\" (UID: \"3263be87-2868-4473-a163-9c01b3afbe5b\") " pod="kuadrant-system/authorino-5674d54b-xj9cr"
Jul 24 18:54:04.573246 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:54:04.573164    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nh6qx\" (UniqueName: \"kubernetes.io/projected/3263be87-2868-4473-a163-9c01b3afbe5b-kube-api-access-nh6qx\") pod \"authorino-5674d54b-xj9cr\" (UID: \"3263be87-2868-4473-a163-9c01b3afbe5b\") " pod="kuadrant-system/authorino-5674d54b-xj9cr"
Jul 24 18:54:04.575646 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:54:04.575625    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/3263be87-2868-4473-a163-9c01b3afbe5b-tls-cert\") pod \"authorino-5674d54b-xj9cr\" (UID: \"3263be87-2868-4473-a163-9c01b3afbe5b\") " pod="kuadrant-system/authorino-5674d54b-xj9cr"
Jul 24 18:54:04.581224 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:54:04.581201    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nh6qx\" (UniqueName: \"kubernetes.io/projected/3263be87-2868-4473-a163-9c01b3afbe5b-kube-api-access-nh6qx\") pod \"authorino-5674d54b-xj9cr\" (UID: \"3263be87-2868-4473-a163-9c01b3afbe5b\") " pod="kuadrant-system/authorino-5674d54b-xj9cr"
Jul 24 18:54:04.730595 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:54:04.730563    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5674d54b-xj9cr"
Jul 24 18:54:04.742605 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:54:04.742563    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:54:04.868327 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:54:04.868236    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5674d54b-xj9cr"]
Jul 24 18:54:04.870584 ip-10-0-141-146 kubenswrapper[2580]: W0724 18:54:04.870556    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3263be87_2868_4473_a163_9c01b3afbe5b.slice/crio-aa5c62176b8ecce6a2e7afb452a8303cfbb5a0bd2a2dc6dfb3c6cc4c8f42d15c WatchSource:0}: Error finding container aa5c62176b8ecce6a2e7afb452a8303cfbb5a0bd2a2dc6dfb3c6cc4c8f42d15c: Status 404 returned error can't find the container with id aa5c62176b8ecce6a2e7afb452a8303cfbb5a0bd2a2dc6dfb3c6cc4c8f42d15c
Jul 24 18:54:05.091683 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:54:05.091590    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5674d54b-xj9cr" event={"ID":"3263be87-2868-4473-a163-9c01b3afbe5b","Type":"ContainerStarted","Data":"aa5c62176b8ecce6a2e7afb452a8303cfbb5a0bd2a2dc6dfb3c6cc4c8f42d15c"}
Jul 24 18:54:06.007687 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:54:06.007599    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:54:06.087809 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:54:06.087783    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qvzgb_dd21fc27-5a24-4f3a-a912-043af27a4342/ovn-acl-logging/0.log"
Jul 24 18:54:06.091917 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:54:06.091888    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qvzgb_dd21fc27-5a24-4f3a-a912-043af27a4342/ovn-acl-logging/0.log"
Jul 24 18:54:06.100449 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:54:06.100410    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5674d54b-xj9cr" event={"ID":"3263be87-2868-4473-a163-9c01b3afbe5b","Type":"ContainerStarted","Data":"36d4139c2f42e1259b751a6fbe4c77ed57972e3361cb1aa749bb5763ffb64759"}
Jul 24 18:54:06.132989 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:54:06.132929    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5674d54b-xj9cr" podStartSLOduration=1.5523158769999998 podStartE2EDuration="2.132894129s" totalImagesPullingTime="580.578252ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 18:54:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:54:06.131552698 +0000 UTC m=+601.340924742" watchObservedRunningTime="2026-07-24 18:54:06.132894129 +0000 UTC m=+601.342266189"
Jul 24 18:54:06.163700 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:54:06.163661    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-689fb694cf-6jqnk"]
Jul 24 18:54:06.163910 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:54:06.163882    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-689fb694cf-6jqnk" podUID="dad42308-de9c-440d-bc61-fe67043cb840" containerName="authorino" containerID="cri-o://0da1a9259686d85466b6ff6b6e497d809b399d9827dc261836294cf0d8be7215" gracePeriod=30
Jul 24 18:54:06.447171 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:54:06.447140    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-689fb694cf-6jqnk"
Jul 24 18:54:06.494083 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:54:06.494043    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kfbsc\" (UniqueName: \"kubernetes.io/projected/dad42308-de9c-440d-bc61-fe67043cb840-kube-api-access-kfbsc\") pod \"dad42308-de9c-440d-bc61-fe67043cb840\" (UID: \"dad42308-de9c-440d-bc61-fe67043cb840\") "
Jul 24 18:54:06.494281 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:54:06.494182    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/dad42308-de9c-440d-bc61-fe67043cb840-tls-cert\") pod \"dad42308-de9c-440d-bc61-fe67043cb840\" (UID: \"dad42308-de9c-440d-bc61-fe67043cb840\") "
Jul 24 18:54:06.496479 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:54:06.496445    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dad42308-de9c-440d-bc61-fe67043cb840-kube-api-access-kfbsc" (OuterVolumeSpecName: "kube-api-access-kfbsc") pod "dad42308-de9c-440d-bc61-fe67043cb840" (UID: "dad42308-de9c-440d-bc61-fe67043cb840"). InnerVolumeSpecName "kube-api-access-kfbsc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 18:54:06.505916 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:54:06.505877    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dad42308-de9c-440d-bc61-fe67043cb840-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "dad42308-de9c-440d-bc61-fe67043cb840" (UID: "dad42308-de9c-440d-bc61-fe67043cb840"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 18:54:06.595677 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:54:06.595628    2580 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/dad42308-de9c-440d-bc61-fe67043cb840-tls-cert\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 24 18:54:06.595677 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:54:06.595677    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kfbsc\" (UniqueName: \"kubernetes.io/projected/dad42308-de9c-440d-bc61-fe67043cb840-kube-api-access-kfbsc\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 24 18:54:07.106593 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:54:07.106557    2580 generic.go:356] "Generic (PLEG): container finished" podID="dad42308-de9c-440d-bc61-fe67043cb840" containerID="0da1a9259686d85466b6ff6b6e497d809b399d9827dc261836294cf0d8be7215" exitCode=0
Jul 24 18:54:07.107059 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:54:07.106602    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-689fb694cf-6jqnk"
Jul 24 18:54:07.107059 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:54:07.106643    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-689fb694cf-6jqnk" event={"ID":"dad42308-de9c-440d-bc61-fe67043cb840","Type":"ContainerDied","Data":"0da1a9259686d85466b6ff6b6e497d809b399d9827dc261836294cf0d8be7215"}
Jul 24 18:54:07.107059 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:54:07.106687    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-689fb694cf-6jqnk" event={"ID":"dad42308-de9c-440d-bc61-fe67043cb840","Type":"ContainerDied","Data":"cfd952498c052b0949138ff64386b08df4417124d6c8d740a932899152dd0d34"}
Jul 24 18:54:07.107059 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:54:07.106707    2580 scope.go:117] "RemoveContainer" containerID="0da1a9259686d85466b6ff6b6e497d809b399d9827dc261836294cf0d8be7215"
Jul 24 18:54:07.135347 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:54:07.135313    2580 scope.go:117] "RemoveContainer" containerID="0da1a9259686d85466b6ff6b6e497d809b399d9827dc261836294cf0d8be7215"
Jul 24 18:54:07.135933 ip-10-0-141-146 kubenswrapper[2580]: E0724 18:54:07.135808    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0da1a9259686d85466b6ff6b6e497d809b399d9827dc261836294cf0d8be7215\": container with ID starting with 0da1a9259686d85466b6ff6b6e497d809b399d9827dc261836294cf0d8be7215 not found: ID does not exist" containerID="0da1a9259686d85466b6ff6b6e497d809b399d9827dc261836294cf0d8be7215"
Jul 24 18:54:07.135933 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:54:07.135852    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0da1a9259686d85466b6ff6b6e497d809b399d9827dc261836294cf0d8be7215"} err="failed to get container status \"0da1a9259686d85466b6ff6b6e497d809b399d9827dc261836294cf0d8be7215\": rpc error: code = NotFound desc = could not find container \"0da1a9259686d85466b6ff6b6e497d809b399d9827dc261836294cf0d8be7215\": container with ID starting with 0da1a9259686d85466b6ff6b6e497d809b399d9827dc261836294cf0d8be7215 not found: ID does not exist"
Jul 24 18:54:07.151888 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:54:07.151841    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-689fb694cf-6jqnk"]
Jul 24 18:54:07.154094 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:54:07.154068    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-689fb694cf-6jqnk"]
Jul 24 18:54:07.241527 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:54:07.241491    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dad42308-de9c-440d-bc61-fe67043cb840" path="/var/lib/kubelet/pods/dad42308-de9c-440d-bc61-fe67043cb840/volumes"
Jul 24 18:54:31.040574 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:54:31.040464    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:55:01.680194 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:55:01.680155    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:55:01.778021 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:55:01.777983    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:55:14.053200 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:55:14.053166    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:56:10.836663 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:56:10.836627    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:56:12.030799 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:56:12.030765    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:56:52.674484 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:56:52.674446    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:56:52.773053 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:56:52.773020    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:56:52.873338 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:56:52.873303    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:56:58.510631 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:56:58.510592    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:56:58.625277 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:56:58.625243    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:56:58.711844 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:56:58.711807    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:56:58.858019 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:56:58.857927    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:57:04.805049 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:57:04.804980    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:57:04.880890 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:57:04.880852    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:58:28.232088 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:58:28.232053    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:58:28.333025 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:58:28.332989    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:59:00.549570 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:59:00.549486    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 18:59:06.123762 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:59:06.123725    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qvzgb_dd21fc27-5a24-4f3a-a912-043af27a4342/ovn-acl-logging/0.log"
Jul 24 18:59:06.128957 ip-10-0-141-146 kubenswrapper[2580]: I0724 18:59:06.128935    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qvzgb_dd21fc27-5a24-4f3a-a912-043af27a4342/ovn-acl-logging/0.log"
Jul 24 19:02:03.851586 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:02:03.851508    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:04:06.153718 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:04:06.153688    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qvzgb_dd21fc27-5a24-4f3a-a912-043af27a4342/ovn-acl-logging/0.log"
Jul 24 19:04:06.161176 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:04:06.161153    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qvzgb_dd21fc27-5a24-4f3a-a912-043af27a4342/ovn-acl-logging/0.log"
Jul 24 19:05:37.190394 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:05:37.190343    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:05:44.958746 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:05:44.958704    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-b-87181f2e-kserve-5f84db9895-fmpmd"]
Jul 24 19:05:44.959344 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:05:44.959150    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dad42308-de9c-440d-bc61-fe67043cb840" containerName="authorino"
Jul 24 19:05:44.959344 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:05:44.959162    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="dad42308-de9c-440d-bc61-fe67043cb840" containerName="authorino"
Jul 24 19:05:44.959344 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:05:44.959219    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="dad42308-de9c-440d-bc61-fe67043cb840" containerName="authorino"
Jul 24 19:05:44.962237 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:05:44.962218    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-87181f2e-kserve-5f84db9895-fmpmd"
Jul 24 19:05:44.964839 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:05:44.964812    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-b-87181f2e-kserve-self-signed-certs\""
Jul 24 19:05:44.973339 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:05:44.973316    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-87181f2e-kserve-5f84db9895-fmpmd"]
Jul 24 19:05:44.994742 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:05:44.994703    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:05:45.078918 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:05:45.078881    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vkzc7\" (UniqueName: \"kubernetes.io/projected/b9f95856-44a9-4cbd-ae73-181590e551e7-kube-api-access-vkzc7\") pod \"e2e-same-id-b-87181f2e-kserve-5f84db9895-fmpmd\" (UID: \"b9f95856-44a9-4cbd-ae73-181590e551e7\") " pod="llm/e2e-same-id-b-87181f2e-kserve-5f84db9895-fmpmd"
Jul 24 19:05:45.079108 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:05:45.078927    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b9f95856-44a9-4cbd-ae73-181590e551e7-home\") pod \"e2e-same-id-b-87181f2e-kserve-5f84db9895-fmpmd\" (UID: \"b9f95856-44a9-4cbd-ae73-181590e551e7\") " pod="llm/e2e-same-id-b-87181f2e-kserve-5f84db9895-fmpmd"
Jul 24 19:05:45.079108 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:05:45.078945    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b9f95856-44a9-4cbd-ae73-181590e551e7-tmp-dir\") pod \"e2e-same-id-b-87181f2e-kserve-5f84db9895-fmpmd\" (UID: \"b9f95856-44a9-4cbd-ae73-181590e551e7\") " pod="llm/e2e-same-id-b-87181f2e-kserve-5f84db9895-fmpmd"
Jul 24 19:05:45.079108 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:05:45.079036    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b9f95856-44a9-4cbd-ae73-181590e551e7-tls-certs\") pod \"e2e-same-id-b-87181f2e-kserve-5f84db9895-fmpmd\" (UID: \"b9f95856-44a9-4cbd-ae73-181590e551e7\") " pod="llm/e2e-same-id-b-87181f2e-kserve-5f84db9895-fmpmd"
Jul 24 19:05:45.079108 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:05:45.079106    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b9f95856-44a9-4cbd-ae73-181590e551e7-dshm\") pod \"e2e-same-id-b-87181f2e-kserve-5f84db9895-fmpmd\" (UID: \"b9f95856-44a9-4cbd-ae73-181590e551e7\") " pod="llm/e2e-same-id-b-87181f2e-kserve-5f84db9895-fmpmd"
Jul 24 19:05:45.079318 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:05:45.079149    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b9f95856-44a9-4cbd-ae73-181590e551e7-model-cache\") pod \"e2e-same-id-b-87181f2e-kserve-5f84db9895-fmpmd\" (UID: \"b9f95856-44a9-4cbd-ae73-181590e551e7\") " pod="llm/e2e-same-id-b-87181f2e-kserve-5f84db9895-fmpmd"
Jul 24 19:05:45.180354 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:05:45.180318    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vkzc7\" (UniqueName: \"kubernetes.io/projected/b9f95856-44a9-4cbd-ae73-181590e551e7-kube-api-access-vkzc7\") pod \"e2e-same-id-b-87181f2e-kserve-5f84db9895-fmpmd\" (UID: \"b9f95856-44a9-4cbd-ae73-181590e551e7\") " pod="llm/e2e-same-id-b-87181f2e-kserve-5f84db9895-fmpmd"
Jul 24 19:05:45.180557 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:05:45.180363    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b9f95856-44a9-4cbd-ae73-181590e551e7-home\") pod \"e2e-same-id-b-87181f2e-kserve-5f84db9895-fmpmd\" (UID: \"b9f95856-44a9-4cbd-ae73-181590e551e7\") " pod="llm/e2e-same-id-b-87181f2e-kserve-5f84db9895-fmpmd"
Jul 24 19:05:45.180557 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:05:45.180383    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b9f95856-44a9-4cbd-ae73-181590e551e7-tmp-dir\") pod \"e2e-same-id-b-87181f2e-kserve-5f84db9895-fmpmd\" (UID: \"b9f95856-44a9-4cbd-ae73-181590e551e7\") " pod="llm/e2e-same-id-b-87181f2e-kserve-5f84db9895-fmpmd"
Jul 24 19:05:45.180557 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:05:45.180409    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b9f95856-44a9-4cbd-ae73-181590e551e7-tls-certs\") pod \"e2e-same-id-b-87181f2e-kserve-5f84db9895-fmpmd\" (UID: \"b9f95856-44a9-4cbd-ae73-181590e551e7\") " pod="llm/e2e-same-id-b-87181f2e-kserve-5f84db9895-fmpmd"
Jul 24 19:05:45.180557 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:05:45.180442    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b9f95856-44a9-4cbd-ae73-181590e551e7-dshm\") pod \"e2e-same-id-b-87181f2e-kserve-5f84db9895-fmpmd\" (UID: \"b9f95856-44a9-4cbd-ae73-181590e551e7\") " pod="llm/e2e-same-id-b-87181f2e-kserve-5f84db9895-fmpmd"
Jul 24 19:05:45.180557 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:05:45.180458    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b9f95856-44a9-4cbd-ae73-181590e551e7-model-cache\") pod \"e2e-same-id-b-87181f2e-kserve-5f84db9895-fmpmd\" (UID: \"b9f95856-44a9-4cbd-ae73-181590e551e7\") " pod="llm/e2e-same-id-b-87181f2e-kserve-5f84db9895-fmpmd"
Jul 24 19:05:45.180832 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:05:45.180808    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b9f95856-44a9-4cbd-ae73-181590e551e7-tmp-dir\") pod \"e2e-same-id-b-87181f2e-kserve-5f84db9895-fmpmd\" (UID: \"b9f95856-44a9-4cbd-ae73-181590e551e7\") " pod="llm/e2e-same-id-b-87181f2e-kserve-5f84db9895-fmpmd"
Jul 24 19:05:45.180832 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:05:45.180822    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b9f95856-44a9-4cbd-ae73-181590e551e7-home\") pod \"e2e-same-id-b-87181f2e-kserve-5f84db9895-fmpmd\" (UID: \"b9f95856-44a9-4cbd-ae73-181590e551e7\") " pod="llm/e2e-same-id-b-87181f2e-kserve-5f84db9895-fmpmd"
Jul 24 19:05:45.180906 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:05:45.180870    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b9f95856-44a9-4cbd-ae73-181590e551e7-model-cache\") pod \"e2e-same-id-b-87181f2e-kserve-5f84db9895-fmpmd\" (UID: \"b9f95856-44a9-4cbd-ae73-181590e551e7\") " pod="llm/e2e-same-id-b-87181f2e-kserve-5f84db9895-fmpmd"
Jul 24 19:05:45.182846 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:05:45.182816    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b9f95856-44a9-4cbd-ae73-181590e551e7-dshm\") pod \"e2e-same-id-b-87181f2e-kserve-5f84db9895-fmpmd\" (UID: \"b9f95856-44a9-4cbd-ae73-181590e551e7\") " pod="llm/e2e-same-id-b-87181f2e-kserve-5f84db9895-fmpmd"
Jul 24 19:05:45.183056 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:05:45.183039    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b9f95856-44a9-4cbd-ae73-181590e551e7-tls-certs\") pod \"e2e-same-id-b-87181f2e-kserve-5f84db9895-fmpmd\" (UID: \"b9f95856-44a9-4cbd-ae73-181590e551e7\") " pod="llm/e2e-same-id-b-87181f2e-kserve-5f84db9895-fmpmd"
Jul 24 19:05:45.188322 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:05:45.188299    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vkzc7\" (UniqueName: \"kubernetes.io/projected/b9f95856-44a9-4cbd-ae73-181590e551e7-kube-api-access-vkzc7\") pod \"e2e-same-id-b-87181f2e-kserve-5f84db9895-fmpmd\" (UID: \"b9f95856-44a9-4cbd-ae73-181590e551e7\") " pod="llm/e2e-same-id-b-87181f2e-kserve-5f84db9895-fmpmd"
Jul 24 19:05:45.271369 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:05:45.271290    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-87181f2e-kserve-5f84db9895-fmpmd"
Jul 24 19:05:45.407778 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:05:45.407742    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-87181f2e-kserve-5f84db9895-fmpmd"]
Jul 24 19:05:45.411194 ip-10-0-141-146 kubenswrapper[2580]: W0724 19:05:45.411156    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb9f95856_44a9_4cbd_ae73_181590e551e7.slice/crio-f4f3aa5d7e0c376a79b273b1874ca2a47552b0576f445cb86c6961bda79cd122 WatchSource:0}: Error finding container f4f3aa5d7e0c376a79b273b1874ca2a47552b0576f445cb86c6961bda79cd122: Status 404 returned error can't find the container with id f4f3aa5d7e0c376a79b273b1874ca2a47552b0576f445cb86c6961bda79cd122
Jul 24 19:05:46.420391 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:05:46.420348    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-87181f2e-kserve-5f84db9895-fmpmd" event={"ID":"b9f95856-44a9-4cbd-ae73-181590e551e7","Type":"ContainerStarted","Data":"3342165d6b5be8bbc7501200cd4b823a102185abfb07c8bea00199e957e80f30"}
Jul 24 19:05:46.420391 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:05:46.420390    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-87181f2e-kserve-5f84db9895-fmpmd" event={"ID":"b9f95856-44a9-4cbd-ae73-181590e551e7","Type":"ContainerStarted","Data":"f4f3aa5d7e0c376a79b273b1874ca2a47552b0576f445cb86c6961bda79cd122"}
Jul 24 19:05:46.437832 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:05:46.437783    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-b-87181f2e-kserve-5f84db9895-fmpmd" podStartSLOduration=2.437767351 podStartE2EDuration="2.437767351s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 19:05:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:05:46.4370065 +0000 UTC m=+1301.646378543" watchObservedRunningTime="2026-07-24 19:05:46.437767351 +0000 UTC m=+1301.647139439"
Jul 24 19:05:55.272071 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:05:55.272033    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-b-87181f2e-kserve-5f84db9895-fmpmd"
Jul 24 19:05:55.272525 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:05:55.272090    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-b-87181f2e-kserve-5f84db9895-fmpmd"
Jul 24 19:05:55.284327 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:05:55.284296    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-b-87181f2e-kserve-5f84db9895-fmpmd"
Jul 24 19:05:55.472568 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:05:55.472538    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-b-87181f2e-kserve-5f84db9895-fmpmd"
Jul 24 19:06:05.238748 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:06:05.238713    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:06:06.776343 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:06:06.776310    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-87181f2e-kserve-5f84db9895-fmpmd"]
Jul 24 19:06:06.795735 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:06:06.795696    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:06:07.216850 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:06:07.216812    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:06:07.269974 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:06:07.269935    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:06:21.796166 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:06:21.796069    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-b-87181f2e-kserve-5f84db9895-fmpmd" podUID="b9f95856-44a9-4cbd-ae73-181590e551e7" containerName="main" containerID="cri-o://3342165d6b5be8bbc7501200cd4b823a102185abfb07c8bea00199e957e80f30" gracePeriod=45
Jul 24 19:06:22.042077 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:06:22.042050    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-87181f2e-kserve-5f84db9895-fmpmd"
Jul 24 19:06:22.173971 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:06:22.173870    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b9f95856-44a9-4cbd-ae73-181590e551e7-model-cache\") pod \"b9f95856-44a9-4cbd-ae73-181590e551e7\" (UID: \"b9f95856-44a9-4cbd-ae73-181590e551e7\") "
Jul 24 19:06:22.173971 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:06:22.173952    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b9f95856-44a9-4cbd-ae73-181590e551e7-home\") pod \"b9f95856-44a9-4cbd-ae73-181590e551e7\" (UID: \"b9f95856-44a9-4cbd-ae73-181590e551e7\") "
Jul 24 19:06:22.174272 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:06:22.173991    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b9f95856-44a9-4cbd-ae73-181590e551e7-tmp-dir\") pod \"b9f95856-44a9-4cbd-ae73-181590e551e7\" (UID: \"b9f95856-44a9-4cbd-ae73-181590e551e7\") "
Jul 24 19:06:22.174272 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:06:22.174010    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vkzc7\" (UniqueName: \"kubernetes.io/projected/b9f95856-44a9-4cbd-ae73-181590e551e7-kube-api-access-vkzc7\") pod \"b9f95856-44a9-4cbd-ae73-181590e551e7\" (UID: \"b9f95856-44a9-4cbd-ae73-181590e551e7\") "
Jul 24 19:06:22.174272 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:06:22.174039    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b9f95856-44a9-4cbd-ae73-181590e551e7-dshm\") pod \"b9f95856-44a9-4cbd-ae73-181590e551e7\" (UID: \"b9f95856-44a9-4cbd-ae73-181590e551e7\") "
Jul 24 19:06:22.174272 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:06:22.174062    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b9f95856-44a9-4cbd-ae73-181590e551e7-tls-certs\") pod \"b9f95856-44a9-4cbd-ae73-181590e551e7\" (UID: \"b9f95856-44a9-4cbd-ae73-181590e551e7\") "
Jul 24 19:06:22.174472 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:06:22.174239    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b9f95856-44a9-4cbd-ae73-181590e551e7-model-cache" (OuterVolumeSpecName: "model-cache") pod "b9f95856-44a9-4cbd-ae73-181590e551e7" (UID: "b9f95856-44a9-4cbd-ae73-181590e551e7"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:06:22.174472 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:06:22.174297    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b9f95856-44a9-4cbd-ae73-181590e551e7-home" (OuterVolumeSpecName: "home") pod "b9f95856-44a9-4cbd-ae73-181590e551e7" (UID: "b9f95856-44a9-4cbd-ae73-181590e551e7"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:06:22.174472 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:06:22.174313    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b9f95856-44a9-4cbd-ae73-181590e551e7-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "b9f95856-44a9-4cbd-ae73-181590e551e7" (UID: "b9f95856-44a9-4cbd-ae73-181590e551e7"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:06:22.174472 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:06:22.174444    2580 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b9f95856-44a9-4cbd-ae73-181590e551e7-home\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 24 19:06:22.174472 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:06:22.174463    2580 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b9f95856-44a9-4cbd-ae73-181590e551e7-tmp-dir\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 24 19:06:22.174655 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:06:22.174478    2580 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b9f95856-44a9-4cbd-ae73-181590e551e7-model-cache\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 24 19:06:22.176419 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:06:22.176390    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b9f95856-44a9-4cbd-ae73-181590e551e7-dshm" (OuterVolumeSpecName: "dshm") pod "b9f95856-44a9-4cbd-ae73-181590e551e7" (UID: "b9f95856-44a9-4cbd-ae73-181590e551e7"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:06:22.176541 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:06:22.176506    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b9f95856-44a9-4cbd-ae73-181590e551e7-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "b9f95856-44a9-4cbd-ae73-181590e551e7" (UID: "b9f95856-44a9-4cbd-ae73-181590e551e7"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 19:06:22.176541 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:06:22.176519    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b9f95856-44a9-4cbd-ae73-181590e551e7-kube-api-access-vkzc7" (OuterVolumeSpecName: "kube-api-access-vkzc7") pod "b9f95856-44a9-4cbd-ae73-181590e551e7" (UID: "b9f95856-44a9-4cbd-ae73-181590e551e7"). InnerVolumeSpecName "kube-api-access-vkzc7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 19:06:22.275866 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:06:22.275814    2580 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b9f95856-44a9-4cbd-ae73-181590e551e7-tls-certs\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 24 19:06:22.275866 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:06:22.275858    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vkzc7\" (UniqueName: \"kubernetes.io/projected/b9f95856-44a9-4cbd-ae73-181590e551e7-kube-api-access-vkzc7\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 24 19:06:22.275866 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:06:22.275871    2580 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b9f95856-44a9-4cbd-ae73-181590e551e7-dshm\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 24 19:06:22.594723 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:06:22.594688    2580 generic.go:356] "Generic (PLEG): container finished" podID="b9f95856-44a9-4cbd-ae73-181590e551e7" containerID="3342165d6b5be8bbc7501200cd4b823a102185abfb07c8bea00199e957e80f30" exitCode=0
Jul 24 19:06:22.594927 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:06:22.594732    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-87181f2e-kserve-5f84db9895-fmpmd"
Jul 24 19:06:22.594927 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:06:22.594753    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-87181f2e-kserve-5f84db9895-fmpmd" event={"ID":"b9f95856-44a9-4cbd-ae73-181590e551e7","Type":"ContainerDied","Data":"3342165d6b5be8bbc7501200cd4b823a102185abfb07c8bea00199e957e80f30"}
Jul 24 19:06:22.594927 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:06:22.594784    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-87181f2e-kserve-5f84db9895-fmpmd" event={"ID":"b9f95856-44a9-4cbd-ae73-181590e551e7","Type":"ContainerDied","Data":"f4f3aa5d7e0c376a79b273b1874ca2a47552b0576f445cb86c6961bda79cd122"}
Jul 24 19:06:22.594927 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:06:22.594800    2580 scope.go:117] "RemoveContainer" containerID="3342165d6b5be8bbc7501200cd4b823a102185abfb07c8bea00199e957e80f30"
Jul 24 19:06:22.604373 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:06:22.604355    2580 scope.go:117] "RemoveContainer" containerID="3342165d6b5be8bbc7501200cd4b823a102185abfb07c8bea00199e957e80f30"
Jul 24 19:06:22.604630 ip-10-0-141-146 kubenswrapper[2580]: E0724 19:06:22.604610    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3342165d6b5be8bbc7501200cd4b823a102185abfb07c8bea00199e957e80f30\": container with ID starting with 3342165d6b5be8bbc7501200cd4b823a102185abfb07c8bea00199e957e80f30 not found: ID does not exist" containerID="3342165d6b5be8bbc7501200cd4b823a102185abfb07c8bea00199e957e80f30"
Jul 24 19:06:22.604687 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:06:22.604639    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3342165d6b5be8bbc7501200cd4b823a102185abfb07c8bea00199e957e80f30"} err="failed to get container status \"3342165d6b5be8bbc7501200cd4b823a102185abfb07c8bea00199e957e80f30\": rpc error: code = NotFound desc = could not find container \"3342165d6b5be8bbc7501200cd4b823a102185abfb07c8bea00199e957e80f30\": container with ID starting with 3342165d6b5be8bbc7501200cd4b823a102185abfb07c8bea00199e957e80f30 not found: ID does not exist"
Jul 24 19:06:22.617752 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:06:22.617728    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-87181f2e-kserve-5f84db9895-fmpmd"]
Jul 24 19:06:22.621185 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:06:22.621163    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-b-87181f2e-kserve-5f84db9895-fmpmd"]
Jul 24 19:06:23.241451 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:06:23.241417    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b9f95856-44a9-4cbd-ae73-181590e551e7" path="/var/lib/kubelet/pods/b9f95856-44a9-4cbd-ae73-181590e551e7/volumes"
Jul 24 19:06:53.907600 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:06:53.907559    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:06:53.960758 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:06:53.960719    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:07:28.844845 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:07:28.844794    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:08:02.766235 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:08:02.766140    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:09:06.188550 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:09:06.188516    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qvzgb_dd21fc27-5a24-4f3a-a912-043af27a4342/ovn-acl-logging/0.log"
Jul 24 19:09:06.196475 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:09:06.196454    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qvzgb_dd21fc27-5a24-4f3a-a912-043af27a4342/ovn-acl-logging/0.log"
Jul 24 19:09:21.494927 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:09:21.494881    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:09:40.171056 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:09:40.170951    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:09:43.157549 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:09:43.157509    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:09:43.278518 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:09:43.278475    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:09:43.621612 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:09:43.621576    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:09:49.514400 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:09:49.514359    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:09:49.579574 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:09:49.579536    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:09:49.751273 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:09:49.751229    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:09:50.018116 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:09:50.018080    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-d198c699-openshift-default-7c4b5ff8d6-g2g47"]
Jul 24 19:09:50.018481 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:09:50.018467    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b9f95856-44a9-4cbd-ae73-181590e551e7" containerName="main"
Jul 24 19:09:50.018540 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:09:50.018483    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="b9f95856-44a9-4cbd-ae73-181590e551e7" containerName="main"
Jul 24 19:09:50.018577 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:09:50.018556    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="b9f95856-44a9-4cbd-ae73-181590e551e7" containerName="main"
Jul 24 19:09:50.021419 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:09:50.021396    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-d198c699-openshift-default-7c4b5ff8d6-g2g47"
Jul 24 19:09:50.024175 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:09:50.024156    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-d198c699-openshift-default-dockercfg-j5l8f\""
Jul 24 19:09:50.048535 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:09:50.048509    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-d198c699-openshift-default-7c4b5ff8d6-g2g47"]
Jul 24 19:09:50.051054 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:09:50.051028    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:09:50.095403 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:09:50.095371    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e9fde19a-da4a-421b-9c95-607e173091d0-credential-socket\") pod \"e2e-ait-d198c699-openshift-default-7c4b5ff8d6-g2g47\" (UID: \"e9fde19a-da4a-421b-9c95-607e173091d0\") " pod="openshift-ingress/e2e-ait-d198c699-openshift-default-7c4b5ff8d6-g2g47"
Jul 24 19:09:50.095577 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:09:50.095412    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e9fde19a-da4a-421b-9c95-607e173091d0-workload-certs\") pod \"e2e-ait-d198c699-openshift-default-7c4b5ff8d6-g2g47\" (UID: \"e9fde19a-da4a-421b-9c95-607e173091d0\") " pod="openshift-ingress/e2e-ait-d198c699-openshift-default-7c4b5ff8d6-g2g47"
Jul 24 19:09:50.095577 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:09:50.095431    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e9fde19a-da4a-421b-9c95-607e173091d0-istio-token\") pod \"e2e-ait-d198c699-openshift-default-7c4b5ff8d6-g2g47\" (UID: \"e9fde19a-da4a-421b-9c95-607e173091d0\") " pod="openshift-ingress/e2e-ait-d198c699-openshift-default-7c4b5ff8d6-g2g47"
Jul 24 19:09:50.095577 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:09:50.095503    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e9fde19a-da4a-421b-9c95-607e173091d0-workload-socket\") pod \"e2e-ait-d198c699-openshift-default-7c4b5ff8d6-g2g47\" (UID: \"e9fde19a-da4a-421b-9c95-607e173091d0\") " pod="openshift-ingress/e2e-ait-d198c699-openshift-default-7c4b5ff8d6-g2g47"
Jul 24 19:09:50.095577 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:09:50.095519    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e9fde19a-da4a-421b-9c95-607e173091d0-istio-envoy\") pod \"e2e-ait-d198c699-openshift-default-7c4b5ff8d6-g2g47\" (UID: \"e9fde19a-da4a-421b-9c95-607e173091d0\") " pod="openshift-ingress/e2e-ait-d198c699-openshift-default-7c4b5ff8d6-g2g47"
Jul 24 19:09:50.095577 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:09:50.095559    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e9fde19a-da4a-421b-9c95-607e173091d0-istiod-ca-cert\") pod \"e2e-ait-d198c699-openshift-default-7c4b5ff8d6-g2g47\" (UID: \"e9fde19a-da4a-421b-9c95-607e173091d0\") " pod="openshift-ingress/e2e-ait-d198c699-openshift-default-7c4b5ff8d6-g2g47"
Jul 24 19:09:50.095780 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:09:50.095615    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e9fde19a-da4a-421b-9c95-607e173091d0-istio-podinfo\") pod \"e2e-ait-d198c699-openshift-default-7c4b5ff8d6-g2g47\" (UID: \"e9fde19a-da4a-421b-9c95-607e173091d0\") " pod="openshift-ingress/e2e-ait-d198c699-openshift-default-7c4b5ff8d6-g2g47"
Jul 24 19:09:50.095780 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:09:50.095654    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6jcnr\" (UniqueName: \"kubernetes.io/projected/e9fde19a-da4a-421b-9c95-607e173091d0-kube-api-access-6jcnr\") pod \"e2e-ait-d198c699-openshift-default-7c4b5ff8d6-g2g47\" (UID: \"e9fde19a-da4a-421b-9c95-607e173091d0\") " pod="openshift-ingress/e2e-ait-d198c699-openshift-default-7c4b5ff8d6-g2g47"
Jul 24 19:09:50.095780 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:09:50.095685    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e9fde19a-da4a-421b-9c95-607e173091d0-istio-data\") pod \"e2e-ait-d198c699-openshift-default-7c4b5ff8d6-g2g47\" (UID: \"e9fde19a-da4a-421b-9c95-607e173091d0\") " pod="openshift-ingress/e2e-ait-d198c699-openshift-default-7c4b5ff8d6-g2g47"
Jul 24 19:09:50.151344 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:09:50.151309    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:09:50.196682 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:09:50.196647    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e9fde19a-da4a-421b-9c95-607e173091d0-istiod-ca-cert\") pod \"e2e-ait-d198c699-openshift-default-7c4b5ff8d6-g2g47\" (UID: \"e9fde19a-da4a-421b-9c95-607e173091d0\") " pod="openshift-ingress/e2e-ait-d198c699-openshift-default-7c4b5ff8d6-g2g47"
Jul 24 19:09:50.196911 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:09:50.196705    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e9fde19a-da4a-421b-9c95-607e173091d0-istio-podinfo\") pod \"e2e-ait-d198c699-openshift-default-7c4b5ff8d6-g2g47\" (UID: \"e9fde19a-da4a-421b-9c95-607e173091d0\") " pod="openshift-ingress/e2e-ait-d198c699-openshift-default-7c4b5ff8d6-g2g47"
Jul 24 19:09:50.196911 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:09:50.196738    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6jcnr\" (UniqueName: \"kubernetes.io/projected/e9fde19a-da4a-421b-9c95-607e173091d0-kube-api-access-6jcnr\") pod \"e2e-ait-d198c699-openshift-default-7c4b5ff8d6-g2g47\" (UID: \"e9fde19a-da4a-421b-9c95-607e173091d0\") " pod="openshift-ingress/e2e-ait-d198c699-openshift-default-7c4b5ff8d6-g2g47"
Jul 24 19:09:50.196911 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:09:50.196773    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e9fde19a-da4a-421b-9c95-607e173091d0-istio-data\") pod \"e2e-ait-d198c699-openshift-default-7c4b5ff8d6-g2g47\" (UID: \"e9fde19a-da4a-421b-9c95-607e173091d0\") " pod="openshift-ingress/e2e-ait-d198c699-openshift-default-7c4b5ff8d6-g2g47"
Jul 24 19:09:50.197256 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:09:50.197224    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e9fde19a-da4a-421b-9c95-607e173091d0-istio-data\") pod \"e2e-ait-d198c699-openshift-default-7c4b5ff8d6-g2g47\" (UID: \"e9fde19a-da4a-421b-9c95-607e173091d0\") " pod="openshift-ingress/e2e-ait-d198c699-openshift-default-7c4b5ff8d6-g2g47"
Jul 24 19:09:50.197362 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:09:50.197298    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e9fde19a-da4a-421b-9c95-607e173091d0-credential-socket\") pod \"e2e-ait-d198c699-openshift-default-7c4b5ff8d6-g2g47\" (UID: \"e9fde19a-da4a-421b-9c95-607e173091d0\") " pod="openshift-ingress/e2e-ait-d198c699-openshift-default-7c4b5ff8d6-g2g47"
Jul 24 19:09:50.197362 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:09:50.197351    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e9fde19a-da4a-421b-9c95-607e173091d0-credential-socket\") pod \"e2e-ait-d198c699-openshift-default-7c4b5ff8d6-g2g47\" (UID: \"e9fde19a-da4a-421b-9c95-607e173091d0\") " pod="openshift-ingress/e2e-ait-d198c699-openshift-default-7c4b5ff8d6-g2g47"
Jul 24 19:09:50.197519 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:09:50.197501    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e9fde19a-da4a-421b-9c95-607e173091d0-workload-certs\") pod \"e2e-ait-d198c699-openshift-default-7c4b5ff8d6-g2g47\" (UID: \"e9fde19a-da4a-421b-9c95-607e173091d0\") " pod="openshift-ingress/e2e-ait-d198c699-openshift-default-7c4b5ff8d6-g2g47"
Jul 24 19:09:50.197599 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:09:50.197535    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e9fde19a-da4a-421b-9c95-607e173091d0-istio-token\") pod \"e2e-ait-d198c699-openshift-default-7c4b5ff8d6-g2g47\" (UID: \"e9fde19a-da4a-421b-9c95-607e173091d0\") " pod="openshift-ingress/e2e-ait-d198c699-openshift-default-7c4b5ff8d6-g2g47"
Jul 24 19:09:50.197710 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:09:50.197688    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e9fde19a-da4a-421b-9c95-607e173091d0-workload-certs\") pod \"e2e-ait-d198c699-openshift-default-7c4b5ff8d6-g2g47\" (UID: \"e9fde19a-da4a-421b-9c95-607e173091d0\") " pod="openshift-ingress/e2e-ait-d198c699-openshift-default-7c4b5ff8d6-g2g47"
Jul 24 19:09:50.197840 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:09:50.197823    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e9fde19a-da4a-421b-9c95-607e173091d0-workload-socket\") pod \"e2e-ait-d198c699-openshift-default-7c4b5ff8d6-g2g47\" (UID: \"e9fde19a-da4a-421b-9c95-607e173091d0\") " pod="openshift-ingress/e2e-ait-d198c699-openshift-default-7c4b5ff8d6-g2g47"
Jul 24 19:09:50.197925 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:09:50.197854    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e9fde19a-da4a-421b-9c95-607e173091d0-istio-envoy\") pod \"e2e-ait-d198c699-openshift-default-7c4b5ff8d6-g2g47\" (UID: \"e9fde19a-da4a-421b-9c95-607e173091d0\") " pod="openshift-ingress/e2e-ait-d198c699-openshift-default-7c4b5ff8d6-g2g47"
Jul 24 19:09:50.198364 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:09:50.198339    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e9fde19a-da4a-421b-9c95-607e173091d0-workload-socket\") pod \"e2e-ait-d198c699-openshift-default-7c4b5ff8d6-g2g47\" (UID: \"e9fde19a-da4a-421b-9c95-607e173091d0\") " pod="openshift-ingress/e2e-ait-d198c699-openshift-default-7c4b5ff8d6-g2g47"
Jul 24 19:09:50.198488 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:09:50.198394    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e9fde19a-da4a-421b-9c95-607e173091d0-istiod-ca-cert\") pod \"e2e-ait-d198c699-openshift-default-7c4b5ff8d6-g2g47\" (UID: \"e9fde19a-da4a-421b-9c95-607e173091d0\") " pod="openshift-ingress/e2e-ait-d198c699-openshift-default-7c4b5ff8d6-g2g47"
Jul 24 19:09:50.200458 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:09:50.200359    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e9fde19a-da4a-421b-9c95-607e173091d0-istio-podinfo\") pod \"e2e-ait-d198c699-openshift-default-7c4b5ff8d6-g2g47\" (UID: \"e9fde19a-da4a-421b-9c95-607e173091d0\") " pod="openshift-ingress/e2e-ait-d198c699-openshift-default-7c4b5ff8d6-g2g47"
Jul 24 19:09:50.200982 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:09:50.200950    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e9fde19a-da4a-421b-9c95-607e173091d0-istio-envoy\") pod \"e2e-ait-d198c699-openshift-default-7c4b5ff8d6-g2g47\" (UID: \"e9fde19a-da4a-421b-9c95-607e173091d0\") " pod="openshift-ingress/e2e-ait-d198c699-openshift-default-7c4b5ff8d6-g2g47"
Jul 24 19:09:50.206263 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:09:50.206239    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6jcnr\" (UniqueName: \"kubernetes.io/projected/e9fde19a-da4a-421b-9c95-607e173091d0-kube-api-access-6jcnr\") pod \"e2e-ait-d198c699-openshift-default-7c4b5ff8d6-g2g47\" (UID: \"e9fde19a-da4a-421b-9c95-607e173091d0\") " pod="openshift-ingress/e2e-ait-d198c699-openshift-default-7c4b5ff8d6-g2g47"
Jul 24 19:09:50.206476 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:09:50.206454    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e9fde19a-da4a-421b-9c95-607e173091d0-istio-token\") pod \"e2e-ait-d198c699-openshift-default-7c4b5ff8d6-g2g47\" (UID: \"e9fde19a-da4a-421b-9c95-607e173091d0\") " pod="openshift-ingress/e2e-ait-d198c699-openshift-default-7c4b5ff8d6-g2g47"
Jul 24 19:09:50.332916 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:09:50.332815    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-d198c699-openshift-default-7c4b5ff8d6-g2g47"
Jul 24 19:09:50.474607 ip-10-0-141-146 kubenswrapper[2580]: W0724 19:09:50.474578    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9fde19a_da4a_421b_9c95_607e173091d0.slice/crio-6378dc1571a3e8639724dbc7403cf87a28f4ac56cc5be7f2090e69fc199874cd WatchSource:0}: Error finding container 6378dc1571a3e8639724dbc7403cf87a28f4ac56cc5be7f2090e69fc199874cd: Status 404 returned error can't find the container with id 6378dc1571a3e8639724dbc7403cf87a28f4ac56cc5be7f2090e69fc199874cd
Jul 24 19:09:50.477067 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:09:50.477031    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 24 19:09:50.477206 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:09:50.477151    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 24 19:09:50.477206 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:09:50.477196    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 24 19:09:50.481180 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:09:50.479463    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-d198c699-openshift-default-7c4b5ff8d6-g2g47"]
Jul 24 19:09:50.615253 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:09:50.615148    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-d198c699-openshift-default-7c4b5ff8d6-g2g47" event={"ID":"e9fde19a-da4a-421b-9c95-607e173091d0","Type":"ContainerStarted","Data":"a0557c1efd147f9549971e5cb1757482ec2c3542910b3b607056897d420194e3"}
Jul 24 19:09:50.615253 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:09:50.615221    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-d198c699-openshift-default-7c4b5ff8d6-g2g47" event={"ID":"e9fde19a-da4a-421b-9c95-607e173091d0","Type":"ContainerStarted","Data":"6378dc1571a3e8639724dbc7403cf87a28f4ac56cc5be7f2090e69fc199874cd"}
Jul 24 19:09:50.636771 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:09:50.636707    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-d198c699-openshift-default-7c4b5ff8d6-g2g47" podStartSLOduration=1.63668342 podStartE2EDuration="1.63668342s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 19:09:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:09:50.634380549 +0000 UTC m=+1545.843752630" watchObservedRunningTime="2026-07-24 19:09:50.63668342 +0000 UTC m=+1545.846055464"
Jul 24 19:09:51.333178 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:09:51.333142    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-d198c699-openshift-default-7c4b5ff8d6-g2g47"
Jul 24 19:09:51.337854 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:09:51.337832    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-d198c699-openshift-default-7c4b5ff8d6-g2g47"
Jul 24 19:09:51.621456 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:09:51.621374    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-d198c699-openshift-default-7c4b5ff8d6-g2g47"
Jul 24 19:09:51.622468 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:09:51.622448    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-d198c699-openshift-default-7c4b5ff8d6-g2g47"
Jul 24 19:09:51.973154 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:09:51.973088    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:09:52.072593 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:09:52.072553    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:09:52.304903 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:09:52.304785    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:09:52.476814 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:09:52.476774    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:09:52.811938 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:09:52.811905    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:09:52.904707 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:09:52.904672    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:10:05.688598 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:10:05.688565    2580 generic.go:356] "Generic (PLEG): container finished" podID="e9fde19a-da4a-421b-9c95-607e173091d0" containerID="a0557c1efd147f9549971e5cb1757482ec2c3542910b3b607056897d420194e3" exitCode=0
Jul 24 19:10:05.689111 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:10:05.688642    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-d198c699-openshift-default-7c4b5ff8d6-g2g47" event={"ID":"e9fde19a-da4a-421b-9c95-607e173091d0","Type":"ContainerDied","Data":"a0557c1efd147f9549971e5cb1757482ec2c3542910b3b607056897d420194e3"}
Jul 24 19:10:05.689211 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:10:05.689192    2580 scope.go:117] "RemoveContainer" containerID="a0557c1efd147f9549971e5cb1757482ec2c3542910b3b607056897d420194e3"
Jul 24 19:10:05.690250 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:10:05.690223    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 24 19:10:05.690355 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:10:05.690287    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 24 19:10:05.690355 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:10:05.690328    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 24 19:10:06.622009 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:10:06.621966    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-d198c699-openshift-default-7c4b5ff8d6-g2g47"
Jul 24 19:10:06.695717 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:10:06.695676    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-d198c699-openshift-default-7c4b5ff8d6-g2g47" event={"ID":"e9fde19a-da4a-421b-9c95-607e173091d0","Type":"ContainerStarted","Data":"08f390439db97d0eb11c414a5e8bffb9b51062206259c5297a8dfee5c6e01dd4"}
Jul 24 19:10:07.333802 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:10:07.333759    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-d198c699-openshift-default-7c4b5ff8d6-g2g47"
Jul 24 19:10:07.335002 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:10:07.334968    2580 patch_prober.go:28] interesting pod/e2e-ait-d198c699-openshift-default-7c4b5ff8d6-g2g47 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" start-of-body=
Jul 24 19:10:07.335182 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:10:07.335019    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-d198c699-openshift-default-7c4b5ff8d6-g2g47" podUID="e9fde19a-da4a-421b-9c95-607e173091d0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused"
Jul 24 19:10:08.333471 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:10:08.333429    2580 patch_prober.go:28] interesting pod/e2e-ait-d198c699-openshift-default-7c4b5ff8d6-g2g47 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" start-of-body=
Jul 24 19:10:08.333884 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:10:08.333489    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-d198c699-openshift-default-7c4b5ff8d6-g2g47" podUID="e9fde19a-da4a-421b-9c95-607e173091d0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused"
Jul 24 19:10:09.333890 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:10:09.333852    2580 patch_prober.go:28] interesting pod/e2e-ait-d198c699-openshift-default-7c4b5ff8d6-g2g47 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" start-of-body=
Jul 24 19:10:09.334318 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:10:09.333913    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-d198c699-openshift-default-7c4b5ff8d6-g2g47" podUID="e9fde19a-da4a-421b-9c95-607e173091d0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused"
Jul 24 19:10:10.333251 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:10:10.333201    2580 patch_prober.go:28] interesting pod/e2e-ait-d198c699-openshift-default-7c4b5ff8d6-g2g47 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" start-of-body=
Jul 24 19:10:10.333473 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:10:10.333267    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-d198c699-openshift-default-7c4b5ff8d6-g2g47" podUID="e9fde19a-da4a-421b-9c95-607e173091d0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused"
Jul 24 19:10:11.337227 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:10:11.337196    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-d198c699-openshift-default-7c4b5ff8d6-g2g47"
Jul 24 19:10:11.337602 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:10:11.337441    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-d198c699-openshift-default-7c4b5ff8d6-g2g47"
Jul 24 19:10:11.338109 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:10:11.338093    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-d198c699-openshift-default-7c4b5ff8d6-g2g47"
Jul 24 19:10:28.137697 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:10:28.137651    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:10:28.238365 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:10:28.238331    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:10:28.339646 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:10:28.339570    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:10:32.597976 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:10:32.597938    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:10:32.727218 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:10:32.727176    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-d198c699-openshift-default-7c4b5ff8d6-g2g47"]
Jul 24 19:10:32.727453 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:10:32.727409    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-d198c699-openshift-default-7c4b5ff8d6-g2g47" podUID="e9fde19a-da4a-421b-9c95-607e173091d0" containerName="istio-proxy" containerID="cri-o://08f390439db97d0eb11c414a5e8bffb9b51062206259c5297a8dfee5c6e01dd4" gracePeriod=30
Jul 24 19:10:32.751310 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:10:32.751276    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:10:32.978039 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:10:32.977997    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:10:33.228802 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:10:33.228714    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:10:33.349904 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:10:33.349860    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:10:33.444555 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:10:33.444519    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:10:33.742151 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:10:33.742104    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:10:34.111040 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:10:34.110946    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:10:37.869109 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:10:37.869068    2580 generic.go:356] "Generic (PLEG): container finished" podID="e9fde19a-da4a-421b-9c95-607e173091d0" containerID="08f390439db97d0eb11c414a5e8bffb9b51062206259c5297a8dfee5c6e01dd4" exitCode=0
Jul 24 19:10:37.869635 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:10:37.869148    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-d198c699-openshift-default-7c4b5ff8d6-g2g47" event={"ID":"e9fde19a-da4a-421b-9c95-607e173091d0","Type":"ContainerDied","Data":"08f390439db97d0eb11c414a5e8bffb9b51062206259c5297a8dfee5c6e01dd4"}
Jul 24 19:10:37.869635 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:10:37.869211    2580 scope.go:117] "RemoveContainer" containerID="a0557c1efd147f9549971e5cb1757482ec2c3542910b3b607056897d420194e3"
Jul 24 19:10:37.976913 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:10:37.976882    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-d198c699-openshift-default-7c4b5ff8d6-g2g47"
Jul 24 19:10:38.080354 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:10:38.080274    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e9fde19a-da4a-421b-9c95-607e173091d0-istio-token\") pod \"e9fde19a-da4a-421b-9c95-607e173091d0\" (UID: \"e9fde19a-da4a-421b-9c95-607e173091d0\") "
Jul 24 19:10:38.080354 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:10:38.080315    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e9fde19a-da4a-421b-9c95-607e173091d0-istiod-ca-cert\") pod \"e9fde19a-da4a-421b-9c95-607e173091d0\" (UID: \"e9fde19a-da4a-421b-9c95-607e173091d0\") "
Jul 24 19:10:38.080354 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:10:38.080353    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e9fde19a-da4a-421b-9c95-607e173091d0-istio-envoy\") pod \"e9fde19a-da4a-421b-9c95-607e173091d0\" (UID: \"e9fde19a-da4a-421b-9c95-607e173091d0\") "
Jul 24 19:10:38.080642 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:10:38.080370    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e9fde19a-da4a-421b-9c95-607e173091d0-istio-podinfo\") pod \"e9fde19a-da4a-421b-9c95-607e173091d0\" (UID: \"e9fde19a-da4a-421b-9c95-607e173091d0\") "
Jul 24 19:10:38.080642 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:10:38.080404    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e9fde19a-da4a-421b-9c95-607e173091d0-credential-socket\") pod \"e9fde19a-da4a-421b-9c95-607e173091d0\" (UID: \"e9fde19a-da4a-421b-9c95-607e173091d0\") "
Jul 24 19:10:38.080642 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:10:38.080610    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e9fde19a-da4a-421b-9c95-607e173091d0-workload-socket\") pod \"e9fde19a-da4a-421b-9c95-607e173091d0\" (UID: \"e9fde19a-da4a-421b-9c95-607e173091d0\") "
Jul 24 19:10:38.080807 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:10:38.080665    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e9fde19a-da4a-421b-9c95-607e173091d0-istio-data\") pod \"e9fde19a-da4a-421b-9c95-607e173091d0\" (UID: \"e9fde19a-da4a-421b-9c95-607e173091d0\") "
Jul 24 19:10:38.080807 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:10:38.080712    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e9fde19a-da4a-421b-9c95-607e173091d0-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e9fde19a-da4a-421b-9c95-607e173091d0" (UID: "e9fde19a-da4a-421b-9c95-607e173091d0"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:10:38.080807 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:10:38.080716    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e9fde19a-da4a-421b-9c95-607e173091d0-workload-certs\") pod \"e9fde19a-da4a-421b-9c95-607e173091d0\" (UID: \"e9fde19a-da4a-421b-9c95-607e173091d0\") "
Jul 24 19:10:38.080807 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:10:38.080767    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6jcnr\" (UniqueName: \"kubernetes.io/projected/e9fde19a-da4a-421b-9c95-607e173091d0-kube-api-access-6jcnr\") pod \"e9fde19a-da4a-421b-9c95-607e173091d0\" (UID: \"e9fde19a-da4a-421b-9c95-607e173091d0\") "
Jul 24 19:10:38.081001 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:10:38.080800    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e9fde19a-da4a-421b-9c95-607e173091d0-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e9fde19a-da4a-421b-9c95-607e173091d0" (UID: "e9fde19a-da4a-421b-9c95-607e173091d0"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 19:10:38.081001 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:10:38.080972    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e9fde19a-da4a-421b-9c95-607e173091d0-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e9fde19a-da4a-421b-9c95-607e173091d0" (UID: "e9fde19a-da4a-421b-9c95-607e173091d0"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:10:38.081407 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:10:38.081382    2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e9fde19a-da4a-421b-9c95-607e173091d0-istiod-ca-cert\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 24 19:10:38.081407 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:10:38.081409    2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e9fde19a-da4a-421b-9c95-607e173091d0-credential-socket\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 24 19:10:38.081589 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:10:38.081423    2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e9fde19a-da4a-421b-9c95-607e173091d0-workload-certs\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 24 19:10:38.081897 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:10:38.081863    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e9fde19a-da4a-421b-9c95-607e173091d0-istio-data" (OuterVolumeSpecName: "istio-data") pod "e9fde19a-da4a-421b-9c95-607e173091d0" (UID: "e9fde19a-da4a-421b-9c95-607e173091d0"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:10:38.082160 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:10:38.082117    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e9fde19a-da4a-421b-9c95-607e173091d0-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e9fde19a-da4a-421b-9c95-607e173091d0" (UID: "e9fde19a-da4a-421b-9c95-607e173091d0"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:10:38.082964 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:10:38.082938    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e9fde19a-da4a-421b-9c95-607e173091d0-istio-token" (OuterVolumeSpecName: "istio-token") pod "e9fde19a-da4a-421b-9c95-607e173091d0" (UID: "e9fde19a-da4a-421b-9c95-607e173091d0"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 19:10:38.083054 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:10:38.082992    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e9fde19a-da4a-421b-9c95-607e173091d0-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e9fde19a-da4a-421b-9c95-607e173091d0" (UID: "e9fde19a-da4a-421b-9c95-607e173091d0"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 24 19:10:38.083213 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:10:38.083195    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e9fde19a-da4a-421b-9c95-607e173091d0-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e9fde19a-da4a-421b-9c95-607e173091d0" (UID: "e9fde19a-da4a-421b-9c95-607e173091d0"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:10:38.083393 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:10:38.083370    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e9fde19a-da4a-421b-9c95-607e173091d0-kube-api-access-6jcnr" (OuterVolumeSpecName: "kube-api-access-6jcnr") pod "e9fde19a-da4a-421b-9c95-607e173091d0" (UID: "e9fde19a-da4a-421b-9c95-607e173091d0"). InnerVolumeSpecName "kube-api-access-6jcnr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 19:10:38.182502 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:10:38.182466    2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e9fde19a-da4a-421b-9c95-607e173091d0-workload-socket\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 24 19:10:38.182502 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:10:38.182496    2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e9fde19a-da4a-421b-9c95-607e173091d0-istio-data\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 24 19:10:38.182502 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:10:38.182505    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6jcnr\" (UniqueName: \"kubernetes.io/projected/e9fde19a-da4a-421b-9c95-607e173091d0-kube-api-access-6jcnr\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 24 19:10:38.182502 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:10:38.182514    2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e9fde19a-da4a-421b-9c95-607e173091d0-istio-token\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 24 19:10:38.182763 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:10:38.182522    2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e9fde19a-da4a-421b-9c95-607e173091d0-istio-envoy\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 24 19:10:38.182763 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:10:38.182530    2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e9fde19a-da4a-421b-9c95-607e173091d0-istio-podinfo\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 24 19:10:38.876179 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:10:38.876150    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-d198c699-openshift-default-7c4b5ff8d6-g2g47"
Jul 24 19:10:38.876179 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:10:38.876161    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-d198c699-openshift-default-7c4b5ff8d6-g2g47" event={"ID":"e9fde19a-da4a-421b-9c95-607e173091d0","Type":"ContainerDied","Data":"6378dc1571a3e8639724dbc7403cf87a28f4ac56cc5be7f2090e69fc199874cd"}
Jul 24 19:10:38.876691 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:10:38.876217    2580 scope.go:117] "RemoveContainer" containerID="08f390439db97d0eb11c414a5e8bffb9b51062206259c5297a8dfee5c6e01dd4"
Jul 24 19:10:38.898011 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:10:38.897984    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-d198c699-openshift-default-7c4b5ff8d6-g2g47"]
Jul 24 19:10:38.901344 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:10:38.901322    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-d198c699-openshift-default-7c4b5ff8d6-g2g47"]
Jul 24 19:10:39.051144 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:10:39.051078    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:10:39.162299 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:10:39.162209    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:10:39.241622 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:10:39.241587    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e9fde19a-da4a-421b-9c95-607e173091d0" path="/var/lib/kubelet/pods/e9fde19a-da4a-421b-9c95-607e173091d0/volumes"
Jul 24 19:10:39.376384 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:10:39.376346    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:10:39.687434 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:10:39.687393    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:10:39.782664 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:10:39.782629    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:11:14.605938 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:11:14.605900    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:11:14.707330 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:11:14.707296    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:11:14.766636 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:11:14.766596    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:11:19.108713 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:11:19.108676    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:11:19.274938 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:11:19.274884    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:11:19.518090 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:11:19.518052    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:11:19.757186 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:11:19.757153    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:11:20.065150 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:11:20.065103    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:11:20.413218 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:11:20.413109    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:11:22.153389 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:11:22.153350    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:11:22.248949 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:11:22.248905    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:11:22.320669 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:11:22.320635    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:11:22.836236 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:11:22.836204    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:11:22.930053 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:11:22.930015    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:11:58.565034 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:11:58.564998    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:11:58.644576 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:11:58.644538    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:11:58.745202 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:11:58.745159    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:12:03.032970 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:12:03.032933    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:12:04.236077 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:12:04.236045    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:12:04.476225 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:12:04.476184    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:12:04.690653 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:12:04.690628    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:12:04.958802 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:12:04.958720    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-73fbe69e-openshift-default-7b7b7f4568-5n8d2"]
Jul 24 19:12:04.959293 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:12:04.959277    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e9fde19a-da4a-421b-9c95-607e173091d0" containerName="istio-proxy"
Jul 24 19:12:04.959348 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:12:04.959296    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="e9fde19a-da4a-421b-9c95-607e173091d0" containerName="istio-proxy"
Jul 24 19:12:04.959420 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:12:04.959408    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="e9fde19a-da4a-421b-9c95-607e173091d0" containerName="istio-proxy"
Jul 24 19:12:04.962757 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:12:04.962738    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-73fbe69e-openshift-default-7b7b7f4568-5n8d2"
Jul 24 19:12:04.965745 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:12:04.965724    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-73fbe69e-openshift-default-dockercfg-7s9fc\""
Jul 24 19:12:04.974794 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:12:04.974772    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-73fbe69e-openshift-default-7b7b7f4568-5n8d2"]
Jul 24 19:12:04.997236 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:12:04.997206    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:12:05.107845 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:12:05.107807    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5b8c664a-462f-4da7-9e77-c51b6155173f-workload-certs\") pod \"e2e-derive-73fbe69e-openshift-default-7b7b7f4568-5n8d2\" (UID: \"5b8c664a-462f-4da7-9e77-c51b6155173f\") " pod="openshift-ingress/e2e-derive-73fbe69e-openshift-default-7b7b7f4568-5n8d2"
Jul 24 19:12:05.107845 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:12:05.107844    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mjvm6\" (UniqueName: \"kubernetes.io/projected/5b8c664a-462f-4da7-9e77-c51b6155173f-kube-api-access-mjvm6\") pod \"e2e-derive-73fbe69e-openshift-default-7b7b7f4568-5n8d2\" (UID: \"5b8c664a-462f-4da7-9e77-c51b6155173f\") " pod="openshift-ingress/e2e-derive-73fbe69e-openshift-default-7b7b7f4568-5n8d2"
Jul 24 19:12:05.108071 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:12:05.107869    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5b8c664a-462f-4da7-9e77-c51b6155173f-istio-data\") pod \"e2e-derive-73fbe69e-openshift-default-7b7b7f4568-5n8d2\" (UID: \"5b8c664a-462f-4da7-9e77-c51b6155173f\") " pod="openshift-ingress/e2e-derive-73fbe69e-openshift-default-7b7b7f4568-5n8d2"
Jul 24 19:12:05.108071 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:12:05.107940    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b8c664a-462f-4da7-9e77-c51b6155173f-workload-socket\") pod \"e2e-derive-73fbe69e-openshift-default-7b7b7f4568-5n8d2\" (UID: \"5b8c664a-462f-4da7-9e77-c51b6155173f\") " pod="openshift-ingress/e2e-derive-73fbe69e-openshift-default-7b7b7f4568-5n8d2"
Jul 24 19:12:05.108071 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:12:05.108004    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b8c664a-462f-4da7-9e77-c51b6155173f-credential-socket\") pod \"e2e-derive-73fbe69e-openshift-default-7b7b7f4568-5n8d2\" (UID: \"5b8c664a-462f-4da7-9e77-c51b6155173f\") " pod="openshift-ingress/e2e-derive-73fbe69e-openshift-default-7b7b7f4568-5n8d2"
Jul 24 19:12:05.108071 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:12:05.108029    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5b8c664a-462f-4da7-9e77-c51b6155173f-istio-podinfo\") pod \"e2e-derive-73fbe69e-openshift-default-7b7b7f4568-5n8d2\" (UID: \"5b8c664a-462f-4da7-9e77-c51b6155173f\") " pod="openshift-ingress/e2e-derive-73fbe69e-openshift-default-7b7b7f4568-5n8d2"
Jul 24 19:12:05.108279 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:12:05.108067    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5b8c664a-462f-4da7-9e77-c51b6155173f-istio-envoy\") pod \"e2e-derive-73fbe69e-openshift-default-7b7b7f4568-5n8d2\" (UID: \"5b8c664a-462f-4da7-9e77-c51b6155173f\") " pod="openshift-ingress/e2e-derive-73fbe69e-openshift-default-7b7b7f4568-5n8d2"
Jul 24 19:12:05.108279 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:12:05.108165    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5b8c664a-462f-4da7-9e77-c51b6155173f-istio-token\") pod \"e2e-derive-73fbe69e-openshift-default-7b7b7f4568-5n8d2\" (UID: \"5b8c664a-462f-4da7-9e77-c51b6155173f\") " pod="openshift-ingress/e2e-derive-73fbe69e-openshift-default-7b7b7f4568-5n8d2"
Jul 24 19:12:05.108279 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:12:05.108195    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5b8c664a-462f-4da7-9e77-c51b6155173f-istiod-ca-cert\") pod \"e2e-derive-73fbe69e-openshift-default-7b7b7f4568-5n8d2\" (UID: \"5b8c664a-462f-4da7-9e77-c51b6155173f\") " pod="openshift-ingress/e2e-derive-73fbe69e-openshift-default-7b7b7f4568-5n8d2"
Jul 24 19:12:05.209402 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:12:05.209313    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5b8c664a-462f-4da7-9e77-c51b6155173f-workload-certs\") pod \"e2e-derive-73fbe69e-openshift-default-7b7b7f4568-5n8d2\" (UID: \"5b8c664a-462f-4da7-9e77-c51b6155173f\") " pod="openshift-ingress/e2e-derive-73fbe69e-openshift-default-7b7b7f4568-5n8d2"
Jul 24 19:12:05.209402 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:12:05.209348    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mjvm6\" (UniqueName: \"kubernetes.io/projected/5b8c664a-462f-4da7-9e77-c51b6155173f-kube-api-access-mjvm6\") pod \"e2e-derive-73fbe69e-openshift-default-7b7b7f4568-5n8d2\" (UID: \"5b8c664a-462f-4da7-9e77-c51b6155173f\") " pod="openshift-ingress/e2e-derive-73fbe69e-openshift-default-7b7b7f4568-5n8d2"
Jul 24 19:12:05.209402 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:12:05.209371    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5b8c664a-462f-4da7-9e77-c51b6155173f-istio-data\") pod \"e2e-derive-73fbe69e-openshift-default-7b7b7f4568-5n8d2\" (UID: \"5b8c664a-462f-4da7-9e77-c51b6155173f\") " pod="openshift-ingress/e2e-derive-73fbe69e-openshift-default-7b7b7f4568-5n8d2"
Jul 24 19:12:05.209402 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:12:05.209393    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b8c664a-462f-4da7-9e77-c51b6155173f-workload-socket\") pod \"e2e-derive-73fbe69e-openshift-default-7b7b7f4568-5n8d2\" (UID: \"5b8c664a-462f-4da7-9e77-c51b6155173f\") " pod="openshift-ingress/e2e-derive-73fbe69e-openshift-default-7b7b7f4568-5n8d2"
Jul 24 19:12:05.209788 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:12:05.209420    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b8c664a-462f-4da7-9e77-c51b6155173f-credential-socket\") pod \"e2e-derive-73fbe69e-openshift-default-7b7b7f4568-5n8d2\" (UID: \"5b8c664a-462f-4da7-9e77-c51b6155173f\") " pod="openshift-ingress/e2e-derive-73fbe69e-openshift-default-7b7b7f4568-5n8d2"
Jul 24 19:12:05.209788 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:12:05.209445    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5b8c664a-462f-4da7-9e77-c51b6155173f-istio-podinfo\") pod \"e2e-derive-73fbe69e-openshift-default-7b7b7f4568-5n8d2\" (UID: \"5b8c664a-462f-4da7-9e77-c51b6155173f\") " pod="openshift-ingress/e2e-derive-73fbe69e-openshift-default-7b7b7f4568-5n8d2"
Jul 24 19:12:05.209788 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:12:05.209472    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5b8c664a-462f-4da7-9e77-c51b6155173f-istio-envoy\") pod \"e2e-derive-73fbe69e-openshift-default-7b7b7f4568-5n8d2\" (UID: \"5b8c664a-462f-4da7-9e77-c51b6155173f\") " pod="openshift-ingress/e2e-derive-73fbe69e-openshift-default-7b7b7f4568-5n8d2"
Jul 24 19:12:05.209788 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:12:05.209513    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5b8c664a-462f-4da7-9e77-c51b6155173f-istio-token\") pod \"e2e-derive-73fbe69e-openshift-default-7b7b7f4568-5n8d2\" (UID: \"5b8c664a-462f-4da7-9e77-c51b6155173f\") " pod="openshift-ingress/e2e-derive-73fbe69e-openshift-default-7b7b7f4568-5n8d2"
Jul 24 19:12:05.209788 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:12:05.209547    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5b8c664a-462f-4da7-9e77-c51b6155173f-istiod-ca-cert\") pod \"e2e-derive-73fbe69e-openshift-default-7b7b7f4568-5n8d2\" (UID: \"5b8c664a-462f-4da7-9e77-c51b6155173f\") " pod="openshift-ingress/e2e-derive-73fbe69e-openshift-default-7b7b7f4568-5n8d2"
Jul 24 19:12:05.209788 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:12:05.209748    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5b8c664a-462f-4da7-9e77-c51b6155173f-istio-data\") pod \"e2e-derive-73fbe69e-openshift-default-7b7b7f4568-5n8d2\" (UID: \"5b8c664a-462f-4da7-9e77-c51b6155173f\") " pod="openshift-ingress/e2e-derive-73fbe69e-openshift-default-7b7b7f4568-5n8d2"
Jul 24 19:12:05.210033 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:12:05.209817    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5b8c664a-462f-4da7-9e77-c51b6155173f-workload-certs\") pod \"e2e-derive-73fbe69e-openshift-default-7b7b7f4568-5n8d2\" (UID: \"5b8c664a-462f-4da7-9e77-c51b6155173f\") " pod="openshift-ingress/e2e-derive-73fbe69e-openshift-default-7b7b7f4568-5n8d2"
Jul 24 19:12:05.210033 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:12:05.209878    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b8c664a-462f-4da7-9e77-c51b6155173f-credential-socket\") pod \"e2e-derive-73fbe69e-openshift-default-7b7b7f4568-5n8d2\" (UID: \"5b8c664a-462f-4da7-9e77-c51b6155173f\") " pod="openshift-ingress/e2e-derive-73fbe69e-openshift-default-7b7b7f4568-5n8d2"
Jul 24 19:12:05.210218 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:12:05.210193    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b8c664a-462f-4da7-9e77-c51b6155173f-workload-socket\") pod \"e2e-derive-73fbe69e-openshift-default-7b7b7f4568-5n8d2\" (UID: \"5b8c664a-462f-4da7-9e77-c51b6155173f\") " pod="openshift-ingress/e2e-derive-73fbe69e-openshift-default-7b7b7f4568-5n8d2"
Jul 24 19:12:05.210293 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:12:05.210260    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5b8c664a-462f-4da7-9e77-c51b6155173f-istiod-ca-cert\") pod \"e2e-derive-73fbe69e-openshift-default-7b7b7f4568-5n8d2\" (UID: \"5b8c664a-462f-4da7-9e77-c51b6155173f\") " pod="openshift-ingress/e2e-derive-73fbe69e-openshift-default-7b7b7f4568-5n8d2"
Jul 24 19:12:05.211900 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:12:05.211876    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5b8c664a-462f-4da7-9e77-c51b6155173f-istio-envoy\") pod \"e2e-derive-73fbe69e-openshift-default-7b7b7f4568-5n8d2\" (UID: \"5b8c664a-462f-4da7-9e77-c51b6155173f\") " pod="openshift-ingress/e2e-derive-73fbe69e-openshift-default-7b7b7f4568-5n8d2"
Jul 24 19:12:05.212028 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:12:05.212010    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5b8c664a-462f-4da7-9e77-c51b6155173f-istio-podinfo\") pod \"e2e-derive-73fbe69e-openshift-default-7b7b7f4568-5n8d2\" (UID: \"5b8c664a-462f-4da7-9e77-c51b6155173f\") " pod="openshift-ingress/e2e-derive-73fbe69e-openshift-default-7b7b7f4568-5n8d2"
Jul 24 19:12:05.218359 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:12:05.218336    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mjvm6\" (UniqueName: \"kubernetes.io/projected/5b8c664a-462f-4da7-9e77-c51b6155173f-kube-api-access-mjvm6\") pod \"e2e-derive-73fbe69e-openshift-default-7b7b7f4568-5n8d2\" (UID: \"5b8c664a-462f-4da7-9e77-c51b6155173f\") " pod="openshift-ingress/e2e-derive-73fbe69e-openshift-default-7b7b7f4568-5n8d2"
Jul 24 19:12:05.218639 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:12:05.218618    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5b8c664a-462f-4da7-9e77-c51b6155173f-istio-token\") pod \"e2e-derive-73fbe69e-openshift-default-7b7b7f4568-5n8d2\" (UID: \"5b8c664a-462f-4da7-9e77-c51b6155173f\") " pod="openshift-ingress/e2e-derive-73fbe69e-openshift-default-7b7b7f4568-5n8d2"
Jul 24 19:12:05.277385 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:12:05.277352    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-73fbe69e-openshift-default-dockercfg-7s9fc\""
Jul 24 19:12:05.284868 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:12:05.284844    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-73fbe69e-openshift-default-7b7b7f4568-5n8d2"
Jul 24 19:12:05.431934 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:12:05.431908    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-73fbe69e-openshift-default-7b7b7f4568-5n8d2"]
Jul 24 19:12:05.434106 ip-10-0-141-146 kubenswrapper[2580]: W0724 19:12:05.434075    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b8c664a_462f_4da7_9e77_c51b6155173f.slice/crio-77d8d7c05f4313705df116929a6ed0f8c40fd8d1e2e8e3b5408551cd8d471734 WatchSource:0}: Error finding container 77d8d7c05f4313705df116929a6ed0f8c40fd8d1e2e8e3b5408551cd8d471734: Status 404 returned error can't find the container with id 77d8d7c05f4313705df116929a6ed0f8c40fd8d1e2e8e3b5408551cd8d471734
Jul 24 19:12:05.436335 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:12:05.436304    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 24 19:12:05.436423 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:12:05.436367    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 24 19:12:05.436423 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:12:05.436395    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 24 19:12:05.531749 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:12:05.531713    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:12:06.284447 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:12:06.284412    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-73fbe69e-openshift-default-7b7b7f4568-5n8d2" event={"ID":"5b8c664a-462f-4da7-9e77-c51b6155173f","Type":"ContainerStarted","Data":"c734086c01aa6db45a4846699b6f288480c7fa49994298d289da6763ee7d7e93"}
Jul 24 19:12:06.284911 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:12:06.284511    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-73fbe69e-openshift-default-7b7b7f4568-5n8d2" event={"ID":"5b8c664a-462f-4da7-9e77-c51b6155173f","Type":"ContainerStarted","Data":"77d8d7c05f4313705df116929a6ed0f8c40fd8d1e2e8e3b5408551cd8d471734"}
Jul 24 19:12:06.285089 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:12:06.285072    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-73fbe69e-openshift-default-7b7b7f4568-5n8d2"
Jul 24 19:12:06.290107 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:12:06.290086    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-73fbe69e-openshift-default-7b7b7f4568-5n8d2"
Jul 24 19:12:06.338307 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:12:06.338251    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-73fbe69e-openshift-default-7b7b7f4568-5n8d2" podStartSLOduration=2.3382249 podStartE2EDuration="2.3382249s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 19:12:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:12:06.33701078 +0000 UTC m=+1681.546382832" watchObservedRunningTime="2026-07-24 19:12:06.3382249 +0000 UTC m=+1681.547596941"
Jul 24 19:12:07.289063 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:12:07.289028    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-73fbe69e-openshift-default-7b7b7f4568-5n8d2"
Jul 24 19:12:07.289919 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:12:07.289902    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-73fbe69e-openshift-default-7b7b7f4568-5n8d2"
Jul 24 19:12:07.725729 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:12:07.725680    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:12:07.806648 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:12:07.806614    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:12:07.911440 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:12:07.911407    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:12:08.009534 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:12:08.009429    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:12:08.435789 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:12:08.435695    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:12:08.535524 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:12:08.535493    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:12:21.361391 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:12:21.361355    2580 generic.go:356] "Generic (PLEG): container finished" podID="5b8c664a-462f-4da7-9e77-c51b6155173f" containerID="c734086c01aa6db45a4846699b6f288480c7fa49994298d289da6763ee7d7e93" exitCode=0
Jul 24 19:12:21.361803 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:12:21.361428    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-73fbe69e-openshift-default-7b7b7f4568-5n8d2" event={"ID":"5b8c664a-462f-4da7-9e77-c51b6155173f","Type":"ContainerDied","Data":"c734086c01aa6db45a4846699b6f288480c7fa49994298d289da6763ee7d7e93"}
Jul 24 19:12:21.361803 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:12:21.361797    2580 scope.go:117] "RemoveContainer" containerID="c734086c01aa6db45a4846699b6f288480c7fa49994298d289da6763ee7d7e93"
Jul 24 19:12:21.362958 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:12:21.362933    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 24 19:12:21.363014 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:12:21.362999    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 24 19:12:21.363063 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:12:21.363030    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 24 19:12:22.289199 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:12:22.289161    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-73fbe69e-openshift-default-7b7b7f4568-5n8d2"
Jul 24 19:12:22.367438 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:12:22.367404    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-73fbe69e-openshift-default-7b7b7f4568-5n8d2" event={"ID":"5b8c664a-462f-4da7-9e77-c51b6155173f","Type":"ContainerStarted","Data":"ba4b48f0f3f3d5663c51a0e22f6049308e0f40e0c6f35f395188b77bf815e1cc"}
Jul 24 19:12:23.286101 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:12:23.286070    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-73fbe69e-openshift-default-7b7b7f4568-5n8d2"
Jul 24 19:12:23.287276 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:12:23.287251    2580 patch_prober.go:28] interesting pod/e2e-derive-73fbe69e-openshift-default-7b7b7f4568-5n8d2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body=
Jul 24 19:12:23.287403 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:12:23.287299    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-73fbe69e-openshift-default-7b7b7f4568-5n8d2" podUID="5b8c664a-462f-4da7-9e77-c51b6155173f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused"
Jul 24 19:12:24.285354 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:12:24.285314    2580 patch_prober.go:28] interesting pod/e2e-derive-73fbe69e-openshift-default-7b7b7f4568-5n8d2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body=
Jul 24 19:12:24.285732 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:12:24.285389    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-73fbe69e-openshift-default-7b7b7f4568-5n8d2" podUID="5b8c664a-462f-4da7-9e77-c51b6155173f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused"
Jul 24 19:12:25.285807 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:12:25.285771    2580 patch_prober.go:28] interesting pod/e2e-derive-73fbe69e-openshift-default-7b7b7f4568-5n8d2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body=
Jul 24 19:12:25.286205 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:12:25.285825    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-73fbe69e-openshift-default-7b7b7f4568-5n8d2" podUID="5b8c664a-462f-4da7-9e77-c51b6155173f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused"
Jul 24 19:12:26.285500 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:12:26.285461    2580 patch_prober.go:28] interesting pod/e2e-derive-73fbe69e-openshift-default-7b7b7f4568-5n8d2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body=
Jul 24 19:12:26.285684 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:12:26.285523    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-73fbe69e-openshift-default-7b7b7f4568-5n8d2" podUID="5b8c664a-462f-4da7-9e77-c51b6155173f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused"
Jul 24 19:12:27.289535 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:12:27.289500    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-73fbe69e-openshift-default-7b7b7f4568-5n8d2"
Jul 24 19:12:27.289915 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:12:27.289784    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-73fbe69e-openshift-default-7b7b7f4568-5n8d2"
Jul 24 19:12:27.290427 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:12:27.290407    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-73fbe69e-openshift-default-7b7b7f4568-5n8d2"
Jul 24 19:12:43.143413 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:12:43.143374    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:12:44.362215 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:12:44.362170    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:12:47.640205 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:12:47.640168    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:12:47.778911 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:12:47.778875    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-73fbe69e-openshift-default-7b7b7f4568-5n8d2"]
Jul 24 19:12:47.779216 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:12:47.779188    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-73fbe69e-openshift-default-7b7b7f4568-5n8d2" podUID="5b8c664a-462f-4da7-9e77-c51b6155173f" containerName="istio-proxy" containerID="cri-o://ba4b48f0f3f3d5663c51a0e22f6049308e0f40e0c6f35f395188b77bf815e1cc" gracePeriod=30
Jul 24 19:12:47.802129 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:12:47.802091    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:12:48.030450 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:12:48.030415    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:12:48.498489 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:12:48.498460    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:12:48.595010 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:12:48.594974    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:12:48.696638 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:12:48.696600    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:12:50.144945 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:12:50.144901    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:12:53.042546 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:12:53.042483    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-73fbe69e-openshift-default-7b7b7f4568-5n8d2"
Jul 24 19:12:53.193029 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:12:53.193000    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b8c664a-462f-4da7-9e77-c51b6155173f-workload-socket\") pod \"5b8c664a-462f-4da7-9e77-c51b6155173f\" (UID: \"5b8c664a-462f-4da7-9e77-c51b6155173f\") "
Jul 24 19:12:53.193248 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:12:53.193040    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5b8c664a-462f-4da7-9e77-c51b6155173f-istio-token\") pod \"5b8c664a-462f-4da7-9e77-c51b6155173f\" (UID: \"5b8c664a-462f-4da7-9e77-c51b6155173f\") "
Jul 24 19:12:53.193248 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:12:53.193065    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5b8c664a-462f-4da7-9e77-c51b6155173f-workload-certs\") pod \"5b8c664a-462f-4da7-9e77-c51b6155173f\" (UID: \"5b8c664a-462f-4da7-9e77-c51b6155173f\") "
Jul 24 19:12:53.193248 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:12:53.193081    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mjvm6\" (UniqueName: \"kubernetes.io/projected/5b8c664a-462f-4da7-9e77-c51b6155173f-kube-api-access-mjvm6\") pod \"5b8c664a-462f-4da7-9e77-c51b6155173f\" (UID: \"5b8c664a-462f-4da7-9e77-c51b6155173f\") "
Jul 24 19:12:53.193248 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:12:53.193109    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5b8c664a-462f-4da7-9e77-c51b6155173f-istio-envoy\") pod \"5b8c664a-462f-4da7-9e77-c51b6155173f\" (UID: \"5b8c664a-462f-4da7-9e77-c51b6155173f\") "
Jul 24 19:12:53.193248 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:12:53.193160    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5b8c664a-462f-4da7-9e77-c51b6155173f-istiod-ca-cert\") pod \"5b8c664a-462f-4da7-9e77-c51b6155173f\" (UID: \"5b8c664a-462f-4da7-9e77-c51b6155173f\") "
Jul 24 19:12:53.193248 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:12:53.193227    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b8c664a-462f-4da7-9e77-c51b6155173f-credential-socket\") pod \"5b8c664a-462f-4da7-9e77-c51b6155173f\" (UID: \"5b8c664a-462f-4da7-9e77-c51b6155173f\") "
Jul 24 19:12:53.193550 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:12:53.193276    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5b8c664a-462f-4da7-9e77-c51b6155173f-istio-data\") pod \"5b8c664a-462f-4da7-9e77-c51b6155173f\" (UID: \"5b8c664a-462f-4da7-9e77-c51b6155173f\") "
Jul 24 19:12:53.193550 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:12:53.193306    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5b8c664a-462f-4da7-9e77-c51b6155173f-istio-podinfo\") pod \"5b8c664a-462f-4da7-9e77-c51b6155173f\" (UID: \"5b8c664a-462f-4da7-9e77-c51b6155173f\") "
Jul 24 19:12:53.193550 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:12:53.193401    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b8c664a-462f-4da7-9e77-c51b6155173f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5b8c664a-462f-4da7-9e77-c51b6155173f" (UID: "5b8c664a-462f-4da7-9e77-c51b6155173f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:12:53.193550 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:12:53.193441    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b8c664a-462f-4da7-9e77-c51b6155173f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5b8c664a-462f-4da7-9e77-c51b6155173f" (UID: "5b8c664a-462f-4da7-9e77-c51b6155173f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:12:53.193760 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:12:53.193547    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b8c664a-462f-4da7-9e77-c51b6155173f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5b8c664a-462f-4da7-9e77-c51b6155173f" (UID: "5b8c664a-462f-4da7-9e77-c51b6155173f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:12:53.193760 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:12:53.193698    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5b8c664a-462f-4da7-9e77-c51b6155173f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5b8c664a-462f-4da7-9e77-c51b6155173f" (UID: "5b8c664a-462f-4da7-9e77-c51b6155173f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 19:12:53.193760 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:12:53.193713    2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b8c664a-462f-4da7-9e77-c51b6155173f-credential-socket\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 24 19:12:53.193760 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:12:53.193731    2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b8c664a-462f-4da7-9e77-c51b6155173f-workload-socket\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 24 19:12:53.193760 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:12:53.193747    2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5b8c664a-462f-4da7-9e77-c51b6155173f-workload-certs\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 24 19:12:53.194444 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:12:53.194417    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b8c664a-462f-4da7-9e77-c51b6155173f-istio-data" (OuterVolumeSpecName: "istio-data") pod "5b8c664a-462f-4da7-9e77-c51b6155173f" (UID: "5b8c664a-462f-4da7-9e77-c51b6155173f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:12:53.195642 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:12:53.195602    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5b8c664a-462f-4da7-9e77-c51b6155173f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5b8c664a-462f-4da7-9e77-c51b6155173f" (UID: "5b8c664a-462f-4da7-9e77-c51b6155173f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 24 19:12:53.195747 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:12:53.195656    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5b8c664a-462f-4da7-9e77-c51b6155173f-istio-token" (OuterVolumeSpecName: "istio-token") pod "5b8c664a-462f-4da7-9e77-c51b6155173f" (UID: "5b8c664a-462f-4da7-9e77-c51b6155173f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 19:12:53.195747 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:12:53.195674    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b8c664a-462f-4da7-9e77-c51b6155173f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5b8c664a-462f-4da7-9e77-c51b6155173f" (UID: "5b8c664a-462f-4da7-9e77-c51b6155173f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:12:53.195747 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:12:53.195720    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5b8c664a-462f-4da7-9e77-c51b6155173f-kube-api-access-mjvm6" (OuterVolumeSpecName: "kube-api-access-mjvm6") pod "5b8c664a-462f-4da7-9e77-c51b6155173f" (UID: "5b8c664a-462f-4da7-9e77-c51b6155173f"). InnerVolumeSpecName "kube-api-access-mjvm6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 19:12:53.294847 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:12:53.294752    2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5b8c664a-462f-4da7-9e77-c51b6155173f-istio-data\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 24 19:12:53.294847 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:12:53.294781    2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5b8c664a-462f-4da7-9e77-c51b6155173f-istio-podinfo\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 24 19:12:53.294847 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:12:53.294795    2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5b8c664a-462f-4da7-9e77-c51b6155173f-istio-token\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 24 19:12:53.294847 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:12:53.294804    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mjvm6\" (UniqueName: \"kubernetes.io/projected/5b8c664a-462f-4da7-9e77-c51b6155173f-kube-api-access-mjvm6\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 24 19:12:53.294847 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:12:53.294816    2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5b8c664a-462f-4da7-9e77-c51b6155173f-istio-envoy\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 24 19:12:53.294847 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:12:53.294827    2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5b8c664a-462f-4da7-9e77-c51b6155173f-istiod-ca-cert\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 24 19:12:53.517505 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:12:53.517472    2580 generic.go:356] "Generic (PLEG): container finished" podID="5b8c664a-462f-4da7-9e77-c51b6155173f" containerID="ba4b48f0f3f3d5663c51a0e22f6049308e0f40e0c6f35f395188b77bf815e1cc" exitCode=0
Jul 24 19:12:53.517704 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:12:53.517518    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-73fbe69e-openshift-default-7b7b7f4568-5n8d2"
Jul 24 19:12:53.517704 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:12:53.517565    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-73fbe69e-openshift-default-7b7b7f4568-5n8d2" event={"ID":"5b8c664a-462f-4da7-9e77-c51b6155173f","Type":"ContainerDied","Data":"ba4b48f0f3f3d5663c51a0e22f6049308e0f40e0c6f35f395188b77bf815e1cc"}
Jul 24 19:12:53.517704 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:12:53.517621    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-73fbe69e-openshift-default-7b7b7f4568-5n8d2" event={"ID":"5b8c664a-462f-4da7-9e77-c51b6155173f","Type":"ContainerDied","Data":"77d8d7c05f4313705df116929a6ed0f8c40fd8d1e2e8e3b5408551cd8d471734"}
Jul 24 19:12:53.517704 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:12:53.517644    2580 scope.go:117] "RemoveContainer" containerID="ba4b48f0f3f3d5663c51a0e22f6049308e0f40e0c6f35f395188b77bf815e1cc"
Jul 24 19:12:53.533081 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:12:53.533056    2580 scope.go:117] "RemoveContainer" containerID="c734086c01aa6db45a4846699b6f288480c7fa49994298d289da6763ee7d7e93"
Jul 24 19:12:53.538323 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:12:53.538297    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-73fbe69e-openshift-default-7b7b7f4568-5n8d2"]
Jul 24 19:12:53.542018 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:12:53.541995    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-73fbe69e-openshift-default-7b7b7f4568-5n8d2"]
Jul 24 19:12:53.543068 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:12:53.543054    2580 scope.go:117] "RemoveContainer" containerID="ba4b48f0f3f3d5663c51a0e22f6049308e0f40e0c6f35f395188b77bf815e1cc"
Jul 24 19:12:53.543429 ip-10-0-141-146 kubenswrapper[2580]: E0724 19:12:53.543411    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ba4b48f0f3f3d5663c51a0e22f6049308e0f40e0c6f35f395188b77bf815e1cc\": container with ID starting with ba4b48f0f3f3d5663c51a0e22f6049308e0f40e0c6f35f395188b77bf815e1cc not found: ID does not exist" containerID="ba4b48f0f3f3d5663c51a0e22f6049308e0f40e0c6f35f395188b77bf815e1cc"
Jul 24 19:12:53.543504 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:12:53.543437    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba4b48f0f3f3d5663c51a0e22f6049308e0f40e0c6f35f395188b77bf815e1cc"} err="failed to get container status \"ba4b48f0f3f3d5663c51a0e22f6049308e0f40e0c6f35f395188b77bf815e1cc\": rpc error: code = NotFound desc = could not find container \"ba4b48f0f3f3d5663c51a0e22f6049308e0f40e0c6f35f395188b77bf815e1cc\": container with ID starting with ba4b48f0f3f3d5663c51a0e22f6049308e0f40e0c6f35f395188b77bf815e1cc not found: ID does not exist"
Jul 24 19:12:53.543504 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:12:53.543455    2580 scope.go:117] "RemoveContainer" containerID="c734086c01aa6db45a4846699b6f288480c7fa49994298d289da6763ee7d7e93"
Jul 24 19:12:53.543730 ip-10-0-141-146 kubenswrapper[2580]: E0724 19:12:53.543711    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c734086c01aa6db45a4846699b6f288480c7fa49994298d289da6763ee7d7e93\": container with ID starting with c734086c01aa6db45a4846699b6f288480c7fa49994298d289da6763ee7d7e93 not found: ID does not exist" containerID="c734086c01aa6db45a4846699b6f288480c7fa49994298d289da6763ee7d7e93"
Jul 24 19:12:53.543789 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:12:53.543739    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c734086c01aa6db45a4846699b6f288480c7fa49994298d289da6763ee7d7e93"} err="failed to get container status \"c734086c01aa6db45a4846699b6f288480c7fa49994298d289da6763ee7d7e93\": rpc error: code = NotFound desc = could not find container \"c734086c01aa6db45a4846699b6f288480c7fa49994298d289da6763ee7d7e93\": container with ID starting with c734086c01aa6db45a4846699b6f288480c7fa49994298d289da6763ee7d7e93 not found: ID does not exist"
Jul 24 19:12:55.241784 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:12:55.241751    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5b8c664a-462f-4da7-9e77-c51b6155173f" path="/var/lib/kubelet/pods/5b8c664a-462f-4da7-9e77-c51b6155173f/volumes"
Jul 24 19:12:56.693065 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:12:56.693027    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:12:56.809768 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:12:56.809729    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:12:56.930782 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:12:56.930744    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:12:57.063618 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:12:57.063530    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:12:57.440516 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:12:57.440482    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:13:12.532244 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:13:12.532208    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:13:12.591332 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:13:12.591295    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:13:23.360889 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:13:23.360850    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:13:29.422062 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:13:29.422029    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:13:29.524853 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:13:29.524819    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:13:29.628287 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:13:29.628243    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:13:45.517499 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:13:45.517455    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:13:51.697875 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:13:51.697842    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:13:51.802548 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:13:51.802507    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:13:51.897992 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:13:51.897961    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:14:02.418094 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:14:02.417997    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:14:03.257074 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:14:03.257041    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:14:06.217464 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:14:06.217432    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qvzgb_dd21fc27-5a24-4f3a-a912-043af27a4342/ovn-acl-logging/0.log"
Jul 24 19:14:06.226502 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:14:06.226481    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qvzgb_dd21fc27-5a24-4f3a-a912-043af27a4342/ovn-acl-logging/0.log"
Jul 24 19:14:09.879952 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:14:09.879915    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:14:09.984022 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:14:09.983982    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:14:10.079268 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:14:10.079231    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:14:10.179255 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:14:10.179161    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:14:21.613687 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:14:21.613646    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:14:21.713448 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:14:21.713415    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:14:21.813908 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:14:21.813870    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:14:22.316549 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:14:22.316518    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:14:22.415334 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:14:22.415295    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:14:23.489091 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:14:23.489053    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:14:29.547199 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:14:29.547163    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:14:29.648610 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:14:29.648574    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:14:30.206331 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:14:30.206296    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:14:35.874989 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:14:35.874946    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:14:35.973309 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:14:35.973268    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:14:36.124071 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:14:36.124036    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:14:36.428705 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:14:36.428663    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:14:36.733970 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:14:36.733930    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:14:39.787854 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:14:39.787814    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:14:39.890920 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:14:39.890890    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:14:39.973782 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:14:39.973744    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:14:40.077824 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:14:40.077734    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:14:40.493546 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:14:40.493498    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:14:40.588678 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:14:40.588632    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:14:44.199789 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:14:44.199747    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:14:44.836222 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:14:44.836187    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:14:44.936722 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:14:44.936682    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:14:45.260794 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:14:45.260760    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:14:51.040059 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:14:51.040023    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:14:51.140284 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:14:51.140241    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:15:01.712115 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:15:01.712077    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:15:01.784482 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:15:01.784454    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:15:01.847459 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:15:01.847429    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:15:06.449269 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:15:06.449228    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:15:06.825343 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:15:06.825237    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:15:12.875745 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:15:12.875687    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:15:12.977353 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:15:12.977320    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:15:13.160894 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:15:13.160806    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:15:13.445583 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:15:13.445543    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:15:13.664551 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:15:13.664517    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:15:13.794830 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:15:13.794737    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:15:19.605588 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:15:19.605548    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:15:19.716712 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:15:19.716665    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:15:19.805673 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:15:19.805641    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:15:19.972975 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:15:19.972936    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:15:25.711573 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:15:25.711480    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:15:25.780665 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:15:25.780623    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:15:32.561609 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:15:32.561575    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:15:32.867958 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:15:32.867878    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:15:33.357336 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:15:33.357303    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:15:36.013798 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:15:36.013759    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:15:36.098744 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:15:36.098710    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:15:36.202142 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:15:36.202084    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:15:36.702429 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:15:36.702394    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:15:36.797616 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:15:36.797581    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:15:40.497625 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:15:40.497580    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:15:50.264771 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:15:50.264729    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-7baf010d/e2e-lifecycle-model-7baf010d-kserve-57d45fb9f5-jcl5c"]
Jul 24 19:15:50.265274 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:15:50.265186    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e9fde19a-da4a-421b-9c95-607e173091d0" containerName="istio-proxy"
Jul 24 19:15:50.265274 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:15:50.265201    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="e9fde19a-da4a-421b-9c95-607e173091d0" containerName="istio-proxy"
Jul 24 19:15:50.265274 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:15:50.265216    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5b8c664a-462f-4da7-9e77-c51b6155173f" containerName="istio-proxy"
Jul 24 19:15:50.265274 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:15:50.265221    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="5b8c664a-462f-4da7-9e77-c51b6155173f" containerName="istio-proxy"
Jul 24 19:15:50.265274 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:15:50.265233    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5b8c664a-462f-4da7-9e77-c51b6155173f" containerName="istio-proxy"
Jul 24 19:15:50.265274 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:15:50.265239    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="5b8c664a-462f-4da7-9e77-c51b6155173f" containerName="istio-proxy"
Jul 24 19:15:50.265541 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:15:50.265302    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="e9fde19a-da4a-421b-9c95-607e173091d0" containerName="istio-proxy"
Jul 24 19:15:50.265541 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:15:50.265309    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="5b8c664a-462f-4da7-9e77-c51b6155173f" containerName="istio-proxy"
Jul 24 19:15:50.268163 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:15:50.268147    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-7baf010d/e2e-lifecycle-model-7baf010d-kserve-57d45fb9f5-jcl5c"
Jul 24 19:15:50.271923 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:15:50.271901    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-7baf010d\"/\"e2e-lifecycle-model-7baf010d-kserve-self-signed-certs\""
Jul 24 19:15:50.271923 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:15:50.271911    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-7baf010d\"/\"default-dockercfg-cxz6j\""
Jul 24 19:15:50.272096 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:15:50.271963    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-7baf010d\"/\"kube-root-ca.crt\""
Jul 24 19:15:50.272096 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:15:50.271911    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-7baf010d\"/\"openshift-service-ca.crt\""
Jul 24 19:15:50.277356 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:15:50.277335    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-7baf010d/e2e-lifecycle-model-7baf010d-kserve-57d45fb9f5-jcl5c"]
Jul 24 19:15:50.342459 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:15:50.342427    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5f645266-cf84-4848-adff-f015b51a8566-dshm\") pod \"e2e-lifecycle-model-7baf010d-kserve-57d45fb9f5-jcl5c\" (UID: \"5f645266-cf84-4848-adff-f015b51a8566\") " pod="ai-tenant-e2e-mt-7baf010d/e2e-lifecycle-model-7baf010d-kserve-57d45fb9f5-jcl5c"
Jul 24 19:15:50.342623 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:15:50.342482    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5f645266-cf84-4848-adff-f015b51a8566-tls-certs\") pod \"e2e-lifecycle-model-7baf010d-kserve-57d45fb9f5-jcl5c\" (UID: \"5f645266-cf84-4848-adff-f015b51a8566\") " pod="ai-tenant-e2e-mt-7baf010d/e2e-lifecycle-model-7baf010d-kserve-57d45fb9f5-jcl5c"
Jul 24 19:15:50.342623 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:15:50.342505    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5plxp\" (UniqueName: \"kubernetes.io/projected/5f645266-cf84-4848-adff-f015b51a8566-kube-api-access-5plxp\") pod \"e2e-lifecycle-model-7baf010d-kserve-57d45fb9f5-jcl5c\" (UID: \"5f645266-cf84-4848-adff-f015b51a8566\") " pod="ai-tenant-e2e-mt-7baf010d/e2e-lifecycle-model-7baf010d-kserve-57d45fb9f5-jcl5c"
Jul 24 19:15:50.342623 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:15:50.342559    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5f645266-cf84-4848-adff-f015b51a8566-home\") pod \"e2e-lifecycle-model-7baf010d-kserve-57d45fb9f5-jcl5c\" (UID: \"5f645266-cf84-4848-adff-f015b51a8566\") " pod="ai-tenant-e2e-mt-7baf010d/e2e-lifecycle-model-7baf010d-kserve-57d45fb9f5-jcl5c"
Jul 24 19:15:50.342785 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:15:50.342660    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5f645266-cf84-4848-adff-f015b51a8566-tmp-dir\") pod \"e2e-lifecycle-model-7baf010d-kserve-57d45fb9f5-jcl5c\" (UID: \"5f645266-cf84-4848-adff-f015b51a8566\") " pod="ai-tenant-e2e-mt-7baf010d/e2e-lifecycle-model-7baf010d-kserve-57d45fb9f5-jcl5c"
Jul 24 19:15:50.342841 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:15:50.342804    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5f645266-cf84-4848-adff-f015b51a8566-model-cache\") pod \"e2e-lifecycle-model-7baf010d-kserve-57d45fb9f5-jcl5c\" (UID: \"5f645266-cf84-4848-adff-f015b51a8566\") " pod="ai-tenant-e2e-mt-7baf010d/e2e-lifecycle-model-7baf010d-kserve-57d45fb9f5-jcl5c"
Jul 24 19:15:50.357985 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:15:50.357942    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:15:50.443562 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:15:50.443529    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5f645266-cf84-4848-adff-f015b51a8566-dshm\") pod \"e2e-lifecycle-model-7baf010d-kserve-57d45fb9f5-jcl5c\" (UID: \"5f645266-cf84-4848-adff-f015b51a8566\") " pod="ai-tenant-e2e-mt-7baf010d/e2e-lifecycle-model-7baf010d-kserve-57d45fb9f5-jcl5c"
Jul 24 19:15:50.443562 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:15:50.443563    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5f645266-cf84-4848-adff-f015b51a8566-tls-certs\") pod \"e2e-lifecycle-model-7baf010d-kserve-57d45fb9f5-jcl5c\" (UID: \"5f645266-cf84-4848-adff-f015b51a8566\") " pod="ai-tenant-e2e-mt-7baf010d/e2e-lifecycle-model-7baf010d-kserve-57d45fb9f5-jcl5c"
Jul 24 19:15:50.443840 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:15:50.443591    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5plxp\" (UniqueName: \"kubernetes.io/projected/5f645266-cf84-4848-adff-f015b51a8566-kube-api-access-5plxp\") pod \"e2e-lifecycle-model-7baf010d-kserve-57d45fb9f5-jcl5c\" (UID: \"5f645266-cf84-4848-adff-f015b51a8566\") " pod="ai-tenant-e2e-mt-7baf010d/e2e-lifecycle-model-7baf010d-kserve-57d45fb9f5-jcl5c"
Jul 24 19:15:50.443840 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:15:50.443717    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5f645266-cf84-4848-adff-f015b51a8566-home\") pod \"e2e-lifecycle-model-7baf010d-kserve-57d45fb9f5-jcl5c\" (UID: \"5f645266-cf84-4848-adff-f015b51a8566\") " pod="ai-tenant-e2e-mt-7baf010d/e2e-lifecycle-model-7baf010d-kserve-57d45fb9f5-jcl5c"
Jul 24 19:15:50.443840 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:15:50.443829    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5f645266-cf84-4848-adff-f015b51a8566-tmp-dir\") pod \"e2e-lifecycle-model-7baf010d-kserve-57d45fb9f5-jcl5c\" (UID: \"5f645266-cf84-4848-adff-f015b51a8566\") " pod="ai-tenant-e2e-mt-7baf010d/e2e-lifecycle-model-7baf010d-kserve-57d45fb9f5-jcl5c"
Jul 24 19:15:50.444014 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:15:50.443998    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5f645266-cf84-4848-adff-f015b51a8566-model-cache\") pod \"e2e-lifecycle-model-7baf010d-kserve-57d45fb9f5-jcl5c\" (UID: \"5f645266-cf84-4848-adff-f015b51a8566\") " pod="ai-tenant-e2e-mt-7baf010d/e2e-lifecycle-model-7baf010d-kserve-57d45fb9f5-jcl5c"
Jul 24 19:15:50.444081 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:15:50.444064    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5f645266-cf84-4848-adff-f015b51a8566-home\") pod \"e2e-lifecycle-model-7baf010d-kserve-57d45fb9f5-jcl5c\" (UID: \"5f645266-cf84-4848-adff-f015b51a8566\") " pod="ai-tenant-e2e-mt-7baf010d/e2e-lifecycle-model-7baf010d-kserve-57d45fb9f5-jcl5c"
Jul 24 19:15:50.444198 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:15:50.444176    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5f645266-cf84-4848-adff-f015b51a8566-tmp-dir\") pod \"e2e-lifecycle-model-7baf010d-kserve-57d45fb9f5-jcl5c\" (UID: \"5f645266-cf84-4848-adff-f015b51a8566\") " pod="ai-tenant-e2e-mt-7baf010d/e2e-lifecycle-model-7baf010d-kserve-57d45fb9f5-jcl5c"
Jul 24 19:15:50.444305 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:15:50.444290    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5f645266-cf84-4848-adff-f015b51a8566-model-cache\") pod \"e2e-lifecycle-model-7baf010d-kserve-57d45fb9f5-jcl5c\" (UID: \"5f645266-cf84-4848-adff-f015b51a8566\") " pod="ai-tenant-e2e-mt-7baf010d/e2e-lifecycle-model-7baf010d-kserve-57d45fb9f5-jcl5c"
Jul 24 19:15:50.445990 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:15:50.445967    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5f645266-cf84-4848-adff-f015b51a8566-dshm\") pod \"e2e-lifecycle-model-7baf010d-kserve-57d45fb9f5-jcl5c\" (UID: \"5f645266-cf84-4848-adff-f015b51a8566\") " pod="ai-tenant-e2e-mt-7baf010d/e2e-lifecycle-model-7baf010d-kserve-57d45fb9f5-jcl5c"
Jul 24 19:15:50.446290 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:15:50.446273    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5f645266-cf84-4848-adff-f015b51a8566-tls-certs\") pod \"e2e-lifecycle-model-7baf010d-kserve-57d45fb9f5-jcl5c\" (UID: \"5f645266-cf84-4848-adff-f015b51a8566\") " pod="ai-tenant-e2e-mt-7baf010d/e2e-lifecycle-model-7baf010d-kserve-57d45fb9f5-jcl5c"
Jul 24 19:15:50.454511 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:15:50.454489    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5plxp\" (UniqueName: \"kubernetes.io/projected/5f645266-cf84-4848-adff-f015b51a8566-kube-api-access-5plxp\") pod \"e2e-lifecycle-model-7baf010d-kserve-57d45fb9f5-jcl5c\" (UID: \"5f645266-cf84-4848-adff-f015b51a8566\") " pod="ai-tenant-e2e-mt-7baf010d/e2e-lifecycle-model-7baf010d-kserve-57d45fb9f5-jcl5c"
Jul 24 19:15:50.578521 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:15:50.578386    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-7baf010d/e2e-lifecycle-model-7baf010d-kserve-57d45fb9f5-jcl5c"
Jul 24 19:15:50.718598 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:15:50.718570    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-7baf010d/e2e-lifecycle-model-7baf010d-kserve-57d45fb9f5-jcl5c"]
Jul 24 19:15:50.720806 ip-10-0-141-146 kubenswrapper[2580]: W0724 19:15:50.720778    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5f645266_cf84_4848_adff_f015b51a8566.slice/crio-c74ff2d8f98857a49b0b7ba00fbfe63d77356a292be6bea118be1a12e97f5447 WatchSource:0}: Error finding container c74ff2d8f98857a49b0b7ba00fbfe63d77356a292be6bea118be1a12e97f5447: Status 404 returned error can't find the container with id c74ff2d8f98857a49b0b7ba00fbfe63d77356a292be6bea118be1a12e97f5447
Jul 24 19:15:51.348949 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:15:51.348910    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-7baf010d/e2e-lifecycle-model-7baf010d-kserve-57d45fb9f5-jcl5c" event={"ID":"5f645266-cf84-4848-adff-f015b51a8566","Type":"ContainerStarted","Data":"212eab6a1295928e60a08da74dc7f46b9c8eee16bf8e2d5cfafa905e33618faa"}
Jul 24 19:15:51.349368 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:15:51.348956    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-7baf010d/e2e-lifecycle-model-7baf010d-kserve-57d45fb9f5-jcl5c" event={"ID":"5f645266-cf84-4848-adff-f015b51a8566","Type":"ContainerStarted","Data":"c74ff2d8f98857a49b0b7ba00fbfe63d77356a292be6bea118be1a12e97f5447"}
Jul 24 19:15:51.382079 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:15:51.382026    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-7baf010d/e2e-lifecycle-model-7baf010d-kserve-57d45fb9f5-jcl5c" podStartSLOduration=1.382008766 podStartE2EDuration="1.382008766s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 19:15:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:15:51.3794272 +0000 UTC m=+1906.588799243" watchObservedRunningTime="2026-07-24 19:15:51.382008766 +0000 UTC m=+1906.591380808"
Jul 24 19:16:00.578767 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:16:00.578731    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-7baf010d/e2e-lifecycle-model-7baf010d-kserve-57d45fb9f5-jcl5c"
Jul 24 19:16:00.579230 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:16:00.578781    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-7baf010d/e2e-lifecycle-model-7baf010d-kserve-57d45fb9f5-jcl5c"
Jul 24 19:16:00.591317 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:16:00.591291    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-7baf010d/e2e-lifecycle-model-7baf010d-kserve-57d45fb9f5-jcl5c"
Jul 24 19:16:01.407206 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:16:01.407171    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-7baf010d/e2e-lifecycle-model-7baf010d-kserve-57d45fb9f5-jcl5c"
Jul 24 19:16:30.426471 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:16:30.426425    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:16:30.555440 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:16:30.555407    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:16:30.654338 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:16:30.654300    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:16:34.943452 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:16:34.943412    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:16:38.097145 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:16:38.097078    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:16:43.073447 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:16:43.073410    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-7baf010d/e2e-lifecycle-model-7baf010d-kserve-57d45fb9f5-jcl5c"]
Jul 24 19:16:43.169555 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:16:43.169522    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:16:58.093559 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:16:58.093464    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-7baf010d/e2e-lifecycle-model-7baf010d-kserve-57d45fb9f5-jcl5c" podUID="5f645266-cf84-4848-adff-f015b51a8566" containerName="main" containerID="cri-o://212eab6a1295928e60a08da74dc7f46b9c8eee16bf8e2d5cfafa905e33618faa" gracePeriod=45
Jul 24 19:16:58.337982 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:16:58.337954    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-7baf010d/e2e-lifecycle-model-7baf010d-kserve-57d45fb9f5-jcl5c"
Jul 24 19:16:58.418204 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:16:58.418084    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5f645266-cf84-4848-adff-f015b51a8566-tmp-dir\") pod \"5f645266-cf84-4848-adff-f015b51a8566\" (UID: \"5f645266-cf84-4848-adff-f015b51a8566\") "
Jul 24 19:16:58.418204 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:16:58.418154    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5f645266-cf84-4848-adff-f015b51a8566-dshm\") pod \"5f645266-cf84-4848-adff-f015b51a8566\" (UID: \"5f645266-cf84-4848-adff-f015b51a8566\") "
Jul 24 19:16:58.418426 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:16:58.418210    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5plxp\" (UniqueName: \"kubernetes.io/projected/5f645266-cf84-4848-adff-f015b51a8566-kube-api-access-5plxp\") pod \"5f645266-cf84-4848-adff-f015b51a8566\" (UID: \"5f645266-cf84-4848-adff-f015b51a8566\") "
Jul 24 19:16:58.418426 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:16:58.418230    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5f645266-cf84-4848-adff-f015b51a8566-home\") pod \"5f645266-cf84-4848-adff-f015b51a8566\" (UID: \"5f645266-cf84-4848-adff-f015b51a8566\") "
Jul 24 19:16:58.418426 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:16:58.418246    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5f645266-cf84-4848-adff-f015b51a8566-model-cache\") pod \"5f645266-cf84-4848-adff-f015b51a8566\" (UID: \"5f645266-cf84-4848-adff-f015b51a8566\") "
Jul 24 19:16:58.418426 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:16:58.418268    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5f645266-cf84-4848-adff-f015b51a8566-tls-certs\") pod \"5f645266-cf84-4848-adff-f015b51a8566\" (UID: \"5f645266-cf84-4848-adff-f015b51a8566\") "
Jul 24 19:16:58.418426 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:16:58.418320    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f645266-cf84-4848-adff-f015b51a8566-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "5f645266-cf84-4848-adff-f015b51a8566" (UID: "5f645266-cf84-4848-adff-f015b51a8566"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:16:58.418673 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:16:58.418507    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f645266-cf84-4848-adff-f015b51a8566-home" (OuterVolumeSpecName: "home") pod "5f645266-cf84-4848-adff-f015b51a8566" (UID: "5f645266-cf84-4848-adff-f015b51a8566"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:16:58.418673 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:16:58.418526    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f645266-cf84-4848-adff-f015b51a8566-model-cache" (OuterVolumeSpecName: "model-cache") pod "5f645266-cf84-4848-adff-f015b51a8566" (UID: "5f645266-cf84-4848-adff-f015b51a8566"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:16:58.418673 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:16:58.418620    2580 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5f645266-cf84-4848-adff-f015b51a8566-tmp-dir\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 24 19:16:58.418673 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:16:58.418635    2580 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5f645266-cf84-4848-adff-f015b51a8566-home\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 24 19:16:58.418673 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:16:58.418643    2580 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5f645266-cf84-4848-adff-f015b51a8566-model-cache\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 24 19:16:58.420534 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:16:58.420512    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f645266-cf84-4848-adff-f015b51a8566-dshm" (OuterVolumeSpecName: "dshm") pod "5f645266-cf84-4848-adff-f015b51a8566" (UID: "5f645266-cf84-4848-adff-f015b51a8566"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:16:58.420630 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:16:58.420591    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5f645266-cf84-4848-adff-f015b51a8566-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "5f645266-cf84-4848-adff-f015b51a8566" (UID: "5f645266-cf84-4848-adff-f015b51a8566"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 19:16:58.420630 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:16:58.420597    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5f645266-cf84-4848-adff-f015b51a8566-kube-api-access-5plxp" (OuterVolumeSpecName: "kube-api-access-5plxp") pod "5f645266-cf84-4848-adff-f015b51a8566" (UID: "5f645266-cf84-4848-adff-f015b51a8566"). InnerVolumeSpecName "kube-api-access-5plxp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 19:16:58.519399 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:16:58.519362    2580 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5f645266-cf84-4848-adff-f015b51a8566-dshm\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 24 19:16:58.519399 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:16:58.519391    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5plxp\" (UniqueName: \"kubernetes.io/projected/5f645266-cf84-4848-adff-f015b51a8566-kube-api-access-5plxp\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 24 19:16:58.519399 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:16:58.519401    2580 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5f645266-cf84-4848-adff-f015b51a8566-tls-certs\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 24 19:16:58.670469 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:16:58.670388    2580 generic.go:356] "Generic (PLEG): container finished" podID="5f645266-cf84-4848-adff-f015b51a8566" containerID="212eab6a1295928e60a08da74dc7f46b9c8eee16bf8e2d5cfafa905e33618faa" exitCode=0
Jul 24 19:16:58.670469 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:16:58.670436    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-7baf010d/e2e-lifecycle-model-7baf010d-kserve-57d45fb9f5-jcl5c"
Jul 24 19:16:58.670670 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:16:58.670471    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-7baf010d/e2e-lifecycle-model-7baf010d-kserve-57d45fb9f5-jcl5c" event={"ID":"5f645266-cf84-4848-adff-f015b51a8566","Type":"ContainerDied","Data":"212eab6a1295928e60a08da74dc7f46b9c8eee16bf8e2d5cfafa905e33618faa"}
Jul 24 19:16:58.670670 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:16:58.670511    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-7baf010d/e2e-lifecycle-model-7baf010d-kserve-57d45fb9f5-jcl5c" event={"ID":"5f645266-cf84-4848-adff-f015b51a8566","Type":"ContainerDied","Data":"c74ff2d8f98857a49b0b7ba00fbfe63d77356a292be6bea118be1a12e97f5447"}
Jul 24 19:16:58.670670 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:16:58.670529    2580 scope.go:117] "RemoveContainer" containerID="212eab6a1295928e60a08da74dc7f46b9c8eee16bf8e2d5cfafa905e33618faa"
Jul 24 19:16:58.679723 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:16:58.679705    2580 scope.go:117] "RemoveContainer" containerID="212eab6a1295928e60a08da74dc7f46b9c8eee16bf8e2d5cfafa905e33618faa"
Jul 24 19:16:58.680008 ip-10-0-141-146 kubenswrapper[2580]: E0724 19:16:58.679988    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"212eab6a1295928e60a08da74dc7f46b9c8eee16bf8e2d5cfafa905e33618faa\": container with ID starting with 212eab6a1295928e60a08da74dc7f46b9c8eee16bf8e2d5cfafa905e33618faa not found: ID does not exist" containerID="212eab6a1295928e60a08da74dc7f46b9c8eee16bf8e2d5cfafa905e33618faa"
Jul 24 19:16:58.680063 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:16:58.680018    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"212eab6a1295928e60a08da74dc7f46b9c8eee16bf8e2d5cfafa905e33618faa"} err="failed to get container status \"212eab6a1295928e60a08da74dc7f46b9c8eee16bf8e2d5cfafa905e33618faa\": rpc error: code = NotFound desc = could not find container \"212eab6a1295928e60a08da74dc7f46b9c8eee16bf8e2d5cfafa905e33618faa\": container with ID starting with 212eab6a1295928e60a08da74dc7f46b9c8eee16bf8e2d5cfafa905e33618faa not found: ID does not exist"
Jul 24 19:16:58.693464 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:16:58.693429    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-7baf010d/e2e-lifecycle-model-7baf010d-kserve-57d45fb9f5-jcl5c"]
Jul 24 19:16:58.698325 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:16:58.698296    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-7baf010d/e2e-lifecycle-model-7baf010d-kserve-57d45fb9f5-jcl5c"]
Jul 24 19:16:59.241180 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:16:59.241147    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5f645266-cf84-4848-adff-f015b51a8566" path="/var/lib/kubelet/pods/5f645266-cf84-4848-adff-f015b51a8566/volumes"
Jul 24 19:17:19.223881 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:17:19.223842    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:17:20.185990 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:17:20.185947    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:17:25.819977 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:17:25.819939    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:17:25.968255 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:17:25.968218    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:17:26.121335 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:17:26.121244    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:17:26.378921 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:17:26.378822    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:17:27.391586 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:17:27.391543    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:17:27.493226 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:17:27.493182    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:17:27.589049 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:17:27.589011    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:17:28.294290 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:17:28.294250    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:17:28.390635 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:17:28.390588    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:17:28.490563 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:17:28.490527    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:17:29.811502 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:17:29.811428    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:17:35.654737 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:17:35.654692    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:17:35.722142 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:17:35.722088    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:17:36.338702 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:17:36.338659    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:17:42.237639 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:17:42.237606    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:17:42.337081 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:17:42.337046    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:17:42.435600 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:17:42.435554    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:17:49.727012 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:17:49.726967    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:17:52.962639 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:17:52.962603    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:17:53.306424 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:17:53.306332    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:18:14.246519 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:18:14.246478    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:18:20.489479 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:18:20.489429    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:18:20.591669 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:18:20.591619    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:18:20.852073 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:18:20.851984    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:18:21.144260 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:18:21.144158    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:18:21.342793 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:18:21.342748    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:18:23.844085 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:18:23.844044    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:18:23.949222 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:18:23.949179    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:18:24.045948 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:18:24.045908    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:18:24.208414 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:18:24.208373    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:18:24.648589 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:18:24.648500    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:18:24.750931 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:18:24.750896    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:18:28.354743 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:18:28.354652    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:18:28.669705 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:18:28.669606    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:18:28.928066 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:18:28.927982    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-948d66-openshift-default-9dcb8546-nkq5z"]
Jul 24 19:18:28.928511 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:18:28.928492    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f645266-cf84-4848-adff-f015b51a8566" containerName="main"
Jul 24 19:18:28.928615 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:18:28.928514    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f645266-cf84-4848-adff-f015b51a8566" containerName="main"
Jul 24 19:18:28.928615 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:18:28.928602    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="5f645266-cf84-4848-adff-f015b51a8566" containerName="main"
Jul 24 19:18:28.928725 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:18:28.928616    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="5b8c664a-462f-4da7-9e77-c51b6155173f" containerName="istio-proxy"
Jul 24 19:18:28.932063 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:18:28.932042    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-948d66-openshift-default-9dcb8546-nkq5z"
Jul 24 19:18:28.934422 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:18:28.934400    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-948d66-openshift-default-dockercfg-67v54\""
Jul 24 19:18:28.942539 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:18:28.942512    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-948d66-openshift-default-9dcb8546-nkq5z"]
Jul 24 19:18:28.953657 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:18:28.953622    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:18:28.995497 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:18:28.995466    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e48d522c-d2c9-4716-9b77-bdc9d9a2707d-istio-envoy\") pod \"e2e-inf-b-948d66-openshift-default-9dcb8546-nkq5z\" (UID: \"e48d522c-d2c9-4716-9b77-bdc9d9a2707d\") " pod="openshift-ingress/e2e-inf-b-948d66-openshift-default-9dcb8546-nkq5z"
Jul 24 19:18:28.995497 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:18:28.995499    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e48d522c-d2c9-4716-9b77-bdc9d9a2707d-workload-certs\") pod \"e2e-inf-b-948d66-openshift-default-9dcb8546-nkq5z\" (UID: \"e48d522c-d2c9-4716-9b77-bdc9d9a2707d\") " pod="openshift-ingress/e2e-inf-b-948d66-openshift-default-9dcb8546-nkq5z"
Jul 24 19:18:28.995753 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:18:28.995525    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e48d522c-d2c9-4716-9b77-bdc9d9a2707d-istio-podinfo\") pod \"e2e-inf-b-948d66-openshift-default-9dcb8546-nkq5z\" (UID: \"e48d522c-d2c9-4716-9b77-bdc9d9a2707d\") " pod="openshift-ingress/e2e-inf-b-948d66-openshift-default-9dcb8546-nkq5z"
Jul 24 19:18:28.995753 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:18:28.995546    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e48d522c-d2c9-4716-9b77-bdc9d9a2707d-credential-socket\") pod \"e2e-inf-b-948d66-openshift-default-9dcb8546-nkq5z\" (UID: \"e48d522c-d2c9-4716-9b77-bdc9d9a2707d\") " pod="openshift-ingress/e2e-inf-b-948d66-openshift-default-9dcb8546-nkq5z"
Jul 24 19:18:28.995753 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:18:28.995603    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e48d522c-d2c9-4716-9b77-bdc9d9a2707d-istio-data\") pod \"e2e-inf-b-948d66-openshift-default-9dcb8546-nkq5z\" (UID: \"e48d522c-d2c9-4716-9b77-bdc9d9a2707d\") " pod="openshift-ingress/e2e-inf-b-948d66-openshift-default-9dcb8546-nkq5z"
Jul 24 19:18:28.995753 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:18:28.995628    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e48d522c-d2c9-4716-9b77-bdc9d9a2707d-workload-socket\") pod \"e2e-inf-b-948d66-openshift-default-9dcb8546-nkq5z\" (UID: \"e48d522c-d2c9-4716-9b77-bdc9d9a2707d\") " pod="openshift-ingress/e2e-inf-b-948d66-openshift-default-9dcb8546-nkq5z"
Jul 24 19:18:28.995753 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:18:28.995668    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e48d522c-d2c9-4716-9b77-bdc9d9a2707d-istio-token\") pod \"e2e-inf-b-948d66-openshift-default-9dcb8546-nkq5z\" (UID: \"e48d522c-d2c9-4716-9b77-bdc9d9a2707d\") " pod="openshift-ingress/e2e-inf-b-948d66-openshift-default-9dcb8546-nkq5z"
Jul 24 19:18:28.995753 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:18:28.995686    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vj2rc\" (UniqueName: \"kubernetes.io/projected/e48d522c-d2c9-4716-9b77-bdc9d9a2707d-kube-api-access-vj2rc\") pod \"e2e-inf-b-948d66-openshift-default-9dcb8546-nkq5z\" (UID: \"e48d522c-d2c9-4716-9b77-bdc9d9a2707d\") " pod="openshift-ingress/e2e-inf-b-948d66-openshift-default-9dcb8546-nkq5z"
Jul 24 19:18:28.995753 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:18:28.995712    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e48d522c-d2c9-4716-9b77-bdc9d9a2707d-istiod-ca-cert\") pod \"e2e-inf-b-948d66-openshift-default-9dcb8546-nkq5z\" (UID: \"e48d522c-d2c9-4716-9b77-bdc9d9a2707d\") " pod="openshift-ingress/e2e-inf-b-948d66-openshift-default-9dcb8546-nkq5z"
Jul 24 19:18:29.096416 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:18:29.096378    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e48d522c-d2c9-4716-9b77-bdc9d9a2707d-istio-token\") pod \"e2e-inf-b-948d66-openshift-default-9dcb8546-nkq5z\" (UID: \"e48d522c-d2c9-4716-9b77-bdc9d9a2707d\") " pod="openshift-ingress/e2e-inf-b-948d66-openshift-default-9dcb8546-nkq5z"
Jul 24 19:18:29.096416 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:18:29.096419    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vj2rc\" (UniqueName: \"kubernetes.io/projected/e48d522c-d2c9-4716-9b77-bdc9d9a2707d-kube-api-access-vj2rc\") pod \"e2e-inf-b-948d66-openshift-default-9dcb8546-nkq5z\" (UID: \"e48d522c-d2c9-4716-9b77-bdc9d9a2707d\") " pod="openshift-ingress/e2e-inf-b-948d66-openshift-default-9dcb8546-nkq5z"
Jul 24 19:18:29.096684 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:18:29.096440    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e48d522c-d2c9-4716-9b77-bdc9d9a2707d-istiod-ca-cert\") pod \"e2e-inf-b-948d66-openshift-default-9dcb8546-nkq5z\" (UID: \"e48d522c-d2c9-4716-9b77-bdc9d9a2707d\") " pod="openshift-ingress/e2e-inf-b-948d66-openshift-default-9dcb8546-nkq5z"
Jul 24 19:18:29.096684 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:18:29.096502    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e48d522c-d2c9-4716-9b77-bdc9d9a2707d-istio-envoy\") pod \"e2e-inf-b-948d66-openshift-default-9dcb8546-nkq5z\" (UID: \"e48d522c-d2c9-4716-9b77-bdc9d9a2707d\") " pod="openshift-ingress/e2e-inf-b-948d66-openshift-default-9dcb8546-nkq5z"
Jul 24 19:18:29.096684 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:18:29.096517    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e48d522c-d2c9-4716-9b77-bdc9d9a2707d-workload-certs\") pod \"e2e-inf-b-948d66-openshift-default-9dcb8546-nkq5z\" (UID: \"e48d522c-d2c9-4716-9b77-bdc9d9a2707d\") " pod="openshift-ingress/e2e-inf-b-948d66-openshift-default-9dcb8546-nkq5z"
Jul 24 19:18:29.096684 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:18:29.096537    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e48d522c-d2c9-4716-9b77-bdc9d9a2707d-istio-podinfo\") pod \"e2e-inf-b-948d66-openshift-default-9dcb8546-nkq5z\" (UID: \"e48d522c-d2c9-4716-9b77-bdc9d9a2707d\") " pod="openshift-ingress/e2e-inf-b-948d66-openshift-default-9dcb8546-nkq5z"
Jul 24 19:18:29.096684 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:18:29.096557    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e48d522c-d2c9-4716-9b77-bdc9d9a2707d-credential-socket\") pod \"e2e-inf-b-948d66-openshift-default-9dcb8546-nkq5z\" (UID: \"e48d522c-d2c9-4716-9b77-bdc9d9a2707d\") " pod="openshift-ingress/e2e-inf-b-948d66-openshift-default-9dcb8546-nkq5z"
Jul 24 19:18:29.096684 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:18:29.096590    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e48d522c-d2c9-4716-9b77-bdc9d9a2707d-istio-data\") pod \"e2e-inf-b-948d66-openshift-default-9dcb8546-nkq5z\" (UID: \"e48d522c-d2c9-4716-9b77-bdc9d9a2707d\") " pod="openshift-ingress/e2e-inf-b-948d66-openshift-default-9dcb8546-nkq5z"
Jul 24 19:18:29.096684 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:18:29.096627    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e48d522c-d2c9-4716-9b77-bdc9d9a2707d-workload-socket\") pod \"e2e-inf-b-948d66-openshift-default-9dcb8546-nkq5z\" (UID: \"e48d522c-d2c9-4716-9b77-bdc9d9a2707d\") " pod="openshift-ingress/e2e-inf-b-948d66-openshift-default-9dcb8546-nkq5z"
Jul 24 19:18:29.097160 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:18:29.097043    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e48d522c-d2c9-4716-9b77-bdc9d9a2707d-workload-certs\") pod \"e2e-inf-b-948d66-openshift-default-9dcb8546-nkq5z\" (UID: \"e48d522c-d2c9-4716-9b77-bdc9d9a2707d\") " pod="openshift-ingress/e2e-inf-b-948d66-openshift-default-9dcb8546-nkq5z"
Jul 24 19:18:29.097160 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:18:29.097057    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e48d522c-d2c9-4716-9b77-bdc9d9a2707d-credential-socket\") pod \"e2e-inf-b-948d66-openshift-default-9dcb8546-nkq5z\" (UID: \"e48d522c-d2c9-4716-9b77-bdc9d9a2707d\") " pod="openshift-ingress/e2e-inf-b-948d66-openshift-default-9dcb8546-nkq5z"
Jul 24 19:18:29.097283 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:18:29.097267    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e48d522c-d2c9-4716-9b77-bdc9d9a2707d-workload-socket\") pod \"e2e-inf-b-948d66-openshift-default-9dcb8546-nkq5z\" (UID: \"e48d522c-d2c9-4716-9b77-bdc9d9a2707d\") " pod="openshift-ingress/e2e-inf-b-948d66-openshift-default-9dcb8546-nkq5z"
Jul 24 19:18:29.097507 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:18:29.097477    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e48d522c-d2c9-4716-9b77-bdc9d9a2707d-istio-data\") pod \"e2e-inf-b-948d66-openshift-default-9dcb8546-nkq5z\" (UID: \"e48d522c-d2c9-4716-9b77-bdc9d9a2707d\") " pod="openshift-ingress/e2e-inf-b-948d66-openshift-default-9dcb8546-nkq5z"
Jul 24 19:18:29.097771 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:18:29.097657    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e48d522c-d2c9-4716-9b77-bdc9d9a2707d-istiod-ca-cert\") pod \"e2e-inf-b-948d66-openshift-default-9dcb8546-nkq5z\" (UID: \"e48d522c-d2c9-4716-9b77-bdc9d9a2707d\") " pod="openshift-ingress/e2e-inf-b-948d66-openshift-default-9dcb8546-nkq5z"
Jul 24 19:18:29.099158 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:18:29.099137    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e48d522c-d2c9-4716-9b77-bdc9d9a2707d-istio-envoy\") pod \"e2e-inf-b-948d66-openshift-default-9dcb8546-nkq5z\" (UID: \"e48d522c-d2c9-4716-9b77-bdc9d9a2707d\") " pod="openshift-ingress/e2e-inf-b-948d66-openshift-default-9dcb8546-nkq5z"
Jul 24 19:18:29.099489 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:18:29.099471    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e48d522c-d2c9-4716-9b77-bdc9d9a2707d-istio-podinfo\") pod \"e2e-inf-b-948d66-openshift-default-9dcb8546-nkq5z\" (UID: \"e48d522c-d2c9-4716-9b77-bdc9d9a2707d\") " pod="openshift-ingress/e2e-inf-b-948d66-openshift-default-9dcb8546-nkq5z"
Jul 24 19:18:29.105162 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:18:29.105137    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e48d522c-d2c9-4716-9b77-bdc9d9a2707d-istio-token\") pod \"e2e-inf-b-948d66-openshift-default-9dcb8546-nkq5z\" (UID: \"e48d522c-d2c9-4716-9b77-bdc9d9a2707d\") " pod="openshift-ingress/e2e-inf-b-948d66-openshift-default-9dcb8546-nkq5z"
Jul 24 19:18:29.105430 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:18:29.105413    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vj2rc\" (UniqueName: \"kubernetes.io/projected/e48d522c-d2c9-4716-9b77-bdc9d9a2707d-kube-api-access-vj2rc\") pod \"e2e-inf-b-948d66-openshift-default-9dcb8546-nkq5z\" (UID: \"e48d522c-d2c9-4716-9b77-bdc9d9a2707d\") " pod="openshift-ingress/e2e-inf-b-948d66-openshift-default-9dcb8546-nkq5z"
Jul 24 19:18:29.243315 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:18:29.243283    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-948d66-openshift-default-9dcb8546-nkq5z"
Jul 24 19:18:29.342935 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:18:29.342814    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:18:29.396399 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:18:29.396370    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-948d66-openshift-default-9dcb8546-nkq5z"]
Jul 24 19:18:29.399524 ip-10-0-141-146 kubenswrapper[2580]: W0724 19:18:29.399496    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode48d522c_d2c9_4716_9b77_bdc9d9a2707d.slice/crio-0827d9013032d8a03673687d73c13191b28015ae7d1410650193b401c94e232a WatchSource:0}: Error finding container 0827d9013032d8a03673687d73c13191b28015ae7d1410650193b401c94e232a: Status 404 returned error can't find the container with id 0827d9013032d8a03673687d73c13191b28015ae7d1410650193b401c94e232a
Jul 24 19:18:29.401660 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:18:29.401631    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 24 19:18:29.401744 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:18:29.401696    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 24 19:18:29.401744 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:18:29.401723    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 24 19:18:30.107796 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:18:30.107754    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-948d66-openshift-default-9dcb8546-nkq5z" event={"ID":"e48d522c-d2c9-4716-9b77-bdc9d9a2707d","Type":"ContainerStarted","Data":"d79d40ce4ae41ea3e3d9ba6ed11ef2a43720fb4b908864806e19278546f197ea"}
Jul 24 19:18:30.107977 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:18:30.107822    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-948d66-openshift-default-9dcb8546-nkq5z" event={"ID":"e48d522c-d2c9-4716-9b77-bdc9d9a2707d","Type":"ContainerStarted","Data":"0827d9013032d8a03673687d73c13191b28015ae7d1410650193b401c94e232a"}
Jul 24 19:18:30.133139 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:18:30.133044    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-948d66-openshift-default-9dcb8546-nkq5z" podStartSLOduration=2.1330198989999998 podStartE2EDuration="2.133019899s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 19:18:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:18:30.129860685 +0000 UTC m=+2065.339232766" watchObservedRunningTime="2026-07-24 19:18:30.133019899 +0000 UTC m=+2065.342391943"
Jul 24 19:18:30.244246 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:18:30.244211    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-948d66-openshift-default-9dcb8546-nkq5z"
Jul 24 19:18:30.250206 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:18:30.250178    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-948d66-openshift-default-9dcb8546-nkq5z"
Jul 24 19:18:31.113386 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:18:31.113353    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-948d66-openshift-default-9dcb8546-nkq5z"
Jul 24 19:18:31.114464 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:18:31.114442    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-948d66-openshift-default-9dcb8546-nkq5z"
Jul 24 19:18:32.018658 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:18:32.018623    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:18:32.114005 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:18:32.113962    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:18:32.223797 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:18:32.223762    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:18:32.577068 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:18:32.577038    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:18:32.756068 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:18:32.756029    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:18:32.852394 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:18:32.852294    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:18:36.494632 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:18:36.494577    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:18:44.176307 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:18:44.176268    2580 generic.go:356] "Generic (PLEG): container finished" podID="e48d522c-d2c9-4716-9b77-bdc9d9a2707d" containerID="d79d40ce4ae41ea3e3d9ba6ed11ef2a43720fb4b908864806e19278546f197ea" exitCode=0
Jul 24 19:18:44.176781 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:18:44.176344    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-948d66-openshift-default-9dcb8546-nkq5z" event={"ID":"e48d522c-d2c9-4716-9b77-bdc9d9a2707d","Type":"ContainerDied","Data":"d79d40ce4ae41ea3e3d9ba6ed11ef2a43720fb4b908864806e19278546f197ea"}
Jul 24 19:18:44.176781 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:18:44.176767    2580 scope.go:117] "RemoveContainer" containerID="d79d40ce4ae41ea3e3d9ba6ed11ef2a43720fb4b908864806e19278546f197ea"
Jul 24 19:18:44.177904 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:18:44.177872    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 24 19:18:44.177990 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:18:44.177958    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 24 19:18:44.178043 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:18:44.178002    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 24 19:18:45.183134 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:18:45.183094    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-948d66-openshift-default-9dcb8546-nkq5z" event={"ID":"e48d522c-d2c9-4716-9b77-bdc9d9a2707d","Type":"ContainerStarted","Data":"ffefd4f2a2e4132f1658fd507dddd3644c4e73128331cb72fff609d11430b5c5"}
Jul 24 19:18:45.244183 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:18:45.244149    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-948d66-openshift-default-9dcb8546-nkq5z"
Jul 24 19:18:45.245398 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:18:45.245370    2580 patch_prober.go:28] interesting pod/e2e-inf-b-948d66-openshift-default-9dcb8546-nkq5z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body=
Jul 24 19:18:45.245545 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:18:45.245427    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-948d66-openshift-default-9dcb8546-nkq5z" podUID="e48d522c-d2c9-4716-9b77-bdc9d9a2707d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused"
Jul 24 19:18:46.114091 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:18:46.114040    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-948d66-openshift-default-9dcb8546-nkq5z"
Jul 24 19:18:46.244475 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:18:46.244442    2580 patch_prober.go:28] interesting pod/e2e-inf-b-948d66-openshift-default-9dcb8546-nkq5z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body=
Jul 24 19:18:46.244947 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:18:46.244501    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-948d66-openshift-default-9dcb8546-nkq5z" podUID="e48d522c-d2c9-4716-9b77-bdc9d9a2707d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused"
Jul 24 19:18:47.243811 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:18:47.243774    2580 patch_prober.go:28] interesting pod/e2e-inf-b-948d66-openshift-default-9dcb8546-nkq5z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body=
Jul 24 19:18:47.243995 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:18:47.243830    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-948d66-openshift-default-9dcb8546-nkq5z" podUID="e48d522c-d2c9-4716-9b77-bdc9d9a2707d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused"
Jul 24 19:18:48.243743 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:18:48.243698    2580 patch_prober.go:28] interesting pod/e2e-inf-b-948d66-openshift-default-9dcb8546-nkq5z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body=
Jul 24 19:18:48.244289 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:18:48.243771    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-948d66-openshift-default-9dcb8546-nkq5z" podUID="e48d522c-d2c9-4716-9b77-bdc9d9a2707d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused"
Jul 24 19:18:49.248283 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:18:49.248252    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-948d66-openshift-default-9dcb8546-nkq5z"
Jul 24 19:18:49.249203 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:18:49.249184    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-948d66-openshift-default-9dcb8546-nkq5z"
Jul 24 19:18:53.963615 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:18:53.963564    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-950cf0/test-model-950cf0-kserve-f8b459d59-v2lb2"]
Jul 24 19:18:53.966822 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:18:53.966802    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-950cf0/test-model-950cf0-kserve-f8b459d59-v2lb2"
Jul 24 19:18:53.969526 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:18:53.969492    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-950cf0\"/\"openshift-service-ca.crt\""
Jul 24 19:18:53.970678 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:18:53.970652    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-950cf0\"/\"default-dockercfg-fmk94\""
Jul 24 19:18:53.970810 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:18:53.970690    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-950cf0\"/\"kube-root-ca.crt\""
Jul 24 19:18:53.970810 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:18:53.970664    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-950cf0\"/\"test-model-950cf0-kserve-self-signed-certs\""
Jul 24 19:18:53.976179 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:18:53.976153    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-950cf0/test-model-950cf0-kserve-f8b459d59-v2lb2"]
Jul 24 19:18:53.998681 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:18:53.998635    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:18:54.058961 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:18:54.058920    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6ad84a1a-bb63-4efa-a391-6e4c3e41f6d1-tls-certs\") pod \"test-model-950cf0-kserve-f8b459d59-v2lb2\" (UID: \"6ad84a1a-bb63-4efa-a391-6e4c3e41f6d1\") " pod="ai-tenant-e2e-inf-a-950cf0/test-model-950cf0-kserve-f8b459d59-v2lb2"
Jul 24 19:18:54.059195 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:18:54.058970    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6ad84a1a-bb63-4efa-a391-6e4c3e41f6d1-model-cache\") pod \"test-model-950cf0-kserve-f8b459d59-v2lb2\" (UID: \"6ad84a1a-bb63-4efa-a391-6e4c3e41f6d1\") " pod="ai-tenant-e2e-inf-a-950cf0/test-model-950cf0-kserve-f8b459d59-v2lb2"
Jul 24 19:18:54.059195 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:18:54.059072    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6ad84a1a-bb63-4efa-a391-6e4c3e41f6d1-tmp-dir\") pod \"test-model-950cf0-kserve-f8b459d59-v2lb2\" (UID: \"6ad84a1a-bb63-4efa-a391-6e4c3e41f6d1\") " pod="ai-tenant-e2e-inf-a-950cf0/test-model-950cf0-kserve-f8b459d59-v2lb2"
Jul 24 19:18:54.059195 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:18:54.059151    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8xl76\" (UniqueName: \"kubernetes.io/projected/6ad84a1a-bb63-4efa-a391-6e4c3e41f6d1-kube-api-access-8xl76\") pod \"test-model-950cf0-kserve-f8b459d59-v2lb2\" (UID: \"6ad84a1a-bb63-4efa-a391-6e4c3e41f6d1\") " pod="ai-tenant-e2e-inf-a-950cf0/test-model-950cf0-kserve-f8b459d59-v2lb2"
Jul 24 19:18:54.059339 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:18:54.059215    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6ad84a1a-bb63-4efa-a391-6e4c3e41f6d1-dshm\") pod \"test-model-950cf0-kserve-f8b459d59-v2lb2\" (UID: \"6ad84a1a-bb63-4efa-a391-6e4c3e41f6d1\") " pod="ai-tenant-e2e-inf-a-950cf0/test-model-950cf0-kserve-f8b459d59-v2lb2"
Jul 24 19:18:54.059339 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:18:54.059244    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6ad84a1a-bb63-4efa-a391-6e4c3e41f6d1-home\") pod \"test-model-950cf0-kserve-f8b459d59-v2lb2\" (UID: \"6ad84a1a-bb63-4efa-a391-6e4c3e41f6d1\") " pod="ai-tenant-e2e-inf-a-950cf0/test-model-950cf0-kserve-f8b459d59-v2lb2"
Jul 24 19:18:54.160800 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:18:54.160764    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6ad84a1a-bb63-4efa-a391-6e4c3e41f6d1-tls-certs\") pod \"test-model-950cf0-kserve-f8b459d59-v2lb2\" (UID: \"6ad84a1a-bb63-4efa-a391-6e4c3e41f6d1\") " pod="ai-tenant-e2e-inf-a-950cf0/test-model-950cf0-kserve-f8b459d59-v2lb2"
Jul 24 19:18:54.160800 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:18:54.160803    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6ad84a1a-bb63-4efa-a391-6e4c3e41f6d1-model-cache\") pod \"test-model-950cf0-kserve-f8b459d59-v2lb2\" (UID: \"6ad84a1a-bb63-4efa-a391-6e4c3e41f6d1\") " pod="ai-tenant-e2e-inf-a-950cf0/test-model-950cf0-kserve-f8b459d59-v2lb2"
Jul 24 19:18:54.161086 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:18:54.160832    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6ad84a1a-bb63-4efa-a391-6e4c3e41f6d1-tmp-dir\") pod \"test-model-950cf0-kserve-f8b459d59-v2lb2\" (UID: \"6ad84a1a-bb63-4efa-a391-6e4c3e41f6d1\") " pod="ai-tenant-e2e-inf-a-950cf0/test-model-950cf0-kserve-f8b459d59-v2lb2"
Jul 24 19:18:54.161086 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:18:54.160861    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8xl76\" (UniqueName: \"kubernetes.io/projected/6ad84a1a-bb63-4efa-a391-6e4c3e41f6d1-kube-api-access-8xl76\") pod \"test-model-950cf0-kserve-f8b459d59-v2lb2\" (UID: \"6ad84a1a-bb63-4efa-a391-6e4c3e41f6d1\") " pod="ai-tenant-e2e-inf-a-950cf0/test-model-950cf0-kserve-f8b459d59-v2lb2"
Jul 24 19:18:54.161086 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:18:54.160905    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6ad84a1a-bb63-4efa-a391-6e4c3e41f6d1-dshm\") pod \"test-model-950cf0-kserve-f8b459d59-v2lb2\" (UID: \"6ad84a1a-bb63-4efa-a391-6e4c3e41f6d1\") " pod="ai-tenant-e2e-inf-a-950cf0/test-model-950cf0-kserve-f8b459d59-v2lb2"
Jul 24 19:18:54.161086 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:18:54.160923    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6ad84a1a-bb63-4efa-a391-6e4c3e41f6d1-home\") pod \"test-model-950cf0-kserve-f8b459d59-v2lb2\" (UID: \"6ad84a1a-bb63-4efa-a391-6e4c3e41f6d1\") " pod="ai-tenant-e2e-inf-a-950cf0/test-model-950cf0-kserve-f8b459d59-v2lb2"
Jul 24 19:18:54.161354 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:18:54.161300    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6ad84a1a-bb63-4efa-a391-6e4c3e41f6d1-model-cache\") pod \"test-model-950cf0-kserve-f8b459d59-v2lb2\" (UID: \"6ad84a1a-bb63-4efa-a391-6e4c3e41f6d1\") " pod="ai-tenant-e2e-inf-a-950cf0/test-model-950cf0-kserve-f8b459d59-v2lb2"
Jul 24 19:18:54.161354 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:18:54.161340    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6ad84a1a-bb63-4efa-a391-6e4c3e41f6d1-tmp-dir\") pod \"test-model-950cf0-kserve-f8b459d59-v2lb2\" (UID: \"6ad84a1a-bb63-4efa-a391-6e4c3e41f6d1\") " pod="ai-tenant-e2e-inf-a-950cf0/test-model-950cf0-kserve-f8b459d59-v2lb2"
Jul 24 19:18:54.161429 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:18:54.161376    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6ad84a1a-bb63-4efa-a391-6e4c3e41f6d1-home\") pod \"test-model-950cf0-kserve-f8b459d59-v2lb2\" (UID: \"6ad84a1a-bb63-4efa-a391-6e4c3e41f6d1\") " pod="ai-tenant-e2e-inf-a-950cf0/test-model-950cf0-kserve-f8b459d59-v2lb2"
Jul 24 19:18:54.163349 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:18:54.163324    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6ad84a1a-bb63-4efa-a391-6e4c3e41f6d1-dshm\") pod \"test-model-950cf0-kserve-f8b459d59-v2lb2\" (UID: \"6ad84a1a-bb63-4efa-a391-6e4c3e41f6d1\") " pod="ai-tenant-e2e-inf-a-950cf0/test-model-950cf0-kserve-f8b459d59-v2lb2"
Jul 24 19:18:54.163650 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:18:54.163632    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6ad84a1a-bb63-4efa-a391-6e4c3e41f6d1-tls-certs\") pod \"test-model-950cf0-kserve-f8b459d59-v2lb2\" (UID: \"6ad84a1a-bb63-4efa-a391-6e4c3e41f6d1\") " pod="ai-tenant-e2e-inf-a-950cf0/test-model-950cf0-kserve-f8b459d59-v2lb2"
Jul 24 19:18:54.169234 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:18:54.169210    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8xl76\" (UniqueName: \"kubernetes.io/projected/6ad84a1a-bb63-4efa-a391-6e4c3e41f6d1-kube-api-access-8xl76\") pod \"test-model-950cf0-kserve-f8b459d59-v2lb2\" (UID: \"6ad84a1a-bb63-4efa-a391-6e4c3e41f6d1\") " pod="ai-tenant-e2e-inf-a-950cf0/test-model-950cf0-kserve-f8b459d59-v2lb2"
Jul 24 19:18:54.278068 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:18:54.277965    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-950cf0/test-model-950cf0-kserve-f8b459d59-v2lb2"
Jul 24 19:18:54.416711 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:18:54.416651    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-950cf0/test-model-950cf0-kserve-f8b459d59-v2lb2"]
Jul 24 19:18:54.419149 ip-10-0-141-146 kubenswrapper[2580]: W0724 19:18:54.419107    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6ad84a1a_bb63_4efa_a391_6e4c3e41f6d1.slice/crio-f7b3251491c052bf1f14d7a9c685a125617ea923ce683d4ff7e8fae1bf040619 WatchSource:0}: Error finding container f7b3251491c052bf1f14d7a9c685a125617ea923ce683d4ff7e8fae1bf040619: Status 404 returned error can't find the container with id f7b3251491c052bf1f14d7a9c685a125617ea923ce683d4ff7e8fae1bf040619
Jul 24 19:18:55.235181 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:18:55.235111    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-950cf0/test-model-950cf0-kserve-f8b459d59-v2lb2" event={"ID":"6ad84a1a-bb63-4efa-a391-6e4c3e41f6d1","Type":"ContainerStarted","Data":"49be805bc040cee31e12cbb9c84126bbe8c4f91e5a83628ec584614a2cea5652"}
Jul 24 19:18:55.235572 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:18:55.235193    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-950cf0/test-model-950cf0-kserve-f8b459d59-v2lb2" event={"ID":"6ad84a1a-bb63-4efa-a391-6e4c3e41f6d1","Type":"ContainerStarted","Data":"f7b3251491c052bf1f14d7a9c685a125617ea923ce683d4ff7e8fae1bf040619"}
Jul 24 19:18:55.254207 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:18:55.254157    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-950cf0/test-model-950cf0-kserve-f8b459d59-v2lb2" podStartSLOduration=2.254141203 podStartE2EDuration="2.254141203s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 19:18:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:18:55.253231626 +0000 UTC m=+2090.462603669" watchObservedRunningTime="2026-07-24 19:18:55.254141203 +0000 UTC m=+2090.463513237"
Jul 24 19:19:04.278115 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:19:04.278084    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-950cf0/test-model-950cf0-kserve-f8b459d59-v2lb2"
Jul 24 19:19:04.278565 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:19:04.278155    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-950cf0/test-model-950cf0-kserve-f8b459d59-v2lb2"
Jul 24 19:19:04.290780 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:19:04.290750    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-950cf0/test-model-950cf0-kserve-f8b459d59-v2lb2"
Jul 24 19:19:05.293688 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:19:05.293650    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-950cf0/test-model-950cf0-kserve-f8b459d59-v2lb2"
Jul 24 19:19:06.248334 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:19:06.248306    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qvzgb_dd21fc27-5a24-4f3a-a912-043af27a4342/ovn-acl-logging/0.log"
Jul 24 19:19:06.258542 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:19:06.258518    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qvzgb_dd21fc27-5a24-4f3a-a912-043af27a4342/ovn-acl-logging/0.log"
Jul 24 19:19:14.872390 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:19:14.872353    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-948d66/test-model-948d66-kserve-667bd98499-6wc26"]
Jul 24 19:19:14.875755 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:19:14.875739    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-948d66/test-model-948d66-kserve-667bd98499-6wc26"
Jul 24 19:19:14.878876 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:19:14.878855    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-948d66\"/\"kube-root-ca.crt\""
Jul 24 19:19:14.879893 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:19:14.879874    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-948d66\"/\"default-dockercfg-gm84n\""
Jul 24 19:19:14.880002 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:19:14.879914    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-948d66\"/\"test-model-948d66-kserve-self-signed-certs\""
Jul 24 19:19:14.880002 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:19:14.879931    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-948d66\"/\"openshift-service-ca.crt\""
Jul 24 19:19:14.884174 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:19:14.884151    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-948d66/test-model-948d66-kserve-667bd98499-6wc26"]
Jul 24 19:19:14.961110 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:19:14.961070    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:19:14.968359 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:19:14.968328    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/427b1afe-da16-451c-b187-639d584aa1a2-home\") pod \"test-model-948d66-kserve-667bd98499-6wc26\" (UID: \"427b1afe-da16-451c-b187-639d584aa1a2\") " pod="ai-tenant-e2e-inf-b-948d66/test-model-948d66-kserve-667bd98499-6wc26"
Jul 24 19:19:14.968499 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:19:14.968364    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/427b1afe-da16-451c-b187-639d584aa1a2-tmp-dir\") pod \"test-model-948d66-kserve-667bd98499-6wc26\" (UID: \"427b1afe-da16-451c-b187-639d584aa1a2\") " pod="ai-tenant-e2e-inf-b-948d66/test-model-948d66-kserve-667bd98499-6wc26"
Jul 24 19:19:14.968499 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:19:14.968403    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/427b1afe-da16-451c-b187-639d584aa1a2-dshm\") pod \"test-model-948d66-kserve-667bd98499-6wc26\" (UID: \"427b1afe-da16-451c-b187-639d584aa1a2\") " pod="ai-tenant-e2e-inf-b-948d66/test-model-948d66-kserve-667bd98499-6wc26"
Jul 24 19:19:14.968499 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:19:14.968476    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l7jgl\" (UniqueName: \"kubernetes.io/projected/427b1afe-da16-451c-b187-639d584aa1a2-kube-api-access-l7jgl\") pod \"test-model-948d66-kserve-667bd98499-6wc26\" (UID: \"427b1afe-da16-451c-b187-639d584aa1a2\") " pod="ai-tenant-e2e-inf-b-948d66/test-model-948d66-kserve-667bd98499-6wc26"
Jul 24 19:19:14.968607 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:19:14.968512    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/427b1afe-da16-451c-b187-639d584aa1a2-model-cache\") pod \"test-model-948d66-kserve-667bd98499-6wc26\" (UID: \"427b1afe-da16-451c-b187-639d584aa1a2\") " pod="ai-tenant-e2e-inf-b-948d66/test-model-948d66-kserve-667bd98499-6wc26"
Jul 24 19:19:14.968607 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:19:14.968533    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/427b1afe-da16-451c-b187-639d584aa1a2-tls-certs\") pod \"test-model-948d66-kserve-667bd98499-6wc26\" (UID: \"427b1afe-da16-451c-b187-639d584aa1a2\") " pod="ai-tenant-e2e-inf-b-948d66/test-model-948d66-kserve-667bd98499-6wc26"
Jul 24 19:19:15.069571 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:19:15.069533    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/427b1afe-da16-451c-b187-639d584aa1a2-dshm\") pod \"test-model-948d66-kserve-667bd98499-6wc26\" (UID: \"427b1afe-da16-451c-b187-639d584aa1a2\") " pod="ai-tenant-e2e-inf-b-948d66/test-model-948d66-kserve-667bd98499-6wc26"
Jul 24 19:19:15.069760 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:19:15.069590    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l7jgl\" (UniqueName: \"kubernetes.io/projected/427b1afe-da16-451c-b187-639d584aa1a2-kube-api-access-l7jgl\") pod \"test-model-948d66-kserve-667bd98499-6wc26\" (UID: \"427b1afe-da16-451c-b187-639d584aa1a2\") " pod="ai-tenant-e2e-inf-b-948d66/test-model-948d66-kserve-667bd98499-6wc26"
Jul 24 19:19:15.069760 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:19:15.069709    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/427b1afe-da16-451c-b187-639d584aa1a2-model-cache\") pod \"test-model-948d66-kserve-667bd98499-6wc26\" (UID: \"427b1afe-da16-451c-b187-639d584aa1a2\") " pod="ai-tenant-e2e-inf-b-948d66/test-model-948d66-kserve-667bd98499-6wc26"
Jul 24 19:19:15.069760 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:19:15.069746    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/427b1afe-da16-451c-b187-639d584aa1a2-tls-certs\") pod \"test-model-948d66-kserve-667bd98499-6wc26\" (UID: \"427b1afe-da16-451c-b187-639d584aa1a2\") " pod="ai-tenant-e2e-inf-b-948d66/test-model-948d66-kserve-667bd98499-6wc26"
Jul 24 19:19:15.069873 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:19:15.069841    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/427b1afe-da16-451c-b187-639d584aa1a2-home\") pod \"test-model-948d66-kserve-667bd98499-6wc26\" (UID: \"427b1afe-da16-451c-b187-639d584aa1a2\") " pod="ai-tenant-e2e-inf-b-948d66/test-model-948d66-kserve-667bd98499-6wc26"
Jul 24 19:19:15.069909 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:19:15.069875    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/427b1afe-da16-451c-b187-639d584aa1a2-tmp-dir\") pod \"test-model-948d66-kserve-667bd98499-6wc26\" (UID: \"427b1afe-da16-451c-b187-639d584aa1a2\") " pod="ai-tenant-e2e-inf-b-948d66/test-model-948d66-kserve-667bd98499-6wc26"
Jul 24 19:19:15.070084 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:19:15.070064    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/427b1afe-da16-451c-b187-639d584aa1a2-model-cache\") pod \"test-model-948d66-kserve-667bd98499-6wc26\" (UID: \"427b1afe-da16-451c-b187-639d584aa1a2\") " pod="ai-tenant-e2e-inf-b-948d66/test-model-948d66-kserve-667bd98499-6wc26"
Jul 24 19:19:15.070262 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:19:15.070243    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/427b1afe-da16-451c-b187-639d584aa1a2-tmp-dir\") pod \"test-model-948d66-kserve-667bd98499-6wc26\" (UID: \"427b1afe-da16-451c-b187-639d584aa1a2\") " pod="ai-tenant-e2e-inf-b-948d66/test-model-948d66-kserve-667bd98499-6wc26"
Jul 24 19:19:15.070325 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:19:15.070266    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/427b1afe-da16-451c-b187-639d584aa1a2-home\") pod \"test-model-948d66-kserve-667bd98499-6wc26\" (UID: \"427b1afe-da16-451c-b187-639d584aa1a2\") " pod="ai-tenant-e2e-inf-b-948d66/test-model-948d66-kserve-667bd98499-6wc26"
Jul 24 19:19:15.071987 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:19:15.071963    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/427b1afe-da16-451c-b187-639d584aa1a2-dshm\") pod \"test-model-948d66-kserve-667bd98499-6wc26\" (UID: \"427b1afe-da16-451c-b187-639d584aa1a2\") " pod="ai-tenant-e2e-inf-b-948d66/test-model-948d66-kserve-667bd98499-6wc26"
Jul 24 19:19:15.072308 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:19:15.072293    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/427b1afe-da16-451c-b187-639d584aa1a2-tls-certs\") pod \"test-model-948d66-kserve-667bd98499-6wc26\" (UID: \"427b1afe-da16-451c-b187-639d584aa1a2\") " pod="ai-tenant-e2e-inf-b-948d66/test-model-948d66-kserve-667bd98499-6wc26"
Jul 24 19:19:15.078583 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:19:15.078530    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l7jgl\" (UniqueName: \"kubernetes.io/projected/427b1afe-da16-451c-b187-639d584aa1a2-kube-api-access-l7jgl\") pod \"test-model-948d66-kserve-667bd98499-6wc26\" (UID: \"427b1afe-da16-451c-b187-639d584aa1a2\") " pod="ai-tenant-e2e-inf-b-948d66/test-model-948d66-kserve-667bd98499-6wc26"
Jul 24 19:19:15.186886 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:19:15.186798    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-948d66/test-model-948d66-kserve-667bd98499-6wc26"
Jul 24 19:19:15.333567 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:19:15.333544    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-948d66/test-model-948d66-kserve-667bd98499-6wc26"]
Jul 24 19:19:15.335553 ip-10-0-141-146 kubenswrapper[2580]: W0724 19:19:15.335528    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod427b1afe_da16_451c_b187_639d584aa1a2.slice/crio-0e3c57a968cb31784ddfcb5cfac15980d0370dafdf131a05944a472dace080c4 WatchSource:0}: Error finding container 0e3c57a968cb31784ddfcb5cfac15980d0370dafdf131a05944a472dace080c4: Status 404 returned error can't find the container with id 0e3c57a968cb31784ddfcb5cfac15980d0370dafdf131a05944a472dace080c4
Jul 24 19:19:16.336014 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:19:16.335975    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-948d66/test-model-948d66-kserve-667bd98499-6wc26" event={"ID":"427b1afe-da16-451c-b187-639d584aa1a2","Type":"ContainerStarted","Data":"866a47fb0d6f353cf0bbc7064026b473185b2585c5d5d98d6be7bc79d7da5fe1"}
Jul 24 19:19:16.336014 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:19:16.336021    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-948d66/test-model-948d66-kserve-667bd98499-6wc26" event={"ID":"427b1afe-da16-451c-b187-639d584aa1a2","Type":"ContainerStarted","Data":"0e3c57a968cb31784ddfcb5cfac15980d0370dafdf131a05944a472dace080c4"}
Jul 24 19:19:16.356655 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:19:16.356607    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-948d66/test-model-948d66-kserve-667bd98499-6wc26" podStartSLOduration=2.356592173 podStartE2EDuration="2.356592173s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 19:19:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:19:16.355436692 +0000 UTC m=+2111.564808753" watchObservedRunningTime="2026-07-24 19:19:16.356592173 +0000 UTC m=+2111.565964215"
Jul 24 19:19:25.187079 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:19:25.187037    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-948d66/test-model-948d66-kserve-667bd98499-6wc26"
Jul 24 19:19:25.187545 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:19:25.187198    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-948d66/test-model-948d66-kserve-667bd98499-6wc26"
Jul 24 19:19:25.199856 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:19:25.199832    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-948d66/test-model-948d66-kserve-667bd98499-6wc26"
Jul 24 19:19:25.389403 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:19:25.389370    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-948d66/test-model-948d66-kserve-667bd98499-6wc26"
Jul 24 19:20:01.448952 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:20:01.448854    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-950cf0/test-model-950cf0-kserve-f8b459d59-v2lb2"]
Jul 24 19:20:01.469632 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:20:01.469594    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:20:02.405095 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:20:02.405055    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-948d66/test-model-948d66-kserve-667bd98499-6wc26"]
Jul 24 19:20:02.418016 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:20:02.417969    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:20:12.994147 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:20:12.994080    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:20:13.066590 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:20:13.066557    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:20:13.136546 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:20:13.136511    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:20:16.468954 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:20:16.468914    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-950cf0/test-model-950cf0-kserve-f8b459d59-v2lb2" podUID="6ad84a1a-bb63-4efa-a391-6e4c3e41f6d1" containerName="main" containerID="cri-o://49be805bc040cee31e12cbb9c84126bbe8c4f91e5a83628ec584614a2cea5652" gracePeriod=45
Jul 24 19:20:16.493938 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:20:16.493906    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:20:16.633055 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:20:16.633023    2580 generic.go:356] "Generic (PLEG): container finished" podID="6ad84a1a-bb63-4efa-a391-6e4c3e41f6d1" containerID="49be805bc040cee31e12cbb9c84126bbe8c4f91e5a83628ec584614a2cea5652" exitCode=0
Jul 24 19:20:16.633242 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:20:16.633089    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-950cf0/test-model-950cf0-kserve-f8b459d59-v2lb2" event={"ID":"6ad84a1a-bb63-4efa-a391-6e4c3e41f6d1","Type":"ContainerDied","Data":"49be805bc040cee31e12cbb9c84126bbe8c4f91e5a83628ec584614a2cea5652"}
Jul 24 19:20:16.737733 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:20:16.737708    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-950cf0/test-model-950cf0-kserve-f8b459d59-v2lb2"
Jul 24 19:20:16.788466 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:20:16.788433    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6ad84a1a-bb63-4efa-a391-6e4c3e41f6d1-dshm\") pod \"6ad84a1a-bb63-4efa-a391-6e4c3e41f6d1\" (UID: \"6ad84a1a-bb63-4efa-a391-6e4c3e41f6d1\") "
Jul 24 19:20:16.788655 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:20:16.788477    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6ad84a1a-bb63-4efa-a391-6e4c3e41f6d1-tmp-dir\") pod \"6ad84a1a-bb63-4efa-a391-6e4c3e41f6d1\" (UID: \"6ad84a1a-bb63-4efa-a391-6e4c3e41f6d1\") "
Jul 24 19:20:16.788655 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:20:16.788523    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6ad84a1a-bb63-4efa-a391-6e4c3e41f6d1-tls-certs\") pod \"6ad84a1a-bb63-4efa-a391-6e4c3e41f6d1\" (UID: \"6ad84a1a-bb63-4efa-a391-6e4c3e41f6d1\") "
Jul 24 19:20:16.788655 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:20:16.788550    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8xl76\" (UniqueName: \"kubernetes.io/projected/6ad84a1a-bb63-4efa-a391-6e4c3e41f6d1-kube-api-access-8xl76\") pod \"6ad84a1a-bb63-4efa-a391-6e4c3e41f6d1\" (UID: \"6ad84a1a-bb63-4efa-a391-6e4c3e41f6d1\") "
Jul 24 19:20:16.788655 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:20:16.788568    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6ad84a1a-bb63-4efa-a391-6e4c3e41f6d1-model-cache\") pod \"6ad84a1a-bb63-4efa-a391-6e4c3e41f6d1\" (UID: \"6ad84a1a-bb63-4efa-a391-6e4c3e41f6d1\") "
Jul 24 19:20:16.788655 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:20:16.788598    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6ad84a1a-bb63-4efa-a391-6e4c3e41f6d1-home\") pod \"6ad84a1a-bb63-4efa-a391-6e4c3e41f6d1\" (UID: \"6ad84a1a-bb63-4efa-a391-6e4c3e41f6d1\") "
Jul 24 19:20:16.788936 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:20:16.788840    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6ad84a1a-bb63-4efa-a391-6e4c3e41f6d1-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "6ad84a1a-bb63-4efa-a391-6e4c3e41f6d1" (UID: "6ad84a1a-bb63-4efa-a391-6e4c3e41f6d1"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:20:16.788936 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:20:16.788856    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6ad84a1a-bb63-4efa-a391-6e4c3e41f6d1-model-cache" (OuterVolumeSpecName: "model-cache") pod "6ad84a1a-bb63-4efa-a391-6e4c3e41f6d1" (UID: "6ad84a1a-bb63-4efa-a391-6e4c3e41f6d1"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:20:16.789037 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:20:16.788946    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6ad84a1a-bb63-4efa-a391-6e4c3e41f6d1-home" (OuterVolumeSpecName: "home") pod "6ad84a1a-bb63-4efa-a391-6e4c3e41f6d1" (UID: "6ad84a1a-bb63-4efa-a391-6e4c3e41f6d1"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:20:16.789037 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:20:16.789010    2580 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6ad84a1a-bb63-4efa-a391-6e4c3e41f6d1-tmp-dir\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 24 19:20:16.789037 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:20:16.789028    2580 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6ad84a1a-bb63-4efa-a391-6e4c3e41f6d1-model-cache\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 24 19:20:16.790978 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:20:16.790955    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6ad84a1a-bb63-4efa-a391-6e4c3e41f6d1-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "6ad84a1a-bb63-4efa-a391-6e4c3e41f6d1" (UID: "6ad84a1a-bb63-4efa-a391-6e4c3e41f6d1"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 19:20:16.791068 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:20:16.790979    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6ad84a1a-bb63-4efa-a391-6e4c3e41f6d1-dshm" (OuterVolumeSpecName: "dshm") pod "6ad84a1a-bb63-4efa-a391-6e4c3e41f6d1" (UID: "6ad84a1a-bb63-4efa-a391-6e4c3e41f6d1"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:20:16.791068 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:20:16.791050    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6ad84a1a-bb63-4efa-a391-6e4c3e41f6d1-kube-api-access-8xl76" (OuterVolumeSpecName: "kube-api-access-8xl76") pod "6ad84a1a-bb63-4efa-a391-6e4c3e41f6d1" (UID: "6ad84a1a-bb63-4efa-a391-6e4c3e41f6d1"). InnerVolumeSpecName "kube-api-access-8xl76". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 19:20:16.889791 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:20:16.889739    2580 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6ad84a1a-bb63-4efa-a391-6e4c3e41f6d1-dshm\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 24 19:20:16.889791 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:20:16.889787    2580 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6ad84a1a-bb63-4efa-a391-6e4c3e41f6d1-tls-certs\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 24 19:20:16.889791 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:20:16.889799    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8xl76\" (UniqueName: \"kubernetes.io/projected/6ad84a1a-bb63-4efa-a391-6e4c3e41f6d1-kube-api-access-8xl76\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 24 19:20:16.889791 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:20:16.889807    2580 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6ad84a1a-bb63-4efa-a391-6e4c3e41f6d1-home\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 24 19:20:17.425247 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:20:17.425198    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-948d66/test-model-948d66-kserve-667bd98499-6wc26" podUID="427b1afe-da16-451c-b187-639d584aa1a2" containerName="main" containerID="cri-o://866a47fb0d6f353cf0bbc7064026b473185b2585c5d5d98d6be7bc79d7da5fe1" gracePeriod=45
Jul 24 19:20:17.593378 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:20:17.593341    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:20:17.639242 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:20:17.639215    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-950cf0/test-model-950cf0-kserve-f8b459d59-v2lb2"
Jul 24 19:20:17.639431 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:20:17.639247    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-950cf0/test-model-950cf0-kserve-f8b459d59-v2lb2" event={"ID":"6ad84a1a-bb63-4efa-a391-6e4c3e41f6d1","Type":"ContainerDied","Data":"f7b3251491c052bf1f14d7a9c685a125617ea923ce683d4ff7e8fae1bf040619"}
Jul 24 19:20:17.639431 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:20:17.639308    2580 scope.go:117] "RemoveContainer" containerID="49be805bc040cee31e12cbb9c84126bbe8c4f91e5a83628ec584614a2cea5652"
Jul 24 19:20:17.641258 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:20:17.641228    2580 generic.go:356] "Generic (PLEG): container finished" podID="427b1afe-da16-451c-b187-639d584aa1a2" containerID="866a47fb0d6f353cf0bbc7064026b473185b2585c5d5d98d6be7bc79d7da5fe1" exitCode=0
Jul 24 19:20:17.641399 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:20:17.641268    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-948d66/test-model-948d66-kserve-667bd98499-6wc26" event={"ID":"427b1afe-da16-451c-b187-639d584aa1a2","Type":"ContainerDied","Data":"866a47fb0d6f353cf0bbc7064026b473185b2585c5d5d98d6be7bc79d7da5fe1"}
Jul 24 19:20:17.657738 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:20:17.657704    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-950cf0/test-model-950cf0-kserve-f8b459d59-v2lb2"]
Jul 24 19:20:17.660924 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:20:17.660896    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-950cf0/test-model-950cf0-kserve-f8b459d59-v2lb2"]
Jul 24 19:20:17.687340 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:20:17.687303    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-948d66/test-model-948d66-kserve-667bd98499-6wc26"
Jul 24 19:20:17.797843 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:20:17.797743    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/427b1afe-da16-451c-b187-639d584aa1a2-dshm\") pod \"427b1afe-da16-451c-b187-639d584aa1a2\" (UID: \"427b1afe-da16-451c-b187-639d584aa1a2\") "
Jul 24 19:20:17.797843 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:20:17.797782    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/427b1afe-da16-451c-b187-639d584aa1a2-tmp-dir\") pod \"427b1afe-da16-451c-b187-639d584aa1a2\" (UID: \"427b1afe-da16-451c-b187-639d584aa1a2\") "
Jul 24 19:20:17.797843 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:20:17.797806    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/427b1afe-da16-451c-b187-639d584aa1a2-home\") pod \"427b1afe-da16-451c-b187-639d584aa1a2\" (UID: \"427b1afe-da16-451c-b187-639d584aa1a2\") "
Jul 24 19:20:17.797843 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:20:17.797828    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l7jgl\" (UniqueName: \"kubernetes.io/projected/427b1afe-da16-451c-b187-639d584aa1a2-kube-api-access-l7jgl\") pod \"427b1afe-da16-451c-b187-639d584aa1a2\" (UID: \"427b1afe-da16-451c-b187-639d584aa1a2\") "
Jul 24 19:20:17.798231 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:20:17.797883    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/427b1afe-da16-451c-b187-639d584aa1a2-model-cache\") pod \"427b1afe-da16-451c-b187-639d584aa1a2\" (UID: \"427b1afe-da16-451c-b187-639d584aa1a2\") "
Jul 24 19:20:17.798231 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:20:17.797983    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/427b1afe-da16-451c-b187-639d584aa1a2-tls-certs\") pod \"427b1afe-da16-451c-b187-639d584aa1a2\" (UID: \"427b1afe-da16-451c-b187-639d584aa1a2\") "
Jul 24 19:20:17.798231 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:20:17.798041    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/427b1afe-da16-451c-b187-639d584aa1a2-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "427b1afe-da16-451c-b187-639d584aa1a2" (UID: "427b1afe-da16-451c-b187-639d584aa1a2"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:20:17.798231 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:20:17.798078    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/427b1afe-da16-451c-b187-639d584aa1a2-home" (OuterVolumeSpecName: "home") pod "427b1afe-da16-451c-b187-639d584aa1a2" (UID: "427b1afe-da16-451c-b187-639d584aa1a2"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:20:17.798378 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:20:17.798255    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/427b1afe-da16-451c-b187-639d584aa1a2-model-cache" (OuterVolumeSpecName: "model-cache") pod "427b1afe-da16-451c-b187-639d584aa1a2" (UID: "427b1afe-da16-451c-b187-639d584aa1a2"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:20:17.798446 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:20:17.798388    2580 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/427b1afe-da16-451c-b187-639d584aa1a2-tmp-dir\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 24 19:20:17.798446 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:20:17.798404    2580 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/427b1afe-da16-451c-b187-639d584aa1a2-home\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 24 19:20:17.798446 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:20:17.798417    2580 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/427b1afe-da16-451c-b187-639d584aa1a2-model-cache\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 24 19:20:17.800381 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:20:17.800357    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/427b1afe-da16-451c-b187-639d584aa1a2-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "427b1afe-da16-451c-b187-639d584aa1a2" (UID: "427b1afe-da16-451c-b187-639d584aa1a2"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 19:20:17.800464 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:20:17.800409    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/427b1afe-da16-451c-b187-639d584aa1a2-kube-api-access-l7jgl" (OuterVolumeSpecName: "kube-api-access-l7jgl") pod "427b1afe-da16-451c-b187-639d584aa1a2" (UID: "427b1afe-da16-451c-b187-639d584aa1a2"). InnerVolumeSpecName "kube-api-access-l7jgl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 19:20:17.800464 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:20:17.800418    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/427b1afe-da16-451c-b187-639d584aa1a2-dshm" (OuterVolumeSpecName: "dshm") pod "427b1afe-da16-451c-b187-639d584aa1a2" (UID: "427b1afe-da16-451c-b187-639d584aa1a2"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:20:17.899894 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:20:17.899844    2580 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/427b1afe-da16-451c-b187-639d584aa1a2-tls-certs\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 24 19:20:17.899894 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:20:17.899881    2580 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/427b1afe-da16-451c-b187-639d584aa1a2-dshm\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 24 19:20:17.899894 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:20:17.899894    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l7jgl\" (UniqueName: \"kubernetes.io/projected/427b1afe-da16-451c-b187-639d584aa1a2-kube-api-access-l7jgl\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 24 19:20:17.963063 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:20:17.963025    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:20:18.647783 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:20:18.647750    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-948d66/test-model-948d66-kserve-667bd98499-6wc26"
Jul 24 19:20:18.647783 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:20:18.647758    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-948d66/test-model-948d66-kserve-667bd98499-6wc26" event={"ID":"427b1afe-da16-451c-b187-639d584aa1a2","Type":"ContainerDied","Data":"0e3c57a968cb31784ddfcb5cfac15980d0370dafdf131a05944a472dace080c4"}
Jul 24 19:20:18.648380 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:20:18.647811    2580 scope.go:117] "RemoveContainer" containerID="866a47fb0d6f353cf0bbc7064026b473185b2585c5d5d98d6be7bc79d7da5fe1"
Jul 24 19:20:18.668502 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:20:18.668471    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-948d66/test-model-948d66-kserve-667bd98499-6wc26"]
Jul 24 19:20:18.672281 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:20:18.672254    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-948d66/test-model-948d66-kserve-667bd98499-6wc26"]
Jul 24 19:20:19.242396 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:20:19.242360    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="427b1afe-da16-451c-b187-639d584aa1a2" path="/var/lib/kubelet/pods/427b1afe-da16-451c-b187-639d584aa1a2/volumes"
Jul 24 19:20:19.242779 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:20:19.242765    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6ad84a1a-bb63-4efa-a391-6e4c3e41f6d1" path="/var/lib/kubelet/pods/6ad84a1a-bb63-4efa-a391-6e4c3e41f6d1/volumes"
Jul 24 19:20:23.888837 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:20:23.888796    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:20:23.976026 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:20:23.975983    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:20:24.186678 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:20:24.186585    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:20:24.398758 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:20:24.398725    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:20:34.965076 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:20:34.965031    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:20:35.038481 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:20:35.038446    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:20:35.097680 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:20:35.097643    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:20:39.577864 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:20:39.577825    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:20:39.948271 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:20:39.948240    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:20:45.597149 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:20:45.597077    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:20:46.164159 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:20:46.164109    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:20:46.265433 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:20:46.265395    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:20:46.482267 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:20:46.482231    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-948d66-openshift-default-9dcb8546-nkq5z"]
Jul 24 19:20:46.482484 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:20:46.482430    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-948d66-openshift-default-9dcb8546-nkq5z" podUID="e48d522c-d2c9-4716-9b77-bdc9d9a2707d" containerName="istio-proxy" containerID="cri-o://ffefd4f2a2e4132f1658fd507dddd3644c4e73128331cb72fff609d11430b5c5" gracePeriod=30
Jul 24 19:20:46.517649 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:20:46.517610    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:20:46.678338 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:20:46.678298    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:20:47.036388 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:20:47.036344    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:20:47.348657 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:20:47.348570    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:20:47.658293 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:20:47.658198    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:20:49.251253 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:20:49.251217    2580 patch_prober.go:28] interesting pod/e2e-inf-b-948d66-openshift-default-9dcb8546-nkq5z container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 24 19:20:49.251711 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:20:49.251296    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-948d66-openshift-default-9dcb8546-nkq5z" podUID="e48d522c-d2c9-4716-9b77-bdc9d9a2707d" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 24 19:20:50.608566 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:20:50.608529    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:20:50.688629 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:20:50.688593    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:20:50.757027 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:20:50.756988    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:20:51.296043 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:20:51.296007    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:20:51.397582 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:20:51.397540    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:20:51.482740 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:20:51.482704    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:20:51.746428 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:20:51.746398    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-948d66-openshift-default-9dcb8546-nkq5z"
Jul 24 19:20:51.812112 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:20:51.812077    2580 generic.go:356] "Generic (PLEG): container finished" podID="e48d522c-d2c9-4716-9b77-bdc9d9a2707d" containerID="ffefd4f2a2e4132f1658fd507dddd3644c4e73128331cb72fff609d11430b5c5" exitCode=0
Jul 24 19:20:51.812112 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:20:51.812113    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-948d66-openshift-default-9dcb8546-nkq5z" event={"ID":"e48d522c-d2c9-4716-9b77-bdc9d9a2707d","Type":"ContainerDied","Data":"ffefd4f2a2e4132f1658fd507dddd3644c4e73128331cb72fff609d11430b5c5"}
Jul 24 19:20:51.812372 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:20:51.812151    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-948d66-openshift-default-9dcb8546-nkq5z"
Jul 24 19:20:51.812372 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:20:51.812175    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-948d66-openshift-default-9dcb8546-nkq5z" event={"ID":"e48d522c-d2c9-4716-9b77-bdc9d9a2707d","Type":"ContainerDied","Data":"0827d9013032d8a03673687d73c13191b28015ae7d1410650193b401c94e232a"}
Jul 24 19:20:51.812372 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:20:51.812197    2580 scope.go:117] "RemoveContainer" containerID="ffefd4f2a2e4132f1658fd507dddd3644c4e73128331cb72fff609d11430b5c5"
Jul 24 19:20:51.820941 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:20:51.820921    2580 scope.go:117] "RemoveContainer" containerID="d79d40ce4ae41ea3e3d9ba6ed11ef2a43720fb4b908864806e19278546f197ea"
Jul 24 19:20:51.828882 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:20:51.828866    2580 scope.go:117] "RemoveContainer" containerID="ffefd4f2a2e4132f1658fd507dddd3644c4e73128331cb72fff609d11430b5c5"
Jul 24 19:20:51.829151 ip-10-0-141-146 kubenswrapper[2580]: E0724 19:20:51.829115    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ffefd4f2a2e4132f1658fd507dddd3644c4e73128331cb72fff609d11430b5c5\": container with ID starting with ffefd4f2a2e4132f1658fd507dddd3644c4e73128331cb72fff609d11430b5c5 not found: ID does not exist" containerID="ffefd4f2a2e4132f1658fd507dddd3644c4e73128331cb72fff609d11430b5c5"
Jul 24 19:20:51.829247 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:20:51.829158    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ffefd4f2a2e4132f1658fd507dddd3644c4e73128331cb72fff609d11430b5c5"} err="failed to get container status \"ffefd4f2a2e4132f1658fd507dddd3644c4e73128331cb72fff609d11430b5c5\": rpc error: code = NotFound desc = could not find container \"ffefd4f2a2e4132f1658fd507dddd3644c4e73128331cb72fff609d11430b5c5\": container with ID starting with ffefd4f2a2e4132f1658fd507dddd3644c4e73128331cb72fff609d11430b5c5 not found: ID does not exist"
Jul 24 19:20:51.829247 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:20:51.829174    2580 scope.go:117] "RemoveContainer" containerID="d79d40ce4ae41ea3e3d9ba6ed11ef2a43720fb4b908864806e19278546f197ea"
Jul 24 19:20:51.829410 ip-10-0-141-146 kubenswrapper[2580]: E0724 19:20:51.829391    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d79d40ce4ae41ea3e3d9ba6ed11ef2a43720fb4b908864806e19278546f197ea\": container with ID starting with d79d40ce4ae41ea3e3d9ba6ed11ef2a43720fb4b908864806e19278546f197ea not found: ID does not exist" containerID="d79d40ce4ae41ea3e3d9ba6ed11ef2a43720fb4b908864806e19278546f197ea"
Jul 24 19:20:51.829455 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:20:51.829418    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d79d40ce4ae41ea3e3d9ba6ed11ef2a43720fb4b908864806e19278546f197ea"} err="failed to get container status \"d79d40ce4ae41ea3e3d9ba6ed11ef2a43720fb4b908864806e19278546f197ea\": rpc error: code = NotFound desc = could not find container \"d79d40ce4ae41ea3e3d9ba6ed11ef2a43720fb4b908864806e19278546f197ea\": container with ID starting with d79d40ce4ae41ea3e3d9ba6ed11ef2a43720fb4b908864806e19278546f197ea not found: ID does not exist"
Jul 24 19:20:51.843743 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:20:51.843722    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e48d522c-d2c9-4716-9b77-bdc9d9a2707d-workload-certs\") pod \"e48d522c-d2c9-4716-9b77-bdc9d9a2707d\" (UID: \"e48d522c-d2c9-4716-9b77-bdc9d9a2707d\") "
Jul 24 19:20:51.843830 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:20:51.843788    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vj2rc\" (UniqueName: \"kubernetes.io/projected/e48d522c-d2c9-4716-9b77-bdc9d9a2707d-kube-api-access-vj2rc\") pod \"e48d522c-d2c9-4716-9b77-bdc9d9a2707d\" (UID: \"e48d522c-d2c9-4716-9b77-bdc9d9a2707d\") "
Jul 24 19:20:51.843830 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:20:51.843817    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e48d522c-d2c9-4716-9b77-bdc9d9a2707d-istio-podinfo\") pod \"e48d522c-d2c9-4716-9b77-bdc9d9a2707d\" (UID: \"e48d522c-d2c9-4716-9b77-bdc9d9a2707d\") "
Jul 24 19:20:51.843928 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:20:51.843857    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e48d522c-d2c9-4716-9b77-bdc9d9a2707d-workload-socket\") pod \"e48d522c-d2c9-4716-9b77-bdc9d9a2707d\" (UID: \"e48d522c-d2c9-4716-9b77-bdc9d9a2707d\") "
Jul 24 19:20:51.843928 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:20:51.843883    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e48d522c-d2c9-4716-9b77-bdc9d9a2707d-istio-data\") pod \"e48d522c-d2c9-4716-9b77-bdc9d9a2707d\" (UID: \"e48d522c-d2c9-4716-9b77-bdc9d9a2707d\") "
Jul 24 19:20:51.843928 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:20:51.843921    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e48d522c-d2c9-4716-9b77-bdc9d9a2707d-istiod-ca-cert\") pod \"e48d522c-d2c9-4716-9b77-bdc9d9a2707d\" (UID: \"e48d522c-d2c9-4716-9b77-bdc9d9a2707d\") "
Jul 24 19:20:51.844091 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:20:51.843949    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e48d522c-d2c9-4716-9b77-bdc9d9a2707d-istio-envoy\") pod \"e48d522c-d2c9-4716-9b77-bdc9d9a2707d\" (UID: \"e48d522c-d2c9-4716-9b77-bdc9d9a2707d\") "
Jul 24 19:20:51.844091 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:20:51.843986    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e48d522c-d2c9-4716-9b77-bdc9d9a2707d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e48d522c-d2c9-4716-9b77-bdc9d9a2707d" (UID: "e48d522c-d2c9-4716-9b77-bdc9d9a2707d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:20:51.844091 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:20:51.844006    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e48d522c-d2c9-4716-9b77-bdc9d9a2707d-credential-socket\") pod \"e48d522c-d2c9-4716-9b77-bdc9d9a2707d\" (UID: \"e48d522c-d2c9-4716-9b77-bdc9d9a2707d\") "
Jul 24 19:20:51.844274 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:20:51.844140    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e48d522c-d2c9-4716-9b77-bdc9d9a2707d-istio-token\") pod \"e48d522c-d2c9-4716-9b77-bdc9d9a2707d\" (UID: \"e48d522c-d2c9-4716-9b77-bdc9d9a2707d\") "
Jul 24 19:20:51.844274 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:20:51.844235    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e48d522c-d2c9-4716-9b77-bdc9d9a2707d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e48d522c-d2c9-4716-9b77-bdc9d9a2707d" (UID: "e48d522c-d2c9-4716-9b77-bdc9d9a2707d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:20:51.844397 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:20:51.844327    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e48d522c-d2c9-4716-9b77-bdc9d9a2707d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e48d522c-d2c9-4716-9b77-bdc9d9a2707d" (UID: "e48d522c-d2c9-4716-9b77-bdc9d9a2707d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:20:51.844453 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:20:51.844389    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e48d522c-d2c9-4716-9b77-bdc9d9a2707d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e48d522c-d2c9-4716-9b77-bdc9d9a2707d" (UID: "e48d522c-d2c9-4716-9b77-bdc9d9a2707d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 19:20:51.844584 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:20:51.844554    2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e48d522c-d2c9-4716-9b77-bdc9d9a2707d-workload-socket\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 24 19:20:51.844867 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:20:51.844592    2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e48d522c-d2c9-4716-9b77-bdc9d9a2707d-istiod-ca-cert\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 24 19:20:51.844867 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:20:51.844607    2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e48d522c-d2c9-4716-9b77-bdc9d9a2707d-credential-socket\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 24 19:20:51.844867 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:20:51.844620    2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e48d522c-d2c9-4716-9b77-bdc9d9a2707d-workload-certs\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 24 19:20:51.845049 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:20:51.845006    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e48d522c-d2c9-4716-9b77-bdc9d9a2707d-istio-data" (OuterVolumeSpecName: "istio-data") pod "e48d522c-d2c9-4716-9b77-bdc9d9a2707d" (UID: "e48d522c-d2c9-4716-9b77-bdc9d9a2707d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:20:51.846255 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:20:51.846233    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e48d522c-d2c9-4716-9b77-bdc9d9a2707d-kube-api-access-vj2rc" (OuterVolumeSpecName: "kube-api-access-vj2rc") pod "e48d522c-d2c9-4716-9b77-bdc9d9a2707d" (UID: "e48d522c-d2c9-4716-9b77-bdc9d9a2707d"). InnerVolumeSpecName "kube-api-access-vj2rc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 19:20:51.846355 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:20:51.846311    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e48d522c-d2c9-4716-9b77-bdc9d9a2707d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e48d522c-d2c9-4716-9b77-bdc9d9a2707d" (UID: "e48d522c-d2c9-4716-9b77-bdc9d9a2707d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 24 19:20:51.846355 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:20:51.846300    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e48d522c-d2c9-4716-9b77-bdc9d9a2707d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e48d522c-d2c9-4716-9b77-bdc9d9a2707d" (UID: "e48d522c-d2c9-4716-9b77-bdc9d9a2707d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:20:51.846518 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:20:51.846497    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e48d522c-d2c9-4716-9b77-bdc9d9a2707d-istio-token" (OuterVolumeSpecName: "istio-token") pod "e48d522c-d2c9-4716-9b77-bdc9d9a2707d" (UID: "e48d522c-d2c9-4716-9b77-bdc9d9a2707d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 19:20:51.945661 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:20:51.945627    2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e48d522c-d2c9-4716-9b77-bdc9d9a2707d-istio-token\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 24 19:20:51.945661 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:20:51.945660    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vj2rc\" (UniqueName: \"kubernetes.io/projected/e48d522c-d2c9-4716-9b77-bdc9d9a2707d-kube-api-access-vj2rc\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 24 19:20:51.945661 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:20:51.945671    2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e48d522c-d2c9-4716-9b77-bdc9d9a2707d-istio-podinfo\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 24 19:20:51.945915 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:20:51.945680    2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e48d522c-d2c9-4716-9b77-bdc9d9a2707d-istio-data\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 24 19:20:51.945915 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:20:51.945690    2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e48d522c-d2c9-4716-9b77-bdc9d9a2707d-istio-envoy\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 24 19:20:52.140142 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:20:52.135419    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-948d66-openshift-default-9dcb8546-nkq5z"]
Jul 24 19:20:52.144143 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:20:52.144098    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-948d66-openshift-default-9dcb8546-nkq5z"]
Jul 24 19:20:53.241318 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:20:53.241285    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e48d522c-d2c9-4716-9b77-bdc9d9a2707d" path="/var/lib/kubelet/pods/e48d522c-d2c9-4716-9b77-bdc9d9a2707d/volumes"
Jul 24 19:20:55.087525 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:20:55.087492    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:20:55.539434 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:20:55.539396    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:20:55.803437 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:20:55.803357    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-ff6bd9-openshift-default-7f8485dc9b-n5v4z"]
Jul 24 19:20:55.803814 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:20:55.803796    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e48d522c-d2c9-4716-9b77-bdc9d9a2707d" containerName="istio-proxy"
Jul 24 19:20:55.803905 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:20:55.803816    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="e48d522c-d2c9-4716-9b77-bdc9d9a2707d" containerName="istio-proxy"
Jul 24 19:20:55.803905 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:20:55.803835    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="427b1afe-da16-451c-b187-639d584aa1a2" containerName="main"
Jul 24 19:20:55.803905 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:20:55.803842    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="427b1afe-da16-451c-b187-639d584aa1a2" containerName="main"
Jul 24 19:20:55.803905 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:20:55.803877    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ad84a1a-bb63-4efa-a391-6e4c3e41f6d1" containerName="main"
Jul 24 19:20:55.803905 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:20:55.803886    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ad84a1a-bb63-4efa-a391-6e4c3e41f6d1" containerName="main"
Jul 24 19:20:55.804197 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:20:55.803974    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="e48d522c-d2c9-4716-9b77-bdc9d9a2707d" containerName="istio-proxy"
Jul 24 19:20:55.804197 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:20:55.803988    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="6ad84a1a-bb63-4efa-a391-6e4c3e41f6d1" containerName="main"
Jul 24 19:20:55.804197 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:20:55.804001    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="427b1afe-da16-451c-b187-639d584aa1a2" containerName="main"
Jul 24 19:20:55.808311 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:20:55.808286    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-ff6bd9-openshift-default-7f8485dc9b-n5v4z"
Jul 24 19:20:55.811020 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:20:55.811000    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-ff6bd9-openshift-default-dockercfg-n594z\""
Jul 24 19:20:55.818971 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:20:55.818949    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-ff6bd9-openshift-default-7f8485dc9b-n5v4z"]
Jul 24 19:20:55.838931 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:20:55.838892    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:20:55.882317 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:20:55.882284    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c9018fdb-6385-44a0-90a4-a77fccb688b5-istio-data\") pod \"e2e-api-b-ff6bd9-openshift-default-7f8485dc9b-n5v4z\" (UID: \"c9018fdb-6385-44a0-90a4-a77fccb688b5\") " pod="openshift-ingress/e2e-api-b-ff6bd9-openshift-default-7f8485dc9b-n5v4z"
Jul 24 19:20:55.882503 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:20:55.882330    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c9018fdb-6385-44a0-90a4-a77fccb688b5-istiod-ca-cert\") pod \"e2e-api-b-ff6bd9-openshift-default-7f8485dc9b-n5v4z\" (UID: \"c9018fdb-6385-44a0-90a4-a77fccb688b5\") " pod="openshift-ingress/e2e-api-b-ff6bd9-openshift-default-7f8485dc9b-n5v4z"
Jul 24 19:20:55.882503 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:20:55.882399    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c9018fdb-6385-44a0-90a4-a77fccb688b5-istio-token\") pod \"e2e-api-b-ff6bd9-openshift-default-7f8485dc9b-n5v4z\" (UID: \"c9018fdb-6385-44a0-90a4-a77fccb688b5\") " pod="openshift-ingress/e2e-api-b-ff6bd9-openshift-default-7f8485dc9b-n5v4z"
Jul 24 19:20:55.882503 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:20:55.882454    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c9018fdb-6385-44a0-90a4-a77fccb688b5-workload-socket\") pod \"e2e-api-b-ff6bd9-openshift-default-7f8485dc9b-n5v4z\" (UID: \"c9018fdb-6385-44a0-90a4-a77fccb688b5\") " pod="openshift-ingress/e2e-api-b-ff6bd9-openshift-default-7f8485dc9b-n5v4z"
Jul 24 19:20:55.882503 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:20:55.882475    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c9018fdb-6385-44a0-90a4-a77fccb688b5-credential-socket\") pod \"e2e-api-b-ff6bd9-openshift-default-7f8485dc9b-n5v4z\" (UID: \"c9018fdb-6385-44a0-90a4-a77fccb688b5\") " pod="openshift-ingress/e2e-api-b-ff6bd9-openshift-default-7f8485dc9b-n5v4z"
Jul 24 19:20:55.882724 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:20:55.882514    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c9018fdb-6385-44a0-90a4-a77fccb688b5-istio-podinfo\") pod \"e2e-api-b-ff6bd9-openshift-default-7f8485dc9b-n5v4z\" (UID: \"c9018fdb-6385-44a0-90a4-a77fccb688b5\") " pod="openshift-ingress/e2e-api-b-ff6bd9-openshift-default-7f8485dc9b-n5v4z"
Jul 24 19:20:55.882724 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:20:55.882538    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k6lrk\" (UniqueName: \"kubernetes.io/projected/c9018fdb-6385-44a0-90a4-a77fccb688b5-kube-api-access-k6lrk\") pod \"e2e-api-b-ff6bd9-openshift-default-7f8485dc9b-n5v4z\" (UID: \"c9018fdb-6385-44a0-90a4-a77fccb688b5\") " pod="openshift-ingress/e2e-api-b-ff6bd9-openshift-default-7f8485dc9b-n5v4z"
Jul 24 19:20:55.882724 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:20:55.882578    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c9018fdb-6385-44a0-90a4-a77fccb688b5-workload-certs\") pod \"e2e-api-b-ff6bd9-openshift-default-7f8485dc9b-n5v4z\" (UID: \"c9018fdb-6385-44a0-90a4-a77fccb688b5\") " pod="openshift-ingress/e2e-api-b-ff6bd9-openshift-default-7f8485dc9b-n5v4z"
Jul 24 19:20:55.882724 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:20:55.882593    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c9018fdb-6385-44a0-90a4-a77fccb688b5-istio-envoy\") pod \"e2e-api-b-ff6bd9-openshift-default-7f8485dc9b-n5v4z\" (UID: \"c9018fdb-6385-44a0-90a4-a77fccb688b5\") " pod="openshift-ingress/e2e-api-b-ff6bd9-openshift-default-7f8485dc9b-n5v4z"
Jul 24 19:20:55.983430 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:20:55.983373    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c9018fdb-6385-44a0-90a4-a77fccb688b5-istio-data\") pod \"e2e-api-b-ff6bd9-openshift-default-7f8485dc9b-n5v4z\" (UID: \"c9018fdb-6385-44a0-90a4-a77fccb688b5\") " pod="openshift-ingress/e2e-api-b-ff6bd9-openshift-default-7f8485dc9b-n5v4z"
Jul 24 19:20:55.983430 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:20:55.983436    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c9018fdb-6385-44a0-90a4-a77fccb688b5-istiod-ca-cert\") pod \"e2e-api-b-ff6bd9-openshift-default-7f8485dc9b-n5v4z\" (UID: \"c9018fdb-6385-44a0-90a4-a77fccb688b5\") " pod="openshift-ingress/e2e-api-b-ff6bd9-openshift-default-7f8485dc9b-n5v4z"
Jul 24 19:20:55.983720 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:20:55.983469    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c9018fdb-6385-44a0-90a4-a77fccb688b5-istio-token\") pod \"e2e-api-b-ff6bd9-openshift-default-7f8485dc9b-n5v4z\" (UID: \"c9018fdb-6385-44a0-90a4-a77fccb688b5\") " pod="openshift-ingress/e2e-api-b-ff6bd9-openshift-default-7f8485dc9b-n5v4z"
Jul 24 19:20:55.983720 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:20:55.983501    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c9018fdb-6385-44a0-90a4-a77fccb688b5-workload-socket\") pod \"e2e-api-b-ff6bd9-openshift-default-7f8485dc9b-n5v4z\" (UID: \"c9018fdb-6385-44a0-90a4-a77fccb688b5\") " pod="openshift-ingress/e2e-api-b-ff6bd9-openshift-default-7f8485dc9b-n5v4z"
Jul 24 19:20:55.983720 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:20:55.983528    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c9018fdb-6385-44a0-90a4-a77fccb688b5-credential-socket\") pod \"e2e-api-b-ff6bd9-openshift-default-7f8485dc9b-n5v4z\" (UID: \"c9018fdb-6385-44a0-90a4-a77fccb688b5\") " pod="openshift-ingress/e2e-api-b-ff6bd9-openshift-default-7f8485dc9b-n5v4z"
Jul 24 19:20:55.983720 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:20:55.983559    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c9018fdb-6385-44a0-90a4-a77fccb688b5-istio-podinfo\") pod \"e2e-api-b-ff6bd9-openshift-default-7f8485dc9b-n5v4z\" (UID: \"c9018fdb-6385-44a0-90a4-a77fccb688b5\") " pod="openshift-ingress/e2e-api-b-ff6bd9-openshift-default-7f8485dc9b-n5v4z"
Jul 24 19:20:55.983720 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:20:55.983589    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k6lrk\" (UniqueName: \"kubernetes.io/projected/c9018fdb-6385-44a0-90a4-a77fccb688b5-kube-api-access-k6lrk\") pod \"e2e-api-b-ff6bd9-openshift-default-7f8485dc9b-n5v4z\" (UID: \"c9018fdb-6385-44a0-90a4-a77fccb688b5\") " pod="openshift-ingress/e2e-api-b-ff6bd9-openshift-default-7f8485dc9b-n5v4z"
Jul 24 19:20:55.983720 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:20:55.983629    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c9018fdb-6385-44a0-90a4-a77fccb688b5-workload-certs\") pod \"e2e-api-b-ff6bd9-openshift-default-7f8485dc9b-n5v4z\" (UID: \"c9018fdb-6385-44a0-90a4-a77fccb688b5\") " pod="openshift-ingress/e2e-api-b-ff6bd9-openshift-default-7f8485dc9b-n5v4z"
Jul 24 19:20:55.983720 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:20:55.983645    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c9018fdb-6385-44a0-90a4-a77fccb688b5-istio-envoy\") pod \"e2e-api-b-ff6bd9-openshift-default-7f8485dc9b-n5v4z\" (UID: \"c9018fdb-6385-44a0-90a4-a77fccb688b5\") " pod="openshift-ingress/e2e-api-b-ff6bd9-openshift-default-7f8485dc9b-n5v4z"
Jul 24 19:20:55.984085 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:20:55.983907    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c9018fdb-6385-44a0-90a4-a77fccb688b5-istio-data\") pod \"e2e-api-b-ff6bd9-openshift-default-7f8485dc9b-n5v4z\" (UID: \"c9018fdb-6385-44a0-90a4-a77fccb688b5\") " pod="openshift-ingress/e2e-api-b-ff6bd9-openshift-default-7f8485dc9b-n5v4z"
Jul 24 19:20:55.984085 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:20:55.983966    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c9018fdb-6385-44a0-90a4-a77fccb688b5-credential-socket\") pod \"e2e-api-b-ff6bd9-openshift-default-7f8485dc9b-n5v4z\" (UID: \"c9018fdb-6385-44a0-90a4-a77fccb688b5\") " pod="openshift-ingress/e2e-api-b-ff6bd9-openshift-default-7f8485dc9b-n5v4z"
Jul 24 19:20:55.984217 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:20:55.984079    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c9018fdb-6385-44a0-90a4-a77fccb688b5-workload-socket\") pod \"e2e-api-b-ff6bd9-openshift-default-7f8485dc9b-n5v4z\" (UID: \"c9018fdb-6385-44a0-90a4-a77fccb688b5\") " pod="openshift-ingress/e2e-api-b-ff6bd9-openshift-default-7f8485dc9b-n5v4z"
Jul 24 19:20:55.984217 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:20:55.984182    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c9018fdb-6385-44a0-90a4-a77fccb688b5-workload-certs\") pod \"e2e-api-b-ff6bd9-openshift-default-7f8485dc9b-n5v4z\" (UID: \"c9018fdb-6385-44a0-90a4-a77fccb688b5\") " pod="openshift-ingress/e2e-api-b-ff6bd9-openshift-default-7f8485dc9b-n5v4z"
Jul 24 19:20:55.984565 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:20:55.984546    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c9018fdb-6385-44a0-90a4-a77fccb688b5-istiod-ca-cert\") pod \"e2e-api-b-ff6bd9-openshift-default-7f8485dc9b-n5v4z\" (UID: \"c9018fdb-6385-44a0-90a4-a77fccb688b5\") " pod="openshift-ingress/e2e-api-b-ff6bd9-openshift-default-7f8485dc9b-n5v4z"
Jul 24 19:20:55.985985 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:20:55.985961    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c9018fdb-6385-44a0-90a4-a77fccb688b5-istio-envoy\") pod \"e2e-api-b-ff6bd9-openshift-default-7f8485dc9b-n5v4z\" (UID: \"c9018fdb-6385-44a0-90a4-a77fccb688b5\") " pod="openshift-ingress/e2e-api-b-ff6bd9-openshift-default-7f8485dc9b-n5v4z"
Jul 24 19:20:55.986216 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:20:55.986191    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c9018fdb-6385-44a0-90a4-a77fccb688b5-istio-podinfo\") pod \"e2e-api-b-ff6bd9-openshift-default-7f8485dc9b-n5v4z\" (UID: \"c9018fdb-6385-44a0-90a4-a77fccb688b5\") " pod="openshift-ingress/e2e-api-b-ff6bd9-openshift-default-7f8485dc9b-n5v4z"
Jul 24 19:20:55.998082 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:20:55.998055    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c9018fdb-6385-44a0-90a4-a77fccb688b5-istio-token\") pod \"e2e-api-b-ff6bd9-openshift-default-7f8485dc9b-n5v4z\" (UID: \"c9018fdb-6385-44a0-90a4-a77fccb688b5\") " pod="openshift-ingress/e2e-api-b-ff6bd9-openshift-default-7f8485dc9b-n5v4z"
Jul 24 19:20:55.998232 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:20:55.998167    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k6lrk\" (UniqueName: \"kubernetes.io/projected/c9018fdb-6385-44a0-90a4-a77fccb688b5-kube-api-access-k6lrk\") pod \"e2e-api-b-ff6bd9-openshift-default-7f8485dc9b-n5v4z\" (UID: \"c9018fdb-6385-44a0-90a4-a77fccb688b5\") " pod="openshift-ingress/e2e-api-b-ff6bd9-openshift-default-7f8485dc9b-n5v4z"
Jul 24 19:20:56.121645 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:20:56.121547    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-ff6bd9-openshift-default-7f8485dc9b-n5v4z"
Jul 24 19:20:56.188145 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:20:56.188089    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:20:56.269041 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:20:56.269015    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-ff6bd9-openshift-default-7f8485dc9b-n5v4z"]
Jul 24 19:20:56.271525 ip-10-0-141-146 kubenswrapper[2580]: W0724 19:20:56.271493    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9018fdb_6385_44a0_90a4_a77fccb688b5.slice/crio-0ff15a7ddcd615bec9a1cb06396480534336f059f488a3235bbd049139bf65ef WatchSource:0}: Error finding container 0ff15a7ddcd615bec9a1cb06396480534336f059f488a3235bbd049139bf65ef: Status 404 returned error can't find the container with id 0ff15a7ddcd615bec9a1cb06396480534336f059f488a3235bbd049139bf65ef
Jul 24 19:20:56.273801 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:20:56.273766    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 24 19:20:56.273890 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:20:56.273851    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 24 19:20:56.273934 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:20:56.273892    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 24 19:20:56.839963 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:20:56.839925    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-ff6bd9-openshift-default-7f8485dc9b-n5v4z" event={"ID":"c9018fdb-6385-44a0-90a4-a77fccb688b5","Type":"ContainerStarted","Data":"edb659dd860273a2fcdf647bfcc1e3019608267de50e9874671ee9fb42d9d441"}
Jul 24 19:20:56.840169 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:20:56.839978    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-ff6bd9-openshift-default-7f8485dc9b-n5v4z" event={"ID":"c9018fdb-6385-44a0-90a4-a77fccb688b5","Type":"ContainerStarted","Data":"0ff15a7ddcd615bec9a1cb06396480534336f059f488a3235bbd049139bf65ef"}
Jul 24 19:20:56.862351 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:20:56.862293    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-ff6bd9-openshift-default-7f8485dc9b-n5v4z" podStartSLOduration=1.862275635 podStartE2EDuration="1.862275635s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 19:20:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:20:56.861934197 +0000 UTC m=+2212.071306252" watchObservedRunningTime="2026-07-24 19:20:56.862275635 +0000 UTC m=+2212.071647678"
Jul 24 19:20:57.122768 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:20:57.122671    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-ff6bd9-openshift-default-7f8485dc9b-n5v4z"
Jul 24 19:20:57.128046 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:20:57.128022    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-ff6bd9-openshift-default-7f8485dc9b-n5v4z"
Jul 24 19:20:57.844487 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:20:57.844451    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-ff6bd9-openshift-default-7f8485dc9b-n5v4z"
Jul 24 19:20:57.845545 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:20:57.845524    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-ff6bd9-openshift-default-7f8485dc9b-n5v4z"
Jul 24 19:20:58.988389 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:20:58.988344    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:20:59.072218 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:20:59.072174    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:20:59.151894 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:20:59.151859    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:20:59.382061 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:20:59.381947    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:20:59.792696 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:20:59.792662    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:20:59.922650 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:20:59.922605    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:21:03.407939 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:21:03.407807    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:21:10.913606 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:21:10.913556    2580 generic.go:356] "Generic (PLEG): container finished" podID="c9018fdb-6385-44a0-90a4-a77fccb688b5" containerID="edb659dd860273a2fcdf647bfcc1e3019608267de50e9874671ee9fb42d9d441" exitCode=0
Jul 24 19:21:10.914062 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:21:10.913626    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-ff6bd9-openshift-default-7f8485dc9b-n5v4z" event={"ID":"c9018fdb-6385-44a0-90a4-a77fccb688b5","Type":"ContainerDied","Data":"edb659dd860273a2fcdf647bfcc1e3019608267de50e9874671ee9fb42d9d441"}
Jul 24 19:21:10.914110 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:21:10.914063    2580 scope.go:117] "RemoveContainer" containerID="edb659dd860273a2fcdf647bfcc1e3019608267de50e9874671ee9fb42d9d441"
Jul 24 19:21:10.915261 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:21:10.915230    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 24 19:21:10.915383 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:21:10.915314    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 24 19:21:10.915383 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:21:10.915364    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 24 19:21:11.921310 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:21:11.921265    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-ff6bd9-openshift-default-7f8485dc9b-n5v4z" event={"ID":"c9018fdb-6385-44a0-90a4-a77fccb688b5","Type":"ContainerStarted","Data":"d68d7a514621794342d448f71e1d20b7180dcde110153651570e93f1dde742c0"}
Jul 24 19:21:12.122692 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:21:12.122651    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-ff6bd9-openshift-default-7f8485dc9b-n5v4z"
Jul 24 19:21:12.123831 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:21:12.123801    2580 patch_prober.go:28] interesting pod/e2e-api-b-ff6bd9-openshift-default-7f8485dc9b-n5v4z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Jul 24 19:21:12.123985 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:21:12.123849    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-ff6bd9-openshift-default-7f8485dc9b-n5v4z" podUID="c9018fdb-6385-44a0-90a4-a77fccb688b5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Jul 24 19:21:12.845353 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:21:12.845309    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-ff6bd9-openshift-default-7f8485dc9b-n5v4z"
Jul 24 19:21:13.122380 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:21:13.122282    2580 patch_prober.go:28] interesting pod/e2e-api-b-ff6bd9-openshift-default-7f8485dc9b-n5v4z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Jul 24 19:21:13.122380 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:21:13.122345    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-ff6bd9-openshift-default-7f8485dc9b-n5v4z" podUID="c9018fdb-6385-44a0-90a4-a77fccb688b5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Jul 24 19:21:14.122068 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:21:14.122031    2580 patch_prober.go:28] interesting pod/e2e-api-b-ff6bd9-openshift-default-7f8485dc9b-n5v4z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Jul 24 19:21:14.122268 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:21:14.122090    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-ff6bd9-openshift-default-7f8485dc9b-n5v4z" podUID="c9018fdb-6385-44a0-90a4-a77fccb688b5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Jul 24 19:21:15.122310 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:21:15.122264    2580 patch_prober.go:28] interesting pod/e2e-api-b-ff6bd9-openshift-default-7f8485dc9b-n5v4z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Jul 24 19:21:15.122710 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:21:15.122340    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-ff6bd9-openshift-default-7f8485dc9b-n5v4z" podUID="c9018fdb-6385-44a0-90a4-a77fccb688b5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Jul 24 19:21:16.122505 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:21:16.122461    2580 patch_prober.go:28] interesting pod/e2e-api-b-ff6bd9-openshift-default-7f8485dc9b-n5v4z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Jul 24 19:21:16.123005 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:21:16.122555    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-ff6bd9-openshift-default-7f8485dc9b-n5v4z" podUID="c9018fdb-6385-44a0-90a4-a77fccb688b5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Jul 24 19:21:17.126396 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:21:17.126364    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-ff6bd9-openshift-default-7f8485dc9b-n5v4z"
Jul 24 19:21:17.127414 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:21:17.127395    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-ff6bd9-openshift-default-7f8485dc9b-n5v4z"
Jul 24 19:21:26.755097 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:21:26.755014    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:21:26.830945 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:21:26.830901    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:21:26.900619 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:21:26.900582    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:21:31.468240 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:21:31.468190    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:21:31.857710 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:21:31.857598    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:21:37.652523 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:21:37.652493    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:21:37.718302 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:21:37.718260    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:21:37.923482 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:21:37.923380    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:21:38.132473 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:21:38.132429    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:21:53.744033 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:21:53.743997    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:21:53.844193 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:21:53.844149    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:21:53.946268 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:21:53.946226    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:21:58.367802 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:21:58.367766    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:21:58.730264 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:21:58.730222    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:22:04.567574 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:22:04.567524    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:22:04.667210 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:22:04.667173    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:22:04.808723 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:22:04.808688    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-ff6bd9-openshift-default-7f8485dc9b-n5v4z"]
Jul 24 19:22:04.808949 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:22:04.808922    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-ff6bd9-openshift-default-7f8485dc9b-n5v4z" podUID="c9018fdb-6385-44a0-90a4-a77fccb688b5" containerName="istio-proxy" containerID="cri-o://d68d7a514621794342d448f71e1d20b7180dcde110153651570e93f1dde742c0" gracePeriod=30
Jul 24 19:22:04.827573 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:22:04.827461    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:22:05.058416 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:22:05.058368    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:22:05.394084 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:22:05.394046    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:22:05.710412 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:22:05.710371    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:22:05.788575 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:22:05.788529    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:22:09.116801 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:22:09.116760    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:22:09.194821 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:22:09.194693    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:22:09.266886 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:22:09.266849    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:22:09.767225 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:22:09.767183    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:22:09.879154 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:22:09.879104    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:22:09.952403 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:22:09.952369    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:22:10.077510 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:22:10.077487    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-ff6bd9-openshift-default-7f8485dc9b-n5v4z"
Jul 24 19:22:10.198687 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:22:10.198659    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c9018fdb-6385-44a0-90a4-a77fccb688b5-credential-socket\") pod \"c9018fdb-6385-44a0-90a4-a77fccb688b5\" (UID: \"c9018fdb-6385-44a0-90a4-a77fccb688b5\") "
Jul 24 19:22:10.199200 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:22:10.198694    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c9018fdb-6385-44a0-90a4-a77fccb688b5-istio-envoy\") pod \"c9018fdb-6385-44a0-90a4-a77fccb688b5\" (UID: \"c9018fdb-6385-44a0-90a4-a77fccb688b5\") "
Jul 24 19:22:10.199200 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:22:10.198718    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c9018fdb-6385-44a0-90a4-a77fccb688b5-istio-podinfo\") pod \"c9018fdb-6385-44a0-90a4-a77fccb688b5\" (UID: \"c9018fdb-6385-44a0-90a4-a77fccb688b5\") "
Jul 24 19:22:10.199200 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:22:10.198733    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c9018fdb-6385-44a0-90a4-a77fccb688b5-istio-data\") pod \"c9018fdb-6385-44a0-90a4-a77fccb688b5\" (UID: \"c9018fdb-6385-44a0-90a4-a77fccb688b5\") "
Jul 24 19:22:10.199200 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:22:10.198764    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c9018fdb-6385-44a0-90a4-a77fccb688b5-istiod-ca-cert\") pod \"c9018fdb-6385-44a0-90a4-a77fccb688b5\" (UID: \"c9018fdb-6385-44a0-90a4-a77fccb688b5\") "
Jul 24 19:22:10.199200 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:22:10.198812    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c9018fdb-6385-44a0-90a4-a77fccb688b5-workload-certs\") pod \"c9018fdb-6385-44a0-90a4-a77fccb688b5\" (UID: \"c9018fdb-6385-44a0-90a4-a77fccb688b5\") "
Jul 24 19:22:10.199200 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:22:10.198853    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c9018fdb-6385-44a0-90a4-a77fccb688b5-workload-socket\") pod \"c9018fdb-6385-44a0-90a4-a77fccb688b5\" (UID: \"c9018fdb-6385-44a0-90a4-a77fccb688b5\") "
Jul 24 19:22:10.199200 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:22:10.198878    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c9018fdb-6385-44a0-90a4-a77fccb688b5-istio-token\") pod \"c9018fdb-6385-44a0-90a4-a77fccb688b5\" (UID: \"c9018fdb-6385-44a0-90a4-a77fccb688b5\") "
Jul 24 19:22:10.199200 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:22:10.198989    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k6lrk\" (UniqueName: \"kubernetes.io/projected/c9018fdb-6385-44a0-90a4-a77fccb688b5-kube-api-access-k6lrk\") pod \"c9018fdb-6385-44a0-90a4-a77fccb688b5\" (UID: \"c9018fdb-6385-44a0-90a4-a77fccb688b5\") "
Jul 24 19:22:10.199200 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:22:10.199046    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c9018fdb-6385-44a0-90a4-a77fccb688b5-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c9018fdb-6385-44a0-90a4-a77fccb688b5" (UID: "c9018fdb-6385-44a0-90a4-a77fccb688b5"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:22:10.199794 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:22:10.199287    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c9018fdb-6385-44a0-90a4-a77fccb688b5-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c9018fdb-6385-44a0-90a4-a77fccb688b5" (UID: "c9018fdb-6385-44a0-90a4-a77fccb688b5"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:22:10.199794 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:22:10.199298    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c9018fdb-6385-44a0-90a4-a77fccb688b5-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c9018fdb-6385-44a0-90a4-a77fccb688b5" (UID: "c9018fdb-6385-44a0-90a4-a77fccb688b5"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:22:10.199794 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:22:10.199422    2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c9018fdb-6385-44a0-90a4-a77fccb688b5-credential-socket\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 24 19:22:10.199794 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:22:10.199446    2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c9018fdb-6385-44a0-90a4-a77fccb688b5-workload-certs\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 24 19:22:10.199794 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:22:10.199488    2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c9018fdb-6385-44a0-90a4-a77fccb688b5-workload-socket\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 24 19:22:10.199794 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:22:10.199724    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c9018fdb-6385-44a0-90a4-a77fccb688b5-istio-data" (OuterVolumeSpecName: "istio-data") pod "c9018fdb-6385-44a0-90a4-a77fccb688b5" (UID: "c9018fdb-6385-44a0-90a4-a77fccb688b5"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:22:10.200156 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:22:10.199845    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c9018fdb-6385-44a0-90a4-a77fccb688b5-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c9018fdb-6385-44a0-90a4-a77fccb688b5" (UID: "c9018fdb-6385-44a0-90a4-a77fccb688b5"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 19:22:10.201355 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:22:10.201335    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c9018fdb-6385-44a0-90a4-a77fccb688b5-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c9018fdb-6385-44a0-90a4-a77fccb688b5" (UID: "c9018fdb-6385-44a0-90a4-a77fccb688b5"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:22:10.201774 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:22:10.201748    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c9018fdb-6385-44a0-90a4-a77fccb688b5-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c9018fdb-6385-44a0-90a4-a77fccb688b5" (UID: "c9018fdb-6385-44a0-90a4-a77fccb688b5"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 24 19:22:10.201886 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:22:10.201844    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c9018fdb-6385-44a0-90a4-a77fccb688b5-istio-token" (OuterVolumeSpecName: "istio-token") pod "c9018fdb-6385-44a0-90a4-a77fccb688b5" (UID: "c9018fdb-6385-44a0-90a4-a77fccb688b5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 19:22:10.201949 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:22:10.201909    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c9018fdb-6385-44a0-90a4-a77fccb688b5-kube-api-access-k6lrk" (OuterVolumeSpecName: "kube-api-access-k6lrk") pod "c9018fdb-6385-44a0-90a4-a77fccb688b5" (UID: "c9018fdb-6385-44a0-90a4-a77fccb688b5"). InnerVolumeSpecName "kube-api-access-k6lrk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 19:22:10.204836 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:22:10.204811    2580 generic.go:356] "Generic (PLEG): container finished" podID="c9018fdb-6385-44a0-90a4-a77fccb688b5" containerID="d68d7a514621794342d448f71e1d20b7180dcde110153651570e93f1dde742c0" exitCode=0
Jul 24 19:22:10.204935 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:22:10.204852    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-ff6bd9-openshift-default-7f8485dc9b-n5v4z"
Jul 24 19:22:10.204935 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:22:10.204872    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-ff6bd9-openshift-default-7f8485dc9b-n5v4z" event={"ID":"c9018fdb-6385-44a0-90a4-a77fccb688b5","Type":"ContainerDied","Data":"d68d7a514621794342d448f71e1d20b7180dcde110153651570e93f1dde742c0"}
Jul 24 19:22:10.204935 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:22:10.204919    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-ff6bd9-openshift-default-7f8485dc9b-n5v4z" event={"ID":"c9018fdb-6385-44a0-90a4-a77fccb688b5","Type":"ContainerDied","Data":"0ff15a7ddcd615bec9a1cb06396480534336f059f488a3235bbd049139bf65ef"}
Jul 24 19:22:10.205144 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:22:10.204941    2580 scope.go:117] "RemoveContainer" containerID="d68d7a514621794342d448f71e1d20b7180dcde110153651570e93f1dde742c0"
Jul 24 19:22:10.222187 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:22:10.222164    2580 scope.go:117] "RemoveContainer" containerID="edb659dd860273a2fcdf647bfcc1e3019608267de50e9874671ee9fb42d9d441"
Jul 24 19:22:10.230616 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:22:10.230592    2580 scope.go:117] "RemoveContainer" containerID="d68d7a514621794342d448f71e1d20b7180dcde110153651570e93f1dde742c0"
Jul 24 19:22:10.230892 ip-10-0-141-146 kubenswrapper[2580]: E0724 19:22:10.230869    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d68d7a514621794342d448f71e1d20b7180dcde110153651570e93f1dde742c0\": container with ID starting with d68d7a514621794342d448f71e1d20b7180dcde110153651570e93f1dde742c0 not found: ID does not exist" containerID="d68d7a514621794342d448f71e1d20b7180dcde110153651570e93f1dde742c0"
Jul 24 19:22:10.230979 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:22:10.230907    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d68d7a514621794342d448f71e1d20b7180dcde110153651570e93f1dde742c0"} err="failed to get container status \"d68d7a514621794342d448f71e1d20b7180dcde110153651570e93f1dde742c0\": rpc error: code = NotFound desc = could not find container \"d68d7a514621794342d448f71e1d20b7180dcde110153651570e93f1dde742c0\": container with ID starting with d68d7a514621794342d448f71e1d20b7180dcde110153651570e93f1dde742c0 not found: ID does not exist"
Jul 24 19:22:10.230979 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:22:10.230932    2580 scope.go:117] "RemoveContainer" containerID="edb659dd860273a2fcdf647bfcc1e3019608267de50e9874671ee9fb42d9d441"
Jul 24 19:22:10.231219 ip-10-0-141-146 kubenswrapper[2580]: E0724 19:22:10.231202    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"edb659dd860273a2fcdf647bfcc1e3019608267de50e9874671ee9fb42d9d441\": container with ID starting with edb659dd860273a2fcdf647bfcc1e3019608267de50e9874671ee9fb42d9d441 not found: ID does not exist" containerID="edb659dd860273a2fcdf647bfcc1e3019608267de50e9874671ee9fb42d9d441"
Jul 24 19:22:10.231268 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:22:10.231226    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"edb659dd860273a2fcdf647bfcc1e3019608267de50e9874671ee9fb42d9d441"} err="failed to get container status \"edb659dd860273a2fcdf647bfcc1e3019608267de50e9874671ee9fb42d9d441\": rpc error: code = NotFound desc = could not find container \"edb659dd860273a2fcdf647bfcc1e3019608267de50e9874671ee9fb42d9d441\": container with ID starting with edb659dd860273a2fcdf647bfcc1e3019608267de50e9874671ee9fb42d9d441 not found: ID does not exist"
Jul 24 19:22:10.235991 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:22:10.235967    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-ff6bd9-openshift-default-7f8485dc9b-n5v4z"]
Jul 24 19:22:10.240376 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:22:10.240345    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-ff6bd9-openshift-default-7f8485dc9b-n5v4z"]
Jul 24 19:22:10.300111 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:22:10.300077    2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c9018fdb-6385-44a0-90a4-a77fccb688b5-istio-token\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 24 19:22:10.300111 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:22:10.300106    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k6lrk\" (UniqueName: \"kubernetes.io/projected/c9018fdb-6385-44a0-90a4-a77fccb688b5-kube-api-access-k6lrk\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 24 19:22:10.300111 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:22:10.300144    2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c9018fdb-6385-44a0-90a4-a77fccb688b5-istio-envoy\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 24 19:22:10.300375 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:22:10.300158    2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c9018fdb-6385-44a0-90a4-a77fccb688b5-istio-podinfo\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 24 19:22:10.300375 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:22:10.300166    2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c9018fdb-6385-44a0-90a4-a77fccb688b5-istio-data\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 24 19:22:10.300375 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:22:10.300177    2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c9018fdb-6385-44a0-90a4-a77fccb688b5-istiod-ca-cert\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 24 19:22:11.242028 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:22:11.241990    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c9018fdb-6385-44a0-90a4-a77fccb688b5" path="/var/lib/kubelet/pods/c9018fdb-6385-44a0-90a4-a77fccb688b5/volumes"
Jul 24 19:22:12.000757 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:22:12.000718    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:22:13.603630 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:22:13.603592    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:22:13.916873 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:22:13.916778    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:22:14.182532 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:22:14.182457    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-48f4d2-openshift-default-f8748787b-9fqhj"]
Jul 24 19:22:14.182855 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:22:14.182842    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e48d522c-d2c9-4716-9b77-bdc9d9a2707d" containerName="istio-proxy"
Jul 24 19:22:14.182897 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:22:14.182856    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="e48d522c-d2c9-4716-9b77-bdc9d9a2707d" containerName="istio-proxy"
Jul 24 19:22:14.182897 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:22:14.182868    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c9018fdb-6385-44a0-90a4-a77fccb688b5" containerName="istio-proxy"
Jul 24 19:22:14.182897 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:22:14.182873    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="c9018fdb-6385-44a0-90a4-a77fccb688b5" containerName="istio-proxy"
Jul 24 19:22:14.182897 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:22:14.182882    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c9018fdb-6385-44a0-90a4-a77fccb688b5" containerName="istio-proxy"
Jul 24 19:22:14.182897 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:22:14.182887    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="c9018fdb-6385-44a0-90a4-a77fccb688b5" containerName="istio-proxy"
Jul 24 19:22:14.183050 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:22:14.182952    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="c9018fdb-6385-44a0-90a4-a77fccb688b5" containerName="istio-proxy"
Jul 24 19:22:14.183050 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:22:14.182959    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="c9018fdb-6385-44a0-90a4-a77fccb688b5" containerName="istio-proxy"
Jul 24 19:22:14.183050 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:22:14.182964    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="e48d522c-d2c9-4716-9b77-bdc9d9a2707d" containerName="istio-proxy"
Jul 24 19:22:14.189099 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:22:14.189071    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-48f4d2-openshift-default-f8748787b-9fqhj"
Jul 24 19:22:14.192345 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:22:14.192322    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-48f4d2-openshift-default-dockercfg-wqn85\""
Jul 24 19:22:14.199544 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:22:14.199517    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-48f4d2-openshift-default-f8748787b-9fqhj"]
Jul 24 19:22:14.213487 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:22:14.213458    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:22:14.239807 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:22:14.239772    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ac395bec-c4ec-4b1c-9078-d4f995574cdc-workload-certs\") pod \"e2e-shared-b-48f4d2-openshift-default-f8748787b-9fqhj\" (UID: \"ac395bec-c4ec-4b1c-9078-d4f995574cdc\") " pod="openshift-ingress/e2e-shared-b-48f4d2-openshift-default-f8748787b-9fqhj"
Jul 24 19:22:14.239807 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:22:14.239813    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac395bec-c4ec-4b1c-9078-d4f995574cdc-workload-socket\") pod \"e2e-shared-b-48f4d2-openshift-default-f8748787b-9fqhj\" (UID: \"ac395bec-c4ec-4b1c-9078-d4f995574cdc\") " pod="openshift-ingress/e2e-shared-b-48f4d2-openshift-default-f8748787b-9fqhj"
Jul 24 19:22:14.240076 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:22:14.239839    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac395bec-c4ec-4b1c-9078-d4f995574cdc-credential-socket\") pod \"e2e-shared-b-48f4d2-openshift-default-f8748787b-9fqhj\" (UID: \"ac395bec-c4ec-4b1c-9078-d4f995574cdc\") " pod="openshift-ingress/e2e-shared-b-48f4d2-openshift-default-f8748787b-9fqhj"
Jul 24 19:22:14.240076 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:22:14.239897    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4vvst\" (UniqueName: \"kubernetes.io/projected/ac395bec-c4ec-4b1c-9078-d4f995574cdc-kube-api-access-4vvst\") pod \"e2e-shared-b-48f4d2-openshift-default-f8748787b-9fqhj\" (UID: \"ac395bec-c4ec-4b1c-9078-d4f995574cdc\") " pod="openshift-ingress/e2e-shared-b-48f4d2-openshift-default-f8748787b-9fqhj"
Jul 24 19:22:14.240076 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:22:14.239964    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ac395bec-c4ec-4b1c-9078-d4f995574cdc-istio-podinfo\") pod \"e2e-shared-b-48f4d2-openshift-default-f8748787b-9fqhj\" (UID: \"ac395bec-c4ec-4b1c-9078-d4f995574cdc\") " pod="openshift-ingress/e2e-shared-b-48f4d2-openshift-default-f8748787b-9fqhj"
Jul 24 19:22:14.240076 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:22:14.240002    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ac395bec-c4ec-4b1c-9078-d4f995574cdc-istio-envoy\") pod \"e2e-shared-b-48f4d2-openshift-default-f8748787b-9fqhj\" (UID: \"ac395bec-c4ec-4b1c-9078-d4f995574cdc\") " pod="openshift-ingress/e2e-shared-b-48f4d2-openshift-default-f8748787b-9fqhj"
Jul 24 19:22:14.240076 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:22:14.240040    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ac395bec-c4ec-4b1c-9078-d4f995574cdc-istio-token\") pod \"e2e-shared-b-48f4d2-openshift-default-f8748787b-9fqhj\" (UID: \"ac395bec-c4ec-4b1c-9078-d4f995574cdc\") " pod="openshift-ingress/e2e-shared-b-48f4d2-openshift-default-f8748787b-9fqhj"
Jul 24 19:22:14.240322 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:22:14.240092    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ac395bec-c4ec-4b1c-9078-d4f995574cdc-istiod-ca-cert\") pod \"e2e-shared-b-48f4d2-openshift-default-f8748787b-9fqhj\" (UID: \"ac395bec-c4ec-4b1c-9078-d4f995574cdc\") " pod="openshift-ingress/e2e-shared-b-48f4d2-openshift-default-f8748787b-9fqhj"
Jul 24 19:22:14.240322 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:22:14.240168    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ac395bec-c4ec-4b1c-9078-d4f995574cdc-istio-data\") pod \"e2e-shared-b-48f4d2-openshift-default-f8748787b-9fqhj\" (UID: \"ac395bec-c4ec-4b1c-9078-d4f995574cdc\") " pod="openshift-ingress/e2e-shared-b-48f4d2-openshift-default-f8748787b-9fqhj"
Jul 24 19:22:14.341151 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:22:14.341075    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ac395bec-c4ec-4b1c-9078-d4f995574cdc-workload-certs\") pod \"e2e-shared-b-48f4d2-openshift-default-f8748787b-9fqhj\" (UID: \"ac395bec-c4ec-4b1c-9078-d4f995574cdc\") " pod="openshift-ingress/e2e-shared-b-48f4d2-openshift-default-f8748787b-9fqhj"
Jul 24 19:22:14.341151 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:22:14.341155    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac395bec-c4ec-4b1c-9078-d4f995574cdc-workload-socket\") pod \"e2e-shared-b-48f4d2-openshift-default-f8748787b-9fqhj\" (UID: \"ac395bec-c4ec-4b1c-9078-d4f995574cdc\") " pod="openshift-ingress/e2e-shared-b-48f4d2-openshift-default-f8748787b-9fqhj"
Jul 24 19:22:14.341435 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:22:14.341198    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac395bec-c4ec-4b1c-9078-d4f995574cdc-credential-socket\") pod \"e2e-shared-b-48f4d2-openshift-default-f8748787b-9fqhj\" (UID: \"ac395bec-c4ec-4b1c-9078-d4f995574cdc\") " pod="openshift-ingress/e2e-shared-b-48f4d2-openshift-default-f8748787b-9fqhj"
Jul 24 19:22:14.341435 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:22:14.341236    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4vvst\" (UniqueName: \"kubernetes.io/projected/ac395bec-c4ec-4b1c-9078-d4f995574cdc-kube-api-access-4vvst\") pod \"e2e-shared-b-48f4d2-openshift-default-f8748787b-9fqhj\" (UID: \"ac395bec-c4ec-4b1c-9078-d4f995574cdc\") " pod="openshift-ingress/e2e-shared-b-48f4d2-openshift-default-f8748787b-9fqhj"
Jul 24 19:22:14.341435 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:22:14.341292    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ac395bec-c4ec-4b1c-9078-d4f995574cdc-istio-podinfo\") pod \"e2e-shared-b-48f4d2-openshift-default-f8748787b-9fqhj\" (UID: \"ac395bec-c4ec-4b1c-9078-d4f995574cdc\") " pod="openshift-ingress/e2e-shared-b-48f4d2-openshift-default-f8748787b-9fqhj"
Jul 24 19:22:14.341435 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:22:14.341323    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ac395bec-c4ec-4b1c-9078-d4f995574cdc-istio-envoy\") pod \"e2e-shared-b-48f4d2-openshift-default-f8748787b-9fqhj\" (UID: \"ac395bec-c4ec-4b1c-9078-d4f995574cdc\") " pod="openshift-ingress/e2e-shared-b-48f4d2-openshift-default-f8748787b-9fqhj"
Jul 24 19:22:14.341435 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:22:14.341356    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ac395bec-c4ec-4b1c-9078-d4f995574cdc-istio-token\") pod \"e2e-shared-b-48f4d2-openshift-default-f8748787b-9fqhj\" (UID: \"ac395bec-c4ec-4b1c-9078-d4f995574cdc\") " pod="openshift-ingress/e2e-shared-b-48f4d2-openshift-default-f8748787b-9fqhj"
Jul 24 19:22:14.341693 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:22:14.341550    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac395bec-c4ec-4b1c-9078-d4f995574cdc-workload-socket\") pod \"e2e-shared-b-48f4d2-openshift-default-f8748787b-9fqhj\" (UID: \"ac395bec-c4ec-4b1c-9078-d4f995574cdc\") " pod="openshift-ingress/e2e-shared-b-48f4d2-openshift-default-f8748787b-9fqhj"
Jul 24 19:22:14.341693 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:22:14.341571    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac395bec-c4ec-4b1c-9078-d4f995574cdc-credential-socket\") pod \"e2e-shared-b-48f4d2-openshift-default-f8748787b-9fqhj\" (UID: \"ac395bec-c4ec-4b1c-9078-d4f995574cdc\") " pod="openshift-ingress/e2e-shared-b-48f4d2-openshift-default-f8748787b-9fqhj"
Jul 24 19:22:14.341693 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:22:14.341644    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ac395bec-c4ec-4b1c-9078-d4f995574cdc-istiod-ca-cert\") pod \"e2e-shared-b-48f4d2-openshift-default-f8748787b-9fqhj\" (UID: \"ac395bec-c4ec-4b1c-9078-d4f995574cdc\") " pod="openshift-ingress/e2e-shared-b-48f4d2-openshift-default-f8748787b-9fqhj"
Jul 24 19:22:14.341693 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:22:14.341647    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ac395bec-c4ec-4b1c-9078-d4f995574cdc-workload-certs\") pod \"e2e-shared-b-48f4d2-openshift-default-f8748787b-9fqhj\" (UID: \"ac395bec-c4ec-4b1c-9078-d4f995574cdc\") " pod="openshift-ingress/e2e-shared-b-48f4d2-openshift-default-f8748787b-9fqhj"
Jul 24 19:22:14.341907 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:22:14.341757    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ac395bec-c4ec-4b1c-9078-d4f995574cdc-istio-data\") pod \"e2e-shared-b-48f4d2-openshift-default-f8748787b-9fqhj\" (UID: \"ac395bec-c4ec-4b1c-9078-d4f995574cdc\") " pod="openshift-ingress/e2e-shared-b-48f4d2-openshift-default-f8748787b-9fqhj"
Jul 24 19:22:14.342143 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:22:14.342036    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ac395bec-c4ec-4b1c-9078-d4f995574cdc-istio-data\") pod \"e2e-shared-b-48f4d2-openshift-default-f8748787b-9fqhj\" (UID: \"ac395bec-c4ec-4b1c-9078-d4f995574cdc\") " pod="openshift-ingress/e2e-shared-b-48f4d2-openshift-default-f8748787b-9fqhj"
Jul 24 19:22:14.342355 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:22:14.342263    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ac395bec-c4ec-4b1c-9078-d4f995574cdc-istiod-ca-cert\") pod \"e2e-shared-b-48f4d2-openshift-default-f8748787b-9fqhj\" (UID: \"ac395bec-c4ec-4b1c-9078-d4f995574cdc\") " pod="openshift-ingress/e2e-shared-b-48f4d2-openshift-default-f8748787b-9fqhj"
Jul 24 19:22:14.343750 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:22:14.343733    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ac395bec-c4ec-4b1c-9078-d4f995574cdc-istio-envoy\") pod \"e2e-shared-b-48f4d2-openshift-default-f8748787b-9fqhj\" (UID: \"ac395bec-c4ec-4b1c-9078-d4f995574cdc\") " pod="openshift-ingress/e2e-shared-b-48f4d2-openshift-default-f8748787b-9fqhj"
Jul 24 19:22:14.344086 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:22:14.344067    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ac395bec-c4ec-4b1c-9078-d4f995574cdc-istio-podinfo\") pod \"e2e-shared-b-48f4d2-openshift-default-f8748787b-9fqhj\" (UID: \"ac395bec-c4ec-4b1c-9078-d4f995574cdc\") " pod="openshift-ingress/e2e-shared-b-48f4d2-openshift-default-f8748787b-9fqhj"
Jul 24 19:22:14.350150 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:22:14.350111    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ac395bec-c4ec-4b1c-9078-d4f995574cdc-istio-token\") pod \"e2e-shared-b-48f4d2-openshift-default-f8748787b-9fqhj\" (UID: \"ac395bec-c4ec-4b1c-9078-d4f995574cdc\") " pod="openshift-ingress/e2e-shared-b-48f4d2-openshift-default-f8748787b-9fqhj"
Jul 24 19:22:14.350437 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:22:14.350417    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4vvst\" (UniqueName: \"kubernetes.io/projected/ac395bec-c4ec-4b1c-9078-d4f995574cdc-kube-api-access-4vvst\") pod \"e2e-shared-b-48f4d2-openshift-default-f8748787b-9fqhj\" (UID: \"ac395bec-c4ec-4b1c-9078-d4f995574cdc\") " pod="openshift-ingress/e2e-shared-b-48f4d2-openshift-default-f8748787b-9fqhj"
Jul 24 19:22:14.486344 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:22:14.486304    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:22:14.501306 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:22:14.501276    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-48f4d2-openshift-default-f8748787b-9fqhj"
Jul 24 19:22:14.649436 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:22:14.649404    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-48f4d2-openshift-default-f8748787b-9fqhj"]
Jul 24 19:22:14.651546 ip-10-0-141-146 kubenswrapper[2580]: W0724 19:22:14.651519    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac395bec_c4ec_4b1c_9078_d4f995574cdc.slice/crio-a3a28a4cc3248d19bb54ec299238ecb41fec07f6cc86878306d5be828b60e23e WatchSource:0}: Error finding container a3a28a4cc3248d19bb54ec299238ecb41fec07f6cc86878306d5be828b60e23e: Status 404 returned error can't find the container with id a3a28a4cc3248d19bb54ec299238ecb41fec07f6cc86878306d5be828b60e23e
Jul 24 19:22:14.654170 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:22:14.654139    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 24 19:22:14.654243 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:22:14.654204    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 24 19:22:14.654243 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:22:14.654232    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 24 19:22:15.230967 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:22:15.230929    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-48f4d2-openshift-default-f8748787b-9fqhj" event={"ID":"ac395bec-c4ec-4b1c-9078-d4f995574cdc","Type":"ContainerStarted","Data":"8b7558c8424929c495c3fc5b056c9eba7c08e2e6e56deae9679ed6ddc25e4463"}
Jul 24 19:22:15.231158 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:22:15.230985    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-48f4d2-openshift-default-f8748787b-9fqhj" event={"ID":"ac395bec-c4ec-4b1c-9078-d4f995574cdc","Type":"ContainerStarted","Data":"a3a28a4cc3248d19bb54ec299238ecb41fec07f6cc86878306d5be828b60e23e"}
Jul 24 19:22:15.251371 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:22:15.251314    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-48f4d2-openshift-default-f8748787b-9fqhj" podStartSLOduration=1.2512989380000001 podStartE2EDuration="1.251298938s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 19:22:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:22:15.249467768 +0000 UTC m=+2290.458839838" watchObservedRunningTime="2026-07-24 19:22:15.251298938 +0000 UTC m=+2290.460670980"
Jul 24 19:22:15.501910 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:22:15.501829    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-48f4d2-openshift-default-f8748787b-9fqhj"
Jul 24 19:22:15.506842 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:22:15.506820    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-48f4d2-openshift-default-f8748787b-9fqhj"
Jul 24 19:22:16.236039 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:22:16.236004    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-48f4d2-openshift-default-f8748787b-9fqhj"
Jul 24 19:22:16.236978 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:22:16.236959    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-48f4d2-openshift-default-f8748787b-9fqhj"
Jul 24 19:22:17.161691 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:22:17.161653    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:22:17.251665 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:22:17.251631    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:22:17.328269 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:22:17.328231    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:22:17.427186 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:22:17.427076    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:22:17.827956 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:22:17.827924    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:22:17.935319 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:22:17.935287    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:22:21.624703 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:22:21.624661    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:22:29.089250 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:22:29.089200    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-e05f4d/auth-test-model-e05f4d-kserve-c674bfc55-dr8rq"]
Jul 24 19:22:29.093500 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:22:29.093476    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-e05f4d/auth-test-model-e05f4d-kserve-c674bfc55-dr8rq"
Jul 24 19:22:29.097644 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:22:29.097617    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-e05f4d\"/\"openshift-service-ca.crt\""
Jul 24 19:22:29.097803 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:22:29.097650    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-e05f4d\"/\"kube-root-ca.crt\""
Jul 24 19:22:29.097803 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:22:29.097617    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-e05f4d\"/\"default-dockercfg-v29xv\""
Jul 24 19:22:29.097803 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:22:29.097681    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-e05f4d\"/\"auth-test-model-e05f4d-kserve-self-signed-certs\""
Jul 24 19:22:29.103269 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:22:29.103243    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-e05f4d/auth-test-model-e05f4d-kserve-c674bfc55-dr8rq"]
Jul 24 19:22:29.171910 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:22:29.171877    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:22:29.195904 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:22:29.195868    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/48ae17ec-db2e-4b56-8205-96b6b3902ddd-tls-certs\") pod \"auth-test-model-e05f4d-kserve-c674bfc55-dr8rq\" (UID: \"48ae17ec-db2e-4b56-8205-96b6b3902ddd\") " pod="ai-tenant-e2e-shared-a-e05f4d/auth-test-model-e05f4d-kserve-c674bfc55-dr8rq"
Jul 24 19:22:29.196133 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:22:29.195913    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/48ae17ec-db2e-4b56-8205-96b6b3902ddd-model-cache\") pod \"auth-test-model-e05f4d-kserve-c674bfc55-dr8rq\" (UID: \"48ae17ec-db2e-4b56-8205-96b6b3902ddd\") " pod="ai-tenant-e2e-shared-a-e05f4d/auth-test-model-e05f4d-kserve-c674bfc55-dr8rq"
Jul 24 19:22:29.196133 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:22:29.195935    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/48ae17ec-db2e-4b56-8205-96b6b3902ddd-tmp-dir\") pod \"auth-test-model-e05f4d-kserve-c674bfc55-dr8rq\" (UID: \"48ae17ec-db2e-4b56-8205-96b6b3902ddd\") " pod="ai-tenant-e2e-shared-a-e05f4d/auth-test-model-e05f4d-kserve-c674bfc55-dr8rq"
Jul 24 19:22:29.196133 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:22:29.196053    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/48ae17ec-db2e-4b56-8205-96b6b3902ddd-home\") pod \"auth-test-model-e05f4d-kserve-c674bfc55-dr8rq\" (UID: \"48ae17ec-db2e-4b56-8205-96b6b3902ddd\") " pod="ai-tenant-e2e-shared-a-e05f4d/auth-test-model-e05f4d-kserve-c674bfc55-dr8rq"
Jul 24 19:22:29.196259 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:22:29.196197    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/48ae17ec-db2e-4b56-8205-96b6b3902ddd-dshm\") pod \"auth-test-model-e05f4d-kserve-c674bfc55-dr8rq\" (UID: \"48ae17ec-db2e-4b56-8205-96b6b3902ddd\") " pod="ai-tenant-e2e-shared-a-e05f4d/auth-test-model-e05f4d-kserve-c674bfc55-dr8rq"
Jul 24 19:22:29.196259 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:22:29.196218    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2ztkx\" (UniqueName: \"kubernetes.io/projected/48ae17ec-db2e-4b56-8205-96b6b3902ddd-kube-api-access-2ztkx\") pod \"auth-test-model-e05f4d-kserve-c674bfc55-dr8rq\" (UID: \"48ae17ec-db2e-4b56-8205-96b6b3902ddd\") " pod="ai-tenant-e2e-shared-a-e05f4d/auth-test-model-e05f4d-kserve-c674bfc55-dr8rq"
Jul 24 19:22:29.297133 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:22:29.297090    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/48ae17ec-db2e-4b56-8205-96b6b3902ddd-dshm\") pod \"auth-test-model-e05f4d-kserve-c674bfc55-dr8rq\" (UID: \"48ae17ec-db2e-4b56-8205-96b6b3902ddd\") " pod="ai-tenant-e2e-shared-a-e05f4d/auth-test-model-e05f4d-kserve-c674bfc55-dr8rq"
Jul 24 19:22:29.297332 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:22:29.297159    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2ztkx\" (UniqueName: \"kubernetes.io/projected/48ae17ec-db2e-4b56-8205-96b6b3902ddd-kube-api-access-2ztkx\") pod \"auth-test-model-e05f4d-kserve-c674bfc55-dr8rq\" (UID: \"48ae17ec-db2e-4b56-8205-96b6b3902ddd\") " pod="ai-tenant-e2e-shared-a-e05f4d/auth-test-model-e05f4d-kserve-c674bfc55-dr8rq"
Jul 24 19:22:29.297332 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:22:29.297209    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/48ae17ec-db2e-4b56-8205-96b6b3902ddd-tls-certs\") pod \"auth-test-model-e05f4d-kserve-c674bfc55-dr8rq\" (UID: \"48ae17ec-db2e-4b56-8205-96b6b3902ddd\") " pod="ai-tenant-e2e-shared-a-e05f4d/auth-test-model-e05f4d-kserve-c674bfc55-dr8rq"
Jul 24 19:22:29.297332 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:22:29.297253    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/48ae17ec-db2e-4b56-8205-96b6b3902ddd-model-cache\") pod \"auth-test-model-e05f4d-kserve-c674bfc55-dr8rq\" (UID: \"48ae17ec-db2e-4b56-8205-96b6b3902ddd\") " pod="ai-tenant-e2e-shared-a-e05f4d/auth-test-model-e05f4d-kserve-c674bfc55-dr8rq"
Jul 24 19:22:29.297332 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:22:29.297283    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/48ae17ec-db2e-4b56-8205-96b6b3902ddd-tmp-dir\") pod \"auth-test-model-e05f4d-kserve-c674bfc55-dr8rq\" (UID: \"48ae17ec-db2e-4b56-8205-96b6b3902ddd\") " pod="ai-tenant-e2e-shared-a-e05f4d/auth-test-model-e05f4d-kserve-c674bfc55-dr8rq"
Jul 24 19:22:29.297551 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:22:29.297351    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/48ae17ec-db2e-4b56-8205-96b6b3902ddd-home\") pod \"auth-test-model-e05f4d-kserve-c674bfc55-dr8rq\" (UID: \"48ae17ec-db2e-4b56-8205-96b6b3902ddd\") " pod="ai-tenant-e2e-shared-a-e05f4d/auth-test-model-e05f4d-kserve-c674bfc55-dr8rq"
Jul 24 19:22:29.297936 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:22:29.297886    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/48ae17ec-db2e-4b56-8205-96b6b3902ddd-model-cache\") pod \"auth-test-model-e05f4d-kserve-c674bfc55-dr8rq\" (UID: \"48ae17ec-db2e-4b56-8205-96b6b3902ddd\") " pod="ai-tenant-e2e-shared-a-e05f4d/auth-test-model-e05f4d-kserve-c674bfc55-dr8rq"
Jul 24 19:22:29.297936 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:22:29.297912    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/48ae17ec-db2e-4b56-8205-96b6b3902ddd-home\") pod \"auth-test-model-e05f4d-kserve-c674bfc55-dr8rq\" (UID: \"48ae17ec-db2e-4b56-8205-96b6b3902ddd\") " pod="ai-tenant-e2e-shared-a-e05f4d/auth-test-model-e05f4d-kserve-c674bfc55-dr8rq"
Jul 24 19:22:29.298100 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:22:29.298006    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/48ae17ec-db2e-4b56-8205-96b6b3902ddd-tmp-dir\") pod \"auth-test-model-e05f4d-kserve-c674bfc55-dr8rq\" (UID: \"48ae17ec-db2e-4b56-8205-96b6b3902ddd\") " pod="ai-tenant-e2e-shared-a-e05f4d/auth-test-model-e05f4d-kserve-c674bfc55-dr8rq"
Jul 24 19:22:29.300336 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:22:29.300307    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/48ae17ec-db2e-4b56-8205-96b6b3902ddd-dshm\") pod \"auth-test-model-e05f4d-kserve-c674bfc55-dr8rq\" (UID: \"48ae17ec-db2e-4b56-8205-96b6b3902ddd\") " pod="ai-tenant-e2e-shared-a-e05f4d/auth-test-model-e05f4d-kserve-c674bfc55-dr8rq"
Jul 24 19:22:29.300534 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:22:29.300516    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/48ae17ec-db2e-4b56-8205-96b6b3902ddd-tls-certs\") pod \"auth-test-model-e05f4d-kserve-c674bfc55-dr8rq\" (UID: \"48ae17ec-db2e-4b56-8205-96b6b3902ddd\") " pod="ai-tenant-e2e-shared-a-e05f4d/auth-test-model-e05f4d-kserve-c674bfc55-dr8rq"
Jul 24 19:22:29.305993 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:22:29.305970    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2ztkx\" (UniqueName: \"kubernetes.io/projected/48ae17ec-db2e-4b56-8205-96b6b3902ddd-kube-api-access-2ztkx\") pod \"auth-test-model-e05f4d-kserve-c674bfc55-dr8rq\" (UID: \"48ae17ec-db2e-4b56-8205-96b6b3902ddd\") " pod="ai-tenant-e2e-shared-a-e05f4d/auth-test-model-e05f4d-kserve-c674bfc55-dr8rq"
Jul 24 19:22:29.405616 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:22:29.405522    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-e05f4d/auth-test-model-e05f4d-kserve-c674bfc55-dr8rq"
Jul 24 19:22:29.555362 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:22:29.555319    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-e05f4d/auth-test-model-e05f4d-kserve-c674bfc55-dr8rq"]
Jul 24 19:22:29.557398 ip-10-0-141-146 kubenswrapper[2580]: W0724 19:22:29.557367    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod48ae17ec_db2e_4b56_8205_96b6b3902ddd.slice/crio-1f9e5a704915da1f7394c31b9f8cd5b904c549f78f7b223261d7719343186a8c WatchSource:0}: Error finding container 1f9e5a704915da1f7394c31b9f8cd5b904c549f78f7b223261d7719343186a8c: Status 404 returned error can't find the container with id 1f9e5a704915da1f7394c31b9f8cd5b904c549f78f7b223261d7719343186a8c
Jul 24 19:22:30.307440 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:22:30.307398    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-e05f4d/auth-test-model-e05f4d-kserve-c674bfc55-dr8rq" event={"ID":"48ae17ec-db2e-4b56-8205-96b6b3902ddd","Type":"ContainerStarted","Data":"717506f396dcd846c64ce5066294e16d6c98e73d646a3bb6ad911acec0b171d6"}
Jul 24 19:22:30.307854 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:22:30.307456    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-e05f4d/auth-test-model-e05f4d-kserve-c674bfc55-dr8rq" event={"ID":"48ae17ec-db2e-4b56-8205-96b6b3902ddd","Type":"ContainerStarted","Data":"1f9e5a704915da1f7394c31b9f8cd5b904c549f78f7b223261d7719343186a8c"}
Jul 24 19:22:30.327687 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:22:30.327626    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-e05f4d/auth-test-model-e05f4d-kserve-c674bfc55-dr8rq" podStartSLOduration=1.327608153 podStartE2EDuration="1.327608153s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 19:22:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:22:30.326343224 +0000 UTC m=+2305.535715279" watchObservedRunningTime="2026-07-24 19:22:30.327608153 +0000 UTC m=+2305.536980195"
Jul 24 19:22:31.237981 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:22:31.237897    2580 patch_prober.go:28] interesting pod/e2e-shared-b-48f4d2-openshift-default-f8748787b-9fqhj container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Jul 24 19:22:31.237981 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:22:31.237952    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-48f4d2-openshift-default-f8748787b-9fqhj" podUID="ac395bec-c4ec-4b1c-9078-d4f995574cdc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Jul 24 19:22:31.313595 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:22:31.313558    2580 generic.go:356] "Generic (PLEG): container finished" podID="ac395bec-c4ec-4b1c-9078-d4f995574cdc" containerID="8b7558c8424929c495c3fc5b056c9eba7c08e2e6e56deae9679ed6ddc25e4463" exitCode=0
Jul 24 19:22:31.314008 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:22:31.313631    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-48f4d2-openshift-default-f8748787b-9fqhj" event={"ID":"ac395bec-c4ec-4b1c-9078-d4f995574cdc","Type":"ContainerDied","Data":"8b7558c8424929c495c3fc5b056c9eba7c08e2e6e56deae9679ed6ddc25e4463"}
Jul 24 19:22:31.314099 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:22:31.314086    2580 scope.go:117] "RemoveContainer" containerID="8b7558c8424929c495c3fc5b056c9eba7c08e2e6e56deae9679ed6ddc25e4463"
Jul 24 19:22:31.315195 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:22:31.315162    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 24 19:22:31.315272 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:22:31.315249    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 24 19:22:31.315311 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:22:31.315293    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 24 19:22:32.320521 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:22:32.320483    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-48f4d2-openshift-default-f8748787b-9fqhj" event={"ID":"ac395bec-c4ec-4b1c-9078-d4f995574cdc","Type":"ContainerStarted","Data":"c76833a185fd4785479409e00074fd7f16a4865db6c78a341dc32e5dbf5fcb1d"}
Jul 24 19:22:32.502177 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:22:32.502140    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-48f4d2-openshift-default-f8748787b-9fqhj"
Jul 24 19:22:32.502403 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:22:32.502380    2580 patch_prober.go:28] interesting pod/e2e-shared-b-48f4d2-openshift-default-f8748787b-9fqhj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Jul 24 19:22:32.502460 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:22:32.502440    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-48f4d2-openshift-default-f8748787b-9fqhj" podUID="ac395bec-c4ec-4b1c-9078-d4f995574cdc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Jul 24 19:22:33.502017 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:22:33.501978    2580 patch_prober.go:28] interesting pod/e2e-shared-b-48f4d2-openshift-default-f8748787b-9fqhj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Jul 24 19:22:33.502643 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:22:33.502610    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-48f4d2-openshift-default-f8748787b-9fqhj" podUID="ac395bec-c4ec-4b1c-9078-d4f995574cdc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Jul 24 19:22:34.502420 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:22:34.502379    2580 patch_prober.go:28] interesting pod/e2e-shared-b-48f4d2-openshift-default-f8748787b-9fqhj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Jul 24 19:22:34.503040 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:22:34.503001    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-48f4d2-openshift-default-f8748787b-9fqhj" podUID="ac395bec-c4ec-4b1c-9078-d4f995574cdc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Jul 24 19:22:35.503199 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:22:35.502705    2580 patch_prober.go:28] interesting pod/e2e-shared-b-48f4d2-openshift-default-f8748787b-9fqhj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Jul 24 19:22:35.503199 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:22:35.502780    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-48f4d2-openshift-default-f8748787b-9fqhj" podUID="ac395bec-c4ec-4b1c-9078-d4f995574cdc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Jul 24 19:22:36.501876 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:22:36.501822    2580 patch_prober.go:28] interesting pod/e2e-shared-b-48f4d2-openshift-default-f8748787b-9fqhj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Jul 24 19:22:36.502101 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:22:36.501919    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-48f4d2-openshift-default-f8748787b-9fqhj" podUID="ac395bec-c4ec-4b1c-9078-d4f995574cdc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Jul 24 19:22:37.506622 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:22:37.506591    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-48f4d2-openshift-default-f8748787b-9fqhj"
Jul 24 19:22:37.507101 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:22:37.506933    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-48f4d2-openshift-default-f8748787b-9fqhj"
Jul 24 19:22:37.507704 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:22:37.507684    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-48f4d2-openshift-default-f8748787b-9fqhj"
Jul 24 19:22:39.406264 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:22:39.406230    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-e05f4d/auth-test-model-e05f4d-kserve-c674bfc55-dr8rq"
Jul 24 19:22:39.406264 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:22:39.406272    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-e05f4d/auth-test-model-e05f4d-kserve-c674bfc55-dr8rq"
Jul 24 19:22:39.418869 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:22:39.418838    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-e05f4d/auth-test-model-e05f4d-kserve-c674bfc55-dr8rq"
Jul 24 19:22:40.370981 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:22:40.370951    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-e05f4d/auth-test-model-e05f4d-kserve-c674bfc55-dr8rq"
Jul 24 19:23:10.581693 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:23:10.581645    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:24:06.278862 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:24:06.278832    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qvzgb_dd21fc27-5a24-4f3a-a912-043af27a4342/ovn-acl-logging/0.log"
Jul 24 19:24:06.289738 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:24:06.289711    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qvzgb_dd21fc27-5a24-4f3a-a912-043af27a4342/ovn-acl-logging/0.log"
Jul 24 19:25:17.356411 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:25:17.356373    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-e05f4d/auth-test-model-e05f4d-kserve-c674bfc55-dr8rq"]
Jul 24 19:25:17.406039 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:25:17.406008    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:25:18.200435 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:25:18.200383    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:25:26.868366 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:25:26.868331    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-e05f4d/sub-test-model-e05f4d-kserve-656c845dc5-lr94n"]
Jul 24 19:25:26.871859 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:25:26.871841    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-e05f4d/sub-test-model-e05f4d-kserve-656c845dc5-lr94n"
Jul 24 19:25:26.874378 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:25:26.874349    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-e05f4d\"/\"sub-test-model-e05f4d-kserve-self-signed-certs\""
Jul 24 19:25:26.880946 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:25:26.880485    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a3a70672-ad09-446b-8226-671ea9795f60-home\") pod \"sub-test-model-e05f4d-kserve-656c845dc5-lr94n\" (UID: \"a3a70672-ad09-446b-8226-671ea9795f60\") " pod="ai-tenant-e2e-shared-a-e05f4d/sub-test-model-e05f4d-kserve-656c845dc5-lr94n"
Jul 24 19:25:26.880946 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:25:26.880551    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a3a70672-ad09-446b-8226-671ea9795f60-tmp-dir\") pod \"sub-test-model-e05f4d-kserve-656c845dc5-lr94n\" (UID: \"a3a70672-ad09-446b-8226-671ea9795f60\") " pod="ai-tenant-e2e-shared-a-e05f4d/sub-test-model-e05f4d-kserve-656c845dc5-lr94n"
Jul 24 19:25:26.880946 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:25:26.880576    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a3a70672-ad09-446b-8226-671ea9795f60-dshm\") pod \"sub-test-model-e05f4d-kserve-656c845dc5-lr94n\" (UID: \"a3a70672-ad09-446b-8226-671ea9795f60\") " pod="ai-tenant-e2e-shared-a-e05f4d/sub-test-model-e05f4d-kserve-656c845dc5-lr94n"
Jul 24 19:25:26.880946 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:25:26.880602    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a3a70672-ad09-446b-8226-671ea9795f60-tls-certs\") pod \"sub-test-model-e05f4d-kserve-656c845dc5-lr94n\" (UID: \"a3a70672-ad09-446b-8226-671ea9795f60\") " pod="ai-tenant-e2e-shared-a-e05f4d/sub-test-model-e05f4d-kserve-656c845dc5-lr94n"
Jul 24 19:25:26.880946 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:25:26.880678    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ldhdb\" (UniqueName: \"kubernetes.io/projected/a3a70672-ad09-446b-8226-671ea9795f60-kube-api-access-ldhdb\") pod \"sub-test-model-e05f4d-kserve-656c845dc5-lr94n\" (UID: \"a3a70672-ad09-446b-8226-671ea9795f60\") " pod="ai-tenant-e2e-shared-a-e05f4d/sub-test-model-e05f4d-kserve-656c845dc5-lr94n"
Jul 24 19:25:26.880946 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:25:26.880720    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a3a70672-ad09-446b-8226-671ea9795f60-model-cache\") pod \"sub-test-model-e05f4d-kserve-656c845dc5-lr94n\" (UID: \"a3a70672-ad09-446b-8226-671ea9795f60\") " pod="ai-tenant-e2e-shared-a-e05f4d/sub-test-model-e05f4d-kserve-656c845dc5-lr94n"
Jul 24 19:25:26.881514 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:25:26.881472    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-e05f4d/sub-test-model-e05f4d-kserve-656c845dc5-lr94n"]
Jul 24 19:25:26.904269 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:25:26.904225    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:25:26.981381 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:25:26.981341    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ldhdb\" (UniqueName: \"kubernetes.io/projected/a3a70672-ad09-446b-8226-671ea9795f60-kube-api-access-ldhdb\") pod \"sub-test-model-e05f4d-kserve-656c845dc5-lr94n\" (UID: \"a3a70672-ad09-446b-8226-671ea9795f60\") " pod="ai-tenant-e2e-shared-a-e05f4d/sub-test-model-e05f4d-kserve-656c845dc5-lr94n"
Jul 24 19:25:26.981585 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:25:26.981404    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a3a70672-ad09-446b-8226-671ea9795f60-model-cache\") pod \"sub-test-model-e05f4d-kserve-656c845dc5-lr94n\" (UID: \"a3a70672-ad09-446b-8226-671ea9795f60\") " pod="ai-tenant-e2e-shared-a-e05f4d/sub-test-model-e05f4d-kserve-656c845dc5-lr94n"
Jul 24 19:25:26.981585 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:25:26.981508    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a3a70672-ad09-446b-8226-671ea9795f60-home\") pod \"sub-test-model-e05f4d-kserve-656c845dc5-lr94n\" (UID: \"a3a70672-ad09-446b-8226-671ea9795f60\") " pod="ai-tenant-e2e-shared-a-e05f4d/sub-test-model-e05f4d-kserve-656c845dc5-lr94n"
Jul 24 19:25:26.981585 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:25:26.981552    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a3a70672-ad09-446b-8226-671ea9795f60-tmp-dir\") pod \"sub-test-model-e05f4d-kserve-656c845dc5-lr94n\" (UID: \"a3a70672-ad09-446b-8226-671ea9795f60\") " pod="ai-tenant-e2e-shared-a-e05f4d/sub-test-model-e05f4d-kserve-656c845dc5-lr94n"
Jul 24 19:25:26.981585 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:25:26.981574    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a3a70672-ad09-446b-8226-671ea9795f60-dshm\") pod \"sub-test-model-e05f4d-kserve-656c845dc5-lr94n\" (UID: \"a3a70672-ad09-446b-8226-671ea9795f60\") " pod="ai-tenant-e2e-shared-a-e05f4d/sub-test-model-e05f4d-kserve-656c845dc5-lr94n"
Jul 24 19:25:26.981828 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:25:26.981599    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a3a70672-ad09-446b-8226-671ea9795f60-tls-certs\") pod \"sub-test-model-e05f4d-kserve-656c845dc5-lr94n\" (UID: \"a3a70672-ad09-446b-8226-671ea9795f60\") " pod="ai-tenant-e2e-shared-a-e05f4d/sub-test-model-e05f4d-kserve-656c845dc5-lr94n"
Jul 24 19:25:26.981915 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:25:26.981888    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a3a70672-ad09-446b-8226-671ea9795f60-model-cache\") pod \"sub-test-model-e05f4d-kserve-656c845dc5-lr94n\" (UID: \"a3a70672-ad09-446b-8226-671ea9795f60\") " pod="ai-tenant-e2e-shared-a-e05f4d/sub-test-model-e05f4d-kserve-656c845dc5-lr94n"
Jul 24 19:25:26.982303 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:25:26.982267    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a3a70672-ad09-446b-8226-671ea9795f60-home\") pod \"sub-test-model-e05f4d-kserve-656c845dc5-lr94n\" (UID: \"a3a70672-ad09-446b-8226-671ea9795f60\") " pod="ai-tenant-e2e-shared-a-e05f4d/sub-test-model-e05f4d-kserve-656c845dc5-lr94n"
Jul 24 19:25:26.982303 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:25:26.982276    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a3a70672-ad09-446b-8226-671ea9795f60-tmp-dir\") pod \"sub-test-model-e05f4d-kserve-656c845dc5-lr94n\" (UID: \"a3a70672-ad09-446b-8226-671ea9795f60\") " pod="ai-tenant-e2e-shared-a-e05f4d/sub-test-model-e05f4d-kserve-656c845dc5-lr94n"
Jul 24 19:25:26.984800 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:25:26.984772    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a3a70672-ad09-446b-8226-671ea9795f60-tls-certs\") pod \"sub-test-model-e05f4d-kserve-656c845dc5-lr94n\" (UID: \"a3a70672-ad09-446b-8226-671ea9795f60\") " pod="ai-tenant-e2e-shared-a-e05f4d/sub-test-model-e05f4d-kserve-656c845dc5-lr94n"
Jul 24 19:25:26.984800 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:25:26.984784    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a3a70672-ad09-446b-8226-671ea9795f60-dshm\") pod \"sub-test-model-e05f4d-kserve-656c845dc5-lr94n\" (UID: \"a3a70672-ad09-446b-8226-671ea9795f60\") " pod="ai-tenant-e2e-shared-a-e05f4d/sub-test-model-e05f4d-kserve-656c845dc5-lr94n"
Jul 24 19:25:26.991386 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:25:26.991353    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ldhdb\" (UniqueName: \"kubernetes.io/projected/a3a70672-ad09-446b-8226-671ea9795f60-kube-api-access-ldhdb\") pod \"sub-test-model-e05f4d-kserve-656c845dc5-lr94n\" (UID: \"a3a70672-ad09-446b-8226-671ea9795f60\") " pod="ai-tenant-e2e-shared-a-e05f4d/sub-test-model-e05f4d-kserve-656c845dc5-lr94n"
Jul 24 19:25:27.182406 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:25:27.182307    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-e05f4d/sub-test-model-e05f4d-kserve-656c845dc5-lr94n"
Jul 24 19:25:27.330550 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:25:27.330523    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-e05f4d/sub-test-model-e05f4d-kserve-656c845dc5-lr94n"]
Jul 24 19:25:27.333091 ip-10-0-141-146 kubenswrapper[2580]: W0724 19:25:27.333049    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda3a70672_ad09_446b_8226_671ea9795f60.slice/crio-35434650d1edea41f8a4d13e46709993c307c501a67c921ce306c2506b550491 WatchSource:0}: Error finding container 35434650d1edea41f8a4d13e46709993c307c501a67c921ce306c2506b550491: Status 404 returned error can't find the container with id 35434650d1edea41f8a4d13e46709993c307c501a67c921ce306c2506b550491
Jul 24 19:25:28.192172 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:25:28.192137    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-e05f4d/sub-test-model-e05f4d-kserve-656c845dc5-lr94n" event={"ID":"a3a70672-ad09-446b-8226-671ea9795f60","Type":"ContainerStarted","Data":"28ddee5613defaa4c51bc22302e88b633c6fd1aea6814a21e5371a56417f81a5"}
Jul 24 19:25:28.192172 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:25:28.192180    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-e05f4d/sub-test-model-e05f4d-kserve-656c845dc5-lr94n" event={"ID":"a3a70672-ad09-446b-8226-671ea9795f60","Type":"ContainerStarted","Data":"35434650d1edea41f8a4d13e46709993c307c501a67c921ce306c2506b550491"}
Jul 24 19:25:28.211136 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:25:28.211065    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-e05f4d/sub-test-model-e05f4d-kserve-656c845dc5-lr94n" podStartSLOduration=2.211047653 podStartE2EDuration="2.211047653s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 19:25:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:25:28.209516664 +0000 UTC m=+2483.418888708" watchObservedRunningTime="2026-07-24 19:25:28.211047653 +0000 UTC m=+2483.420419696"
Jul 24 19:25:32.375972 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:25:32.375932    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-e05f4d/auth-test-model-e05f4d-kserve-c674bfc55-dr8rq" podUID="48ae17ec-db2e-4b56-8205-96b6b3902ddd" containerName="main" containerID="cri-o://717506f396dcd846c64ce5066294e16d6c98e73d646a3bb6ad911acec0b171d6" gracePeriod=45
Jul 24 19:25:32.628050 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:25:32.627976    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-e05f4d/auth-test-model-e05f4d-kserve-c674bfc55-dr8rq"
Jul 24 19:25:32.728347 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:25:32.728298    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/48ae17ec-db2e-4b56-8205-96b6b3902ddd-tmp-dir\") pod \"48ae17ec-db2e-4b56-8205-96b6b3902ddd\" (UID: \"48ae17ec-db2e-4b56-8205-96b6b3902ddd\") "
Jul 24 19:25:32.728347 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:25:32.728354    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/48ae17ec-db2e-4b56-8205-96b6b3902ddd-tls-certs\") pod \"48ae17ec-db2e-4b56-8205-96b6b3902ddd\" (UID: \"48ae17ec-db2e-4b56-8205-96b6b3902ddd\") "
Jul 24 19:25:32.728600 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:25:32.728376    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/48ae17ec-db2e-4b56-8205-96b6b3902ddd-model-cache\") pod \"48ae17ec-db2e-4b56-8205-96b6b3902ddd\" (UID: \"48ae17ec-db2e-4b56-8205-96b6b3902ddd\") "
Jul 24 19:25:32.728600 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:25:32.728488    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/48ae17ec-db2e-4b56-8205-96b6b3902ddd-home\") pod \"48ae17ec-db2e-4b56-8205-96b6b3902ddd\" (UID: \"48ae17ec-db2e-4b56-8205-96b6b3902ddd\") "
Jul 24 19:25:32.728600 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:25:32.728535    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2ztkx\" (UniqueName: \"kubernetes.io/projected/48ae17ec-db2e-4b56-8205-96b6b3902ddd-kube-api-access-2ztkx\") pod \"48ae17ec-db2e-4b56-8205-96b6b3902ddd\" (UID: \"48ae17ec-db2e-4b56-8205-96b6b3902ddd\") "
Jul 24 19:25:32.728600 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:25:32.728562    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/48ae17ec-db2e-4b56-8205-96b6b3902ddd-dshm\") pod \"48ae17ec-db2e-4b56-8205-96b6b3902ddd\" (UID: \"48ae17ec-db2e-4b56-8205-96b6b3902ddd\") "
Jul 24 19:25:32.728828 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:25:32.728612    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/48ae17ec-db2e-4b56-8205-96b6b3902ddd-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "48ae17ec-db2e-4b56-8205-96b6b3902ddd" (UID: "48ae17ec-db2e-4b56-8205-96b6b3902ddd"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:25:32.728828 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:25:32.728688    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/48ae17ec-db2e-4b56-8205-96b6b3902ddd-model-cache" (OuterVolumeSpecName: "model-cache") pod "48ae17ec-db2e-4b56-8205-96b6b3902ddd" (UID: "48ae17ec-db2e-4b56-8205-96b6b3902ddd"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:25:32.728828 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:25:32.728795    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/48ae17ec-db2e-4b56-8205-96b6b3902ddd-home" (OuterVolumeSpecName: "home") pod "48ae17ec-db2e-4b56-8205-96b6b3902ddd" (UID: "48ae17ec-db2e-4b56-8205-96b6b3902ddd"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:25:32.728993 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:25:32.728964    2580 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/48ae17ec-db2e-4b56-8205-96b6b3902ddd-tmp-dir\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 24 19:25:32.729038 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:25:32.728994    2580 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/48ae17ec-db2e-4b56-8205-96b6b3902ddd-model-cache\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 24 19:25:32.729038 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:25:32.729008    2580 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/48ae17ec-db2e-4b56-8205-96b6b3902ddd-home\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 24 19:25:32.730806 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:25:32.730787    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/48ae17ec-db2e-4b56-8205-96b6b3902ddd-dshm" (OuterVolumeSpecName: "dshm") pod "48ae17ec-db2e-4b56-8205-96b6b3902ddd" (UID: "48ae17ec-db2e-4b56-8205-96b6b3902ddd"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:25:32.730909 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:25:32.730852    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/48ae17ec-db2e-4b56-8205-96b6b3902ddd-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "48ae17ec-db2e-4b56-8205-96b6b3902ddd" (UID: "48ae17ec-db2e-4b56-8205-96b6b3902ddd"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 19:25:32.730964 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:25:32.730937    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/48ae17ec-db2e-4b56-8205-96b6b3902ddd-kube-api-access-2ztkx" (OuterVolumeSpecName: "kube-api-access-2ztkx") pod "48ae17ec-db2e-4b56-8205-96b6b3902ddd" (UID: "48ae17ec-db2e-4b56-8205-96b6b3902ddd"). InnerVolumeSpecName "kube-api-access-2ztkx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 19:25:32.830163 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:25:32.830109    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2ztkx\" (UniqueName: \"kubernetes.io/projected/48ae17ec-db2e-4b56-8205-96b6b3902ddd-kube-api-access-2ztkx\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 24 19:25:32.830163 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:25:32.830162    2580 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/48ae17ec-db2e-4b56-8205-96b6b3902ddd-dshm\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 24 19:25:32.830163 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:25:32.830174    2580 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/48ae17ec-db2e-4b56-8205-96b6b3902ddd-tls-certs\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 24 19:25:33.216617 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:25:33.216577    2580 generic.go:356] "Generic (PLEG): container finished" podID="48ae17ec-db2e-4b56-8205-96b6b3902ddd" containerID="717506f396dcd846c64ce5066294e16d6c98e73d646a3bb6ad911acec0b171d6" exitCode=0
Jul 24 19:25:33.216814 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:25:33.216621    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-e05f4d/auth-test-model-e05f4d-kserve-c674bfc55-dr8rq"
Jul 24 19:25:33.216814 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:25:33.216658    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-e05f4d/auth-test-model-e05f4d-kserve-c674bfc55-dr8rq" event={"ID":"48ae17ec-db2e-4b56-8205-96b6b3902ddd","Type":"ContainerDied","Data":"717506f396dcd846c64ce5066294e16d6c98e73d646a3bb6ad911acec0b171d6"}
Jul 24 19:25:33.216814 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:25:33.216702    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-e05f4d/auth-test-model-e05f4d-kserve-c674bfc55-dr8rq" event={"ID":"48ae17ec-db2e-4b56-8205-96b6b3902ddd","Type":"ContainerDied","Data":"1f9e5a704915da1f7394c31b9f8cd5b904c549f78f7b223261d7719343186a8c"}
Jul 24 19:25:33.216814 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:25:33.216724    2580 scope.go:117] "RemoveContainer" containerID="717506f396dcd846c64ce5066294e16d6c98e73d646a3bb6ad911acec0b171d6"
Jul 24 19:25:33.226669 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:25:33.226650    2580 scope.go:117] "RemoveContainer" containerID="717506f396dcd846c64ce5066294e16d6c98e73d646a3bb6ad911acec0b171d6"
Jul 24 19:25:33.226960 ip-10-0-141-146 kubenswrapper[2580]: E0724 19:25:33.226937    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"717506f396dcd846c64ce5066294e16d6c98e73d646a3bb6ad911acec0b171d6\": container with ID starting with 717506f396dcd846c64ce5066294e16d6c98e73d646a3bb6ad911acec0b171d6 not found: ID does not exist" containerID="717506f396dcd846c64ce5066294e16d6c98e73d646a3bb6ad911acec0b171d6"
Jul 24 19:25:33.227015 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:25:33.226972    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"717506f396dcd846c64ce5066294e16d6c98e73d646a3bb6ad911acec0b171d6"} err="failed to get container status \"717506f396dcd846c64ce5066294e16d6c98e73d646a3bb6ad911acec0b171d6\": rpc error: code = NotFound desc = could not find container \"717506f396dcd846c64ce5066294e16d6c98e73d646a3bb6ad911acec0b171d6\": container with ID starting with 717506f396dcd846c64ce5066294e16d6c98e73d646a3bb6ad911acec0b171d6 not found: ID does not exist"
Jul 24 19:25:33.242373 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:25:33.242341    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-e05f4d/auth-test-model-e05f4d-kserve-c674bfc55-dr8rq"]
Jul 24 19:25:33.243293 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:25:33.243271    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-e05f4d/auth-test-model-e05f4d-kserve-c674bfc55-dr8rq"]
Jul 24 19:25:35.241652 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:25:35.241617    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="48ae17ec-db2e-4b56-8205-96b6b3902ddd" path="/var/lib/kubelet/pods/48ae17ec-db2e-4b56-8205-96b6b3902ddd/volumes"
Jul 24 19:25:37.183200 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:25:37.183158    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-e05f4d/sub-test-model-e05f4d-kserve-656c845dc5-lr94n"
Jul 24 19:25:37.183610 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:25:37.183218    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-e05f4d/sub-test-model-e05f4d-kserve-656c845dc5-lr94n"
Jul 24 19:25:37.195645 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:25:37.195612    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-e05f4d/sub-test-model-e05f4d-kserve-656c845dc5-lr94n"
Jul 24 19:25:37.248816 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:25:37.248779    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-e05f4d/sub-test-model-e05f4d-kserve-656c845dc5-lr94n"
Jul 24 19:26:02.953507 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:26:02.953424    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-48f4d2/sub-test-model-48f4d2-kserve-59494f4f7f-kbsfj"]
Jul 24 19:26:02.954063 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:26:02.954034    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="48ae17ec-db2e-4b56-8205-96b6b3902ddd" containerName="main"
Jul 24 19:26:02.954063 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:26:02.954061    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="48ae17ec-db2e-4b56-8205-96b6b3902ddd" containerName="main"
Jul 24 19:26:02.954205 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:26:02.954196    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="48ae17ec-db2e-4b56-8205-96b6b3902ddd" containerName="main"
Jul 24 19:26:02.957741 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:26:02.957714    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-48f4d2/sub-test-model-48f4d2-kserve-59494f4f7f-kbsfj"
Jul 24 19:26:02.961550 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:26:02.961518    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-48f4d2\"/\"kube-root-ca.crt\""
Jul 24 19:26:02.961550 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:26:02.961530    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-48f4d2\"/\"sub-test-model-48f4d2-kserve-self-signed-certs\""
Jul 24 19:26:02.961731 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:26:02.961518    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-48f4d2\"/\"openshift-service-ca.crt\""
Jul 24 19:26:02.962133 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:26:02.962088    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-48f4d2\"/\"default-dockercfg-xgbkb\""
Jul 24 19:26:02.967527 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:26:02.967495    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-48f4d2/sub-test-model-48f4d2-kserve-59494f4f7f-kbsfj"]
Jul 24 19:26:02.994186 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:26:02.994149    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:26:03.036678 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:26:03.036636    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/58e1a724-3880-4487-bc37-07ea0f5e4360-model-cache\") pod \"sub-test-model-48f4d2-kserve-59494f4f7f-kbsfj\" (UID: \"58e1a724-3880-4487-bc37-07ea0f5e4360\") " pod="ai-tenant-e2e-shared-b-48f4d2/sub-test-model-48f4d2-kserve-59494f4f7f-kbsfj"
Jul 24 19:26:03.036678 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:26:03.036678    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/58e1a724-3880-4487-bc37-07ea0f5e4360-tmp-dir\") pod \"sub-test-model-48f4d2-kserve-59494f4f7f-kbsfj\" (UID: \"58e1a724-3880-4487-bc37-07ea0f5e4360\") " pod="ai-tenant-e2e-shared-b-48f4d2/sub-test-model-48f4d2-kserve-59494f4f7f-kbsfj"
Jul 24 19:26:03.036945 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:26:03.036782    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/58e1a724-3880-4487-bc37-07ea0f5e4360-home\") pod \"sub-test-model-48f4d2-kserve-59494f4f7f-kbsfj\" (UID: \"58e1a724-3880-4487-bc37-07ea0f5e4360\") " pod="ai-tenant-e2e-shared-b-48f4d2/sub-test-model-48f4d2-kserve-59494f4f7f-kbsfj"
Jul 24 19:26:03.036945 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:26:03.036825    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8gbw9\" (UniqueName: \"kubernetes.io/projected/58e1a724-3880-4487-bc37-07ea0f5e4360-kube-api-access-8gbw9\") pod \"sub-test-model-48f4d2-kserve-59494f4f7f-kbsfj\" (UID: \"58e1a724-3880-4487-bc37-07ea0f5e4360\") " pod="ai-tenant-e2e-shared-b-48f4d2/sub-test-model-48f4d2-kserve-59494f4f7f-kbsfj"
Jul 24 19:26:03.036945 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:26:03.036917    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/58e1a724-3880-4487-bc37-07ea0f5e4360-tls-certs\") pod \"sub-test-model-48f4d2-kserve-59494f4f7f-kbsfj\" (UID: \"58e1a724-3880-4487-bc37-07ea0f5e4360\") " pod="ai-tenant-e2e-shared-b-48f4d2/sub-test-model-48f4d2-kserve-59494f4f7f-kbsfj"
Jul 24 19:26:03.037091 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:26:03.036983    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/58e1a724-3880-4487-bc37-07ea0f5e4360-dshm\") pod \"sub-test-model-48f4d2-kserve-59494f4f7f-kbsfj\" (UID: \"58e1a724-3880-4487-bc37-07ea0f5e4360\") " pod="ai-tenant-e2e-shared-b-48f4d2/sub-test-model-48f4d2-kserve-59494f4f7f-kbsfj"
Jul 24 19:26:03.138049 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:26:03.138014    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/58e1a724-3880-4487-bc37-07ea0f5e4360-home\") pod \"sub-test-model-48f4d2-kserve-59494f4f7f-kbsfj\" (UID: \"58e1a724-3880-4487-bc37-07ea0f5e4360\") " pod="ai-tenant-e2e-shared-b-48f4d2/sub-test-model-48f4d2-kserve-59494f4f7f-kbsfj"
Jul 24 19:26:03.138287 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:26:03.138064    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8gbw9\" (UniqueName: \"kubernetes.io/projected/58e1a724-3880-4487-bc37-07ea0f5e4360-kube-api-access-8gbw9\") pod \"sub-test-model-48f4d2-kserve-59494f4f7f-kbsfj\" (UID: \"58e1a724-3880-4487-bc37-07ea0f5e4360\") " pod="ai-tenant-e2e-shared-b-48f4d2/sub-test-model-48f4d2-kserve-59494f4f7f-kbsfj"
Jul 24 19:26:03.138287 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:26:03.138164    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/58e1a724-3880-4487-bc37-07ea0f5e4360-tls-certs\") pod \"sub-test-model-48f4d2-kserve-59494f4f7f-kbsfj\" (UID: \"58e1a724-3880-4487-bc37-07ea0f5e4360\") " pod="ai-tenant-e2e-shared-b-48f4d2/sub-test-model-48f4d2-kserve-59494f4f7f-kbsfj"
Jul 24 19:26:03.138287 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:26:03.138224    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/58e1a724-3880-4487-bc37-07ea0f5e4360-dshm\") pod \"sub-test-model-48f4d2-kserve-59494f4f7f-kbsfj\" (UID: \"58e1a724-3880-4487-bc37-07ea0f5e4360\") " pod="ai-tenant-e2e-shared-b-48f4d2/sub-test-model-48f4d2-kserve-59494f4f7f-kbsfj"
Jul 24 19:26:03.138287 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:26:03.138259    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/58e1a724-3880-4487-bc37-07ea0f5e4360-model-cache\") pod \"sub-test-model-48f4d2-kserve-59494f4f7f-kbsfj\" (UID: \"58e1a724-3880-4487-bc37-07ea0f5e4360\") " pod="ai-tenant-e2e-shared-b-48f4d2/sub-test-model-48f4d2-kserve-59494f4f7f-kbsfj"
Jul 24 19:26:03.138287 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:26:03.138284    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/58e1a724-3880-4487-bc37-07ea0f5e4360-tmp-dir\") pod \"sub-test-model-48f4d2-kserve-59494f4f7f-kbsfj\" (UID: \"58e1a724-3880-4487-bc37-07ea0f5e4360\") " pod="ai-tenant-e2e-shared-b-48f4d2/sub-test-model-48f4d2-kserve-59494f4f7f-kbsfj"
Jul 24 19:26:03.138536 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:26:03.138499    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/58e1a724-3880-4487-bc37-07ea0f5e4360-home\") pod \"sub-test-model-48f4d2-kserve-59494f4f7f-kbsfj\" (UID: \"58e1a724-3880-4487-bc37-07ea0f5e4360\") " pod="ai-tenant-e2e-shared-b-48f4d2/sub-test-model-48f4d2-kserve-59494f4f7f-kbsfj"
Jul 24 19:26:03.138661 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:26:03.138638    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/58e1a724-3880-4487-bc37-07ea0f5e4360-tmp-dir\") pod \"sub-test-model-48f4d2-kserve-59494f4f7f-kbsfj\" (UID: \"58e1a724-3880-4487-bc37-07ea0f5e4360\") " pod="ai-tenant-e2e-shared-b-48f4d2/sub-test-model-48f4d2-kserve-59494f4f7f-kbsfj"
Jul 24 19:26:03.138778 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:26:03.138639    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/58e1a724-3880-4487-bc37-07ea0f5e4360-model-cache\") pod \"sub-test-model-48f4d2-kserve-59494f4f7f-kbsfj\" (UID: \"58e1a724-3880-4487-bc37-07ea0f5e4360\") " pod="ai-tenant-e2e-shared-b-48f4d2/sub-test-model-48f4d2-kserve-59494f4f7f-kbsfj"
Jul 24 19:26:03.140605 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:26:03.140586    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/58e1a724-3880-4487-bc37-07ea0f5e4360-dshm\") pod \"sub-test-model-48f4d2-kserve-59494f4f7f-kbsfj\" (UID: \"58e1a724-3880-4487-bc37-07ea0f5e4360\") " pod="ai-tenant-e2e-shared-b-48f4d2/sub-test-model-48f4d2-kserve-59494f4f7f-kbsfj"
Jul 24 19:26:03.140885 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:26:03.140868    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/58e1a724-3880-4487-bc37-07ea0f5e4360-tls-certs\") pod \"sub-test-model-48f4d2-kserve-59494f4f7f-kbsfj\" (UID: \"58e1a724-3880-4487-bc37-07ea0f5e4360\") " pod="ai-tenant-e2e-shared-b-48f4d2/sub-test-model-48f4d2-kserve-59494f4f7f-kbsfj"
Jul 24 19:26:03.149468 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:26:03.149440    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8gbw9\" (UniqueName: \"kubernetes.io/projected/58e1a724-3880-4487-bc37-07ea0f5e4360-kube-api-access-8gbw9\") pod \"sub-test-model-48f4d2-kserve-59494f4f7f-kbsfj\" (UID: \"58e1a724-3880-4487-bc37-07ea0f5e4360\") " pod="ai-tenant-e2e-shared-b-48f4d2/sub-test-model-48f4d2-kserve-59494f4f7f-kbsfj"
Jul 24 19:26:03.269416 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:26:03.269331    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-48f4d2/sub-test-model-48f4d2-kserve-59494f4f7f-kbsfj"
Jul 24 19:26:03.419245 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:26:03.419212    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-48f4d2/sub-test-model-48f4d2-kserve-59494f4f7f-kbsfj"]
Jul 24 19:26:03.421953 ip-10-0-141-146 kubenswrapper[2580]: W0724 19:26:03.421925    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod58e1a724_3880_4487_bc37_07ea0f5e4360.slice/crio-bbfb0064038e71f6935093c926dbbc3d612cea93ba49a547e8c0ffec18eaa14b WatchSource:0}: Error finding container bbfb0064038e71f6935093c926dbbc3d612cea93ba49a547e8c0ffec18eaa14b: Status 404 returned error can't find the container with id bbfb0064038e71f6935093c926dbbc3d612cea93ba49a547e8c0ffec18eaa14b
Jul 24 19:26:04.376307 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:26:04.376266    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-48f4d2/sub-test-model-48f4d2-kserve-59494f4f7f-kbsfj" event={"ID":"58e1a724-3880-4487-bc37-07ea0f5e4360","Type":"ContainerStarted","Data":"9e261cc2fb58490f8983945f32829dfd4a9c8f62e985adaf1e93ff4fc433c8aa"}
Jul 24 19:26:04.376307 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:26:04.376309    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-48f4d2/sub-test-model-48f4d2-kserve-59494f4f7f-kbsfj" event={"ID":"58e1a724-3880-4487-bc37-07ea0f5e4360","Type":"ContainerStarted","Data":"bbfb0064038e71f6935093c926dbbc3d612cea93ba49a547e8c0ffec18eaa14b"}
Jul 24 19:26:04.394447 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:26:04.394392    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-48f4d2/sub-test-model-48f4d2-kserve-59494f4f7f-kbsfj" podStartSLOduration=2.394374557 podStartE2EDuration="2.394374557s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 19:26:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:26:04.393166469 +0000 UTC m=+2519.602538525" watchObservedRunningTime="2026-07-24 19:26:04.394374557 +0000 UTC m=+2519.603746600"
Jul 24 19:26:13.269733 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:26:13.269693    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-48f4d2/sub-test-model-48f4d2-kserve-59494f4f7f-kbsfj"
Jul 24 19:26:13.270403 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:26:13.269756    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-48f4d2/sub-test-model-48f4d2-kserve-59494f4f7f-kbsfj"
Jul 24 19:26:13.282712 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:26:13.282682    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-48f4d2/sub-test-model-48f4d2-kserve-59494f4f7f-kbsfj"
Jul 24 19:26:13.432196 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:26:13.432168    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-48f4d2/sub-test-model-48f4d2-kserve-59494f4f7f-kbsfj"
Jul 24 19:26:15.510007 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:26:15.509970    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:26:15.611678 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:26:15.611635    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:26:34.802934 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:26:34.802901    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-e05f4d/sub-test-model-e05f4d-kserve-656c845dc5-lr94n"]
Jul 24 19:26:34.827384 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:26:34.827352    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:26:35.679741 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:26:35.679710    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-48f4d2/sub-test-model-48f4d2-kserve-59494f4f7f-kbsfj"]
Jul 24 19:26:35.700319 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:26:35.700293    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:26:43.360426 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:26:43.360389    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:26:49.822730 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:26:49.822682    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-e05f4d/sub-test-model-e05f4d-kserve-656c845dc5-lr94n" podUID="a3a70672-ad09-446b-8226-671ea9795f60" containerName="main" containerID="cri-o://28ddee5613defaa4c51bc22302e88b633c6fd1aea6814a21e5371a56417f81a5" gracePeriod=45
Jul 24 19:26:50.078923 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:26:50.078859    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-e05f4d/sub-test-model-e05f4d-kserve-656c845dc5-lr94n"
Jul 24 19:26:50.208176 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:26:50.208113    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ldhdb\" (UniqueName: \"kubernetes.io/projected/a3a70672-ad09-446b-8226-671ea9795f60-kube-api-access-ldhdb\") pod \"a3a70672-ad09-446b-8226-671ea9795f60\" (UID: \"a3a70672-ad09-446b-8226-671ea9795f60\") "
Jul 24 19:26:50.208176 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:26:50.208183    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a3a70672-ad09-446b-8226-671ea9795f60-model-cache\") pod \"a3a70672-ad09-446b-8226-671ea9795f60\" (UID: \"a3a70672-ad09-446b-8226-671ea9795f60\") "
Jul 24 19:26:50.208431 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:26:50.208257    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a3a70672-ad09-446b-8226-671ea9795f60-tmp-dir\") pod \"a3a70672-ad09-446b-8226-671ea9795f60\" (UID: \"a3a70672-ad09-446b-8226-671ea9795f60\") "
Jul 24 19:26:50.208431 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:26:50.208295    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a3a70672-ad09-446b-8226-671ea9795f60-home\") pod \"a3a70672-ad09-446b-8226-671ea9795f60\" (UID: \"a3a70672-ad09-446b-8226-671ea9795f60\") "
Jul 24 19:26:50.208431 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:26:50.208332    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a3a70672-ad09-446b-8226-671ea9795f60-tls-certs\") pod \"a3a70672-ad09-446b-8226-671ea9795f60\" (UID: \"a3a70672-ad09-446b-8226-671ea9795f60\") "
Jul 24 19:26:50.208431 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:26:50.208369    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a3a70672-ad09-446b-8226-671ea9795f60-dshm\") pod \"a3a70672-ad09-446b-8226-671ea9795f60\" (UID: \"a3a70672-ad09-446b-8226-671ea9795f60\") "
Jul 24 19:26:50.208636 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:26:50.208464    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a3a70672-ad09-446b-8226-671ea9795f60-model-cache" (OuterVolumeSpecName: "model-cache") pod "a3a70672-ad09-446b-8226-671ea9795f60" (UID: "a3a70672-ad09-446b-8226-671ea9795f60"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:26:50.208636 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:26:50.208524    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a3a70672-ad09-446b-8226-671ea9795f60-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "a3a70672-ad09-446b-8226-671ea9795f60" (UID: "a3a70672-ad09-446b-8226-671ea9795f60"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:26:50.208636 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:26:50.208556    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a3a70672-ad09-446b-8226-671ea9795f60-home" (OuterVolumeSpecName: "home") pod "a3a70672-ad09-446b-8226-671ea9795f60" (UID: "a3a70672-ad09-446b-8226-671ea9795f60"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:26:50.208749 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:26:50.208718    2580 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a3a70672-ad09-446b-8226-671ea9795f60-model-cache\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 24 19:26:50.208749 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:26:50.208733    2580 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a3a70672-ad09-446b-8226-671ea9795f60-tmp-dir\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 24 19:26:50.208749 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:26:50.208744    2580 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a3a70672-ad09-446b-8226-671ea9795f60-home\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 24 19:26:50.210550 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:26:50.210525    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a3a70672-ad09-446b-8226-671ea9795f60-dshm" (OuterVolumeSpecName: "dshm") pod "a3a70672-ad09-446b-8226-671ea9795f60" (UID: "a3a70672-ad09-446b-8226-671ea9795f60"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:26:50.210685 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:26:50.210564    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a3a70672-ad09-446b-8226-671ea9795f60-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "a3a70672-ad09-446b-8226-671ea9795f60" (UID: "a3a70672-ad09-446b-8226-671ea9795f60"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 19:26:50.210685 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:26:50.210599    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a3a70672-ad09-446b-8226-671ea9795f60-kube-api-access-ldhdb" (OuterVolumeSpecName: "kube-api-access-ldhdb") pod "a3a70672-ad09-446b-8226-671ea9795f60" (UID: "a3a70672-ad09-446b-8226-671ea9795f60"). InnerVolumeSpecName "kube-api-access-ldhdb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 19:26:50.310313 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:26:50.310263    2580 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a3a70672-ad09-446b-8226-671ea9795f60-tls-certs\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 24 19:26:50.310313 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:26:50.310310    2580 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a3a70672-ad09-446b-8226-671ea9795f60-dshm\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 24 19:26:50.310313 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:26:50.310325    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ldhdb\" (UniqueName: \"kubernetes.io/projected/a3a70672-ad09-446b-8226-671ea9795f60-kube-api-access-ldhdb\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 24 19:26:50.603277 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:26:50.603235    2580 generic.go:356] "Generic (PLEG): container finished" podID="a3a70672-ad09-446b-8226-671ea9795f60" containerID="28ddee5613defaa4c51bc22302e88b633c6fd1aea6814a21e5371a56417f81a5" exitCode=0
Jul 24 19:26:50.603493 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:26:50.603281    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-e05f4d/sub-test-model-e05f4d-kserve-656c845dc5-lr94n"
Jul 24 19:26:50.603493 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:26:50.603320    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-e05f4d/sub-test-model-e05f4d-kserve-656c845dc5-lr94n" event={"ID":"a3a70672-ad09-446b-8226-671ea9795f60","Type":"ContainerDied","Data":"28ddee5613defaa4c51bc22302e88b633c6fd1aea6814a21e5371a56417f81a5"}
Jul 24 19:26:50.603493 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:26:50.603361    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-e05f4d/sub-test-model-e05f4d-kserve-656c845dc5-lr94n" event={"ID":"a3a70672-ad09-446b-8226-671ea9795f60","Type":"ContainerDied","Data":"35434650d1edea41f8a4d13e46709993c307c501a67c921ce306c2506b550491"}
Jul 24 19:26:50.603493 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:26:50.603378    2580 scope.go:117] "RemoveContainer" containerID="28ddee5613defaa4c51bc22302e88b633c6fd1aea6814a21e5371a56417f81a5"
Jul 24 19:26:50.613405 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:26:50.613380    2580 scope.go:117] "RemoveContainer" containerID="28ddee5613defaa4c51bc22302e88b633c6fd1aea6814a21e5371a56417f81a5"
Jul 24 19:26:50.613668 ip-10-0-141-146 kubenswrapper[2580]: E0724 19:26:50.613650    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"28ddee5613defaa4c51bc22302e88b633c6fd1aea6814a21e5371a56417f81a5\": container with ID starting with 28ddee5613defaa4c51bc22302e88b633c6fd1aea6814a21e5371a56417f81a5 not found: ID does not exist" containerID="28ddee5613defaa4c51bc22302e88b633c6fd1aea6814a21e5371a56417f81a5"
Jul 24 19:26:50.613721 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:26:50.613676    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"28ddee5613defaa4c51bc22302e88b633c6fd1aea6814a21e5371a56417f81a5"} err="failed to get container status \"28ddee5613defaa4c51bc22302e88b633c6fd1aea6814a21e5371a56417f81a5\": rpc error: code = NotFound desc = could not find container \"28ddee5613defaa4c51bc22302e88b633c6fd1aea6814a21e5371a56417f81a5\": container with ID starting with 28ddee5613defaa4c51bc22302e88b633c6fd1aea6814a21e5371a56417f81a5 not found: ID does not exist"
Jul 24 19:26:50.626028 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:26:50.625999    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-e05f4d/sub-test-model-e05f4d-kserve-656c845dc5-lr94n"]
Jul 24 19:26:50.627735 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:26:50.627713    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-e05f4d/sub-test-model-e05f4d-kserve-656c845dc5-lr94n"]
Jul 24 19:26:50.699101 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:26:50.699054    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-48f4d2/sub-test-model-48f4d2-kserve-59494f4f7f-kbsfj" podUID="58e1a724-3880-4487-bc37-07ea0f5e4360" containerName="main" containerID="cri-o://9e261cc2fb58490f8983945f32829dfd4a9c8f62e985adaf1e93ff4fc433c8aa" gracePeriod=45
Jul 24 19:26:50.949442 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:26:50.949415    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-48f4d2/sub-test-model-48f4d2-kserve-59494f4f7f-kbsfj"
Jul 24 19:26:51.016602 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:26:51.016568    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/58e1a724-3880-4487-bc37-07ea0f5e4360-tmp-dir\") pod \"58e1a724-3880-4487-bc37-07ea0f5e4360\" (UID: \"58e1a724-3880-4487-bc37-07ea0f5e4360\") "
Jul 24 19:26:51.016804 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:26:51.016628    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/58e1a724-3880-4487-bc37-07ea0f5e4360-dshm\") pod \"58e1a724-3880-4487-bc37-07ea0f5e4360\" (UID: \"58e1a724-3880-4487-bc37-07ea0f5e4360\") "
Jul 24 19:26:51.016804 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:26:51.016704    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/58e1a724-3880-4487-bc37-07ea0f5e4360-model-cache\") pod \"58e1a724-3880-4487-bc37-07ea0f5e4360\" (UID: \"58e1a724-3880-4487-bc37-07ea0f5e4360\") "
Jul 24 19:26:51.016804 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:26:51.016747    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/58e1a724-3880-4487-bc37-07ea0f5e4360-tls-certs\") pod \"58e1a724-3880-4487-bc37-07ea0f5e4360\" (UID: \"58e1a724-3880-4487-bc37-07ea0f5e4360\") "
Jul 24 19:26:51.016957 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:26:51.016809    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/58e1a724-3880-4487-bc37-07ea0f5e4360-home\") pod \"58e1a724-3880-4487-bc37-07ea0f5e4360\" (UID: \"58e1a724-3880-4487-bc37-07ea0f5e4360\") "
Jul 24 19:26:51.016957 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:26:51.016832    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8gbw9\" (UniqueName: \"kubernetes.io/projected/58e1a724-3880-4487-bc37-07ea0f5e4360-kube-api-access-8gbw9\") pod \"58e1a724-3880-4487-bc37-07ea0f5e4360\" (UID: \"58e1a724-3880-4487-bc37-07ea0f5e4360\") "
Jul 24 19:26:51.016957 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:26:51.016851    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/58e1a724-3880-4487-bc37-07ea0f5e4360-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "58e1a724-3880-4487-bc37-07ea0f5e4360" (UID: "58e1a724-3880-4487-bc37-07ea0f5e4360"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:26:51.017422 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:26:51.017006    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/58e1a724-3880-4487-bc37-07ea0f5e4360-model-cache" (OuterVolumeSpecName: "model-cache") pod "58e1a724-3880-4487-bc37-07ea0f5e4360" (UID: "58e1a724-3880-4487-bc37-07ea0f5e4360"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:26:51.017422 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:26:51.017021    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/58e1a724-3880-4487-bc37-07ea0f5e4360-home" (OuterVolumeSpecName: "home") pod "58e1a724-3880-4487-bc37-07ea0f5e4360" (UID: "58e1a724-3880-4487-bc37-07ea0f5e4360"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:26:51.017422 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:26:51.017233    2580 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/58e1a724-3880-4487-bc37-07ea0f5e4360-model-cache\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 24 19:26:51.017422 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:26:51.017252    2580 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/58e1a724-3880-4487-bc37-07ea0f5e4360-home\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 24 19:26:51.017422 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:26:51.017265    2580 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/58e1a724-3880-4487-bc37-07ea0f5e4360-tmp-dir\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 24 19:26:51.019747 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:26:51.019683    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/58e1a724-3880-4487-bc37-07ea0f5e4360-dshm" (OuterVolumeSpecName: "dshm") pod "58e1a724-3880-4487-bc37-07ea0f5e4360" (UID: "58e1a724-3880-4487-bc37-07ea0f5e4360"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:26:51.019852 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:26:51.019785    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/58e1a724-3880-4487-bc37-07ea0f5e4360-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "58e1a724-3880-4487-bc37-07ea0f5e4360" (UID: "58e1a724-3880-4487-bc37-07ea0f5e4360"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 19:26:51.019894 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:26:51.019883    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/58e1a724-3880-4487-bc37-07ea0f5e4360-kube-api-access-8gbw9" (OuterVolumeSpecName: "kube-api-access-8gbw9") pod "58e1a724-3880-4487-bc37-07ea0f5e4360" (UID: "58e1a724-3880-4487-bc37-07ea0f5e4360"). InnerVolumeSpecName "kube-api-access-8gbw9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 19:26:51.118029 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:26:51.117992    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8gbw9\" (UniqueName: \"kubernetes.io/projected/58e1a724-3880-4487-bc37-07ea0f5e4360-kube-api-access-8gbw9\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 24 19:26:51.118029 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:26:51.118021    2580 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/58e1a724-3880-4487-bc37-07ea0f5e4360-dshm\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 24 19:26:51.118029 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:26:51.118031    2580 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/58e1a724-3880-4487-bc37-07ea0f5e4360-tls-certs\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 24 19:26:51.242079 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:26:51.242047    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a3a70672-ad09-446b-8226-671ea9795f60" path="/var/lib/kubelet/pods/a3a70672-ad09-446b-8226-671ea9795f60/volumes"
Jul 24 19:26:51.609619 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:26:51.609523    2580 generic.go:356] "Generic (PLEG): container finished" podID="58e1a724-3880-4487-bc37-07ea0f5e4360" containerID="9e261cc2fb58490f8983945f32829dfd4a9c8f62e985adaf1e93ff4fc433c8aa" exitCode=0
Jul 24 19:26:51.609619 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:26:51.609570    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-48f4d2/sub-test-model-48f4d2-kserve-59494f4f7f-kbsfj"
Jul 24 19:26:51.609838 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:26:51.609621    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-48f4d2/sub-test-model-48f4d2-kserve-59494f4f7f-kbsfj" event={"ID":"58e1a724-3880-4487-bc37-07ea0f5e4360","Type":"ContainerDied","Data":"9e261cc2fb58490f8983945f32829dfd4a9c8f62e985adaf1e93ff4fc433c8aa"}
Jul 24 19:26:51.609838 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:26:51.609663    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-48f4d2/sub-test-model-48f4d2-kserve-59494f4f7f-kbsfj" event={"ID":"58e1a724-3880-4487-bc37-07ea0f5e4360","Type":"ContainerDied","Data":"bbfb0064038e71f6935093c926dbbc3d612cea93ba49a547e8c0ffec18eaa14b"}
Jul 24 19:26:51.609838 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:26:51.609684    2580 scope.go:117] "RemoveContainer" containerID="9e261cc2fb58490f8983945f32829dfd4a9c8f62e985adaf1e93ff4fc433c8aa"
Jul 24 19:26:51.620344 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:26:51.620284    2580 scope.go:117] "RemoveContainer" containerID="9e261cc2fb58490f8983945f32829dfd4a9c8f62e985adaf1e93ff4fc433c8aa"
Jul 24 19:26:51.620810 ip-10-0-141-146 kubenswrapper[2580]: E0724 19:26:51.620789    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9e261cc2fb58490f8983945f32829dfd4a9c8f62e985adaf1e93ff4fc433c8aa\": container with ID starting with 9e261cc2fb58490f8983945f32829dfd4a9c8f62e985adaf1e93ff4fc433c8aa not found: ID does not exist" containerID="9e261cc2fb58490f8983945f32829dfd4a9c8f62e985adaf1e93ff4fc433c8aa"
Jul 24 19:26:51.620897 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:26:51.620817    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9e261cc2fb58490f8983945f32829dfd4a9c8f62e985adaf1e93ff4fc433c8aa"} err="failed to get container status \"9e261cc2fb58490f8983945f32829dfd4a9c8f62e985adaf1e93ff4fc433c8aa\": rpc error: code = NotFound desc = could not find container \"9e261cc2fb58490f8983945f32829dfd4a9c8f62e985adaf1e93ff4fc433c8aa\": container with ID starting with 9e261cc2fb58490f8983945f32829dfd4a9c8f62e985adaf1e93ff4fc433c8aa not found: ID does not exist"
Jul 24 19:26:51.627173 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:26:51.627147    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-48f4d2/sub-test-model-48f4d2-kserve-59494f4f7f-kbsfj"]
Jul 24 19:26:51.630704 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:26:51.630683    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-48f4d2/sub-test-model-48f4d2-kserve-59494f4f7f-kbsfj"]
Jul 24 19:26:53.242096 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:26:53.242056    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="58e1a724-3880-4487-bc37-07ea0f5e4360" path="/var/lib/kubelet/pods/58e1a724-3880-4487-bc37-07ea0f5e4360/volumes"
Jul 24 19:26:57.052709 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:26:57.052672    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:26:59.565736 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:26:59.565700    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-48f4d2/rate-test-model-48f4d2-kserve-854fdc7959-dpkjv"]
Jul 24 19:26:59.566109 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:26:59.566084    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="58e1a724-3880-4487-bc37-07ea0f5e4360" containerName="main"
Jul 24 19:26:59.566109 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:26:59.566095    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="58e1a724-3880-4487-bc37-07ea0f5e4360" containerName="main"
Jul 24 19:26:59.566109 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:26:59.566106    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a3a70672-ad09-446b-8226-671ea9795f60" containerName="main"
Jul 24 19:26:59.566109 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:26:59.566111    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="a3a70672-ad09-446b-8226-671ea9795f60" containerName="main"
Jul 24 19:26:59.567756 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:26:59.566727    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="a3a70672-ad09-446b-8226-671ea9795f60" containerName="main"
Jul 24 19:26:59.567756 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:26:59.566772    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="58e1a724-3880-4487-bc37-07ea0f5e4360" containerName="main"
Jul 24 19:26:59.575152 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:26:59.575104    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-48f4d2/rate-test-model-48f4d2-kserve-854fdc7959-dpkjv"
Jul 24 19:26:59.578315 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:26:59.578272    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-48f4d2\"/\"kube-root-ca.crt\""
Jul 24 19:26:59.579563 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:26:59.579462    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-48f4d2\"/\"default-dockercfg-xgbkb\""
Jul 24 19:26:59.579563 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:26:59.579485    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-48f4d2\"/\"openshift-service-ca.crt\""
Jul 24 19:26:59.579776 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:26:59.579564    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-48f4d2\"/\"rate-test-model-48f4d2-kserve-self-signed-certs\""
Jul 24 19:26:59.582007 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:26:59.581968    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-48f4d2/rate-test-model-48f4d2-kserve-854fdc7959-dpkjv"]
Jul 24 19:26:59.590307 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:26:59.590282    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:26:59.704058 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:26:59.704016    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f0aa1238-1b23-472a-908e-f77aa24e6a04-home\") pod \"rate-test-model-48f4d2-kserve-854fdc7959-dpkjv\" (UID: \"f0aa1238-1b23-472a-908e-f77aa24e6a04\") " pod="ai-tenant-e2e-shared-b-48f4d2/rate-test-model-48f4d2-kserve-854fdc7959-dpkjv"
Jul 24 19:26:59.704275 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:26:59.704157    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f0aa1238-1b23-472a-908e-f77aa24e6a04-tls-certs\") pod \"rate-test-model-48f4d2-kserve-854fdc7959-dpkjv\" (UID: \"f0aa1238-1b23-472a-908e-f77aa24e6a04\") " pod="ai-tenant-e2e-shared-b-48f4d2/rate-test-model-48f4d2-kserve-854fdc7959-dpkjv"
Jul 24 19:26:59.704275 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:26:59.704226    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f0aa1238-1b23-472a-908e-f77aa24e6a04-dshm\") pod \"rate-test-model-48f4d2-kserve-854fdc7959-dpkjv\" (UID: \"f0aa1238-1b23-472a-908e-f77aa24e6a04\") " pod="ai-tenant-e2e-shared-b-48f4d2/rate-test-model-48f4d2-kserve-854fdc7959-dpkjv"
Jul 24 19:26:59.704275 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:26:59.704268    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t55jv\" (UniqueName: \"kubernetes.io/projected/f0aa1238-1b23-472a-908e-f77aa24e6a04-kube-api-access-t55jv\") pod \"rate-test-model-48f4d2-kserve-854fdc7959-dpkjv\" (UID: \"f0aa1238-1b23-472a-908e-f77aa24e6a04\") " pod="ai-tenant-e2e-shared-b-48f4d2/rate-test-model-48f4d2-kserve-854fdc7959-dpkjv"
Jul 24 19:26:59.704442 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:26:59.704304    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f0aa1238-1b23-472a-908e-f77aa24e6a04-model-cache\") pod \"rate-test-model-48f4d2-kserve-854fdc7959-dpkjv\" (UID: \"f0aa1238-1b23-472a-908e-f77aa24e6a04\") " pod="ai-tenant-e2e-shared-b-48f4d2/rate-test-model-48f4d2-kserve-854fdc7959-dpkjv"
Jul 24 19:26:59.704442 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:26:59.704341    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f0aa1238-1b23-472a-908e-f77aa24e6a04-tmp-dir\") pod \"rate-test-model-48f4d2-kserve-854fdc7959-dpkjv\" (UID: \"f0aa1238-1b23-472a-908e-f77aa24e6a04\") " pod="ai-tenant-e2e-shared-b-48f4d2/rate-test-model-48f4d2-kserve-854fdc7959-dpkjv"
Jul 24 19:26:59.805442 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:26:59.805402    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f0aa1238-1b23-472a-908e-f77aa24e6a04-home\") pod \"rate-test-model-48f4d2-kserve-854fdc7959-dpkjv\" (UID: \"f0aa1238-1b23-472a-908e-f77aa24e6a04\") " pod="ai-tenant-e2e-shared-b-48f4d2/rate-test-model-48f4d2-kserve-854fdc7959-dpkjv"
Jul 24 19:26:59.805597 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:26:59.805489    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f0aa1238-1b23-472a-908e-f77aa24e6a04-tls-certs\") pod \"rate-test-model-48f4d2-kserve-854fdc7959-dpkjv\" (UID: \"f0aa1238-1b23-472a-908e-f77aa24e6a04\") " pod="ai-tenant-e2e-shared-b-48f4d2/rate-test-model-48f4d2-kserve-854fdc7959-dpkjv"
Jul 24 19:26:59.805597 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:26:59.805511    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f0aa1238-1b23-472a-908e-f77aa24e6a04-dshm\") pod \"rate-test-model-48f4d2-kserve-854fdc7959-dpkjv\" (UID: \"f0aa1238-1b23-472a-908e-f77aa24e6a04\") " pod="ai-tenant-e2e-shared-b-48f4d2/rate-test-model-48f4d2-kserve-854fdc7959-dpkjv"
Jul 24 19:26:59.805597 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:26:59.805537    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t55jv\" (UniqueName: \"kubernetes.io/projected/f0aa1238-1b23-472a-908e-f77aa24e6a04-kube-api-access-t55jv\") pod \"rate-test-model-48f4d2-kserve-854fdc7959-dpkjv\" (UID: \"f0aa1238-1b23-472a-908e-f77aa24e6a04\") " pod="ai-tenant-e2e-shared-b-48f4d2/rate-test-model-48f4d2-kserve-854fdc7959-dpkjv"
Jul 24 19:26:59.805597 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:26:59.805561    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f0aa1238-1b23-472a-908e-f77aa24e6a04-model-cache\") pod \"rate-test-model-48f4d2-kserve-854fdc7959-dpkjv\" (UID: \"f0aa1238-1b23-472a-908e-f77aa24e6a04\") " pod="ai-tenant-e2e-shared-b-48f4d2/rate-test-model-48f4d2-kserve-854fdc7959-dpkjv"
Jul 24 19:26:59.805597 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:26:59.805592    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f0aa1238-1b23-472a-908e-f77aa24e6a04-tmp-dir\") pod \"rate-test-model-48f4d2-kserve-854fdc7959-dpkjv\" (UID: \"f0aa1238-1b23-472a-908e-f77aa24e6a04\") " pod="ai-tenant-e2e-shared-b-48f4d2/rate-test-model-48f4d2-kserve-854fdc7959-dpkjv"
Jul 24 19:26:59.805917 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:26:59.805896    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f0aa1238-1b23-472a-908e-f77aa24e6a04-home\") pod \"rate-test-model-48f4d2-kserve-854fdc7959-dpkjv\" (UID: \"f0aa1238-1b23-472a-908e-f77aa24e6a04\") " pod="ai-tenant-e2e-shared-b-48f4d2/rate-test-model-48f4d2-kserve-854fdc7959-dpkjv"
Jul 24 19:26:59.805986 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:26:59.805936    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f0aa1238-1b23-472a-908e-f77aa24e6a04-model-cache\") pod \"rate-test-model-48f4d2-kserve-854fdc7959-dpkjv\" (UID: \"f0aa1238-1b23-472a-908e-f77aa24e6a04\") " pod="ai-tenant-e2e-shared-b-48f4d2/rate-test-model-48f4d2-kserve-854fdc7959-dpkjv"
Jul 24 19:26:59.805986 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:26:59.805973    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f0aa1238-1b23-472a-908e-f77aa24e6a04-tmp-dir\") pod \"rate-test-model-48f4d2-kserve-854fdc7959-dpkjv\" (UID: \"f0aa1238-1b23-472a-908e-f77aa24e6a04\") " pod="ai-tenant-e2e-shared-b-48f4d2/rate-test-model-48f4d2-kserve-854fdc7959-dpkjv"
Jul 24 19:26:59.808082 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:26:59.808064    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f0aa1238-1b23-472a-908e-f77aa24e6a04-dshm\") pod \"rate-test-model-48f4d2-kserve-854fdc7959-dpkjv\" (UID: \"f0aa1238-1b23-472a-908e-f77aa24e6a04\") " pod="ai-tenant-e2e-shared-b-48f4d2/rate-test-model-48f4d2-kserve-854fdc7959-dpkjv"
Jul 24 19:26:59.808280 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:26:59.808263    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f0aa1238-1b23-472a-908e-f77aa24e6a04-tls-certs\") pod \"rate-test-model-48f4d2-kserve-854fdc7959-dpkjv\" (UID: \"f0aa1238-1b23-472a-908e-f77aa24e6a04\") " pod="ai-tenant-e2e-shared-b-48f4d2/rate-test-model-48f4d2-kserve-854fdc7959-dpkjv"
Jul 24 19:26:59.814607 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:26:59.814586    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t55jv\" (UniqueName: \"kubernetes.io/projected/f0aa1238-1b23-472a-908e-f77aa24e6a04-kube-api-access-t55jv\") pod \"rate-test-model-48f4d2-kserve-854fdc7959-dpkjv\" (UID: \"f0aa1238-1b23-472a-908e-f77aa24e6a04\") " pod="ai-tenant-e2e-shared-b-48f4d2/rate-test-model-48f4d2-kserve-854fdc7959-dpkjv"
Jul 24 19:26:59.887759 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:26:59.887664    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-48f4d2/rate-test-model-48f4d2-kserve-854fdc7959-dpkjv"
Jul 24 19:27:00.025793 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:27:00.025762    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-48f4d2/rate-test-model-48f4d2-kserve-854fdc7959-dpkjv"]
Jul 24 19:27:00.029337 ip-10-0-141-146 kubenswrapper[2580]: W0724 19:27:00.029304    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf0aa1238_1b23_472a_908e_f77aa24e6a04.slice/crio-58b8d66c6281b8a2b8bfa7a49f521e145c88e50841d09c5dd74d1316c18b55a9 WatchSource:0}: Error finding container 58b8d66c6281b8a2b8bfa7a49f521e145c88e50841d09c5dd74d1316c18b55a9: Status 404 returned error can't find the container with id 58b8d66c6281b8a2b8bfa7a49f521e145c88e50841d09c5dd74d1316c18b55a9
Jul 24 19:27:00.655110 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:27:00.655071    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-48f4d2/rate-test-model-48f4d2-kserve-854fdc7959-dpkjv" event={"ID":"f0aa1238-1b23-472a-908e-f77aa24e6a04","Type":"ContainerStarted","Data":"aac45c57a6939e58ad3e494a36b42be98a9154b5fb8d8c03b056cbb45187c83c"}
Jul 24 19:27:00.655543 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:27:00.655114    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-48f4d2/rate-test-model-48f4d2-kserve-854fdc7959-dpkjv" event={"ID":"f0aa1238-1b23-472a-908e-f77aa24e6a04","Type":"ContainerStarted","Data":"58b8d66c6281b8a2b8bfa7a49f521e145c88e50841d09c5dd74d1316c18b55a9"}
Jul 24 19:27:00.672809 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:27:00.672755    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-48f4d2/rate-test-model-48f4d2-kserve-854fdc7959-dpkjv" podStartSLOduration=1.672739393 podStartE2EDuration="1.672739393s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 19:26:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:27:00.670923697 +0000 UTC m=+2575.880295741" watchObservedRunningTime="2026-07-24 19:27:00.672739393 +0000 UTC m=+2575.882111435"
Jul 24 19:27:09.888568 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:27:09.888527    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-48f4d2/rate-test-model-48f4d2-kserve-854fdc7959-dpkjv"
Jul 24 19:27:09.889051 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:27:09.888581    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-48f4d2/rate-test-model-48f4d2-kserve-854fdc7959-dpkjv"
Jul 24 19:27:09.901133 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:27:09.901100    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-48f4d2/rate-test-model-48f4d2-kserve-854fdc7959-dpkjv"
Jul 24 19:27:10.715738 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:27:10.715707    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-48f4d2/rate-test-model-48f4d2-kserve-854fdc7959-dpkjv"
Jul 24 19:27:12.921041 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:27:12.921003    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:27:52.619263 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:27:52.619222    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:27:53.474314 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:27:53.474278    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-48f4d2/rate-test-model-48f4d2-kserve-854fdc7959-dpkjv"]
Jul 24 19:27:53.496190 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:27:53.496157    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:28:08.494305 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:28:08.494257    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-48f4d2/rate-test-model-48f4d2-kserve-854fdc7959-dpkjv" podUID="f0aa1238-1b23-472a-908e-f77aa24e6a04" containerName="main" containerID="cri-o://aac45c57a6939e58ad3e494a36b42be98a9154b5fb8d8c03b056cbb45187c83c" gracePeriod=45
Jul 24 19:28:08.759298 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:28:08.759233    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-48f4d2/rate-test-model-48f4d2-kserve-854fdc7959-dpkjv"
Jul 24 19:28:08.885669 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:28:08.885629    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f0aa1238-1b23-472a-908e-f77aa24e6a04-home\") pod \"f0aa1238-1b23-472a-908e-f77aa24e6a04\" (UID: \"f0aa1238-1b23-472a-908e-f77aa24e6a04\") "
Jul 24 19:28:08.885669 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:28:08.885671    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t55jv\" (UniqueName: \"kubernetes.io/projected/f0aa1238-1b23-472a-908e-f77aa24e6a04-kube-api-access-t55jv\") pod \"f0aa1238-1b23-472a-908e-f77aa24e6a04\" (UID: \"f0aa1238-1b23-472a-908e-f77aa24e6a04\") "
Jul 24 19:28:08.885934 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:28:08.885701    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f0aa1238-1b23-472a-908e-f77aa24e6a04-tls-certs\") pod \"f0aa1238-1b23-472a-908e-f77aa24e6a04\" (UID: \"f0aa1238-1b23-472a-908e-f77aa24e6a04\") "
Jul 24 19:28:08.885934 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:28:08.885736    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f0aa1238-1b23-472a-908e-f77aa24e6a04-tmp-dir\") pod \"f0aa1238-1b23-472a-908e-f77aa24e6a04\" (UID: \"f0aa1238-1b23-472a-908e-f77aa24e6a04\") "
Jul 24 19:28:08.885934 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:28:08.885804    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f0aa1238-1b23-472a-908e-f77aa24e6a04-model-cache\") pod \"f0aa1238-1b23-472a-908e-f77aa24e6a04\" (UID: \"f0aa1238-1b23-472a-908e-f77aa24e6a04\") "
Jul 24 19:28:08.885934 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:28:08.885831    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f0aa1238-1b23-472a-908e-f77aa24e6a04-dshm\") pod \"f0aa1238-1b23-472a-908e-f77aa24e6a04\" (UID: \"f0aa1238-1b23-472a-908e-f77aa24e6a04\") "
Jul 24 19:28:08.886219 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:28:08.885945    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f0aa1238-1b23-472a-908e-f77aa24e6a04-home" (OuterVolumeSpecName: "home") pod "f0aa1238-1b23-472a-908e-f77aa24e6a04" (UID: "f0aa1238-1b23-472a-908e-f77aa24e6a04"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:28:08.886219 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:28:08.886049    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f0aa1238-1b23-472a-908e-f77aa24e6a04-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "f0aa1238-1b23-472a-908e-f77aa24e6a04" (UID: "f0aa1238-1b23-472a-908e-f77aa24e6a04"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:28:08.886219 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:28:08.886076    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f0aa1238-1b23-472a-908e-f77aa24e6a04-model-cache" (OuterVolumeSpecName: "model-cache") pod "f0aa1238-1b23-472a-908e-f77aa24e6a04" (UID: "f0aa1238-1b23-472a-908e-f77aa24e6a04"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:28:08.886219 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:28:08.886217    2580 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f0aa1238-1b23-472a-908e-f77aa24e6a04-home\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 24 19:28:08.886389 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:28:08.886230    2580 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f0aa1238-1b23-472a-908e-f77aa24e6a04-tmp-dir\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 24 19:28:08.886389 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:28:08.886242    2580 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f0aa1238-1b23-472a-908e-f77aa24e6a04-model-cache\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 24 19:28:08.888055 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:28:08.888022    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f0aa1238-1b23-472a-908e-f77aa24e6a04-dshm" (OuterVolumeSpecName: "dshm") pod "f0aa1238-1b23-472a-908e-f77aa24e6a04" (UID: "f0aa1238-1b23-472a-908e-f77aa24e6a04"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:28:08.888207 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:28:08.888064    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f0aa1238-1b23-472a-908e-f77aa24e6a04-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "f0aa1238-1b23-472a-908e-f77aa24e6a04" (UID: "f0aa1238-1b23-472a-908e-f77aa24e6a04"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 19:28:08.888207 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:28:08.888066    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f0aa1238-1b23-472a-908e-f77aa24e6a04-kube-api-access-t55jv" (OuterVolumeSpecName: "kube-api-access-t55jv") pod "f0aa1238-1b23-472a-908e-f77aa24e6a04" (UID: "f0aa1238-1b23-472a-908e-f77aa24e6a04"). InnerVolumeSpecName "kube-api-access-t55jv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 19:28:08.987478 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:28:08.987438    2580 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f0aa1238-1b23-472a-908e-f77aa24e6a04-dshm\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 24 19:28:08.987478 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:28:08.987473    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t55jv\" (UniqueName: \"kubernetes.io/projected/f0aa1238-1b23-472a-908e-f77aa24e6a04-kube-api-access-t55jv\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 24 19:28:08.987478 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:28:08.987484    2580 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f0aa1238-1b23-472a-908e-f77aa24e6a04-tls-certs\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 24 19:28:08.988282 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:28:08.988258    2580 generic.go:356] "Generic (PLEG): container finished" podID="f0aa1238-1b23-472a-908e-f77aa24e6a04" containerID="aac45c57a6939e58ad3e494a36b42be98a9154b5fb8d8c03b056cbb45187c83c" exitCode=0
Jul 24 19:28:08.988391 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:28:08.988305    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-48f4d2/rate-test-model-48f4d2-kserve-854fdc7959-dpkjv"
Jul 24 19:28:08.988391 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:28:08.988322    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-48f4d2/rate-test-model-48f4d2-kserve-854fdc7959-dpkjv" event={"ID":"f0aa1238-1b23-472a-908e-f77aa24e6a04","Type":"ContainerDied","Data":"aac45c57a6939e58ad3e494a36b42be98a9154b5fb8d8c03b056cbb45187c83c"}
Jul 24 19:28:08.988391 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:28:08.988355    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-48f4d2/rate-test-model-48f4d2-kserve-854fdc7959-dpkjv" event={"ID":"f0aa1238-1b23-472a-908e-f77aa24e6a04","Type":"ContainerDied","Data":"58b8d66c6281b8a2b8bfa7a49f521e145c88e50841d09c5dd74d1316c18b55a9"}
Jul 24 19:28:08.988391 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:28:08.988371    2580 scope.go:117] "RemoveContainer" containerID="aac45c57a6939e58ad3e494a36b42be98a9154b5fb8d8c03b056cbb45187c83c"
Jul 24 19:28:08.997602 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:28:08.997580    2580 scope.go:117] "RemoveContainer" containerID="aac45c57a6939e58ad3e494a36b42be98a9154b5fb8d8c03b056cbb45187c83c"
Jul 24 19:28:08.997885 ip-10-0-141-146 kubenswrapper[2580]: E0724 19:28:08.997865    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aac45c57a6939e58ad3e494a36b42be98a9154b5fb8d8c03b056cbb45187c83c\": container with ID starting with aac45c57a6939e58ad3e494a36b42be98a9154b5fb8d8c03b056cbb45187c83c not found: ID does not exist" containerID="aac45c57a6939e58ad3e494a36b42be98a9154b5fb8d8c03b056cbb45187c83c"
Jul 24 19:28:08.997956 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:28:08.997893    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aac45c57a6939e58ad3e494a36b42be98a9154b5fb8d8c03b056cbb45187c83c"} err="failed to get container status \"aac45c57a6939e58ad3e494a36b42be98a9154b5fb8d8c03b056cbb45187c83c\": rpc error: code = NotFound desc = could not find container \"aac45c57a6939e58ad3e494a36b42be98a9154b5fb8d8c03b056cbb45187c83c\": container with ID starting with aac45c57a6939e58ad3e494a36b42be98a9154b5fb8d8c03b056cbb45187c83c not found: ID does not exist"
Jul 24 19:28:09.015616 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:28:09.015496    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-48f4d2/rate-test-model-48f4d2-kserve-854fdc7959-dpkjv"]
Jul 24 19:28:09.017396 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:28:09.017368    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-48f4d2/rate-test-model-48f4d2-kserve-854fdc7959-dpkjv"]
Jul 24 19:28:09.242538 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:28:09.242504    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f0aa1238-1b23-472a-908e-f77aa24e6a04" path="/var/lib/kubelet/pods/f0aa1238-1b23-472a-908e-f77aa24e6a04/volumes"
Jul 24 19:28:10.196084 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:28:10.196040    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7401-139848806996848"]
Jul 24 19:28:10.196613 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:28:10.196597    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f0aa1238-1b23-472a-908e-f77aa24e6a04" containerName="main"
Jul 24 19:28:10.196661 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:28:10.196616    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="f0aa1238-1b23-472a-908e-f77aa24e6a04" containerName="main"
Jul 24 19:28:10.196732 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:28:10.196721    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="f0aa1238-1b23-472a-908e-f77aa24e6a04" containerName="main"
Jul 24 19:28:10.202214 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:28:10.202187    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7401-139848806996848"
Jul 24 19:28:10.202844 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:28:10.202817    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7401-139848806996848"]
Jul 24 19:28:10.204820 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:28:10.204798    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-5lllf\""
Jul 24 19:28:10.302157 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:28:10.302084    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g7ft9\" (UniqueName: \"kubernetes.io/projected/5a16124d-e542-4e0b-afa7-af7d160aab7d-kube-api-access-g7ft9\") pod \"test-curl-7401-139848806996848\" (UID: \"5a16124d-e542-4e0b-afa7-af7d160aab7d\") " pod="opendatahub/test-curl-7401-139848806996848"
Jul 24 19:28:10.403610 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:28:10.403554    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g7ft9\" (UniqueName: \"kubernetes.io/projected/5a16124d-e542-4e0b-afa7-af7d160aab7d-kube-api-access-g7ft9\") pod \"test-curl-7401-139848806996848\" (UID: \"5a16124d-e542-4e0b-afa7-af7d160aab7d\") " pod="opendatahub/test-curl-7401-139848806996848"
Jul 24 19:28:10.412230 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:28:10.412201    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g7ft9\" (UniqueName: \"kubernetes.io/projected/5a16124d-e542-4e0b-afa7-af7d160aab7d-kube-api-access-g7ft9\") pod \"test-curl-7401-139848806996848\" (UID: \"5a16124d-e542-4e0b-afa7-af7d160aab7d\") " pod="opendatahub/test-curl-7401-139848806996848"
Jul 24 19:28:10.513531 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:28:10.513430    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7401-139848806996848"
Jul 24 19:28:10.658864 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:28:10.658841    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7401-139848806996848"]
Jul 24 19:28:10.661205 ip-10-0-141-146 kubenswrapper[2580]: W0724 19:28:10.661173    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5a16124d_e542_4e0b_afa7_af7d160aab7d.slice/crio-60b8f7dd768df8e5dd96e5450f072d0f27d7821a6120693a8783014861417368 WatchSource:0}: Error finding container 60b8f7dd768df8e5dd96e5450f072d0f27d7821a6120693a8783014861417368: Status 404 returned error can't find the container with id 60b8f7dd768df8e5dd96e5450f072d0f27d7821a6120693a8783014861417368
Jul 24 19:28:10.662575 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:28:10.662558    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 24 19:28:11.002763 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:28:11.002723    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7401-139848806996848" event={"ID":"5a16124d-e542-4e0b-afa7-af7d160aab7d","Type":"ContainerStarted","Data":"60b8f7dd768df8e5dd96e5450f072d0f27d7821a6120693a8783014861417368"}
Jul 24 19:28:12.011754 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:28:12.011716    2580 generic.go:356] "Generic (PLEG): container finished" podID="5a16124d-e542-4e0b-afa7-af7d160aab7d" containerID="a66e7838d88a1a8a67f2dc718aafb0989d00b02c2c3be0ed4493f401567cead1" exitCode=0
Jul 24 19:28:12.012170 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:28:12.011790    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7401-139848806996848" event={"ID":"5a16124d-e542-4e0b-afa7-af7d160aab7d","Type":"ContainerDied","Data":"a66e7838d88a1a8a67f2dc718aafb0989d00b02c2c3be0ed4493f401567cead1"}
Jul 24 19:28:13.152238 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:28:13.152208    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7401-139848806996848"
Jul 24 19:28:13.177270 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:28:13.177240    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7401-139848806996848_5a16124d-e542-4e0b-afa7-af7d160aab7d/test-curl-7401-139848806996848/0.log"
Jul 24 19:28:13.199961 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:28:13.199920    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7401-139848806996848"]
Jul 24 19:28:13.203526 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:28:13.203488    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7401-139848806996848"]
Jul 24 19:28:13.231682 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:28:13.231649    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g7ft9\" (UniqueName: \"kubernetes.io/projected/5a16124d-e542-4e0b-afa7-af7d160aab7d-kube-api-access-g7ft9\") pod \"5a16124d-e542-4e0b-afa7-af7d160aab7d\" (UID: \"5a16124d-e542-4e0b-afa7-af7d160aab7d\") "
Jul 24 19:28:13.234242 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:28:13.234219    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5a16124d-e542-4e0b-afa7-af7d160aab7d-kube-api-access-g7ft9" (OuterVolumeSpecName: "kube-api-access-g7ft9") pod "5a16124d-e542-4e0b-afa7-af7d160aab7d" (UID: "5a16124d-e542-4e0b-afa7-af7d160aab7d"). InnerVolumeSpecName "kube-api-access-g7ft9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 19:28:13.241632 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:28:13.241609    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5a16124d-e542-4e0b-afa7-af7d160aab7d" path="/var/lib/kubelet/pods/5a16124d-e542-4e0b-afa7-af7d160aab7d/volumes"
Jul 24 19:28:13.332948 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:28:13.332859    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g7ft9\" (UniqueName: \"kubernetes.io/projected/5a16124d-e542-4e0b-afa7-af7d160aab7d-kube-api-access-g7ft9\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 24 19:28:13.728757 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:28:13.728723    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:28:14.023098 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:28:14.022995    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-a-87cd66-openshift-default-694449f47d-k9tjt"]
Jul 24 19:28:14.023556 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:28:14.023530    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5a16124d-e542-4e0b-afa7-af7d160aab7d" containerName="test-curl-7401-139848806996848"
Jul 24 19:28:14.023556 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:28:14.023555    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="5a16124d-e542-4e0b-afa7-af7d160aab7d" containerName="test-curl-7401-139848806996848"
Jul 24 19:28:14.023779 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:28:14.023677    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="5a16124d-e542-4e0b-afa7-af7d160aab7d" containerName="test-curl-7401-139848806996848"
Jul 24 19:28:14.024842 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:28:14.024816    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7401-139848806996848"
Jul 24 19:28:14.027059 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:28:14.027040    2580 scope.go:117] "RemoveContainer" containerID="a66e7838d88a1a8a67f2dc718aafb0989d00b02c2c3be0ed4493f401567cead1"
Jul 24 19:28:14.027190 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:28:14.027162    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-87cd66-openshift-default-694449f47d-k9tjt"
Jul 24 19:28:14.029647 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:28:14.029628    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-a-87cd66-openshift-default-dockercfg-qm7jl\""
Jul 24 19:28:14.037998 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:28:14.037976    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-87cd66-openshift-default-694449f47d-k9tjt"]
Jul 24 19:28:14.142051 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:28:14.142016    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a3d1fc7f-7aa3-482c-9a66-fb95ea31e548-istio-data\") pod \"e2e-ipp-a-87cd66-openshift-default-694449f47d-k9tjt\" (UID: \"a3d1fc7f-7aa3-482c-9a66-fb95ea31e548\") " pod="openshift-ingress/e2e-ipp-a-87cd66-openshift-default-694449f47d-k9tjt"
Jul 24 19:28:14.142246 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:28:14.142070    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a3d1fc7f-7aa3-482c-9a66-fb95ea31e548-credential-socket\") pod \"e2e-ipp-a-87cd66-openshift-default-694449f47d-k9tjt\" (UID: \"a3d1fc7f-7aa3-482c-9a66-fb95ea31e548\") " pod="openshift-ingress/e2e-ipp-a-87cd66-openshift-default-694449f47d-k9tjt"
Jul 24 19:28:14.142246 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:28:14.142131    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j8pnf\" (UniqueName: \"kubernetes.io/projected/a3d1fc7f-7aa3-482c-9a66-fb95ea31e548-kube-api-access-j8pnf\") pod \"e2e-ipp-a-87cd66-openshift-default-694449f47d-k9tjt\" (UID: \"a3d1fc7f-7aa3-482c-9a66-fb95ea31e548\") " pod="openshift-ingress/e2e-ipp-a-87cd66-openshift-default-694449f47d-k9tjt"
Jul 24 19:28:14.142246 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:28:14.142183    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a3d1fc7f-7aa3-482c-9a66-fb95ea31e548-workload-socket\") pod \"e2e-ipp-a-87cd66-openshift-default-694449f47d-k9tjt\" (UID: \"a3d1fc7f-7aa3-482c-9a66-fb95ea31e548\") " pod="openshift-ingress/e2e-ipp-a-87cd66-openshift-default-694449f47d-k9tjt"
Jul 24 19:28:14.142246 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:28:14.142222    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a3d1fc7f-7aa3-482c-9a66-fb95ea31e548-istio-podinfo\") pod \"e2e-ipp-a-87cd66-openshift-default-694449f47d-k9tjt\" (UID: \"a3d1fc7f-7aa3-482c-9a66-fb95ea31e548\") " pod="openshift-ingress/e2e-ipp-a-87cd66-openshift-default-694449f47d-k9tjt"
Jul 24 19:28:14.142390 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:28:14.142275    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a3d1fc7f-7aa3-482c-9a66-fb95ea31e548-workload-certs\") pod \"e2e-ipp-a-87cd66-openshift-default-694449f47d-k9tjt\" (UID: \"a3d1fc7f-7aa3-482c-9a66-fb95ea31e548\") " pod="openshift-ingress/e2e-ipp-a-87cd66-openshift-default-694449f47d-k9tjt"
Jul 24 19:28:14.142390 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:28:14.142301    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a3d1fc7f-7aa3-482c-9a66-fb95ea31e548-istio-token\") pod \"e2e-ipp-a-87cd66-openshift-default-694449f47d-k9tjt\" (UID: \"a3d1fc7f-7aa3-482c-9a66-fb95ea31e548\") " pod="openshift-ingress/e2e-ipp-a-87cd66-openshift-default-694449f47d-k9tjt"
Jul 24 19:28:14.142390 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:28:14.142325    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a3d1fc7f-7aa3-482c-9a66-fb95ea31e548-istio-envoy\") pod \"e2e-ipp-a-87cd66-openshift-default-694449f47d-k9tjt\" (UID: \"a3d1fc7f-7aa3-482c-9a66-fb95ea31e548\") " pod="openshift-ingress/e2e-ipp-a-87cd66-openshift-default-694449f47d-k9tjt"
Jul 24 19:28:14.142390 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:28:14.142385    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a3d1fc7f-7aa3-482c-9a66-fb95ea31e548-istiod-ca-cert\") pod \"e2e-ipp-a-87cd66-openshift-default-694449f47d-k9tjt\" (UID: \"a3d1fc7f-7aa3-482c-9a66-fb95ea31e548\") " pod="openshift-ingress/e2e-ipp-a-87cd66-openshift-default-694449f47d-k9tjt"
Jul 24 19:28:14.243750 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:28:14.243703    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a3d1fc7f-7aa3-482c-9a66-fb95ea31e548-istio-podinfo\") pod \"e2e-ipp-a-87cd66-openshift-default-694449f47d-k9tjt\" (UID: \"a3d1fc7f-7aa3-482c-9a66-fb95ea31e548\") " pod="openshift-ingress/e2e-ipp-a-87cd66-openshift-default-694449f47d-k9tjt"
Jul 24 19:28:14.244296 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:28:14.243774    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a3d1fc7f-7aa3-482c-9a66-fb95ea31e548-workload-certs\") pod \"e2e-ipp-a-87cd66-openshift-default-694449f47d-k9tjt\" (UID: \"a3d1fc7f-7aa3-482c-9a66-fb95ea31e548\") " pod="openshift-ingress/e2e-ipp-a-87cd66-openshift-default-694449f47d-k9tjt"
Jul 24 19:28:14.244296 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:28:14.243807    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a3d1fc7f-7aa3-482c-9a66-fb95ea31e548-istio-token\") pod \"e2e-ipp-a-87cd66-openshift-default-694449f47d-k9tjt\" (UID: \"a3d1fc7f-7aa3-482c-9a66-fb95ea31e548\") " pod="openshift-ingress/e2e-ipp-a-87cd66-openshift-default-694449f47d-k9tjt"
Jul 24 19:28:14.244296 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:28:14.243835    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a3d1fc7f-7aa3-482c-9a66-fb95ea31e548-istio-envoy\") pod \"e2e-ipp-a-87cd66-openshift-default-694449f47d-k9tjt\" (UID: \"a3d1fc7f-7aa3-482c-9a66-fb95ea31e548\") " pod="openshift-ingress/e2e-ipp-a-87cd66-openshift-default-694449f47d-k9tjt"
Jul 24 19:28:14.244296 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:28:14.243896    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a3d1fc7f-7aa3-482c-9a66-fb95ea31e548-istiod-ca-cert\") pod \"e2e-ipp-a-87cd66-openshift-default-694449f47d-k9tjt\" (UID: \"a3d1fc7f-7aa3-482c-9a66-fb95ea31e548\") " pod="openshift-ingress/e2e-ipp-a-87cd66-openshift-default-694449f47d-k9tjt"
Jul 24 19:28:14.244296 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:28:14.243923    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a3d1fc7f-7aa3-482c-9a66-fb95ea31e548-istio-data\") pod \"e2e-ipp-a-87cd66-openshift-default-694449f47d-k9tjt\" (UID: \"a3d1fc7f-7aa3-482c-9a66-fb95ea31e548\") " pod="openshift-ingress/e2e-ipp-a-87cd66-openshift-default-694449f47d-k9tjt"
Jul 24 19:28:14.244296 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:28:14.243962    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a3d1fc7f-7aa3-482c-9a66-fb95ea31e548-credential-socket\") pod \"e2e-ipp-a-87cd66-openshift-default-694449f47d-k9tjt\" (UID: \"a3d1fc7f-7aa3-482c-9a66-fb95ea31e548\") " pod="openshift-ingress/e2e-ipp-a-87cd66-openshift-default-694449f47d-k9tjt"
Jul 24 19:28:14.244296 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:28:14.243989    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j8pnf\" (UniqueName: \"kubernetes.io/projected/a3d1fc7f-7aa3-482c-9a66-fb95ea31e548-kube-api-access-j8pnf\") pod \"e2e-ipp-a-87cd66-openshift-default-694449f47d-k9tjt\" (UID: \"a3d1fc7f-7aa3-482c-9a66-fb95ea31e548\") " pod="openshift-ingress/e2e-ipp-a-87cd66-openshift-default-694449f47d-k9tjt"
Jul 24 19:28:14.244296 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:28:14.244029    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a3d1fc7f-7aa3-482c-9a66-fb95ea31e548-workload-socket\") pod \"e2e-ipp-a-87cd66-openshift-default-694449f47d-k9tjt\" (UID: \"a3d1fc7f-7aa3-482c-9a66-fb95ea31e548\") " pod="openshift-ingress/e2e-ipp-a-87cd66-openshift-default-694449f47d-k9tjt"
Jul 24 19:28:14.244860 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:28:14.244345    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a3d1fc7f-7aa3-482c-9a66-fb95ea31e548-workload-certs\") pod \"e2e-ipp-a-87cd66-openshift-default-694449f47d-k9tjt\" (UID: \"a3d1fc7f-7aa3-482c-9a66-fb95ea31e548\") " pod="openshift-ingress/e2e-ipp-a-87cd66-openshift-default-694449f47d-k9tjt"
Jul 24 19:28:14.244860 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:28:14.244393    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a3d1fc7f-7aa3-482c-9a66-fb95ea31e548-istio-data\") pod \"e2e-ipp-a-87cd66-openshift-default-694449f47d-k9tjt\" (UID: \"a3d1fc7f-7aa3-482c-9a66-fb95ea31e548\") " pod="openshift-ingress/e2e-ipp-a-87cd66-openshift-default-694449f47d-k9tjt"
Jul 24 19:28:14.244860 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:28:14.244413    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a3d1fc7f-7aa3-482c-9a66-fb95ea31e548-credential-socket\") pod \"e2e-ipp-a-87cd66-openshift-default-694449f47d-k9tjt\" (UID: \"a3d1fc7f-7aa3-482c-9a66-fb95ea31e548\") " pod="openshift-ingress/e2e-ipp-a-87cd66-openshift-default-694449f47d-k9tjt"
Jul 24 19:28:14.244860 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:28:14.244510    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a3d1fc7f-7aa3-482c-9a66-fb95ea31e548-workload-socket\") pod \"e2e-ipp-a-87cd66-openshift-default-694449f47d-k9tjt\" (UID: \"a3d1fc7f-7aa3-482c-9a66-fb95ea31e548\") " pod="openshift-ingress/e2e-ipp-a-87cd66-openshift-default-694449f47d-k9tjt"
Jul 24 19:28:14.244860 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:28:14.244833    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a3d1fc7f-7aa3-482c-9a66-fb95ea31e548-istiod-ca-cert\") pod \"e2e-ipp-a-87cd66-openshift-default-694449f47d-k9tjt\" (UID: \"a3d1fc7f-7aa3-482c-9a66-fb95ea31e548\") " pod="openshift-ingress/e2e-ipp-a-87cd66-openshift-default-694449f47d-k9tjt"
Jul 24 19:28:14.246352 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:28:14.246331    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a3d1fc7f-7aa3-482c-9a66-fb95ea31e548-istio-envoy\") pod \"e2e-ipp-a-87cd66-openshift-default-694449f47d-k9tjt\" (UID: \"a3d1fc7f-7aa3-482c-9a66-fb95ea31e548\") " pod="openshift-ingress/e2e-ipp-a-87cd66-openshift-default-694449f47d-k9tjt"
Jul 24 19:28:14.246667 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:28:14.246645    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a3d1fc7f-7aa3-482c-9a66-fb95ea31e548-istio-podinfo\") pod \"e2e-ipp-a-87cd66-openshift-default-694449f47d-k9tjt\" (UID: \"a3d1fc7f-7aa3-482c-9a66-fb95ea31e548\") " pod="openshift-ingress/e2e-ipp-a-87cd66-openshift-default-694449f47d-k9tjt"
Jul 24 19:28:14.251851 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:28:14.251828    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a3d1fc7f-7aa3-482c-9a66-fb95ea31e548-istio-token\") pod \"e2e-ipp-a-87cd66-openshift-default-694449f47d-k9tjt\" (UID: \"a3d1fc7f-7aa3-482c-9a66-fb95ea31e548\") " pod="openshift-ingress/e2e-ipp-a-87cd66-openshift-default-694449f47d-k9tjt"
Jul 24 19:28:14.251933 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:28:14.251851    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j8pnf\" (UniqueName: \"kubernetes.io/projected/a3d1fc7f-7aa3-482c-9a66-fb95ea31e548-kube-api-access-j8pnf\") pod \"e2e-ipp-a-87cd66-openshift-default-694449f47d-k9tjt\" (UID: \"a3d1fc7f-7aa3-482c-9a66-fb95ea31e548\") " pod="openshift-ingress/e2e-ipp-a-87cd66-openshift-default-694449f47d-k9tjt"
Jul 24 19:28:14.339247 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:28:14.339149    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-87cd66-openshift-default-694449f47d-k9tjt"
Jul 24 19:28:14.487102 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:28:14.487046    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-87cd66-openshift-default-694449f47d-k9tjt"]
Jul 24 19:28:14.489250 ip-10-0-141-146 kubenswrapper[2580]: W0724 19:28:14.489219    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3d1fc7f_7aa3_482c_9a66_fb95ea31e548.slice/crio-c2b545df8980573e904c684f18c182d6ba7107ca360535ad10036495c341137f WatchSource:0}: Error finding container c2b545df8980573e904c684f18c182d6ba7107ca360535ad10036495c341137f: Status 404 returned error can't find the container with id c2b545df8980573e904c684f18c182d6ba7107ca360535ad10036495c341137f
Jul 24 19:28:14.491645 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:28:14.491610    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 24 19:28:14.491729 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:28:14.491677    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 24 19:28:14.491729 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:28:14.491706    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 24 19:28:14.910283 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:28:14.910250    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:28:15.031023 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:28:15.030976    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-87cd66-openshift-default-694449f47d-k9tjt" event={"ID":"a3d1fc7f-7aa3-482c-9a66-fb95ea31e548","Type":"ContainerStarted","Data":"9e92fee89976cdf60159d1f1ff68802d84338d8ffb8c3866488a8c899ae36e81"}
Jul 24 19:28:15.031241 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:28:15.031044    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-87cd66-openshift-default-694449f47d-k9tjt" event={"ID":"a3d1fc7f-7aa3-482c-9a66-fb95ea31e548","Type":"ContainerStarted","Data":"c2b545df8980573e904c684f18c182d6ba7107ca360535ad10036495c341137f"}
Jul 24 19:28:15.050304 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:28:15.050239    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-a-87cd66-openshift-default-694449f47d-k9tjt" podStartSLOduration=1.050212668 podStartE2EDuration="1.050212668s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 19:28:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:28:15.049999473 +0000 UTC m=+2650.259371517" watchObservedRunningTime="2026-07-24 19:28:15.050212668 +0000 UTC m=+2650.259584714"
Jul 24 19:28:15.340356 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:28:15.340320    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-87cd66-openshift-default-694449f47d-k9tjt"
Jul 24 19:28:15.345361 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:28:15.345340    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-87cd66-openshift-default-694449f47d-k9tjt"
Jul 24 19:28:16.038089 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:28:16.038048    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-87cd66-openshift-default-694449f47d-k9tjt"
Jul 24 19:28:16.039046 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:28:16.039024    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-87cd66-openshift-default-694449f47d-k9tjt"
Jul 24 19:28:16.987088 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:28:16.987049    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:28:17.081469 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:28:17.081433    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:28:17.310512 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:28:17.310419    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:28:17.643329 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:28:17.643234    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:28:17.804875 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:28:17.804838    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:28:17.900371 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:28:17.900281    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:28:21.508381 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:28:21.508345    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:28:32.079318 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:28:32.079278    2580 patch_prober.go:28] interesting pod/e2e-ipp-a-87cd66-openshift-default-694449f47d-k9tjt container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 24 19:28:32.079745 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:28:32.079346    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-a-87cd66-openshift-default-694449f47d-k9tjt" podUID="a3d1fc7f-7aa3-482c-9a66-fb95ea31e548" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 24 19:28:32.447060 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:28:32.447024    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:28:32.774720 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:28:32.774613    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-b-5ce07c-openshift-default-8485cc8bf8-ldjgs"]
Jul 24 19:28:32.779472 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:28:32.779447    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-5ce07c-openshift-default-8485cc8bf8-ldjgs"
Jul 24 19:28:32.782176 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:28:32.782150    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-b-5ce07c-openshift-default-dockercfg-bt4tr\""
Jul 24 19:28:32.792257 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:28:32.792231    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-5ce07c-openshift-default-8485cc8bf8-ldjgs"]
Jul 24 19:28:32.807849 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:28:32.807813    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:28:32.838481 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:28:32.838445    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/933f9fa9-7e18-46b9-b435-7fe567b40d1a-istio-envoy\") pod \"e2e-ipp-b-5ce07c-openshift-default-8485cc8bf8-ldjgs\" (UID: \"933f9fa9-7e18-46b9-b435-7fe567b40d1a\") " pod="openshift-ingress/e2e-ipp-b-5ce07c-openshift-default-8485cc8bf8-ldjgs"
Jul 24 19:28:32.838663 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:28:32.838507    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/933f9fa9-7e18-46b9-b435-7fe567b40d1a-credential-socket\") pod \"e2e-ipp-b-5ce07c-openshift-default-8485cc8bf8-ldjgs\" (UID: \"933f9fa9-7e18-46b9-b435-7fe567b40d1a\") " pod="openshift-ingress/e2e-ipp-b-5ce07c-openshift-default-8485cc8bf8-ldjgs"
Jul 24 19:28:32.838663 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:28:32.838561    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/933f9fa9-7e18-46b9-b435-7fe567b40d1a-istio-podinfo\") pod \"e2e-ipp-b-5ce07c-openshift-default-8485cc8bf8-ldjgs\" (UID: \"933f9fa9-7e18-46b9-b435-7fe567b40d1a\") " pod="openshift-ingress/e2e-ipp-b-5ce07c-openshift-default-8485cc8bf8-ldjgs"
Jul 24 19:28:32.838663 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:28:32.838582    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/933f9fa9-7e18-46b9-b435-7fe567b40d1a-istiod-ca-cert\") pod \"e2e-ipp-b-5ce07c-openshift-default-8485cc8bf8-ldjgs\" (UID: \"933f9fa9-7e18-46b9-b435-7fe567b40d1a\") " pod="openshift-ingress/e2e-ipp-b-5ce07c-openshift-default-8485cc8bf8-ldjgs"
Jul 24 19:28:32.838663 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:28:32.838640    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/933f9fa9-7e18-46b9-b435-7fe567b40d1a-workload-certs\") pod \"e2e-ipp-b-5ce07c-openshift-default-8485cc8bf8-ldjgs\" (UID: \"933f9fa9-7e18-46b9-b435-7fe567b40d1a\") " pod="openshift-ingress/e2e-ipp-b-5ce07c-openshift-default-8485cc8bf8-ldjgs"
Jul 24 19:28:32.838798 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:28:32.838679    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/933f9fa9-7e18-46b9-b435-7fe567b40d1a-workload-socket\") pod \"e2e-ipp-b-5ce07c-openshift-default-8485cc8bf8-ldjgs\" (UID: \"933f9fa9-7e18-46b9-b435-7fe567b40d1a\") " pod="openshift-ingress/e2e-ipp-b-5ce07c-openshift-default-8485cc8bf8-ldjgs"
Jul 24 19:28:32.838798 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:28:32.838710    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/933f9fa9-7e18-46b9-b435-7fe567b40d1a-istio-token\") pod \"e2e-ipp-b-5ce07c-openshift-default-8485cc8bf8-ldjgs\" (UID: \"933f9fa9-7e18-46b9-b435-7fe567b40d1a\") " pod="openshift-ingress/e2e-ipp-b-5ce07c-openshift-default-8485cc8bf8-ldjgs"
Jul 24 19:28:32.838798 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:28:32.838763    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7mkkr\" (UniqueName: \"kubernetes.io/projected/933f9fa9-7e18-46b9-b435-7fe567b40d1a-kube-api-access-7mkkr\") pod \"e2e-ipp-b-5ce07c-openshift-default-8485cc8bf8-ldjgs\" (UID: \"933f9fa9-7e18-46b9-b435-7fe567b40d1a\") " pod="openshift-ingress/e2e-ipp-b-5ce07c-openshift-default-8485cc8bf8-ldjgs"
Jul 24 19:28:32.838894 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:28:32.838808    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/933f9fa9-7e18-46b9-b435-7fe567b40d1a-istio-data\") pod \"e2e-ipp-b-5ce07c-openshift-default-8485cc8bf8-ldjgs\" (UID: \"933f9fa9-7e18-46b9-b435-7fe567b40d1a\") " pod="openshift-ingress/e2e-ipp-b-5ce07c-openshift-default-8485cc8bf8-ldjgs"
Jul 24 19:28:32.940036 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:28:32.939974    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/933f9fa9-7e18-46b9-b435-7fe567b40d1a-istio-data\") pod \"e2e-ipp-b-5ce07c-openshift-default-8485cc8bf8-ldjgs\" (UID: \"933f9fa9-7e18-46b9-b435-7fe567b40d1a\") " pod="openshift-ingress/e2e-ipp-b-5ce07c-openshift-default-8485cc8bf8-ldjgs"
Jul 24 19:28:32.940264 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:28:32.940048    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/933f9fa9-7e18-46b9-b435-7fe567b40d1a-istio-envoy\") pod \"e2e-ipp-b-5ce07c-openshift-default-8485cc8bf8-ldjgs\" (UID: \"933f9fa9-7e18-46b9-b435-7fe567b40d1a\") " pod="openshift-ingress/e2e-ipp-b-5ce07c-openshift-default-8485cc8bf8-ldjgs"
Jul 24 19:28:32.940264 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:28:32.940151    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/933f9fa9-7e18-46b9-b435-7fe567b40d1a-credential-socket\") pod \"e2e-ipp-b-5ce07c-openshift-default-8485cc8bf8-ldjgs\" (UID: \"933f9fa9-7e18-46b9-b435-7fe567b40d1a\") " pod="openshift-ingress/e2e-ipp-b-5ce07c-openshift-default-8485cc8bf8-ldjgs"
Jul 24 19:28:32.940264 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:28:32.940227    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/933f9fa9-7e18-46b9-b435-7fe567b40d1a-istio-podinfo\") pod \"e2e-ipp-b-5ce07c-openshift-default-8485cc8bf8-ldjgs\" (UID: \"933f9fa9-7e18-46b9-b435-7fe567b40d1a\") " pod="openshift-ingress/e2e-ipp-b-5ce07c-openshift-default-8485cc8bf8-ldjgs"
Jul 24 19:28:32.940264 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:28:32.940260    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/933f9fa9-7e18-46b9-b435-7fe567b40d1a-istiod-ca-cert\") pod \"e2e-ipp-b-5ce07c-openshift-default-8485cc8bf8-ldjgs\" (UID: \"933f9fa9-7e18-46b9-b435-7fe567b40d1a\") " pod="openshift-ingress/e2e-ipp-b-5ce07c-openshift-default-8485cc8bf8-ldjgs"
Jul 24 19:28:32.940467 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:28:32.940291    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/933f9fa9-7e18-46b9-b435-7fe567b40d1a-workload-certs\") pod \"e2e-ipp-b-5ce07c-openshift-default-8485cc8bf8-ldjgs\" (UID: \"933f9fa9-7e18-46b9-b435-7fe567b40d1a\") " pod="openshift-ingress/e2e-ipp-b-5ce07c-openshift-default-8485cc8bf8-ldjgs"
Jul 24 19:28:32.940524 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:28:32.940469    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/933f9fa9-7e18-46b9-b435-7fe567b40d1a-istio-data\") pod \"e2e-ipp-b-5ce07c-openshift-default-8485cc8bf8-ldjgs\" (UID: \"933f9fa9-7e18-46b9-b435-7fe567b40d1a\") " pod="openshift-ingress/e2e-ipp-b-5ce07c-openshift-default-8485cc8bf8-ldjgs"
Jul 24 19:28:32.940582 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:28:32.940559    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/933f9fa9-7e18-46b9-b435-7fe567b40d1a-credential-socket\") pod \"e2e-ipp-b-5ce07c-openshift-default-8485cc8bf8-ldjgs\" (UID: \"933f9fa9-7e18-46b9-b435-7fe567b40d1a\") " pod="openshift-ingress/e2e-ipp-b-5ce07c-openshift-default-8485cc8bf8-ldjgs"
Jul 24 19:28:32.940640 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:28:32.940607    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/933f9fa9-7e18-46b9-b435-7fe567b40d1a-workload-socket\") pod \"e2e-ipp-b-5ce07c-openshift-default-8485cc8bf8-ldjgs\" (UID: \"933f9fa9-7e18-46b9-b435-7fe567b40d1a\") " pod="openshift-ingress/e2e-ipp-b-5ce07c-openshift-default-8485cc8bf8-ldjgs"
Jul 24 19:28:32.940698 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:28:32.940659    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/933f9fa9-7e18-46b9-b435-7fe567b40d1a-istio-token\") pod \"e2e-ipp-b-5ce07c-openshift-default-8485cc8bf8-ldjgs\" (UID: \"933f9fa9-7e18-46b9-b435-7fe567b40d1a\") " pod="openshift-ingress/e2e-ipp-b-5ce07c-openshift-default-8485cc8bf8-ldjgs"
Jul 24 19:28:32.940758 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:28:32.940716    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7mkkr\" (UniqueName: \"kubernetes.io/projected/933f9fa9-7e18-46b9-b435-7fe567b40d1a-kube-api-access-7mkkr\") pod \"e2e-ipp-b-5ce07c-openshift-default-8485cc8bf8-ldjgs\" (UID: \"933f9fa9-7e18-46b9-b435-7fe567b40d1a\") " pod="openshift-ingress/e2e-ipp-b-5ce07c-openshift-default-8485cc8bf8-ldjgs"
Jul 24 19:28:32.940920 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:28:32.940897    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/933f9fa9-7e18-46b9-b435-7fe567b40d1a-workload-socket\") pod \"e2e-ipp-b-5ce07c-openshift-default-8485cc8bf8-ldjgs\" (UID: \"933f9fa9-7e18-46b9-b435-7fe567b40d1a\") " pod="openshift-ingress/e2e-ipp-b-5ce07c-openshift-default-8485cc8bf8-ldjgs"
Jul 24 19:28:32.940996 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:28:32.940661    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/933f9fa9-7e18-46b9-b435-7fe567b40d1a-workload-certs\") pod \"e2e-ipp-b-5ce07c-openshift-default-8485cc8bf8-ldjgs\" (UID: \"933f9fa9-7e18-46b9-b435-7fe567b40d1a\") " pod="openshift-ingress/e2e-ipp-b-5ce07c-openshift-default-8485cc8bf8-ldjgs"
Jul 24 19:28:32.941073 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:28:32.941039    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/933f9fa9-7e18-46b9-b435-7fe567b40d1a-istiod-ca-cert\") pod \"e2e-ipp-b-5ce07c-openshift-default-8485cc8bf8-ldjgs\" (UID: \"933f9fa9-7e18-46b9-b435-7fe567b40d1a\") " pod="openshift-ingress/e2e-ipp-b-5ce07c-openshift-default-8485cc8bf8-ldjgs"
Jul 24 19:28:32.943335 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:28:32.943306    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/933f9fa9-7e18-46b9-b435-7fe567b40d1a-istio-envoy\") pod \"e2e-ipp-b-5ce07c-openshift-default-8485cc8bf8-ldjgs\" (UID: \"933f9fa9-7e18-46b9-b435-7fe567b40d1a\") " pod="openshift-ingress/e2e-ipp-b-5ce07c-openshift-default-8485cc8bf8-ldjgs"
Jul 24 19:28:32.943454 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:28:32.943360    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/933f9fa9-7e18-46b9-b435-7fe567b40d1a-istio-podinfo\") pod \"e2e-ipp-b-5ce07c-openshift-default-8485cc8bf8-ldjgs\" (UID: \"933f9fa9-7e18-46b9-b435-7fe567b40d1a\") " pod="openshift-ingress/e2e-ipp-b-5ce07c-openshift-default-8485cc8bf8-ldjgs"
Jul 24 19:28:32.949613 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:28:32.949582    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/933f9fa9-7e18-46b9-b435-7fe567b40d1a-istio-token\") pod \"e2e-ipp-b-5ce07c-openshift-default-8485cc8bf8-ldjgs\" (UID: \"933f9fa9-7e18-46b9-b435-7fe567b40d1a\") " pod="openshift-ingress/e2e-ipp-b-5ce07c-openshift-default-8485cc8bf8-ldjgs"
Jul 24 19:28:32.949807 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:28:32.949780    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7mkkr\" (UniqueName: \"kubernetes.io/projected/933f9fa9-7e18-46b9-b435-7fe567b40d1a-kube-api-access-7mkkr\") pod \"e2e-ipp-b-5ce07c-openshift-default-8485cc8bf8-ldjgs\" (UID: \"933f9fa9-7e18-46b9-b435-7fe567b40d1a\") " pod="openshift-ingress/e2e-ipp-b-5ce07c-openshift-default-8485cc8bf8-ldjgs"
Jul 24 19:28:33.092362 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:28:33.092273    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-5ce07c-openshift-default-8485cc8bf8-ldjgs"
Jul 24 19:28:33.164834 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:28:33.164789    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:28:33.257404 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:28:33.257378    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-5ce07c-openshift-default-8485cc8bf8-ldjgs"]
Jul 24 19:28:33.275442 ip-10-0-141-146 kubenswrapper[2580]: W0724 19:28:33.275410    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod933f9fa9_7e18_46b9_b435_7fe567b40d1a.slice/crio-47cef8b8a6356bdb38edaa621088dee1b6ea1130309139330e5b5c914d701230 WatchSource:0}: Error finding container 47cef8b8a6356bdb38edaa621088dee1b6ea1130309139330e5b5c914d701230: Status 404 returned error can't find the container with id 47cef8b8a6356bdb38edaa621088dee1b6ea1130309139330e5b5c914d701230
Jul 24 19:28:33.277782 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:28:33.277751    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 24 19:28:33.277869 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:28:33.277823    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 24 19:28:33.277869 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:28:33.277849    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 24 19:28:34.135167 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:28:34.135097    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-5ce07c-openshift-default-8485cc8bf8-ldjgs" event={"ID":"933f9fa9-7e18-46b9-b435-7fe567b40d1a","Type":"ContainerStarted","Data":"febf95799a07d19ecfe0c3f939f05e4c2c783d06999e26e722fbddde187ea462"}
Jul 24 19:28:34.135677 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:28:34.135193    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-5ce07c-openshift-default-8485cc8bf8-ldjgs" event={"ID":"933f9fa9-7e18-46b9-b435-7fe567b40d1a","Type":"ContainerStarted","Data":"47cef8b8a6356bdb38edaa621088dee1b6ea1130309139330e5b5c914d701230"}
Jul 24 19:28:34.136745 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:28:34.136722    2580 generic.go:356] "Generic (PLEG): container finished" podID="a3d1fc7f-7aa3-482c-9a66-fb95ea31e548" containerID="9e92fee89976cdf60159d1f1ff68802d84338d8ffb8c3866488a8c899ae36e81" exitCode=0
Jul 24 19:28:34.136872 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:28:34.136795    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-87cd66-openshift-default-694449f47d-k9tjt" event={"ID":"a3d1fc7f-7aa3-482c-9a66-fb95ea31e548","Type":"ContainerDied","Data":"9e92fee89976cdf60159d1f1ff68802d84338d8ffb8c3866488a8c899ae36e81"}
Jul 24 19:28:34.137217 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:28:34.137199    2580 scope.go:117] "RemoveContainer" containerID="9e92fee89976cdf60159d1f1ff68802d84338d8ffb8c3866488a8c899ae36e81"
Jul 24 19:28:34.138339 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:28:34.138312    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 24 19:28:34.138442 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:28:34.138391    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 24 19:28:34.138442 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:28:34.138437    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 24 19:28:34.155717 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:28:34.155668    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-b-5ce07c-openshift-default-8485cc8bf8-ldjgs" podStartSLOduration=2.155651574 podStartE2EDuration="2.155651574s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 19:28:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:28:34.154689346 +0000 UTC m=+2669.364061381" watchObservedRunningTime="2026-07-24 19:28:34.155651574 +0000 UTC m=+2669.365023608"
Jul 24 19:28:35.092520 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:28:35.092478    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-5ce07c-openshift-default-8485cc8bf8-ldjgs"
Jul 24 19:28:35.100760 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:28:35.100689    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-5ce07c-openshift-default-8485cc8bf8-ldjgs"
Jul 24 19:28:35.145041 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:28:35.145007    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-87cd66-openshift-default-694449f47d-k9tjt" event={"ID":"a3d1fc7f-7aa3-482c-9a66-fb95ea31e548","Type":"ContainerStarted","Data":"f50c743a35e466528c41afc92f224b8625dfbbf8988e6c4c0077c3a0549cf537"}
Jul 24 19:28:35.145489 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:28:35.145276    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-5ce07c-openshift-default-8485cc8bf8-ldjgs"
Jul 24 19:28:35.146466 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:28:35.146442    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-5ce07c-openshift-default-8485cc8bf8-ldjgs"
Jul 24 19:28:35.340086 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:28:35.340045    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-87cd66-openshift-default-694449f47d-k9tjt"
Jul 24 19:28:35.340375 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:28:35.340348    2580 patch_prober.go:28] interesting pod/e2e-ipp-a-87cd66-openshift-default-694449f47d-k9tjt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Jul 24 19:28:35.340441 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:28:35.340421    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-87cd66-openshift-default-694449f47d-k9tjt" podUID="a3d1fc7f-7aa3-482c-9a66-fb95ea31e548" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Jul 24 19:28:36.133598 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:28:36.133559    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:28:36.220530 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:28:36.220466    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:28:36.299721 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:28:36.299681    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:28:36.339971 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:28:36.339933    2580 patch_prober.go:28] interesting pod/e2e-ipp-a-87cd66-openshift-default-694449f47d-k9tjt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Jul 24 19:28:36.340189 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:28:36.340003    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-87cd66-openshift-default-694449f47d-k9tjt" podUID="a3d1fc7f-7aa3-482c-9a66-fb95ea31e548" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Jul 24 19:28:36.809747 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:28:36.809703    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:28:36.908747 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:28:36.908662    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:28:37.339770 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:28:37.339731    2580 patch_prober.go:28] interesting pod/e2e-ipp-a-87cd66-openshift-default-694449f47d-k9tjt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Jul 24 19:28:37.340221 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:28:37.339797    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-87cd66-openshift-default-694449f47d-k9tjt" podUID="a3d1fc7f-7aa3-482c-9a66-fb95ea31e548" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Jul 24 19:28:38.339790 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:28:38.339755    2580 patch_prober.go:28] interesting pod/e2e-ipp-a-87cd66-openshift-default-694449f47d-k9tjt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Jul 24 19:28:38.340250 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:28:38.339828    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-87cd66-openshift-default-694449f47d-k9tjt" podUID="a3d1fc7f-7aa3-482c-9a66-fb95ea31e548" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Jul 24 19:28:39.342899 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:28:39.342868    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-87cd66-openshift-default-694449f47d-k9tjt"
Jul 24 19:28:39.343372 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:28:39.343349    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-87cd66-openshift-default-694449f47d-k9tjt"
Jul 24 19:28:39.344050 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:28:39.344033    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-87cd66-openshift-default-694449f47d-k9tjt"
Jul 24 19:28:40.611005 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:28:40.610958    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:28:48.211167 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:28:48.211115    2580 generic.go:356] "Generic (PLEG): container finished" podID="933f9fa9-7e18-46b9-b435-7fe567b40d1a" containerID="febf95799a07d19ecfe0c3f939f05e4c2c783d06999e26e722fbddde187ea462" exitCode=0
Jul 24 19:28:48.211626 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:28:48.211189    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-5ce07c-openshift-default-8485cc8bf8-ldjgs" event={"ID":"933f9fa9-7e18-46b9-b435-7fe567b40d1a","Type":"ContainerDied","Data":"febf95799a07d19ecfe0c3f939f05e4c2c783d06999e26e722fbddde187ea462"}
Jul 24 19:28:48.211626 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:28:48.211606    2580 scope.go:117] "RemoveContainer" containerID="febf95799a07d19ecfe0c3f939f05e4c2c783d06999e26e722fbddde187ea462"
Jul 24 19:28:48.212717 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:28:48.212693    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 24 19:28:48.212777 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:28:48.212759    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 24 19:28:48.212815 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:28:48.212790    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 24 19:28:49.222089 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:28:49.222051    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-5ce07c-openshift-default-8485cc8bf8-ldjgs" event={"ID":"933f9fa9-7e18-46b9-b435-7fe567b40d1a","Type":"ContainerStarted","Data":"a69e5d218f73551ebb020d3cf2af6f0898068981f6d43c33328937589501de9b"}
Jul 24 19:28:50.093453 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:28:50.093415    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-5ce07c-openshift-default-8485cc8bf8-ldjgs"
Jul 24 19:28:50.094628 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:28:50.094605    2580 patch_prober.go:28] interesting pod/e2e-ipp-b-5ce07c-openshift-default-8485cc8bf8-ldjgs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Jul 24 19:28:50.094694 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:28:50.094658    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-5ce07c-openshift-default-8485cc8bf8-ldjgs" podUID="933f9fa9-7e18-46b9-b435-7fe567b40d1a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Jul 24 19:28:50.145411 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:28:50.145371    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-5ce07c-openshift-default-8485cc8bf8-ldjgs"
Jul 24 19:28:51.093548 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:28:51.093511    2580 patch_prober.go:28] interesting pod/e2e-ipp-b-5ce07c-openshift-default-8485cc8bf8-ldjgs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Jul 24 19:28:51.093946 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:28:51.093570    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-5ce07c-openshift-default-8485cc8bf8-ldjgs" podUID="933f9fa9-7e18-46b9-b435-7fe567b40d1a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Jul 24 19:28:52.093475 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:28:52.093432    2580 patch_prober.go:28] interesting pod/e2e-ipp-b-5ce07c-openshift-default-8485cc8bf8-ldjgs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Jul 24 19:28:52.093667 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:28:52.093514    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-5ce07c-openshift-default-8485cc8bf8-ldjgs" podUID="933f9fa9-7e18-46b9-b435-7fe567b40d1a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Jul 24 19:28:53.093317 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:28:53.093280    2580 patch_prober.go:28] interesting pod/e2e-ipp-b-5ce07c-openshift-default-8485cc8bf8-ldjgs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Jul 24 19:28:53.093532 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:28:53.093352    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-5ce07c-openshift-default-8485cc8bf8-ldjgs" podUID="933f9fa9-7e18-46b9-b435-7fe567b40d1a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Jul 24 19:28:54.096767 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:28:54.096730    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-5ce07c-openshift-default-8485cc8bf8-ldjgs"
Jul 24 19:28:54.097814 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:28:54.097793    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-5ce07c-openshift-default-8485cc8bf8-ldjgs"
Jul 24 19:29:05.952046 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:29:05.952010    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-ipp-a-87cd66/ipp-route-87cd66-kserve-555fb78467-l5zzm"]
Jul 24 19:29:05.955975 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:29:05.955945    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-87cd66/ipp-route-87cd66-kserve-555fb78467-l5zzm"
Jul 24 19:29:05.960272 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:29:05.960245    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-ipp-a-87cd66\"/\"kube-root-ca.crt\""
Jul 24 19:29:05.960430 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:29:05.960245    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-ipp-a-87cd66\"/\"openshift-service-ca.crt\""
Jul 24 19:29:05.960430 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:29:05.960255    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-ipp-a-87cd66\"/\"ipp-route-87cd66-kserve-self-signed-certs\""
Jul 24 19:29:05.960430 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:29:05.960294    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-ipp-a-87cd66\"/\"default-dockercfg-c289x\""
Jul 24 19:29:05.966916 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:29:05.966893    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-ipp-a-87cd66/ipp-route-87cd66-kserve-555fb78467-l5zzm"]
Jul 24 19:29:05.994358 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:29:05.994326    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/93adf5d1-e0cc-41ee-868a-6d3df2091829-model-cache\") pod \"ipp-route-87cd66-kserve-555fb78467-l5zzm\" (UID: \"93adf5d1-e0cc-41ee-868a-6d3df2091829\") " pod="ai-tenant-e2e-ipp-a-87cd66/ipp-route-87cd66-kserve-555fb78467-l5zzm"
Jul 24 19:29:05.994566 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:29:05.994389    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/93adf5d1-e0cc-41ee-868a-6d3df2091829-tmp-dir\") pod \"ipp-route-87cd66-kserve-555fb78467-l5zzm\" (UID: \"93adf5d1-e0cc-41ee-868a-6d3df2091829\") " pod="ai-tenant-e2e-ipp-a-87cd66/ipp-route-87cd66-kserve-555fb78467-l5zzm"
Jul 24 19:29:05.994566 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:29:05.994476    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/93adf5d1-e0cc-41ee-868a-6d3df2091829-home\") pod \"ipp-route-87cd66-kserve-555fb78467-l5zzm\" (UID: \"93adf5d1-e0cc-41ee-868a-6d3df2091829\") " pod="ai-tenant-e2e-ipp-a-87cd66/ipp-route-87cd66-kserve-555fb78467-l5zzm"
Jul 24 19:29:05.994566 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:29:05.994528    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/93adf5d1-e0cc-41ee-868a-6d3df2091829-tls-certs\") pod \"ipp-route-87cd66-kserve-555fb78467-l5zzm\" (UID: \"93adf5d1-e0cc-41ee-868a-6d3df2091829\") " pod="ai-tenant-e2e-ipp-a-87cd66/ipp-route-87cd66-kserve-555fb78467-l5zzm"
Jul 24 19:29:05.994566 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:29:05.994558    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sc4bj\" (UniqueName: \"kubernetes.io/projected/93adf5d1-e0cc-41ee-868a-6d3df2091829-kube-api-access-sc4bj\") pod \"ipp-route-87cd66-kserve-555fb78467-l5zzm\" (UID: \"93adf5d1-e0cc-41ee-868a-6d3df2091829\") " pod="ai-tenant-e2e-ipp-a-87cd66/ipp-route-87cd66-kserve-555fb78467-l5zzm"
Jul 24 19:29:05.994740 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:29:05.994583    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/93adf5d1-e0cc-41ee-868a-6d3df2091829-dshm\") pod \"ipp-route-87cd66-kserve-555fb78467-l5zzm\" (UID: \"93adf5d1-e0cc-41ee-868a-6d3df2091829\") " pod="ai-tenant-e2e-ipp-a-87cd66/ipp-route-87cd66-kserve-555fb78467-l5zzm"
Jul 24 19:29:05.998765 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:29:05.998740    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:29:06.096133 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:29:06.096095    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/93adf5d1-e0cc-41ee-868a-6d3df2091829-home\") pod \"ipp-route-87cd66-kserve-555fb78467-l5zzm\" (UID: \"93adf5d1-e0cc-41ee-868a-6d3df2091829\") " pod="ai-tenant-e2e-ipp-a-87cd66/ipp-route-87cd66-kserve-555fb78467-l5zzm"
Jul 24 19:29:06.096338 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:29:06.096174    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/93adf5d1-e0cc-41ee-868a-6d3df2091829-tls-certs\") pod \"ipp-route-87cd66-kserve-555fb78467-l5zzm\" (UID: \"93adf5d1-e0cc-41ee-868a-6d3df2091829\") " pod="ai-tenant-e2e-ipp-a-87cd66/ipp-route-87cd66-kserve-555fb78467-l5zzm"
Jul 24 19:29:06.096338 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:29:06.096200    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sc4bj\" (UniqueName: \"kubernetes.io/projected/93adf5d1-e0cc-41ee-868a-6d3df2091829-kube-api-access-sc4bj\") pod \"ipp-route-87cd66-kserve-555fb78467-l5zzm\" (UID: \"93adf5d1-e0cc-41ee-868a-6d3df2091829\") " pod="ai-tenant-e2e-ipp-a-87cd66/ipp-route-87cd66-kserve-555fb78467-l5zzm"
Jul 24 19:29:06.096338 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:29:06.096219    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/93adf5d1-e0cc-41ee-868a-6d3df2091829-dshm\") pod \"ipp-route-87cd66-kserve-555fb78467-l5zzm\" (UID: \"93adf5d1-e0cc-41ee-868a-6d3df2091829\") " pod="ai-tenant-e2e-ipp-a-87cd66/ipp-route-87cd66-kserve-555fb78467-l5zzm"
Jul 24 19:29:06.096338 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:29:06.096321    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/93adf5d1-e0cc-41ee-868a-6d3df2091829-model-cache\") pod \"ipp-route-87cd66-kserve-555fb78467-l5zzm\" (UID: \"93adf5d1-e0cc-41ee-868a-6d3df2091829\") " pod="ai-tenant-e2e-ipp-a-87cd66/ipp-route-87cd66-kserve-555fb78467-l5zzm"
Jul 24 19:29:06.096553 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:29:06.096389    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/93adf5d1-e0cc-41ee-868a-6d3df2091829-tmp-dir\") pod \"ipp-route-87cd66-kserve-555fb78467-l5zzm\" (UID: \"93adf5d1-e0cc-41ee-868a-6d3df2091829\") " pod="ai-tenant-e2e-ipp-a-87cd66/ipp-route-87cd66-kserve-555fb78467-l5zzm"
Jul 24 19:29:06.096553 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:29:06.096537    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/93adf5d1-e0cc-41ee-868a-6d3df2091829-home\") pod \"ipp-route-87cd66-kserve-555fb78467-l5zzm\" (UID: \"93adf5d1-e0cc-41ee-868a-6d3df2091829\") " pod="ai-tenant-e2e-ipp-a-87cd66/ipp-route-87cd66-kserve-555fb78467-l5zzm"
Jul 24 19:29:06.096724 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:29:06.096694    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/93adf5d1-e0cc-41ee-868a-6d3df2091829-tmp-dir\") pod \"ipp-route-87cd66-kserve-555fb78467-l5zzm\" (UID: \"93adf5d1-e0cc-41ee-868a-6d3df2091829\") " pod="ai-tenant-e2e-ipp-a-87cd66/ipp-route-87cd66-kserve-555fb78467-l5zzm"
Jul 24 19:29:06.096798 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:29:06.096762    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/93adf5d1-e0cc-41ee-868a-6d3df2091829-model-cache\") pod \"ipp-route-87cd66-kserve-555fb78467-l5zzm\" (UID: \"93adf5d1-e0cc-41ee-868a-6d3df2091829\") " pod="ai-tenant-e2e-ipp-a-87cd66/ipp-route-87cd66-kserve-555fb78467-l5zzm"
Jul 24 19:29:06.098747 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:29:06.098728    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/93adf5d1-e0cc-41ee-868a-6d3df2091829-dshm\") pod \"ipp-route-87cd66-kserve-555fb78467-l5zzm\" (UID: \"93adf5d1-e0cc-41ee-868a-6d3df2091829\") " pod="ai-tenant-e2e-ipp-a-87cd66/ipp-route-87cd66-kserve-555fb78467-l5zzm"
Jul 24 19:29:06.098902 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:29:06.098886    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/93adf5d1-e0cc-41ee-868a-6d3df2091829-tls-certs\") pod \"ipp-route-87cd66-kserve-555fb78467-l5zzm\" (UID: \"93adf5d1-e0cc-41ee-868a-6d3df2091829\") " pod="ai-tenant-e2e-ipp-a-87cd66/ipp-route-87cd66-kserve-555fb78467-l5zzm"
Jul 24 19:29:06.104896 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:29:06.104873    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sc4bj\" (UniqueName: \"kubernetes.io/projected/93adf5d1-e0cc-41ee-868a-6d3df2091829-kube-api-access-sc4bj\") pod \"ipp-route-87cd66-kserve-555fb78467-l5zzm\" (UID: \"93adf5d1-e0cc-41ee-868a-6d3df2091829\") " pod="ai-tenant-e2e-ipp-a-87cd66/ipp-route-87cd66-kserve-555fb78467-l5zzm"
Jul 24 19:29:06.267603 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:29:06.267509    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-87cd66/ipp-route-87cd66-kserve-555fb78467-l5zzm"
Jul 24 19:29:06.318984 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:29:06.318950    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qvzgb_dd21fc27-5a24-4f3a-a912-043af27a4342/ovn-acl-logging/0.log"
Jul 24 19:29:06.329595 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:29:06.329570    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qvzgb_dd21fc27-5a24-4f3a-a912-043af27a4342/ovn-acl-logging/0.log"
Jul 24 19:29:06.412328 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:29:06.412291    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-ipp-a-87cd66/ipp-route-87cd66-kserve-555fb78467-l5zzm"]
Jul 24 19:29:06.415656 ip-10-0-141-146 kubenswrapper[2580]: W0724 19:29:06.415627    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod93adf5d1_e0cc_41ee_868a_6d3df2091829.slice/crio-fb4bdfde3b64dd207951c8540b2bcec4f6be931b4b0ac0bc8462f72d3b835093 WatchSource:0}: Error finding container fb4bdfde3b64dd207951c8540b2bcec4f6be931b4b0ac0bc8462f72d3b835093: Status 404 returned error can't find the container with id fb4bdfde3b64dd207951c8540b2bcec4f6be931b4b0ac0bc8462f72d3b835093
Jul 24 19:29:07.319895 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:29:07.319859    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-87cd66/ipp-route-87cd66-kserve-555fb78467-l5zzm" event={"ID":"93adf5d1-e0cc-41ee-868a-6d3df2091829","Type":"ContainerStarted","Data":"a6f9bd606e309e1be8f43d59120851ecc30aea91f004ab17da9750fcb6deca9c"}
Jul 24 19:29:07.319895 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:29:07.319900    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-87cd66/ipp-route-87cd66-kserve-555fb78467-l5zzm" event={"ID":"93adf5d1-e0cc-41ee-868a-6d3df2091829","Type":"ContainerStarted","Data":"fb4bdfde3b64dd207951c8540b2bcec4f6be931b4b0ac0bc8462f72d3b835093"}
Jul 24 19:29:07.338501 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:29:07.338445    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-ipp-a-87cd66/ipp-route-87cd66-kserve-555fb78467-l5zzm" podStartSLOduration=2.338426533 podStartE2EDuration="2.338426533s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 19:29:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:29:07.336164207 +0000 UTC m=+2702.545536242" watchObservedRunningTime="2026-07-24 19:29:07.338426533 +0000 UTC m=+2702.547798576"
Jul 24 19:29:16.268641 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:29:16.268601    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-ipp-a-87cd66/ipp-route-87cd66-kserve-555fb78467-l5zzm"
Jul 24 19:29:16.269280 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:29:16.268660    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-ipp-a-87cd66/ipp-route-87cd66-kserve-555fb78467-l5zzm"
Jul 24 19:29:16.281574 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:29:16.281549    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-ipp-a-87cd66/ipp-route-87cd66-kserve-555fb78467-l5zzm"
Jul 24 19:29:16.375523 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:29:16.375493    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-ipp-a-87cd66/ipp-route-87cd66-kserve-555fb78467-l5zzm"
Jul 24 19:29:37.035347 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:29:37.035272    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:29:37.316042 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:29:37.315932    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-ad8f3a-openshift-default-8448f7fcc4-c9q6c"]
Jul 24 19:29:37.319641 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:29:37.319620    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-ad8f3a-openshift-default-8448f7fcc4-c9q6c"
Jul 24 19:29:37.322370 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:29:37.322346    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-cleanup-ad8f3a-openshift-default-dockercfg-4p8zj\""
Jul 24 19:29:37.322563 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:29:37.322542    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g4mls\" (UniqueName: \"kubernetes.io/projected/14b10fde-b9d2-4def-a092-ab72d5486f11-kube-api-access-g4mls\") pod \"e2e-ipp-cleanup-ad8f3a-openshift-default-8448f7fcc4-c9q6c\" (UID: \"14b10fde-b9d2-4def-a092-ab72d5486f11\") " pod="openshift-ingress/e2e-ipp-cleanup-ad8f3a-openshift-default-8448f7fcc4-c9q6c"
Jul 24 19:29:37.322650 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:29:37.322587    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/14b10fde-b9d2-4def-a092-ab72d5486f11-istiod-ca-cert\") pod \"e2e-ipp-cleanup-ad8f3a-openshift-default-8448f7fcc4-c9q6c\" (UID: \"14b10fde-b9d2-4def-a092-ab72d5486f11\") " pod="openshift-ingress/e2e-ipp-cleanup-ad8f3a-openshift-default-8448f7fcc4-c9q6c"
Jul 24 19:29:37.322701 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:29:37.322645    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/14b10fde-b9d2-4def-a092-ab72d5486f11-istio-podinfo\") pod \"e2e-ipp-cleanup-ad8f3a-openshift-default-8448f7fcc4-c9q6c\" (UID: \"14b10fde-b9d2-4def-a092-ab72d5486f11\") " pod="openshift-ingress/e2e-ipp-cleanup-ad8f3a-openshift-default-8448f7fcc4-c9q6c"
Jul 24 19:29:37.322785 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:29:37.322759    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/14b10fde-b9d2-4def-a092-ab72d5486f11-istio-envoy\") pod \"e2e-ipp-cleanup-ad8f3a-openshift-default-8448f7fcc4-c9q6c\" (UID: \"14b10fde-b9d2-4def-a092-ab72d5486f11\") " pod="openshift-ingress/e2e-ipp-cleanup-ad8f3a-openshift-default-8448f7fcc4-c9q6c"
Jul 24 19:29:37.322835 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:29:37.322821    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/14b10fde-b9d2-4def-a092-ab72d5486f11-istio-data\") pod \"e2e-ipp-cleanup-ad8f3a-openshift-default-8448f7fcc4-c9q6c\" (UID: \"14b10fde-b9d2-4def-a092-ab72d5486f11\") " pod="openshift-ingress/e2e-ipp-cleanup-ad8f3a-openshift-default-8448f7fcc4-c9q6c"
Jul 24 19:29:37.322879 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:29:37.322846    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/14b10fde-b9d2-4def-a092-ab72d5486f11-istio-token\") pod \"e2e-ipp-cleanup-ad8f3a-openshift-default-8448f7fcc4-c9q6c\" (UID: \"14b10fde-b9d2-4def-a092-ab72d5486f11\") " pod="openshift-ingress/e2e-ipp-cleanup-ad8f3a-openshift-default-8448f7fcc4-c9q6c"
Jul 24 19:29:37.322940 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:29:37.322924    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/14b10fde-b9d2-4def-a092-ab72d5486f11-workload-certs\") pod \"e2e-ipp-cleanup-ad8f3a-openshift-default-8448f7fcc4-c9q6c\" (UID: \"14b10fde-b9d2-4def-a092-ab72d5486f11\") " pod="openshift-ingress/e2e-ipp-cleanup-ad8f3a-openshift-default-8448f7fcc4-c9q6c"
Jul 24 19:29:37.322986 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:29:37.322975    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/14b10fde-b9d2-4def-a092-ab72d5486f11-workload-socket\") pod \"e2e-ipp-cleanup-ad8f3a-openshift-default-8448f7fcc4-c9q6c\" (UID: \"14b10fde-b9d2-4def-a092-ab72d5486f11\") " pod="openshift-ingress/e2e-ipp-cleanup-ad8f3a-openshift-default-8448f7fcc4-c9q6c"
Jul 24 19:29:37.323023 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:29:37.322999    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/14b10fde-b9d2-4def-a092-ab72d5486f11-credential-socket\") pod \"e2e-ipp-cleanup-ad8f3a-openshift-default-8448f7fcc4-c9q6c\" (UID: \"14b10fde-b9d2-4def-a092-ab72d5486f11\") " pod="openshift-ingress/e2e-ipp-cleanup-ad8f3a-openshift-default-8448f7fcc4-c9q6c"
Jul 24 19:29:37.332649 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:29:37.332623    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-ad8f3a-openshift-default-8448f7fcc4-c9q6c"]
Jul 24 19:29:37.363275 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:29:37.363239    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:29:37.424063 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:29:37.424007    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/14b10fde-b9d2-4def-a092-ab72d5486f11-istio-envoy\") pod \"e2e-ipp-cleanup-ad8f3a-openshift-default-8448f7fcc4-c9q6c\" (UID: \"14b10fde-b9d2-4def-a092-ab72d5486f11\") " pod="openshift-ingress/e2e-ipp-cleanup-ad8f3a-openshift-default-8448f7fcc4-c9q6c"
Jul 24 19:29:37.424276 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:29:37.424081    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/14b10fde-b9d2-4def-a092-ab72d5486f11-istio-data\") pod \"e2e-ipp-cleanup-ad8f3a-openshift-default-8448f7fcc4-c9q6c\" (UID: \"14b10fde-b9d2-4def-a092-ab72d5486f11\") " pod="openshift-ingress/e2e-ipp-cleanup-ad8f3a-openshift-default-8448f7fcc4-c9q6c"
Jul 24 19:29:37.424276 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:29:37.424108    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/14b10fde-b9d2-4def-a092-ab72d5486f11-istio-token\") pod \"e2e-ipp-cleanup-ad8f3a-openshift-default-8448f7fcc4-c9q6c\" (UID: \"14b10fde-b9d2-4def-a092-ab72d5486f11\") " pod="openshift-ingress/e2e-ipp-cleanup-ad8f3a-openshift-default-8448f7fcc4-c9q6c"
Jul 24 19:29:37.424276 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:29:37.424198    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/14b10fde-b9d2-4def-a092-ab72d5486f11-workload-certs\") pod \"e2e-ipp-cleanup-ad8f3a-openshift-default-8448f7fcc4-c9q6c\" (UID: \"14b10fde-b9d2-4def-a092-ab72d5486f11\") " pod="openshift-ingress/e2e-ipp-cleanup-ad8f3a-openshift-default-8448f7fcc4-c9q6c"
Jul 24 19:29:37.424276 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:29:37.424239    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/14b10fde-b9d2-4def-a092-ab72d5486f11-workload-socket\") pod \"e2e-ipp-cleanup-ad8f3a-openshift-default-8448f7fcc4-c9q6c\" (UID: \"14b10fde-b9d2-4def-a092-ab72d5486f11\") " pod="openshift-ingress/e2e-ipp-cleanup-ad8f3a-openshift-default-8448f7fcc4-c9q6c"
Jul 24 19:29:37.424276 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:29:37.424267    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/14b10fde-b9d2-4def-a092-ab72d5486f11-credential-socket\") pod \"e2e-ipp-cleanup-ad8f3a-openshift-default-8448f7fcc4-c9q6c\" (UID: \"14b10fde-b9d2-4def-a092-ab72d5486f11\") " pod="openshift-ingress/e2e-ipp-cleanup-ad8f3a-openshift-default-8448f7fcc4-c9q6c"
Jul 24 19:29:37.424510 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:29:37.424339    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g4mls\" (UniqueName: \"kubernetes.io/projected/14b10fde-b9d2-4def-a092-ab72d5486f11-kube-api-access-g4mls\") pod \"e2e-ipp-cleanup-ad8f3a-openshift-default-8448f7fcc4-c9q6c\" (UID: \"14b10fde-b9d2-4def-a092-ab72d5486f11\") " pod="openshift-ingress/e2e-ipp-cleanup-ad8f3a-openshift-default-8448f7fcc4-c9q6c"
Jul 24 19:29:37.424510 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:29:37.424372    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/14b10fde-b9d2-4def-a092-ab72d5486f11-istiod-ca-cert\") pod \"e2e-ipp-cleanup-ad8f3a-openshift-default-8448f7fcc4-c9q6c\" (UID: \"14b10fde-b9d2-4def-a092-ab72d5486f11\") " pod="openshift-ingress/e2e-ipp-cleanup-ad8f3a-openshift-default-8448f7fcc4-c9q6c"
Jul 24 19:29:37.424510 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:29:37.424406    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/14b10fde-b9d2-4def-a092-ab72d5486f11-istio-podinfo\") pod \"e2e-ipp-cleanup-ad8f3a-openshift-default-8448f7fcc4-c9q6c\" (UID: \"14b10fde-b9d2-4def-a092-ab72d5486f11\") " pod="openshift-ingress/e2e-ipp-cleanup-ad8f3a-openshift-default-8448f7fcc4-c9q6c"
Jul 24 19:29:37.425969 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:29:37.425264    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/14b10fde-b9d2-4def-a092-ab72d5486f11-istio-data\") pod \"e2e-ipp-cleanup-ad8f3a-openshift-default-8448f7fcc4-c9q6c\" (UID: \"14b10fde-b9d2-4def-a092-ab72d5486f11\") " pod="openshift-ingress/e2e-ipp-cleanup-ad8f3a-openshift-default-8448f7fcc4-c9q6c"
Jul 24 19:29:37.425969 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:29:37.425586    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/14b10fde-b9d2-4def-a092-ab72d5486f11-credential-socket\") pod \"e2e-ipp-cleanup-ad8f3a-openshift-default-8448f7fcc4-c9q6c\" (UID: \"14b10fde-b9d2-4def-a092-ab72d5486f11\") " pod="openshift-ingress/e2e-ipp-cleanup-ad8f3a-openshift-default-8448f7fcc4-c9q6c"
Jul 24 19:29:37.425969 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:29:37.425840    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/14b10fde-b9d2-4def-a092-ab72d5486f11-workload-certs\") pod \"e2e-ipp-cleanup-ad8f3a-openshift-default-8448f7fcc4-c9q6c\" (UID: \"14b10fde-b9d2-4def-a092-ab72d5486f11\") " pod="openshift-ingress/e2e-ipp-cleanup-ad8f3a-openshift-default-8448f7fcc4-c9q6c"
Jul 24 19:29:37.425969 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:29:37.425924    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/14b10fde-b9d2-4def-a092-ab72d5486f11-istiod-ca-cert\") pod \"e2e-ipp-cleanup-ad8f3a-openshift-default-8448f7fcc4-c9q6c\" (UID: \"14b10fde-b9d2-4def-a092-ab72d5486f11\") " pod="openshift-ingress/e2e-ipp-cleanup-ad8f3a-openshift-default-8448f7fcc4-c9q6c"
Jul 24 19:29:37.426605 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:29:37.426583    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/14b10fde-b9d2-4def-a092-ab72d5486f11-workload-socket\") pod \"e2e-ipp-cleanup-ad8f3a-openshift-default-8448f7fcc4-c9q6c\" (UID: \"14b10fde-b9d2-4def-a092-ab72d5486f11\") " pod="openshift-ingress/e2e-ipp-cleanup-ad8f3a-openshift-default-8448f7fcc4-c9q6c"
Jul 24 19:29:37.427927 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:29:37.427879    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/14b10fde-b9d2-4def-a092-ab72d5486f11-istio-podinfo\") pod \"e2e-ipp-cleanup-ad8f3a-openshift-default-8448f7fcc4-c9q6c\" (UID: \"14b10fde-b9d2-4def-a092-ab72d5486f11\") " pod="openshift-ingress/e2e-ipp-cleanup-ad8f3a-openshift-default-8448f7fcc4-c9q6c"
Jul 24 19:29:37.428408 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:29:37.428383    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/14b10fde-b9d2-4def-a092-ab72d5486f11-istio-envoy\") pod \"e2e-ipp-cleanup-ad8f3a-openshift-default-8448f7fcc4-c9q6c\" (UID: \"14b10fde-b9d2-4def-a092-ab72d5486f11\") " pod="openshift-ingress/e2e-ipp-cleanup-ad8f3a-openshift-default-8448f7fcc4-c9q6c"
Jul 24 19:29:37.437622 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:29:37.437561    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/14b10fde-b9d2-4def-a092-ab72d5486f11-istio-token\") pod \"e2e-ipp-cleanup-ad8f3a-openshift-default-8448f7fcc4-c9q6c\" (UID: \"14b10fde-b9d2-4def-a092-ab72d5486f11\") " pod="openshift-ingress/e2e-ipp-cleanup-ad8f3a-openshift-default-8448f7fcc4-c9q6c"
Jul 24 19:29:37.437791 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:29:37.437741    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g4mls\" (UniqueName: \"kubernetes.io/projected/14b10fde-b9d2-4def-a092-ab72d5486f11-kube-api-access-g4mls\") pod \"e2e-ipp-cleanup-ad8f3a-openshift-default-8448f7fcc4-c9q6c\" (UID: \"14b10fde-b9d2-4def-a092-ab72d5486f11\") " pod="openshift-ingress/e2e-ipp-cleanup-ad8f3a-openshift-default-8448f7fcc4-c9q6c"
Jul 24 19:29:37.630964 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:29:37.630865    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-ad8f3a-openshift-default-8448f7fcc4-c9q6c"
Jul 24 19:29:37.691599 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:29:37.691554    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:29:37.784176 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:29:37.784152    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-ad8f3a-openshift-default-8448f7fcc4-c9q6c"]
Jul 24 19:29:37.786409 ip-10-0-141-146 kubenswrapper[2580]: W0724 19:29:37.786380    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14b10fde_b9d2_4def_a092_ab72d5486f11.slice/crio-47b4eea2123f7545eb49e1df877e5657e590ebbcc3b2db772bfe5eab7d716e06 WatchSource:0}: Error finding container 47b4eea2123f7545eb49e1df877e5657e590ebbcc3b2db772bfe5eab7d716e06: Status 404 returned error can't find the container with id 47b4eea2123f7545eb49e1df877e5657e590ebbcc3b2db772bfe5eab7d716e06
Jul 24 19:29:37.788740 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:29:37.788713    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 24 19:29:37.788821 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:29:37.788777    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 24 19:29:37.788821 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:29:37.788806    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 24 19:29:38.479083 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:29:38.479041    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-ad8f3a-openshift-default-8448f7fcc4-c9q6c" event={"ID":"14b10fde-b9d2-4def-a092-ab72d5486f11","Type":"ContainerStarted","Data":"94b15e93e4e4e61857ae447ae254f0ac66b74a44e6a8e81f1148462193bff0a8"}
Jul 24 19:29:38.479514 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:29:38.479163    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-ad8f3a-openshift-default-8448f7fcc4-c9q6c" event={"ID":"14b10fde-b9d2-4def-a092-ab72d5486f11","Type":"ContainerStarted","Data":"47b4eea2123f7545eb49e1df877e5657e590ebbcc3b2db772bfe5eab7d716e06"}
Jul 24 19:29:38.501189 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:29:38.501113    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-cleanup-ad8f3a-openshift-default-8448f7fcc4-c9q6c" podStartSLOduration=1.501098397 podStartE2EDuration="1.501098397s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 19:29:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:29:38.499997185 +0000 UTC m=+2733.709369234" watchObservedRunningTime="2026-07-24 19:29:38.501098397 +0000 UTC m=+2733.710470469"
Jul 24 19:29:38.631497 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:29:38.631461    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-ad8f3a-openshift-default-8448f7fcc4-c9q6c"
Jul 24 19:29:38.636535 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:29:38.636510    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-ad8f3a-openshift-default-8448f7fcc4-c9q6c"
Jul 24 19:29:39.484070 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:29:39.484035    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-ad8f3a-openshift-default-8448f7fcc4-c9q6c"
Jul 24 19:29:39.484977 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:29:39.484956    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-ad8f3a-openshift-default-8448f7fcc4-c9q6c"
Jul 24 19:29:39.615755 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:29:39.615719    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:29:40.413286 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:29:40.413252    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:29:40.510250 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:29:40.510214    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:29:40.610507 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:29:40.610455    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:29:40.850744 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:29:40.850713    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:29:41.055063 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:29:41.055032    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:29:41.168602 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:29:41.168524    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:29:44.880352 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:29:44.880319    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:29:55.256975 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:29:55.256297    2580 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-ad8f3a-openshift-default-8448f7fcc4-c9q6c container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": read tcp 10.133.0.2:59628->10.133.0.56:15021: read: connection reset by peer" start-of-body=
Jul 24 19:29:55.256975 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:29:55.256364    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-cleanup-ad8f3a-openshift-default-8448f7fcc4-c9q6c" podUID="14b10fde-b9d2-4def-a092-ab72d5486f11" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": read tcp 10.133.0.2:59628->10.133.0.56:15021: read: connection reset by peer"
Jul 24 19:29:55.569025 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:29:55.568933    2580 generic.go:356] "Generic (PLEG): container finished" podID="14b10fde-b9d2-4def-a092-ab72d5486f11" containerID="94b15e93e4e4e61857ae447ae254f0ac66b74a44e6a8e81f1148462193bff0a8" exitCode=0
Jul 24 19:29:55.569025 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:29:55.568984    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-ad8f3a-openshift-default-8448f7fcc4-c9q6c" event={"ID":"14b10fde-b9d2-4def-a092-ab72d5486f11","Type":"ContainerDied","Data":"94b15e93e4e4e61857ae447ae254f0ac66b74a44e6a8e81f1148462193bff0a8"}
Jul 24 19:29:55.569512 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:29:55.569494    2580 scope.go:117] "RemoveContainer" containerID="94b15e93e4e4e61857ae447ae254f0ac66b74a44e6a8e81f1148462193bff0a8"
Jul 24 19:29:55.570662 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:29:55.570633    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 24 19:29:55.570713 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:29:55.570705    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 24 19:29:55.570749 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:29:55.570735    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 24 19:29:56.576229 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:29:56.576192    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-ad8f3a-openshift-default-8448f7fcc4-c9q6c" event={"ID":"14b10fde-b9d2-4def-a092-ab72d5486f11","Type":"ContainerStarted","Data":"3a2bd056fac79c697548e790ef0474110632d4fdf4859773c3666d8ae3eec732"}
Jul 24 19:29:56.631653 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:29:56.631612    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-ad8f3a-openshift-default-8448f7fcc4-c9q6c"
Jul 24 19:29:56.631924 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:29:56.631899    2580 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-ad8f3a-openshift-default-8448f7fcc4-c9q6c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Jul 24 19:29:56.631973 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:29:56.631955    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-ad8f3a-openshift-default-8448f7fcc4-c9q6c" podUID="14b10fde-b9d2-4def-a092-ab72d5486f11" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Jul 24 19:29:57.631585 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:29:57.631538    2580 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-ad8f3a-openshift-default-8448f7fcc4-c9q6c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Jul 24 19:29:57.632008 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:29:57.631607    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-ad8f3a-openshift-default-8448f7fcc4-c9q6c" podUID="14b10fde-b9d2-4def-a092-ab72d5486f11" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Jul 24 19:29:58.631524 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:29:58.631485    2580 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-ad8f3a-openshift-default-8448f7fcc4-c9q6c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Jul 24 19:29:58.631733 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:29:58.631548    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-ad8f3a-openshift-default-8448f7fcc4-c9q6c" podUID="14b10fde-b9d2-4def-a092-ab72d5486f11" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Jul 24 19:29:59.631770 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:29:59.631725    2580 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-ad8f3a-openshift-default-8448f7fcc4-c9q6c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Jul 24 19:29:59.632303 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:29:59.631795    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-ad8f3a-openshift-default-8448f7fcc4-c9q6c" podUID="14b10fde-b9d2-4def-a092-ab72d5486f11" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Jul 24 19:30:00.632319 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:30:00.632280    2580 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-ad8f3a-openshift-default-8448f7fcc4-c9q6c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Jul 24 19:30:00.632725 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:30:00.632340    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-ad8f3a-openshift-default-8448f7fcc4-c9q6c" podUID="14b10fde-b9d2-4def-a092-ab72d5486f11" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Jul 24 19:30:01.634776 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:30:01.634735    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-ad8f3a-openshift-default-8448f7fcc4-c9q6c"
Jul 24 19:30:01.635179 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:30:01.635008    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-ad8f3a-openshift-default-8448f7fcc4-c9q6c"
Jul 24 19:30:01.635874 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:30:01.635849    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-ad8f3a-openshift-default-8448f7fcc4-c9q6c"
Jul 24 19:30:07.132343 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:30:07.132305    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:30:07.242508 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:30:07.242474    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:30:07.410060 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:30:07.409721    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:30:10.869196 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:30:10.869148    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:30:11.253503 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:30:11.253469    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:30:13.212875 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:30:13.212837    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:30:13.312005 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:30:13.311967    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:30:17.622213 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:30:17.622169    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:30:17.723436 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:30:17.723368    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:30:17.867186 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:30:17.867148    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-ad8f3a-openshift-default-8448f7fcc4-c9q6c"]
Jul 24 19:30:17.867416 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:30:17.867371    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-cleanup-ad8f3a-openshift-default-8448f7fcc4-c9q6c" podUID="14b10fde-b9d2-4def-a092-ab72d5486f11" containerName="istio-proxy" containerID="cri-o://3a2bd056fac79c697548e790ef0474110632d4fdf4859773c3666d8ae3eec732" gracePeriod=30
Jul 24 19:30:17.879078 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:30:17.879008    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:30:18.115427 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:30:18.115393    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:30:19.126714 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:30:19.126673    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:30:23.125799 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:30:23.125772    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-ad8f3a-openshift-default-8448f7fcc4-c9q6c"
Jul 24 19:30:23.206309 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:30:23.206280    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/14b10fde-b9d2-4def-a092-ab72d5486f11-workload-certs\") pod \"14b10fde-b9d2-4def-a092-ab72d5486f11\" (UID: \"14b10fde-b9d2-4def-a092-ab72d5486f11\") "
Jul 24 19:30:23.206492 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:30:23.206320    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/14b10fde-b9d2-4def-a092-ab72d5486f11-istio-token\") pod \"14b10fde-b9d2-4def-a092-ab72d5486f11\" (UID: \"14b10fde-b9d2-4def-a092-ab72d5486f11\") "
Jul 24 19:30:23.206492 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:30:23.206363    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/14b10fde-b9d2-4def-a092-ab72d5486f11-credential-socket\") pod \"14b10fde-b9d2-4def-a092-ab72d5486f11\" (UID: \"14b10fde-b9d2-4def-a092-ab72d5486f11\") "
Jul 24 19:30:23.206610 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:30:23.206557    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/14b10fde-b9d2-4def-a092-ab72d5486f11-istiod-ca-cert\") pod \"14b10fde-b9d2-4def-a092-ab72d5486f11\" (UID: \"14b10fde-b9d2-4def-a092-ab72d5486f11\") "
Jul 24 19:30:23.206723 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:30:23.206602    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/14b10fde-b9d2-4def-a092-ab72d5486f11-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "14b10fde-b9d2-4def-a092-ab72d5486f11" (UID: "14b10fde-b9d2-4def-a092-ab72d5486f11"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:30:23.206723 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:30:23.206628    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/14b10fde-b9d2-4def-a092-ab72d5486f11-istio-podinfo\") pod \"14b10fde-b9d2-4def-a092-ab72d5486f11\" (UID: \"14b10fde-b9d2-4def-a092-ab72d5486f11\") "
Jul 24 19:30:23.206723 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:30:23.206633    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/14b10fde-b9d2-4def-a092-ab72d5486f11-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "14b10fde-b9d2-4def-a092-ab72d5486f11" (UID: "14b10fde-b9d2-4def-a092-ab72d5486f11"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:30:23.206723 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:30:23.206708    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/14b10fde-b9d2-4def-a092-ab72d5486f11-istio-envoy\") pod \"14b10fde-b9d2-4def-a092-ab72d5486f11\" (UID: \"14b10fde-b9d2-4def-a092-ab72d5486f11\") "
Jul 24 19:30:23.206924 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:30:23.206737    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/14b10fde-b9d2-4def-a092-ab72d5486f11-istio-data\") pod \"14b10fde-b9d2-4def-a092-ab72d5486f11\" (UID: \"14b10fde-b9d2-4def-a092-ab72d5486f11\") "
Jul 24 19:30:23.206924 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:30:23.206783    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g4mls\" (UniqueName: \"kubernetes.io/projected/14b10fde-b9d2-4def-a092-ab72d5486f11-kube-api-access-g4mls\") pod \"14b10fde-b9d2-4def-a092-ab72d5486f11\" (UID: \"14b10fde-b9d2-4def-a092-ab72d5486f11\") "
Jul 24 19:30:23.206924 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:30:23.206829    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/14b10fde-b9d2-4def-a092-ab72d5486f11-workload-socket\") pod \"14b10fde-b9d2-4def-a092-ab72d5486f11\" (UID: \"14b10fde-b9d2-4def-a092-ab72d5486f11\") "
Jul 24 19:30:23.206924 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:30:23.206895    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/14b10fde-b9d2-4def-a092-ab72d5486f11-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "14b10fde-b9d2-4def-a092-ab72d5486f11" (UID: "14b10fde-b9d2-4def-a092-ab72d5486f11"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 19:30:23.207167 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:30:23.207112    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/14b10fde-b9d2-4def-a092-ab72d5486f11-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "14b10fde-b9d2-4def-a092-ab72d5486f11" (UID: "14b10fde-b9d2-4def-a092-ab72d5486f11"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:30:23.207291 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:30:23.207272    2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/14b10fde-b9d2-4def-a092-ab72d5486f11-workload-socket\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 24 19:30:23.207359 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:30:23.207299    2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/14b10fde-b9d2-4def-a092-ab72d5486f11-workload-certs\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 24 19:30:23.207359 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:30:23.207314    2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/14b10fde-b9d2-4def-a092-ab72d5486f11-credential-socket\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 24 19:30:23.207637 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:30:23.207343    2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/14b10fde-b9d2-4def-a092-ab72d5486f11-istiod-ca-cert\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 24 19:30:23.207637 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:30:23.207602    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/14b10fde-b9d2-4def-a092-ab72d5486f11-istio-data" (OuterVolumeSpecName: "istio-data") pod "14b10fde-b9d2-4def-a092-ab72d5486f11" (UID: "14b10fde-b9d2-4def-a092-ab72d5486f11"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:30:23.209063 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:30:23.209031    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/14b10fde-b9d2-4def-a092-ab72d5486f11-istio-token" (OuterVolumeSpecName: "istio-token") pod "14b10fde-b9d2-4def-a092-ab72d5486f11" (UID: "14b10fde-b9d2-4def-a092-ab72d5486f11"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 19:30:23.209207 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:30:23.209116    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/14b10fde-b9d2-4def-a092-ab72d5486f11-kube-api-access-g4mls" (OuterVolumeSpecName: "kube-api-access-g4mls") pod "14b10fde-b9d2-4def-a092-ab72d5486f11" (UID: "14b10fde-b9d2-4def-a092-ab72d5486f11"). InnerVolumeSpecName "kube-api-access-g4mls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 19:30:23.209384 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:30:23.209358    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/14b10fde-b9d2-4def-a092-ab72d5486f11-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "14b10fde-b9d2-4def-a092-ab72d5486f11" (UID: "14b10fde-b9d2-4def-a092-ab72d5486f11"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 24 19:30:23.209384 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:30:23.209357    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/14b10fde-b9d2-4def-a092-ab72d5486f11-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "14b10fde-b9d2-4def-a092-ab72d5486f11" (UID: "14b10fde-b9d2-4def-a092-ab72d5486f11"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:30:23.308105 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:30:23.308066    2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/14b10fde-b9d2-4def-a092-ab72d5486f11-istio-podinfo\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 24 19:30:23.308105 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:30:23.308102    2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/14b10fde-b9d2-4def-a092-ab72d5486f11-istio-envoy\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 24 19:30:23.308377 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:30:23.308144    2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/14b10fde-b9d2-4def-a092-ab72d5486f11-istio-data\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 24 19:30:23.308377 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:30:23.308158    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g4mls\" (UniqueName: \"kubernetes.io/projected/14b10fde-b9d2-4def-a092-ab72d5486f11-kube-api-access-g4mls\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 24 19:30:23.308377 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:30:23.308172    2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/14b10fde-b9d2-4def-a092-ab72d5486f11-istio-token\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 24 19:30:23.713132 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:30:23.713076    2580 generic.go:356] "Generic (PLEG): container finished" podID="14b10fde-b9d2-4def-a092-ab72d5486f11" containerID="3a2bd056fac79c697548e790ef0474110632d4fdf4859773c3666d8ae3eec732" exitCode=0
Jul 24 19:30:23.713417 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:30:23.713148    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-ad8f3a-openshift-default-8448f7fcc4-c9q6c"
Jul 24 19:30:23.713417 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:30:23.713155    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-ad8f3a-openshift-default-8448f7fcc4-c9q6c" event={"ID":"14b10fde-b9d2-4def-a092-ab72d5486f11","Type":"ContainerDied","Data":"3a2bd056fac79c697548e790ef0474110632d4fdf4859773c3666d8ae3eec732"}
Jul 24 19:30:23.713417 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:30:23.713215    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-ad8f3a-openshift-default-8448f7fcc4-c9q6c" event={"ID":"14b10fde-b9d2-4def-a092-ab72d5486f11","Type":"ContainerDied","Data":"47b4eea2123f7545eb49e1df877e5657e590ebbcc3b2db772bfe5eab7d716e06"}
Jul 24 19:30:23.713417 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:30:23.713245    2580 scope.go:117] "RemoveContainer" containerID="3a2bd056fac79c697548e790ef0474110632d4fdf4859773c3666d8ae3eec732"
Jul 24 19:30:23.722808 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:30:23.722784    2580 scope.go:117] "RemoveContainer" containerID="94b15e93e4e4e61857ae447ae254f0ac66b74a44e6a8e81f1148462193bff0a8"
Jul 24 19:30:23.731525 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:30:23.731506    2580 scope.go:117] "RemoveContainer" containerID="3a2bd056fac79c697548e790ef0474110632d4fdf4859773c3666d8ae3eec732"
Jul 24 19:30:23.731883 ip-10-0-141-146 kubenswrapper[2580]: E0724 19:30:23.731849    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3a2bd056fac79c697548e790ef0474110632d4fdf4859773c3666d8ae3eec732\": container with ID starting with 3a2bd056fac79c697548e790ef0474110632d4fdf4859773c3666d8ae3eec732 not found: ID does not exist" containerID="3a2bd056fac79c697548e790ef0474110632d4fdf4859773c3666d8ae3eec732"
Jul 24 19:30:23.732005 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:30:23.731885    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a2bd056fac79c697548e790ef0474110632d4fdf4859773c3666d8ae3eec732"} err="failed to get container status \"3a2bd056fac79c697548e790ef0474110632d4fdf4859773c3666d8ae3eec732\": rpc error: code = NotFound desc = could not find container \"3a2bd056fac79c697548e790ef0474110632d4fdf4859773c3666d8ae3eec732\": container with ID starting with 3a2bd056fac79c697548e790ef0474110632d4fdf4859773c3666d8ae3eec732 not found: ID does not exist"
Jul 24 19:30:23.732005 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:30:23.731904    2580 scope.go:117] "RemoveContainer" containerID="94b15e93e4e4e61857ae447ae254f0ac66b74a44e6a8e81f1148462193bff0a8"
Jul 24 19:30:23.732222 ip-10-0-141-146 kubenswrapper[2580]: E0724 19:30:23.732198    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"94b15e93e4e4e61857ae447ae254f0ac66b74a44e6a8e81f1148462193bff0a8\": container with ID starting with 94b15e93e4e4e61857ae447ae254f0ac66b74a44e6a8e81f1148462193bff0a8 not found: ID does not exist" containerID="94b15e93e4e4e61857ae447ae254f0ac66b74a44e6a8e81f1148462193bff0a8"
Jul 24 19:30:23.732289 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:30:23.732230    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"94b15e93e4e4e61857ae447ae254f0ac66b74a44e6a8e81f1148462193bff0a8"} err="failed to get container status \"94b15e93e4e4e61857ae447ae254f0ac66b74a44e6a8e81f1148462193bff0a8\": rpc error: code = NotFound desc = could not find container \"94b15e93e4e4e61857ae447ae254f0ac66b74a44e6a8e81f1148462193bff0a8\": container with ID starting with 94b15e93e4e4e61857ae447ae254f0ac66b74a44e6a8e81f1148462193bff0a8 not found: ID does not exist"
Jul 24 19:30:23.736444 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:30:23.736406    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-ad8f3a-openshift-default-8448f7fcc4-c9q6c"]
Jul 24 19:30:23.739896 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:30:23.739871    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-ad8f3a-openshift-default-8448f7fcc4-c9q6c"]
Jul 24 19:30:25.242377 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:30:25.242338    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="14b10fde-b9d2-4def-a092-ab72d5486f11" path="/var/lib/kubelet/pods/14b10fde-b9d2-4def-a092-ab72d5486f11/volumes"
Jul 24 19:30:37.761238 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:30:37.761201    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:30:37.839580 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:30:37.839532    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:30:37.931000 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:30:37.930959    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:30:41.507315 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:30:41.507276    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:30:41.894568 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:30:41.894477    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:30:46.869831 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:30:46.869793    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-ipp-a-87cd66/ipp-route-87cd66-kserve-555fb78467-l5zzm"]
Jul 24 19:30:46.913984 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:30:46.913944    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:31:01.890093 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:31:01.890042    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-ipp-a-87cd66/ipp-route-87cd66-kserve-555fb78467-l5zzm" podUID="93adf5d1-e0cc-41ee-868a-6d3df2091829" containerName="main" containerID="cri-o://a6f9bd606e309e1be8f43d59120851ecc30aea91f004ab17da9750fcb6deca9c" gracePeriod=45
Jul 24 19:31:02.149930 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:31:02.149858    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-87cd66/ipp-route-87cd66-kserve-555fb78467-l5zzm"
Jul 24 19:31:02.220136 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:31:02.220098    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sc4bj\" (UniqueName: \"kubernetes.io/projected/93adf5d1-e0cc-41ee-868a-6d3df2091829-kube-api-access-sc4bj\") pod \"93adf5d1-e0cc-41ee-868a-6d3df2091829\" (UID: \"93adf5d1-e0cc-41ee-868a-6d3df2091829\") "
Jul 24 19:31:02.220308 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:31:02.220165    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/93adf5d1-e0cc-41ee-868a-6d3df2091829-model-cache\") pod \"93adf5d1-e0cc-41ee-868a-6d3df2091829\" (UID: \"93adf5d1-e0cc-41ee-868a-6d3df2091829\") "
Jul 24 19:31:02.220308 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:31:02.220204    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/93adf5d1-e0cc-41ee-868a-6d3df2091829-tls-certs\") pod \"93adf5d1-e0cc-41ee-868a-6d3df2091829\" (UID: \"93adf5d1-e0cc-41ee-868a-6d3df2091829\") "
Jul 24 19:31:02.220308 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:31:02.220245    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/93adf5d1-e0cc-41ee-868a-6d3df2091829-home\") pod \"93adf5d1-e0cc-41ee-868a-6d3df2091829\" (UID: \"93adf5d1-e0cc-41ee-868a-6d3df2091829\") "
Jul 24 19:31:02.220308 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:31:02.220294    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/93adf5d1-e0cc-41ee-868a-6d3df2091829-tmp-dir\") pod \"93adf5d1-e0cc-41ee-868a-6d3df2091829\" (UID: \"93adf5d1-e0cc-41ee-868a-6d3df2091829\") "
Jul 24 19:31:02.220535 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:31:02.220445    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/93adf5d1-e0cc-41ee-868a-6d3df2091829-model-cache" (OuterVolumeSpecName: "model-cache") pod "93adf5d1-e0cc-41ee-868a-6d3df2091829" (UID: "93adf5d1-e0cc-41ee-868a-6d3df2091829"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:31:02.220535 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:31:02.220450    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/93adf5d1-e0cc-41ee-868a-6d3df2091829-dshm\") pod \"93adf5d1-e0cc-41ee-868a-6d3df2091829\" (UID: \"93adf5d1-e0cc-41ee-868a-6d3df2091829\") "
Jul 24 19:31:02.220642 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:31:02.220536    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/93adf5d1-e0cc-41ee-868a-6d3df2091829-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "93adf5d1-e0cc-41ee-868a-6d3df2091829" (UID: "93adf5d1-e0cc-41ee-868a-6d3df2091829"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:31:02.220642 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:31:02.220549    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/93adf5d1-e0cc-41ee-868a-6d3df2091829-home" (OuterVolumeSpecName: "home") pod "93adf5d1-e0cc-41ee-868a-6d3df2091829" (UID: "93adf5d1-e0cc-41ee-868a-6d3df2091829"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:31:02.220958 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:31:02.220940    2580 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/93adf5d1-e0cc-41ee-868a-6d3df2091829-model-cache\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 24 19:31:02.221037 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:31:02.220963    2580 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/93adf5d1-e0cc-41ee-868a-6d3df2091829-home\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 24 19:31:02.221037 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:31:02.220975    2580 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/93adf5d1-e0cc-41ee-868a-6d3df2091829-tmp-dir\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 24 19:31:02.222562 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:31:02.222538    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/93adf5d1-e0cc-41ee-868a-6d3df2091829-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "93adf5d1-e0cc-41ee-868a-6d3df2091829" (UID: "93adf5d1-e0cc-41ee-868a-6d3df2091829"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 19:31:02.222914 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:31:02.222895    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/93adf5d1-e0cc-41ee-868a-6d3df2091829-dshm" (OuterVolumeSpecName: "dshm") pod "93adf5d1-e0cc-41ee-868a-6d3df2091829" (UID: "93adf5d1-e0cc-41ee-868a-6d3df2091829"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:31:02.222976 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:31:02.222911    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/93adf5d1-e0cc-41ee-868a-6d3df2091829-kube-api-access-sc4bj" (OuterVolumeSpecName: "kube-api-access-sc4bj") pod "93adf5d1-e0cc-41ee-868a-6d3df2091829" (UID: "93adf5d1-e0cc-41ee-868a-6d3df2091829"). InnerVolumeSpecName "kube-api-access-sc4bj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 19:31:02.321524 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:31:02.321489    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sc4bj\" (UniqueName: \"kubernetes.io/projected/93adf5d1-e0cc-41ee-868a-6d3df2091829-kube-api-access-sc4bj\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 24 19:31:02.321524 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:31:02.321521    2580 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/93adf5d1-e0cc-41ee-868a-6d3df2091829-tls-certs\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 24 19:31:02.321524 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:31:02.321530    2580 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/93adf5d1-e0cc-41ee-868a-6d3df2091829-dshm\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 24 19:31:02.914804 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:31:02.914766    2580 generic.go:356] "Generic (PLEG): container finished" podID="93adf5d1-e0cc-41ee-868a-6d3df2091829" containerID="a6f9bd606e309e1be8f43d59120851ecc30aea91f004ab17da9750fcb6deca9c" exitCode=0
Jul 24 19:31:02.915280 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:31:02.914816    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-87cd66/ipp-route-87cd66-kserve-555fb78467-l5zzm"
Jul 24 19:31:02.915280 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:31:02.914850    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-87cd66/ipp-route-87cd66-kserve-555fb78467-l5zzm" event={"ID":"93adf5d1-e0cc-41ee-868a-6d3df2091829","Type":"ContainerDied","Data":"a6f9bd606e309e1be8f43d59120851ecc30aea91f004ab17da9750fcb6deca9c"}
Jul 24 19:31:02.915280 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:31:02.914896    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-87cd66/ipp-route-87cd66-kserve-555fb78467-l5zzm" event={"ID":"93adf5d1-e0cc-41ee-868a-6d3df2091829","Type":"ContainerDied","Data":"fb4bdfde3b64dd207951c8540b2bcec4f6be931b4b0ac0bc8462f72d3b835093"}
Jul 24 19:31:02.915280 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:31:02.914915    2580 scope.go:117] "RemoveContainer" containerID="a6f9bd606e309e1be8f43d59120851ecc30aea91f004ab17da9750fcb6deca9c"
Jul 24 19:31:02.925198 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:31:02.925176    2580 scope.go:117] "RemoveContainer" containerID="a6f9bd606e309e1be8f43d59120851ecc30aea91f004ab17da9750fcb6deca9c"
Jul 24 19:31:02.925515 ip-10-0-141-146 kubenswrapper[2580]: E0724 19:31:02.925491    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a6f9bd606e309e1be8f43d59120851ecc30aea91f004ab17da9750fcb6deca9c\": container with ID starting with a6f9bd606e309e1be8f43d59120851ecc30aea91f004ab17da9750fcb6deca9c not found: ID does not exist" containerID="a6f9bd606e309e1be8f43d59120851ecc30aea91f004ab17da9750fcb6deca9c"
Jul 24 19:31:02.925583 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:31:02.925527    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a6f9bd606e309e1be8f43d59120851ecc30aea91f004ab17da9750fcb6deca9c"} err="failed to get container status \"a6f9bd606e309e1be8f43d59120851ecc30aea91f004ab17da9750fcb6deca9c\": rpc error: code = NotFound desc = could not find container \"a6f9bd606e309e1be8f43d59120851ecc30aea91f004ab17da9750fcb6deca9c\": container with ID starting with a6f9bd606e309e1be8f43d59120851ecc30aea91f004ab17da9750fcb6deca9c not found: ID does not exist"
Jul 24 19:31:02.937643 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:31:02.937610    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-ipp-a-87cd66/ipp-route-87cd66-kserve-555fb78467-l5zzm"]
Jul 24 19:31:02.939582 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:31:02.939551    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-ipp-a-87cd66/ipp-route-87cd66-kserve-555fb78467-l5zzm"]
Jul 24 19:31:03.242180 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:31:03.242117    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="93adf5d1-e0cc-41ee-868a-6d3df2091829" path="/var/lib/kubelet/pods/93adf5d1-e0cc-41ee-868a-6d3df2091829/volumes"
Jul 24 19:31:23.053258 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:31:23.053218    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:31:24.056403 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:31:24.056365    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:31:29.824675 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:31:29.824637    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:31:29.925684 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:31:29.925651    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:31:30.097315 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:31:30.097214    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-87cd66-openshift-default-694449f47d-k9tjt"]
Jul 24 19:31:30.097819 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:31:30.097778    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-a-87cd66-openshift-default-694449f47d-k9tjt" podUID="a3d1fc7f-7aa3-482c-9a66-fb95ea31e548" containerName="istio-proxy" containerID="cri-o://f50c743a35e466528c41afc92f224b8625dfbbf8988e6c4c0077c3a0549cf537" gracePeriod=30
Jul 24 19:31:30.116079 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:31:30.116045    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:31:30.333857 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:31:30.333822    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:31:35.362763 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:31:35.362691    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-87cd66-openshift-default-694449f47d-k9tjt"
Jul 24 19:31:35.453022 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:31:35.452993    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a3d1fc7f-7aa3-482c-9a66-fb95ea31e548-workload-socket\") pod \"a3d1fc7f-7aa3-482c-9a66-fb95ea31e548\" (UID: \"a3d1fc7f-7aa3-482c-9a66-fb95ea31e548\") "
Jul 24 19:31:35.453253 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:31:35.453044    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a3d1fc7f-7aa3-482c-9a66-fb95ea31e548-istio-token\") pod \"a3d1fc7f-7aa3-482c-9a66-fb95ea31e548\" (UID: \"a3d1fc7f-7aa3-482c-9a66-fb95ea31e548\") "
Jul 24 19:31:35.453253 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:31:35.453086    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a3d1fc7f-7aa3-482c-9a66-fb95ea31e548-credential-socket\") pod \"a3d1fc7f-7aa3-482c-9a66-fb95ea31e548\" (UID: \"a3d1fc7f-7aa3-482c-9a66-fb95ea31e548\") "
Jul 24 19:31:35.453253 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:31:35.453105    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a3d1fc7f-7aa3-482c-9a66-fb95ea31e548-istio-envoy\") pod \"a3d1fc7f-7aa3-482c-9a66-fb95ea31e548\" (UID: \"a3d1fc7f-7aa3-482c-9a66-fb95ea31e548\") "
Jul 24 19:31:35.453253 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:31:35.453141    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a3d1fc7f-7aa3-482c-9a66-fb95ea31e548-istiod-ca-cert\") pod \"a3d1fc7f-7aa3-482c-9a66-fb95ea31e548\" (UID: \"a3d1fc7f-7aa3-482c-9a66-fb95ea31e548\") "
Jul 24 19:31:35.453253 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:31:35.453157    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a3d1fc7f-7aa3-482c-9a66-fb95ea31e548-workload-certs\") pod \"a3d1fc7f-7aa3-482c-9a66-fb95ea31e548\" (UID: \"a3d1fc7f-7aa3-482c-9a66-fb95ea31e548\") "
Jul 24 19:31:35.453253 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:31:35.453213    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a3d1fc7f-7aa3-482c-9a66-fb95ea31e548-istio-data\") pod \"a3d1fc7f-7aa3-482c-9a66-fb95ea31e548\" (UID: \"a3d1fc7f-7aa3-482c-9a66-fb95ea31e548\") "
Jul 24 19:31:35.453547 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:31:35.453297    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a3d1fc7f-7aa3-482c-9a66-fb95ea31e548-istio-podinfo\") pod \"a3d1fc7f-7aa3-482c-9a66-fb95ea31e548\" (UID: \"a3d1fc7f-7aa3-482c-9a66-fb95ea31e548\") "
Jul 24 19:31:35.453547 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:31:35.453328    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j8pnf\" (UniqueName: \"kubernetes.io/projected/a3d1fc7f-7aa3-482c-9a66-fb95ea31e548-kube-api-access-j8pnf\") pod \"a3d1fc7f-7aa3-482c-9a66-fb95ea31e548\" (UID: \"a3d1fc7f-7aa3-482c-9a66-fb95ea31e548\") "
Jul 24 19:31:35.453547 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:31:35.453341    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a3d1fc7f-7aa3-482c-9a66-fb95ea31e548-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a3d1fc7f-7aa3-482c-9a66-fb95ea31e548" (UID: "a3d1fc7f-7aa3-482c-9a66-fb95ea31e548"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:31:35.453547 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:31:35.453448    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a3d1fc7f-7aa3-482c-9a66-fb95ea31e548-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a3d1fc7f-7aa3-482c-9a66-fb95ea31e548" (UID: "a3d1fc7f-7aa3-482c-9a66-fb95ea31e548"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:31:35.453762 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:31:35.453610    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a3d1fc7f-7aa3-482c-9a66-fb95ea31e548-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a3d1fc7f-7aa3-482c-9a66-fb95ea31e548" (UID: "a3d1fc7f-7aa3-482c-9a66-fb95ea31e548"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 19:31:35.453762 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:31:35.453621    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a3d1fc7f-7aa3-482c-9a66-fb95ea31e548-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a3d1fc7f-7aa3-482c-9a66-fb95ea31e548" (UID: "a3d1fc7f-7aa3-482c-9a66-fb95ea31e548"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:31:35.453762 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:31:35.453734    2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a3d1fc7f-7aa3-482c-9a66-fb95ea31e548-workload-socket\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 24 19:31:35.453762 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:31:35.453754    2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a3d1fc7f-7aa3-482c-9a66-fb95ea31e548-credential-socket\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 24 19:31:35.454155 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:31:35.453769    2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a3d1fc7f-7aa3-482c-9a66-fb95ea31e548-istiod-ca-cert\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 24 19:31:35.454155 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:31:35.453782    2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a3d1fc7f-7aa3-482c-9a66-fb95ea31e548-workload-certs\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 24 19:31:35.454687 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:31:35.454659    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a3d1fc7f-7aa3-482c-9a66-fb95ea31e548-istio-data" (OuterVolumeSpecName: "istio-data") pod "a3d1fc7f-7aa3-482c-9a66-fb95ea31e548" (UID: "a3d1fc7f-7aa3-482c-9a66-fb95ea31e548"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:31:35.455568 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:31:35.455536    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a3d1fc7f-7aa3-482c-9a66-fb95ea31e548-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a3d1fc7f-7aa3-482c-9a66-fb95ea31e548" (UID: "a3d1fc7f-7aa3-482c-9a66-fb95ea31e548"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 24 19:31:35.455656 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:31:35.455622    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a3d1fc7f-7aa3-482c-9a66-fb95ea31e548-kube-api-access-j8pnf" (OuterVolumeSpecName: "kube-api-access-j8pnf") pod "a3d1fc7f-7aa3-482c-9a66-fb95ea31e548" (UID: "a3d1fc7f-7aa3-482c-9a66-fb95ea31e548"). InnerVolumeSpecName "kube-api-access-j8pnf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 19:31:35.455656 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:31:35.455633    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a3d1fc7f-7aa3-482c-9a66-fb95ea31e548-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a3d1fc7f-7aa3-482c-9a66-fb95ea31e548" (UID: "a3d1fc7f-7aa3-482c-9a66-fb95ea31e548"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:31:35.455733 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:31:35.455705    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a3d1fc7f-7aa3-482c-9a66-fb95ea31e548-istio-token" (OuterVolumeSpecName: "istio-token") pod "a3d1fc7f-7aa3-482c-9a66-fb95ea31e548" (UID: "a3d1fc7f-7aa3-482c-9a66-fb95ea31e548"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 19:31:35.554660 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:31:35.554613    2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a3d1fc7f-7aa3-482c-9a66-fb95ea31e548-istio-envoy\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 24 19:31:35.554660 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:31:35.554653    2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a3d1fc7f-7aa3-482c-9a66-fb95ea31e548-istio-data\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 24 19:31:35.554660 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:31:35.554664    2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a3d1fc7f-7aa3-482c-9a66-fb95ea31e548-istio-podinfo\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 24 19:31:35.554914 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:31:35.554676    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j8pnf\" (UniqueName: \"kubernetes.io/projected/a3d1fc7f-7aa3-482c-9a66-fb95ea31e548-kube-api-access-j8pnf\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 24 19:31:35.554914 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:31:35.554689    2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a3d1fc7f-7aa3-482c-9a66-fb95ea31e548-istio-token\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 24 19:31:36.087006 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:31:36.086970    2580 generic.go:356] "Generic (PLEG): container finished" podID="a3d1fc7f-7aa3-482c-9a66-fb95ea31e548" containerID="f50c743a35e466528c41afc92f224b8625dfbbf8988e6c4c0077c3a0549cf537" exitCode=0
Jul 24 19:31:36.087216 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:31:36.087030    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-87cd66-openshift-default-694449f47d-k9tjt"
Jul 24 19:31:36.087216 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:31:36.087055    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-87cd66-openshift-default-694449f47d-k9tjt" event={"ID":"a3d1fc7f-7aa3-482c-9a66-fb95ea31e548","Type":"ContainerDied","Data":"f50c743a35e466528c41afc92f224b8625dfbbf8988e6c4c0077c3a0549cf537"}
Jul 24 19:31:36.087216 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:31:36.087171    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-87cd66-openshift-default-694449f47d-k9tjt" event={"ID":"a3d1fc7f-7aa3-482c-9a66-fb95ea31e548","Type":"ContainerDied","Data":"c2b545df8980573e904c684f18c182d6ba7107ca360535ad10036495c341137f"}
Jul 24 19:31:36.087216 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:31:36.087202    2580 scope.go:117] "RemoveContainer" containerID="f50c743a35e466528c41afc92f224b8625dfbbf8988e6c4c0077c3a0549cf537"
Jul 24 19:31:36.097168 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:31:36.097142    2580 scope.go:117] "RemoveContainer" containerID="9e92fee89976cdf60159d1f1ff68802d84338d8ffb8c3866488a8c899ae36e81"
Jul 24 19:31:36.105647 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:31:36.105630    2580 scope.go:117] "RemoveContainer" containerID="f50c743a35e466528c41afc92f224b8625dfbbf8988e6c4c0077c3a0549cf537"
Jul 24 19:31:36.105937 ip-10-0-141-146 kubenswrapper[2580]: E0724 19:31:36.105916    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f50c743a35e466528c41afc92f224b8625dfbbf8988e6c4c0077c3a0549cf537\": container with ID starting with f50c743a35e466528c41afc92f224b8625dfbbf8988e6c4c0077c3a0549cf537 not found: ID does not exist" containerID="f50c743a35e466528c41afc92f224b8625dfbbf8988e6c4c0077c3a0549cf537"
Jul 24 19:31:36.105991 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:31:36.105948    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f50c743a35e466528c41afc92f224b8625dfbbf8988e6c4c0077c3a0549cf537"} err="failed to get container status \"f50c743a35e466528c41afc92f224b8625dfbbf8988e6c4c0077c3a0549cf537\": rpc error: code = NotFound desc = could not find container \"f50c743a35e466528c41afc92f224b8625dfbbf8988e6c4c0077c3a0549cf537\": container with ID starting with f50c743a35e466528c41afc92f224b8625dfbbf8988e6c4c0077c3a0549cf537 not found: ID does not exist"
Jul 24 19:31:36.105991 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:31:36.105966    2580 scope.go:117] "RemoveContainer" containerID="9e92fee89976cdf60159d1f1ff68802d84338d8ffb8c3866488a8c899ae36e81"
Jul 24 19:31:36.106217 ip-10-0-141-146 kubenswrapper[2580]: E0724 19:31:36.106199    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9e92fee89976cdf60159d1f1ff68802d84338d8ffb8c3866488a8c899ae36e81\": container with ID starting with 9e92fee89976cdf60159d1f1ff68802d84338d8ffb8c3866488a8c899ae36e81 not found: ID does not exist" containerID="9e92fee89976cdf60159d1f1ff68802d84338d8ffb8c3866488a8c899ae36e81"
Jul 24 19:31:36.106258 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:31:36.106224    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9e92fee89976cdf60159d1f1ff68802d84338d8ffb8c3866488a8c899ae36e81"} err="failed to get container status \"9e92fee89976cdf60159d1f1ff68802d84338d8ffb8c3866488a8c899ae36e81\": rpc error: code = NotFound desc = could not find container \"9e92fee89976cdf60159d1f1ff68802d84338d8ffb8c3866488a8c899ae36e81\": container with ID starting with 9e92fee89976cdf60159d1f1ff68802d84338d8ffb8c3866488a8c899ae36e81 not found: ID does not exist"
Jul 24 19:31:36.109954 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:31:36.109931    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-87cd66-openshift-default-694449f47d-k9tjt"]
Jul 24 19:31:36.114925 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:31:36.114902    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-a-87cd66-openshift-default-694449f47d-k9tjt"]
Jul 24 19:31:37.241717 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:31:37.241683    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a3d1fc7f-7aa3-482c-9a66-fb95ea31e548" path="/var/lib/kubelet/pods/a3d1fc7f-7aa3-482c-9a66-fb95ea31e548/volumes"
Jul 24 19:31:41.191048 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:31:41.191016    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:31:41.262805 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:31:41.262764    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:31:41.360373 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:31:41.360340    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:31:45.538859 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:31:45.538799    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:31:45.931319 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:31:45.931207    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:31:51.957391 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:31:51.957345    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:31:52.057914 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:31:52.057846    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:31:52.218356 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:31:52.218263    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-5ce07c-openshift-default-8485cc8bf8-ldjgs"]
Jul 24 19:31:52.218559 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:31:52.218527    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-b-5ce07c-openshift-default-8485cc8bf8-ldjgs" podUID="933f9fa9-7e18-46b9-b435-7fe567b40d1a" containerName="istio-proxy" containerID="cri-o://a69e5d218f73551ebb020d3cf2af6f0898068981f6d43c33328937589501de9b" gracePeriod=30
Jul 24 19:31:52.246302 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:31:52.246271    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:31:52.453797 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:31:52.453759    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:31:54.100070 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:31:54.100030    2580 patch_prober.go:28] interesting pod/e2e-ipp-b-5ce07c-openshift-default-8485cc8bf8-ldjgs container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 24 19:31:54.100551 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:31:54.100093    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-b-5ce07c-openshift-default-8485cc8bf8-ldjgs" podUID="933f9fa9-7e18-46b9-b435-7fe567b40d1a" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 24 19:31:57.471898 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:31:57.471870    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-5ce07c-openshift-default-8485cc8bf8-ldjgs"
Jul 24 19:31:57.577970 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:31:57.577873    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/933f9fa9-7e18-46b9-b435-7fe567b40d1a-istio-podinfo\") pod \"933f9fa9-7e18-46b9-b435-7fe567b40d1a\" (UID: \"933f9fa9-7e18-46b9-b435-7fe567b40d1a\") "
Jul 24 19:31:57.577970 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:31:57.577939    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/933f9fa9-7e18-46b9-b435-7fe567b40d1a-istio-envoy\") pod \"933f9fa9-7e18-46b9-b435-7fe567b40d1a\" (UID: \"933f9fa9-7e18-46b9-b435-7fe567b40d1a\") "
Jul 24 19:31:57.578252 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:31:57.577981    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/933f9fa9-7e18-46b9-b435-7fe567b40d1a-workload-socket\") pod \"933f9fa9-7e18-46b9-b435-7fe567b40d1a\" (UID: \"933f9fa9-7e18-46b9-b435-7fe567b40d1a\") "
Jul 24 19:31:57.578252 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:31:57.578046    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7mkkr\" (UniqueName: \"kubernetes.io/projected/933f9fa9-7e18-46b9-b435-7fe567b40d1a-kube-api-access-7mkkr\") pod \"933f9fa9-7e18-46b9-b435-7fe567b40d1a\" (UID: \"933f9fa9-7e18-46b9-b435-7fe567b40d1a\") "
Jul 24 19:31:57.578252 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:31:57.578086    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/933f9fa9-7e18-46b9-b435-7fe567b40d1a-istio-data\") pod \"933f9fa9-7e18-46b9-b435-7fe567b40d1a\" (UID: \"933f9fa9-7e18-46b9-b435-7fe567b40d1a\") "
Jul 24 19:31:57.578252 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:31:57.578163    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/933f9fa9-7e18-46b9-b435-7fe567b40d1a-workload-certs\") pod \"933f9fa9-7e18-46b9-b435-7fe567b40d1a\" (UID: \"933f9fa9-7e18-46b9-b435-7fe567b40d1a\") "
Jul 24 19:31:57.578252 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:31:57.578212    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/933f9fa9-7e18-46b9-b435-7fe567b40d1a-credential-socket\") pod \"933f9fa9-7e18-46b9-b435-7fe567b40d1a\" (UID: \"933f9fa9-7e18-46b9-b435-7fe567b40d1a\") "
Jul 24 19:31:57.578252 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:31:57.578241    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/933f9fa9-7e18-46b9-b435-7fe567b40d1a-istio-token\") pod \"933f9fa9-7e18-46b9-b435-7fe567b40d1a\" (UID: \"933f9fa9-7e18-46b9-b435-7fe567b40d1a\") "
Jul 24 19:31:57.578572 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:31:57.578269    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/933f9fa9-7e18-46b9-b435-7fe567b40d1a-istiod-ca-cert\") pod \"933f9fa9-7e18-46b9-b435-7fe567b40d1a\" (UID: \"933f9fa9-7e18-46b9-b435-7fe567b40d1a\") "
Jul 24 19:31:57.578572 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:31:57.578340    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/933f9fa9-7e18-46b9-b435-7fe567b40d1a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "933f9fa9-7e18-46b9-b435-7fe567b40d1a" (UID: "933f9fa9-7e18-46b9-b435-7fe567b40d1a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:31:57.578676 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:31:57.578578    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/933f9fa9-7e18-46b9-b435-7fe567b40d1a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "933f9fa9-7e18-46b9-b435-7fe567b40d1a" (UID: "933f9fa9-7e18-46b9-b435-7fe567b40d1a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:31:57.578732 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:31:57.578671    2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/933f9fa9-7e18-46b9-b435-7fe567b40d1a-workload-socket\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 24 19:31:57.578732 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:31:57.578690    2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/933f9fa9-7e18-46b9-b435-7fe567b40d1a-credential-socket\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 24 19:31:57.579010 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:31:57.578766    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/933f9fa9-7e18-46b9-b435-7fe567b40d1a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "933f9fa9-7e18-46b9-b435-7fe567b40d1a" (UID: "933f9fa9-7e18-46b9-b435-7fe567b40d1a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:31:57.579010 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:31:57.578993    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/933f9fa9-7e18-46b9-b435-7fe567b40d1a-istio-data" (OuterVolumeSpecName: "istio-data") pod "933f9fa9-7e18-46b9-b435-7fe567b40d1a" (UID: "933f9fa9-7e18-46b9-b435-7fe567b40d1a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:31:57.579140 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:31:57.579063    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/933f9fa9-7e18-46b9-b435-7fe567b40d1a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "933f9fa9-7e18-46b9-b435-7fe567b40d1a" (UID: "933f9fa9-7e18-46b9-b435-7fe567b40d1a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 19:31:57.580449 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:31:57.580425    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/933f9fa9-7e18-46b9-b435-7fe567b40d1a-kube-api-access-7mkkr" (OuterVolumeSpecName: "kube-api-access-7mkkr") pod "933f9fa9-7e18-46b9-b435-7fe567b40d1a" (UID: "933f9fa9-7e18-46b9-b435-7fe567b40d1a"). InnerVolumeSpecName "kube-api-access-7mkkr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 19:31:57.580575 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:31:57.580528    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/933f9fa9-7e18-46b9-b435-7fe567b40d1a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "933f9fa9-7e18-46b9-b435-7fe567b40d1a" (UID: "933f9fa9-7e18-46b9-b435-7fe567b40d1a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 24 19:31:57.580883 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:31:57.580856    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/933f9fa9-7e18-46b9-b435-7fe567b40d1a-istio-token" (OuterVolumeSpecName: "istio-token") pod "933f9fa9-7e18-46b9-b435-7fe567b40d1a" (UID: "933f9fa9-7e18-46b9-b435-7fe567b40d1a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 19:31:57.580927 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:31:57.580881    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/933f9fa9-7e18-46b9-b435-7fe567b40d1a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "933f9fa9-7e18-46b9-b435-7fe567b40d1a" (UID: "933f9fa9-7e18-46b9-b435-7fe567b40d1a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:31:57.679373 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:31:57.679335    2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/933f9fa9-7e18-46b9-b435-7fe567b40d1a-workload-certs\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 24 19:31:57.679373 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:31:57.679367    2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/933f9fa9-7e18-46b9-b435-7fe567b40d1a-istio-token\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 24 19:31:57.679373 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:31:57.679375    2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/933f9fa9-7e18-46b9-b435-7fe567b40d1a-istiod-ca-cert\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 24 19:31:57.679373 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:31:57.679383    2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/933f9fa9-7e18-46b9-b435-7fe567b40d1a-istio-podinfo\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 24 19:31:57.679664 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:31:57.679392    2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/933f9fa9-7e18-46b9-b435-7fe567b40d1a-istio-envoy\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 24 19:31:57.679664 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:31:57.679401    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7mkkr\" (UniqueName: \"kubernetes.io/projected/933f9fa9-7e18-46b9-b435-7fe567b40d1a-kube-api-access-7mkkr\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 24 19:31:57.679664 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:31:57.679409    2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/933f9fa9-7e18-46b9-b435-7fe567b40d1a-istio-data\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 24 19:31:58.196903 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:31:58.196867    2580 generic.go:356] "Generic (PLEG): container finished" podID="933f9fa9-7e18-46b9-b435-7fe567b40d1a" containerID="a69e5d218f73551ebb020d3cf2af6f0898068981f6d43c33328937589501de9b" exitCode=0
Jul 24 19:31:58.196903 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:31:58.196909    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-5ce07c-openshift-default-8485cc8bf8-ldjgs" event={"ID":"933f9fa9-7e18-46b9-b435-7fe567b40d1a","Type":"ContainerDied","Data":"a69e5d218f73551ebb020d3cf2af6f0898068981f6d43c33328937589501de9b"}
Jul 24 19:31:58.197187 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:31:58.196921    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-5ce07c-openshift-default-8485cc8bf8-ldjgs"
Jul 24 19:31:58.197187 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:31:58.196953    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-5ce07c-openshift-default-8485cc8bf8-ldjgs" event={"ID":"933f9fa9-7e18-46b9-b435-7fe567b40d1a","Type":"ContainerDied","Data":"47cef8b8a6356bdb38edaa621088dee1b6ea1130309139330e5b5c914d701230"}
Jul 24 19:31:58.197187 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:31:58.196977    2580 scope.go:117] "RemoveContainer" containerID="a69e5d218f73551ebb020d3cf2af6f0898068981f6d43c33328937589501de9b"
Jul 24 19:31:58.206970 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:31:58.206951    2580 scope.go:117] "RemoveContainer" containerID="febf95799a07d19ecfe0c3f939f05e4c2c783d06999e26e722fbddde187ea462"
Jul 24 19:31:58.216363 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:31:58.216342    2580 scope.go:117] "RemoveContainer" containerID="a69e5d218f73551ebb020d3cf2af6f0898068981f6d43c33328937589501de9b"
Jul 24 19:31:58.216650 ip-10-0-141-146 kubenswrapper[2580]: E0724 19:31:58.216630    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a69e5d218f73551ebb020d3cf2af6f0898068981f6d43c33328937589501de9b\": container with ID starting with a69e5d218f73551ebb020d3cf2af6f0898068981f6d43c33328937589501de9b not found: ID does not exist" containerID="a69e5d218f73551ebb020d3cf2af6f0898068981f6d43c33328937589501de9b"
Jul 24 19:31:58.216724 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:31:58.216656    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a69e5d218f73551ebb020d3cf2af6f0898068981f6d43c33328937589501de9b"} err="failed to get container status \"a69e5d218f73551ebb020d3cf2af6f0898068981f6d43c33328937589501de9b\": rpc error: code = NotFound desc = could not find container \"a69e5d218f73551ebb020d3cf2af6f0898068981f6d43c33328937589501de9b\": container with ID starting with a69e5d218f73551ebb020d3cf2af6f0898068981f6d43c33328937589501de9b not found: ID does not exist"
Jul 24 19:31:58.216724 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:31:58.216673    2580 scope.go:117] "RemoveContainer" containerID="febf95799a07d19ecfe0c3f939f05e4c2c783d06999e26e722fbddde187ea462"
Jul 24 19:31:58.216946 ip-10-0-141-146 kubenswrapper[2580]: E0724 19:31:58.216924    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"febf95799a07d19ecfe0c3f939f05e4c2c783d06999e26e722fbddde187ea462\": container with ID starting with febf95799a07d19ecfe0c3f939f05e4c2c783d06999e26e722fbddde187ea462 not found: ID does not exist" containerID="febf95799a07d19ecfe0c3f939f05e4c2c783d06999e26e722fbddde187ea462"
Jul 24 19:31:58.216987 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:31:58.216953    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"febf95799a07d19ecfe0c3f939f05e4c2c783d06999e26e722fbddde187ea462"} err="failed to get container status \"febf95799a07d19ecfe0c3f939f05e4c2c783d06999e26e722fbddde187ea462\": rpc error: code = NotFound desc = could not find container \"febf95799a07d19ecfe0c3f939f05e4c2c783d06999e26e722fbddde187ea462\": container with ID starting with febf95799a07d19ecfe0c3f939f05e4c2c783d06999e26e722fbddde187ea462 not found: ID does not exist"
Jul 24 19:31:58.219939 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:31:58.219909    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-5ce07c-openshift-default-8485cc8bf8-ldjgs"]
Jul 24 19:31:58.224259 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:31:58.224231    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-b-5ce07c-openshift-default-8485cc8bf8-ldjgs"]
Jul 24 19:31:59.242300 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:31:59.242260    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="933f9fa9-7e18-46b9-b435-7fe567b40d1a" path="/var/lib/kubelet/pods/933f9fa9-7e18-46b9-b435-7fe567b40d1a/volumes"
Jul 24 19:32:03.052639 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:32:03.052598    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:32:03.120966 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:32:03.120929    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:32:03.222967 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:32:03.222901    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:32:07.672426 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:32:07.672389    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:32:08.083901 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:32:08.083864    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:32:13.800142 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:32:13.800088    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:32:13.900344 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:32:13.900304    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:32:14.060496 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:32:14.060382    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:32:14.278518 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:32:14.278486    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:32:24.894763 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:32:24.894726    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:32:24.994255 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:32:24.994221    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:32:25.094530 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:32:25.094493    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:32:29.482304 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:32:29.482264    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:32:29.849295 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:32:29.849203    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:32:35.831585 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:32:35.831539    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:32:35.933086 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:32:35.933054    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:32:36.060734 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:32:36.060698    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-48f4d2-openshift-default-f8748787b-9fqhj"]
Jul 24 19:32:36.060967 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:32:36.060944    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-48f4d2-openshift-default-f8748787b-9fqhj" podUID="ac395bec-c4ec-4b1c-9078-d4f995574cdc" containerName="istio-proxy" containerID="cri-o://c76833a185fd4785479409e00074fd7f16a4865db6c78a341dc32e5dbf5fcb1d" gracePeriod=30
Jul 24 19:32:36.079345 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:32:36.079298    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:32:36.309543 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:32:36.309503    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:32:36.736112 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:32:36.736073    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5674d54b-xj9cr_3263be87-2868-4473-a163-9c01b3afbe5b/authorino/0.log"
Jul 24 19:32:37.509116 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:32:37.509068    2580 patch_prober.go:28] interesting pod/e2e-shared-b-48f4d2-openshift-default-f8748787b-9fqhj container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 24 19:32:37.509513 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:32:37.509143    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-48f4d2-openshift-default-f8748787b-9fqhj" podUID="ac395bec-c4ec-4b1c-9078-d4f995574cdc" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 24 19:32:41.316538 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:32:41.316506    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-48f4d2-openshift-default-f8748787b-9fqhj"
Jul 24 19:32:41.408980 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:32:41.408889    2580 generic.go:356] "Generic (PLEG): container finished" podID="ac395bec-c4ec-4b1c-9078-d4f995574cdc" containerID="c76833a185fd4785479409e00074fd7f16a4865db6c78a341dc32e5dbf5fcb1d" exitCode=0
Jul 24 19:32:41.408980 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:32:41.408947    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-48f4d2-openshift-default-f8748787b-9fqhj"
Jul 24 19:32:41.409203 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:32:41.408982    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-48f4d2-openshift-default-f8748787b-9fqhj" event={"ID":"ac395bec-c4ec-4b1c-9078-d4f995574cdc","Type":"ContainerDied","Data":"c76833a185fd4785479409e00074fd7f16a4865db6c78a341dc32e5dbf5fcb1d"}
Jul 24 19:32:41.409203 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:32:41.409040    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-48f4d2-openshift-default-f8748787b-9fqhj" event={"ID":"ac395bec-c4ec-4b1c-9078-d4f995574cdc","Type":"ContainerDied","Data":"a3a28a4cc3248d19bb54ec299238ecb41fec07f6cc86878306d5be828b60e23e"}
Jul 24 19:32:41.409203 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:32:41.409064    2580 scope.go:117] "RemoveContainer" containerID="c76833a185fd4785479409e00074fd7f16a4865db6c78a341dc32e5dbf5fcb1d"
Jul 24 19:32:41.413039 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:32:41.413019    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ac395bec-c4ec-4b1c-9078-d4f995574cdc-istio-data\") pod \"ac395bec-c4ec-4b1c-9078-d4f995574cdc\" (UID: \"ac395bec-c4ec-4b1c-9078-d4f995574cdc\") "
Jul 24 19:32:41.413170 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:32:41.413064    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ac395bec-c4ec-4b1c-9078-d4f995574cdc-workload-certs\") pod \"ac395bec-c4ec-4b1c-9078-d4f995574cdc\" (UID: \"ac395bec-c4ec-4b1c-9078-d4f995574cdc\") "
Jul 24 19:32:41.413170 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:32:41.413142    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac395bec-c4ec-4b1c-9078-d4f995574cdc-credential-socket\") pod \"ac395bec-c4ec-4b1c-9078-d4f995574cdc\" (UID: \"ac395bec-c4ec-4b1c-9078-d4f995574cdc\") "
Jul 24 19:32:41.413294 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:32:41.413211    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4vvst\" (UniqueName: \"kubernetes.io/projected/ac395bec-c4ec-4b1c-9078-d4f995574cdc-kube-api-access-4vvst\") pod \"ac395bec-c4ec-4b1c-9078-d4f995574cdc\" (UID: \"ac395bec-c4ec-4b1c-9078-d4f995574cdc\") "
Jul 24 19:32:41.413294 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:32:41.413250    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ac395bec-c4ec-4b1c-9078-d4f995574cdc-istiod-ca-cert\") pod \"ac395bec-c4ec-4b1c-9078-d4f995574cdc\" (UID: \"ac395bec-c4ec-4b1c-9078-d4f995574cdc\") "
Jul 24 19:32:41.413294 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:32:41.413286    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac395bec-c4ec-4b1c-9078-d4f995574cdc-workload-socket\") pod \"ac395bec-c4ec-4b1c-9078-d4f995574cdc\" (UID: \"ac395bec-c4ec-4b1c-9078-d4f995574cdc\") "
Jul 24 19:32:41.413451 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:32:41.413313    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ac395bec-c4ec-4b1c-9078-d4f995574cdc-istio-token\") pod \"ac395bec-c4ec-4b1c-9078-d4f995574cdc\" (UID: \"ac395bec-c4ec-4b1c-9078-d4f995574cdc\") "
Jul 24 19:32:41.413451 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:32:41.413353    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ac395bec-c4ec-4b1c-9078-d4f995574cdc-istio-envoy\") pod \"ac395bec-c4ec-4b1c-9078-d4f995574cdc\" (UID: \"ac395bec-c4ec-4b1c-9078-d4f995574cdc\") "
Jul 24 19:32:41.413451 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:32:41.413387    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac395bec-c4ec-4b1c-9078-d4f995574cdc-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ac395bec-c4ec-4b1c-9078-d4f995574cdc" (UID: "ac395bec-c4ec-4b1c-9078-d4f995574cdc"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:32:41.413451 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:32:41.413400    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ac395bec-c4ec-4b1c-9078-d4f995574cdc-istio-podinfo\") pod \"ac395bec-c4ec-4b1c-9078-d4f995574cdc\" (UID: \"ac395bec-c4ec-4b1c-9078-d4f995574cdc\") "
Jul 24 19:32:41.413663 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:32:41.413477    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac395bec-c4ec-4b1c-9078-d4f995574cdc-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ac395bec-c4ec-4b1c-9078-d4f995574cdc" (UID: "ac395bec-c4ec-4b1c-9078-d4f995574cdc"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:32:41.413723 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:32:41.413686    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ac395bec-c4ec-4b1c-9078-d4f995574cdc-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ac395bec-c4ec-4b1c-9078-d4f995574cdc" (UID: "ac395bec-c4ec-4b1c-9078-d4f995574cdc"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 19:32:41.413791 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:32:41.413770    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac395bec-c4ec-4b1c-9078-d4f995574cdc-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ac395bec-c4ec-4b1c-9078-d4f995574cdc" (UID: "ac395bec-c4ec-4b1c-9078-d4f995574cdc"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:32:41.413873 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:32:41.413854    2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac395bec-c4ec-4b1c-9078-d4f995574cdc-credential-socket\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 24 19:32:41.413932 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:32:41.413878    2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ac395bec-c4ec-4b1c-9078-d4f995574cdc-istiod-ca-cert\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 24 19:32:41.413932 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:32:41.413892    2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac395bec-c4ec-4b1c-9078-d4f995574cdc-workload-socket\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 24 19:32:41.413932 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:32:41.413906    2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ac395bec-c4ec-4b1c-9078-d4f995574cdc-workload-certs\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 24 19:32:41.414338 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:32:41.414299    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac395bec-c4ec-4b1c-9078-d4f995574cdc-istio-data" (OuterVolumeSpecName: "istio-data") pod "ac395bec-c4ec-4b1c-9078-d4f995574cdc" (UID: "ac395bec-c4ec-4b1c-9078-d4f995574cdc"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:32:41.415855 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:32:41.415833    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ac395bec-c4ec-4b1c-9078-d4f995574cdc-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ac395bec-c4ec-4b1c-9078-d4f995574cdc" (UID: "ac395bec-c4ec-4b1c-9078-d4f995574cdc"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 24 19:32:41.415979 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:32:41.415929    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac395bec-c4ec-4b1c-9078-d4f995574cdc-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ac395bec-c4ec-4b1c-9078-d4f995574cdc" (UID: "ac395bec-c4ec-4b1c-9078-d4f995574cdc"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 19:32:41.416046 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:32:41.415981    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ac395bec-c4ec-4b1c-9078-d4f995574cdc-istio-token" (OuterVolumeSpecName: "istio-token") pod "ac395bec-c4ec-4b1c-9078-d4f995574cdc" (UID: "ac395bec-c4ec-4b1c-9078-d4f995574cdc"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 19:32:41.416100 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:32:41.416063    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ac395bec-c4ec-4b1c-9078-d4f995574cdc-kube-api-access-4vvst" (OuterVolumeSpecName: "kube-api-access-4vvst") pod "ac395bec-c4ec-4b1c-9078-d4f995574cdc" (UID: "ac395bec-c4ec-4b1c-9078-d4f995574cdc"). InnerVolumeSpecName "kube-api-access-4vvst". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 19:32:41.419404 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:32:41.419387    2580 scope.go:117] "RemoveContainer" containerID="8b7558c8424929c495c3fc5b056c9eba7c08e2e6e56deae9679ed6ddc25e4463"
Jul 24 19:32:41.435231 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:32:41.435203    2580 scope.go:117] "RemoveContainer" containerID="c76833a185fd4785479409e00074fd7f16a4865db6c78a341dc32e5dbf5fcb1d"
Jul 24 19:32:41.435571 ip-10-0-141-146 kubenswrapper[2580]: E0724 19:32:41.435539    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c76833a185fd4785479409e00074fd7f16a4865db6c78a341dc32e5dbf5fcb1d\": container with ID starting with c76833a185fd4785479409e00074fd7f16a4865db6c78a341dc32e5dbf5fcb1d not found: ID does not exist" containerID="c76833a185fd4785479409e00074fd7f16a4865db6c78a341dc32e5dbf5fcb1d"
Jul 24 19:32:41.435638 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:32:41.435582    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c76833a185fd4785479409e00074fd7f16a4865db6c78a341dc32e5dbf5fcb1d"} err="failed to get container status \"c76833a185fd4785479409e00074fd7f16a4865db6c78a341dc32e5dbf5fcb1d\": rpc error: code = NotFound desc = could not find container \"c76833a185fd4785479409e00074fd7f16a4865db6c78a341dc32e5dbf5fcb1d\": container with ID starting with c76833a185fd4785479409e00074fd7f16a4865db6c78a341dc32e5dbf5fcb1d not found: ID does not exist"
Jul 24 19:32:41.435638 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:32:41.435603    2580 scope.go:117] "RemoveContainer" containerID="8b7558c8424929c495c3fc5b056c9eba7c08e2e6e56deae9679ed6ddc25e4463"
Jul 24 19:32:41.435903 ip-10-0-141-146 kubenswrapper[2580]: E0724 19:32:41.435878    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8b7558c8424929c495c3fc5b056c9eba7c08e2e6e56deae9679ed6ddc25e4463\": container with ID starting with 8b7558c8424929c495c3fc5b056c9eba7c08e2e6e56deae9679ed6ddc25e4463 not found: ID does not exist" containerID="8b7558c8424929c495c3fc5b056c9eba7c08e2e6e56deae9679ed6ddc25e4463"
Jul 24 19:32:41.435946 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:32:41.435910    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b7558c8424929c495c3fc5b056c9eba7c08e2e6e56deae9679ed6ddc25e4463"} err="failed to get container status \"8b7558c8424929c495c3fc5b056c9eba7c08e2e6e56deae9679ed6ddc25e4463\": rpc error: code = NotFound desc = could not find container \"8b7558c8424929c495c3fc5b056c9eba7c08e2e6e56deae9679ed6ddc25e4463\": container with ID starting with 8b7558c8424929c495c3fc5b056c9eba7c08e2e6e56deae9679ed6ddc25e4463 not found: ID does not exist"
Jul 24 19:32:41.515102 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:32:41.515061    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4vvst\" (UniqueName: \"kubernetes.io/projected/ac395bec-c4ec-4b1c-9078-d4f995574cdc-kube-api-access-4vvst\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 24 19:32:41.515102 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:32:41.515095    2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ac395bec-c4ec-4b1c-9078-d4f995574cdc-istio-token\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 24 19:32:41.515102 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:32:41.515106    2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ac395bec-c4ec-4b1c-9078-d4f995574cdc-istio-envoy\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 24 19:32:41.515368 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:32:41.515114    2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ac395bec-c4ec-4b1c-9078-d4f995574cdc-istio-podinfo\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 24 19:32:41.515368 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:32:41.515151    2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ac395bec-c4ec-4b1c-9078-d4f995574cdc-istio-data\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 24 19:32:41.731743 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:32:41.731707    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-48f4d2-openshift-default-f8748787b-9fqhj"]
Jul 24 19:32:41.735566 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:32:41.735524    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-48f4d2-openshift-default-f8748787b-9fqhj"]
Jul 24 19:32:42.654625 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:32:42.654596    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6559d49d8b-kt7hq_35d74943-4e45-4265-9897-7c9c44077378/copy-manifests/0.log"
Jul 24 19:32:42.661607 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:32:42.661576    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6559d49d8b-kt7hq_35d74943-4e45-4265-9897-7c9c44077378/manager/0.log"
Jul 24 19:32:43.242220 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:32:43.242187    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ac395bec-c4ec-4b1c-9078-d4f995574cdc" path="/var/lib/kubelet/pods/ac395bec-c4ec-4b1c-9078-d4f995574cdc/volumes"
Jul 24 19:32:44.816047 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:32:44.816011    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5674d54b-xj9cr_3263be87-2868-4473-a163-9c01b3afbe5b/authorino/0.log"
Jul 24 19:32:45.155732 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:32:45.155647    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-85f9m_a379bea3-1952-43ac-ae0a-9f9e83070628/kuadrant-console-plugin/0.log"
Jul 24 19:32:45.968869 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:32:45.968844    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-6dmlx_c38843e5-8c70-412b-a4d6-1ca77c080c8c/istio-proxy/0.log"
Jul 24 19:32:46.314896 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:32:46.314797    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7d65fbd68-ll8gb_32039b11-c36a-44ae-8bc0-879886c976ae/kube-auth-proxy/0.log"
Jul 24 19:32:46.431428 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:32:46.431394    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-ltr4p_7aa274dc-a001-42aa-915c-7f71cdb098ed/istio-proxy/1.log"
Jul 24 19:32:47.219652 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:32:47.219615    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-nzp2v_7f951fa9-c1c9-491b-8e88-b653b56a3e63/main/0.log"
Jul 24 19:32:47.450250 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:32:47.450216    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4nkj6_ed3c90aa-0ddf-49c8-bc25-3e24233eab31/main/0.log"
Jul 24 19:32:47.677172 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:32:47.677074    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-57fc66f697-4gwbg_f2a2c9af-f736-4082-bb46-e23666647314/main/0.log"
Jul 24 19:32:52.670157 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:32:52.670101    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-rq44j/must-gather-2ncbv"]
Jul 24 19:32:52.670717 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:32:52.670699    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="933f9fa9-7e18-46b9-b435-7fe567b40d1a" containerName="istio-proxy"
Jul 24 19:32:52.670777 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:32:52.670722    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="933f9fa9-7e18-46b9-b435-7fe567b40d1a" containerName="istio-proxy"
Jul 24 19:32:52.670777 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:32:52.670736    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac395bec-c4ec-4b1c-9078-d4f995574cdc" containerName="istio-proxy"
Jul 24 19:32:52.670777 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:32:52.670744    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac395bec-c4ec-4b1c-9078-d4f995574cdc" containerName="istio-proxy"
Jul 24 19:32:52.670777 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:32:52.670764    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac395bec-c4ec-4b1c-9078-d4f995574cdc" containerName="istio-proxy"
Jul 24 19:32:52.670777 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:32:52.670772    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac395bec-c4ec-4b1c-9078-d4f995574cdc" containerName="istio-proxy"
Jul 24 19:32:52.670960 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:32:52.670784    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a3d1fc7f-7aa3-482c-9a66-fb95ea31e548" containerName="istio-proxy"
Jul 24 19:32:52.670960 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:32:52.670792    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="a3d1fc7f-7aa3-482c-9a66-fb95ea31e548" containerName="istio-proxy"
Jul 24 19:32:52.670960 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:32:52.670801    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="14b10fde-b9d2-4def-a092-ab72d5486f11" containerName="istio-proxy"
Jul 24 19:32:52.670960 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:32:52.670809    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="14b10fde-b9d2-4def-a092-ab72d5486f11" containerName="istio-proxy"
Jul 24 19:32:52.670960 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:32:52.670822    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a3d1fc7f-7aa3-482c-9a66-fb95ea31e548" containerName="istio-proxy"
Jul 24 19:32:52.670960 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:32:52.670830    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="a3d1fc7f-7aa3-482c-9a66-fb95ea31e548" containerName="istio-proxy"
Jul 24 19:32:52.670960 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:32:52.670841    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93adf5d1-e0cc-41ee-868a-6d3df2091829" containerName="main"
Jul 24 19:32:52.670960 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:32:52.670848    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="93adf5d1-e0cc-41ee-868a-6d3df2091829" containerName="main"
Jul 24 19:32:52.670960 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:32:52.670865    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="14b10fde-b9d2-4def-a092-ab72d5486f11" containerName="istio-proxy"
Jul 24 19:32:52.670960 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:32:52.670873    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="14b10fde-b9d2-4def-a092-ab72d5486f11" containerName="istio-proxy"
Jul 24 19:32:52.670960 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:32:52.670950    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="ac395bec-c4ec-4b1c-9078-d4f995574cdc" containerName="istio-proxy"
Jul 24 19:32:52.670960 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:32:52.670960    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="a3d1fc7f-7aa3-482c-9a66-fb95ea31e548" containerName="istio-proxy"
Jul 24 19:32:52.671405 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:32:52.670969    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="933f9fa9-7e18-46b9-b435-7fe567b40d1a" containerName="istio-proxy"
Jul 24 19:32:52.671405 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:32:52.670978    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="14b10fde-b9d2-4def-a092-ab72d5486f11" containerName="istio-proxy"
Jul 24 19:32:52.671405 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:32:52.670987    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="93adf5d1-e0cc-41ee-868a-6d3df2091829" containerName="main"
Jul 24 19:32:52.671405 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:32:52.670998    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="933f9fa9-7e18-46b9-b435-7fe567b40d1a" containerName="istio-proxy"
Jul 24 19:32:52.671405 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:32:52.671082    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="933f9fa9-7e18-46b9-b435-7fe567b40d1a" containerName="istio-proxy"
Jul 24 19:32:52.671405 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:32:52.671090    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="933f9fa9-7e18-46b9-b435-7fe567b40d1a" containerName="istio-proxy"
Jul 24 19:32:52.671405 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:32:52.671194    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="ac395bec-c4ec-4b1c-9078-d4f995574cdc" containerName="istio-proxy"
Jul 24 19:32:52.671405 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:32:52.671204    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="a3d1fc7f-7aa3-482c-9a66-fb95ea31e548" containerName="istio-proxy"
Jul 24 19:32:52.671405 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:32:52.671214    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="14b10fde-b9d2-4def-a092-ab72d5486f11" containerName="istio-proxy"
Jul 24 19:32:52.674380 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:32:52.674361    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-rq44j/must-gather-2ncbv"
Jul 24 19:32:52.676855 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:32:52.676833    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-rq44j\"/\"kube-root-ca.crt\""
Jul 24 19:32:52.677525 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:32:52.677504    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-rq44j\"/\"default-dockercfg-c7tk9\""
Jul 24 19:32:52.677630 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:32:52.677510    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-rq44j\"/\"openshift-service-ca.crt\""
Jul 24 19:32:52.683026 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:32:52.682996    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-rq44j/must-gather-2ncbv"]
Jul 24 19:32:52.684587 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:32:52.684565    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:32:52.780453 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:32:52.780409    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:32:52.826610 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:32:52.826572    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/06f62f73-94e6-4614-8d2b-87408573b146-must-gather-output\") pod \"must-gather-2ncbv\" (UID: \"06f62f73-94e6-4614-8d2b-87408573b146\") " pod="openshift-must-gather-rq44j/must-gather-2ncbv"
Jul 24 19:32:52.826804 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:32:52.826669    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ddc88\" (UniqueName: \"kubernetes.io/projected/06f62f73-94e6-4614-8d2b-87408573b146-kube-api-access-ddc88\") pod \"must-gather-2ncbv\" (UID: \"06f62f73-94e6-4614-8d2b-87408573b146\") " pod="openshift-must-gather-rq44j/must-gather-2ncbv"
Jul 24 19:32:52.928075 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:32:52.927974    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ddc88\" (UniqueName: \"kubernetes.io/projected/06f62f73-94e6-4614-8d2b-87408573b146-kube-api-access-ddc88\") pod \"must-gather-2ncbv\" (UID: \"06f62f73-94e6-4614-8d2b-87408573b146\") " pod="openshift-must-gather-rq44j/must-gather-2ncbv"
Jul 24 19:32:52.928285 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:32:52.928080    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/06f62f73-94e6-4614-8d2b-87408573b146-must-gather-output\") pod \"must-gather-2ncbv\" (UID: \"06f62f73-94e6-4614-8d2b-87408573b146\") " pod="openshift-must-gather-rq44j/must-gather-2ncbv"
Jul 24 19:32:52.928436 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:32:52.928418    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/06f62f73-94e6-4614-8d2b-87408573b146-must-gather-output\") pod \"must-gather-2ncbv\" (UID: \"06f62f73-94e6-4614-8d2b-87408573b146\") " pod="openshift-must-gather-rq44j/must-gather-2ncbv"
Jul 24 19:32:52.937298 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:32:52.937267    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ddc88\" (UniqueName: \"kubernetes.io/projected/06f62f73-94e6-4614-8d2b-87408573b146-kube-api-access-ddc88\") pod \"must-gather-2ncbv\" (UID: \"06f62f73-94e6-4614-8d2b-87408573b146\") " pod="openshift-must-gather-rq44j/must-gather-2ncbv"
Jul 24 19:32:52.984904 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:32:52.984868    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-rq44j/must-gather-2ncbv"
Jul 24 19:32:53.124167 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:32:53.124109    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-rq44j/must-gather-2ncbv"]
Jul 24 19:32:53.126519 ip-10-0-141-146 kubenswrapper[2580]: W0724 19:32:53.126490    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod06f62f73_94e6_4614_8d2b_87408573b146.slice/crio-e9ccf42c447c9bf3508ab30ef30ad3d1d5b27f7973dec5fc350610b57ebc5879 WatchSource:0}: Error finding container e9ccf42c447c9bf3508ab30ef30ad3d1d5b27f7973dec5fc350610b57ebc5879: Status 404 returned error can't find the container with id e9ccf42c447c9bf3508ab30ef30ad3d1d5b27f7973dec5fc350610b57ebc5879
Jul 24 19:32:53.471513 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:32:53.471476    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rq44j/must-gather-2ncbv" event={"ID":"06f62f73-94e6-4614-8d2b-87408573b146","Type":"ContainerStarted","Data":"e9ccf42c447c9bf3508ab30ef30ad3d1d5b27f7973dec5fc350610b57ebc5879"}
Jul 24 19:32:54.480284 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:32:54.479982    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rq44j/must-gather-2ncbv" event={"ID":"06f62f73-94e6-4614-8d2b-87408573b146","Type":"ContainerStarted","Data":"92a24958bb3f1c413e7cb585e76cd5c1a5408ff17e076dcf1966f4bcaec86822"}
Jul 24 19:32:54.480284 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:32:54.480036    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rq44j/must-gather-2ncbv" event={"ID":"06f62f73-94e6-4614-8d2b-87408573b146","Type":"ContainerStarted","Data":"5668a7fdd8b104216e2660ae88d262f0a42cdfcb9fdf419cde014bcfd0090ec9"}
Jul 24 19:32:54.497520 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:32:54.497466    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-rq44j/must-gather-2ncbv" podStartSLOduration=1.664427246 podStartE2EDuration="2.49744865s" totalImagesPullingTime="833.021404ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 19:32:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:32:54.497032729 +0000 UTC m=+2929.706404775" watchObservedRunningTime="2026-07-24 19:32:54.49744865 +0000 UTC m=+2929.706820692"
Jul 24 19:32:55.584659 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:32:55.584629    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-phl62_84828167-a9ed-4515-9976-e266991f89fb/global-pull-secret-syncer/0.log"
Jul 24 19:32:55.643351 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:32:55.643315    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log"
Jul 24 19:32:55.773901 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:32:55.773861    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-141-146.ec2.internal_4d95d964f6f5196d055ec9fd47d5b92d/haproxy/0.log"
Jul 24 19:32:56.733173 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:32:56.733137    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:32:56.792917 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:32:56.792861    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mtg4_f0ecb1aa-4b7d-47cf-896b-45714daec302/konnectivity-agent/0.log" limit=1024
Jul 24 19:33:00.474110 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:33:00.473082    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5674d54b-xj9cr_3263be87-2868-4473-a163-9c01b3afbe5b/authorino/0.log"
Jul 24 19:33:00.580078 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:33:00.580047    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-85f9m_a379bea3-1952-43ac-ae0a-9f9e83070628/kuadrant-console-plugin/0.log"
Jul 24 19:33:02.865992 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:33:02.865962    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-78qd9_9ad26be1-409e-4984-bd03-27cfb042295c/kube-state-metrics/0.log"
Jul 24 19:33:02.908529 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:33:02.908434    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-78qd9_9ad26be1-409e-4984-bd03-27cfb042295c/kube-rbac-proxy-main/0.log"
Jul 24 19:33:02.960055 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:33:02.960028    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-78qd9_9ad26be1-409e-4984-bd03-27cfb042295c/kube-rbac-proxy-self/0.log"
Jul 24 19:33:03.003563 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:33:03.003510    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-75bddf7487-kzzkh_86c3e6d3-79ba-4283-9f3a-8dafa564a1ef/metrics-server/0.log"
Jul 24 19:33:03.046422 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:33:03.046363    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-68b7fc9574-lw567_5342146b-438b-4f6b-a0c1-31a44b1876b3/monitoring-plugin/0.log"
Jul 24 19:33:03.320957 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:33:03.320870    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-dftc9_f25db79a-9718-421d-97f4-bc040556fc3e/node-exporter/0.log"
Jul 24 19:33:03.361145 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:33:03.360990    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-dftc9_f25db79a-9718-421d-97f4-bc040556fc3e/kube-rbac-proxy/0.log"
Jul 24 19:33:03.412596 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:33:03.412320    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-dftc9_f25db79a-9718-421d-97f4-bc040556fc3e/init-textfile/0.log"
Jul 24 19:33:03.457564 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:33:03.457506    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-v7dn9_593fff4b-38a9-42cc-b954-d3293c0155b0/kube-rbac-proxy-main/0.log"
Jul 24 19:33:03.490810 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:33:03.490775    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-v7dn9_593fff4b-38a9-42cc-b954-d3293c0155b0/kube-rbac-proxy-self/0.log"
Jul 24 19:33:03.522912 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:33:03.522851    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-v7dn9_593fff4b-38a9-42cc-b954-d3293c0155b0/openshift-state-metrics/0.log"
Jul 24 19:33:03.571811 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:33:03.571734    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_18a9406a-d22c-4623-a52a-8fa5518572d8/prometheus/0.log"
Jul 24 19:33:03.607572 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:33:03.607481    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_18a9406a-d22c-4623-a52a-8fa5518572d8/config-reloader/0.log"
Jul 24 19:33:03.647311 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:33:03.647242    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_18a9406a-d22c-4623-a52a-8fa5518572d8/thanos-sidecar/0.log"
Jul 24 19:33:03.683257 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:33:03.683229    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_18a9406a-d22c-4623-a52a-8fa5518572d8/kube-rbac-proxy-web/0.log"
Jul 24 19:33:03.737173 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:33:03.737076    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_18a9406a-d22c-4623-a52a-8fa5518572d8/kube-rbac-proxy/0.log"
Jul 24 19:33:03.771692 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:33:03.771668    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_18a9406a-d22c-4623-a52a-8fa5518572d8/kube-rbac-proxy-thanos/0.log"
Jul 24 19:33:03.829685 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:33:03.829658    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_18a9406a-d22c-4623-a52a-8fa5518572d8/init-config-reloader/0.log"
Jul 24 19:33:03.889185 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:33:03.889154    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-84d69f794d-gb6zp_5677e339-73f3-4122-a206-4eb54863b56c/prometheus-operator/0.log"
Jul 24 19:33:03.948910 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:33:03.948878    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-84d69f794d-gb6zp_5677e339-73f3-4122-a206-4eb54863b56c/kube-rbac-proxy/0.log"
Jul 24 19:33:04.057032 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:33:04.056954    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-df6b5d4c4-fqzxv_14efd5e5-3db7-4b0c-9806-f9c4df42225d/telemeter-client/0.log"
Jul 24 19:33:04.085731 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:33:04.085656    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-df6b5d4c4-fqzxv_14efd5e5-3db7-4b0c-9806-f9c4df42225d/reload/0.log"
Jul 24 19:33:04.114547 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:33:04.114510    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-df6b5d4c4-fqzxv_14efd5e5-3db7-4b0c-9806-f9c4df42225d/kube-rbac-proxy/0.log"
Jul 24 19:33:04.161929 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:33:04.161891    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-57f6d765c6-m78cf_4e314077-64e7-4060-8771-8be311d2c8cf/thanos-query/0.log"
Jul 24 19:33:04.210409 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:33:04.210367    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-57f6d765c6-m78cf_4e314077-64e7-4060-8771-8be311d2c8cf/kube-rbac-proxy-web/0.log"
Jul 24 19:33:04.250168 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:33:04.250140    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-57f6d765c6-m78cf_4e314077-64e7-4060-8771-8be311d2c8cf/kube-rbac-proxy/0.log"
Jul 24 19:33:04.293541 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:33:04.293514    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-57f6d765c6-m78cf_4e314077-64e7-4060-8771-8be311d2c8cf/prom-label-proxy/0.log"
Jul 24 19:33:04.326250 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:33:04.326166    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-57f6d765c6-m78cf_4e314077-64e7-4060-8771-8be311d2c8cf/kube-rbac-proxy-rules/0.log"
Jul 24 19:33:04.356022 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:33:04.355987    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-57f6d765c6-m78cf_4e314077-64e7-4060-8771-8be311d2c8cf/kube-rbac-proxy-metrics/0.log"
Jul 24 19:33:06.378272 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:33:06.378232    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-rq44j/perf-node-gather-daemonset-kj5pb"]
Jul 24 19:33:06.386654 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:33:06.386620    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-rq44j/perf-node-gather-daemonset-kj5pb"
Jul 24 19:33:06.390834 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:33:06.390805    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-rq44j/perf-node-gather-daemonset-kj5pb"]
Jul 24 19:33:06.499160 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:33:06.499095    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2f8bf644-8023-4d3f-ac81-9490d860fa07-sys\") pod \"perf-node-gather-daemonset-kj5pb\" (UID: \"2f8bf644-8023-4d3f-ac81-9490d860fa07\") " pod="openshift-must-gather-rq44j/perf-node-gather-daemonset-kj5pb"
Jul 24 19:33:06.499355 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:33:06.499183    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2f8bf644-8023-4d3f-ac81-9490d860fa07-proc\") pod \"perf-node-gather-daemonset-kj5pb\" (UID: \"2f8bf644-8023-4d3f-ac81-9490d860fa07\") " pod="openshift-must-gather-rq44j/perf-node-gather-daemonset-kj5pb"
Jul 24 19:33:06.499355 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:33:06.499260    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2f8bf644-8023-4d3f-ac81-9490d860fa07-lib-modules\") pod \"perf-node-gather-daemonset-kj5pb\" (UID: \"2f8bf644-8023-4d3f-ac81-9490d860fa07\") " pod="openshift-must-gather-rq44j/perf-node-gather-daemonset-kj5pb"
Jul 24 19:33:06.499473 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:33:06.499368    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2f8bf644-8023-4d3f-ac81-9490d860fa07-podres\") pod \"perf-node-gather-daemonset-kj5pb\" (UID: \"2f8bf644-8023-4d3f-ac81-9490d860fa07\") " pod="openshift-must-gather-rq44j/perf-node-gather-daemonset-kj5pb"
Jul 24 19:33:06.499528 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:33:06.499468    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r46w2\" (UniqueName: \"kubernetes.io/projected/2f8bf644-8023-4d3f-ac81-9490d860fa07-kube-api-access-r46w2\") pod \"perf-node-gather-daemonset-kj5pb\" (UID: \"2f8bf644-8023-4d3f-ac81-9490d860fa07\") " pod="openshift-must-gather-rq44j/perf-node-gather-daemonset-kj5pb"
Jul 24 19:33:06.600327 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:33:06.600283    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2f8bf644-8023-4d3f-ac81-9490d860fa07-lib-modules\") pod \"perf-node-gather-daemonset-kj5pb\" (UID: \"2f8bf644-8023-4d3f-ac81-9490d860fa07\") " pod="openshift-must-gather-rq44j/perf-node-gather-daemonset-kj5pb"
Jul 24 19:33:06.600767 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:33:06.600354    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2f8bf644-8023-4d3f-ac81-9490d860fa07-podres\") pod \"perf-node-gather-daemonset-kj5pb\" (UID: \"2f8bf644-8023-4d3f-ac81-9490d860fa07\") " pod="openshift-must-gather-rq44j/perf-node-gather-daemonset-kj5pb"
Jul 24 19:33:06.600767 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:33:06.600415    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r46w2\" (UniqueName: \"kubernetes.io/projected/2f8bf644-8023-4d3f-ac81-9490d860fa07-kube-api-access-r46w2\") pod \"perf-node-gather-daemonset-kj5pb\" (UID: \"2f8bf644-8023-4d3f-ac81-9490d860fa07\") " pod="openshift-must-gather-rq44j/perf-node-gather-daemonset-kj5pb"
Jul 24 19:33:06.600767 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:33:06.600454    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2f8bf644-8023-4d3f-ac81-9490d860fa07-sys\") pod \"perf-node-gather-daemonset-kj5pb\" (UID: \"2f8bf644-8023-4d3f-ac81-9490d860fa07\") " pod="openshift-must-gather-rq44j/perf-node-gather-daemonset-kj5pb"
Jul 24 19:33:06.600767 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:33:06.600477    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2f8bf644-8023-4d3f-ac81-9490d860fa07-proc\") pod \"perf-node-gather-daemonset-kj5pb\" (UID: \"2f8bf644-8023-4d3f-ac81-9490d860fa07\") " pod="openshift-must-gather-rq44j/perf-node-gather-daemonset-kj5pb"
Jul 24 19:33:06.600767 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:33:06.600480    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2f8bf644-8023-4d3f-ac81-9490d860fa07-lib-modules\") pod \"perf-node-gather-daemonset-kj5pb\" (UID: \"2f8bf644-8023-4d3f-ac81-9490d860fa07\") " pod="openshift-must-gather-rq44j/perf-node-gather-daemonset-kj5pb"
Jul 24 19:33:06.600767 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:33:06.600501    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2f8bf644-8023-4d3f-ac81-9490d860fa07-podres\") pod \"perf-node-gather-daemonset-kj5pb\" (UID: \"2f8bf644-8023-4d3f-ac81-9490d860fa07\") " pod="openshift-must-gather-rq44j/perf-node-gather-daemonset-kj5pb"
Jul 24 19:33:06.600767 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:33:06.600541    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2f8bf644-8023-4d3f-ac81-9490d860fa07-sys\") pod \"perf-node-gather-daemonset-kj5pb\" (UID: \"2f8bf644-8023-4d3f-ac81-9490d860fa07\") " pod="openshift-must-gather-rq44j/perf-node-gather-daemonset-kj5pb"
Jul 24 19:33:06.600767 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:33:06.600570    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2f8bf644-8023-4d3f-ac81-9490d860fa07-proc\") pod \"perf-node-gather-daemonset-kj5pb\" (UID: \"2f8bf644-8023-4d3f-ac81-9490d860fa07\") " pod="openshift-must-gather-rq44j/perf-node-gather-daemonset-kj5pb"
Jul 24 19:33:06.609465 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:33:06.609431    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r46w2\" (UniqueName: \"kubernetes.io/projected/2f8bf644-8023-4d3f-ac81-9490d860fa07-kube-api-access-r46w2\") pod \"perf-node-gather-daemonset-kj5pb\" (UID: \"2f8bf644-8023-4d3f-ac81-9490d860fa07\") " pod="openshift-must-gather-rq44j/perf-node-gather-daemonset-kj5pb"
Jul 24 19:33:06.704259 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:33:06.704216    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-rq44j/perf-node-gather-daemonset-kj5pb"
Jul 24 19:33:06.876919 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:33:06.876879    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-rq44j/perf-node-gather-daemonset-kj5pb"]
Jul 24 19:33:06.881389 ip-10-0-141-146 kubenswrapper[2580]: W0724 19:33:06.881351    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod2f8bf644_8023_4d3f_ac81_9490d860fa07.slice/crio-6b8d5c48ba14e62c7e32c26c851e61e5dede07c36f958db1071f7744981e7d64 WatchSource:0}: Error finding container 6b8d5c48ba14e62c7e32c26c851e61e5dede07c36f958db1071f7744981e7d64: Status 404 returned error can't find the container with id 6b8d5c48ba14e62c7e32c26c851e61e5dede07c36f958db1071f7744981e7d64
Jul 24 19:33:07.576392 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:33:07.576348    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rq44j/perf-node-gather-daemonset-kj5pb" event={"ID":"2f8bf644-8023-4d3f-ac81-9490d860fa07","Type":"ContainerStarted","Data":"d94d058b5f65d73e8a27fc4c6a616c1eab276649df1bcadfde729508a87f5e8f"}
Jul 24 19:33:07.576912 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:33:07.576419    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rq44j/perf-node-gather-daemonset-kj5pb" event={"ID":"2f8bf644-8023-4d3f-ac81-9490d860fa07","Type":"ContainerStarted","Data":"6b8d5c48ba14e62c7e32c26c851e61e5dede07c36f958db1071f7744981e7d64"}
Jul 24 19:33:07.576912 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:33:07.576450    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-rq44j/perf-node-gather-daemonset-kj5pb"
Jul 24 19:33:07.594904 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:33:07.594835    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-rq44j/perf-node-gather-daemonset-kj5pb" podStartSLOduration=1.594811323 podStartE2EDuration="1.594811323s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 19:33:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 19:33:07.592655318 +0000 UTC m=+2942.802027364" watchObservedRunningTime="2026-07-24 19:33:07.594811323 +0000 UTC m=+2942.804183366"
Jul 24 19:33:08.659712 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:33:08.659665    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-q7dr8_fc688138-e740-43b8-b546-24938b83af0c/dns/0.log"
Jul 24 19:33:08.685927 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:33:08.685901    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-q7dr8_fc688138-e740-43b8-b546-24938b83af0c/kube-rbac-proxy/0.log"
Jul 24 19:33:08.769961 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:33:08.769933    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-r9l62_359b63b5-ced8-4939-9897-521d32070ec0/dns-node-resolver/0.log"
Jul 24 19:33:09.302713 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:33:09.302686    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-6c848b7cd9-9vxgb_38d8deb1-fcf4-434a-bc3a-d19f6e944f09/registry/0.log"
Jul 24 19:33:09.374096 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:33:09.374066    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-wgt82_8bcaaf05-ea88-48e2-9f47-a6c9b10f4ec3/node-ca/0.log"
Jul 24 19:33:10.321524 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:33:10.321491    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-6dmlx_c38843e5-8c70-412b-a4d6-1ca77c080c8c/istio-proxy/0.log"
Jul 24 19:33:10.635909 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:33:10.635831    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7d65fbd68-ll8gb_32039b11-c36a-44ae-8bc0-879886c976ae/kube-auth-proxy/0.log"
Jul 24 19:33:10.668642 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:33:10.668607    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-ltr4p_7aa274dc-a001-42aa-915c-7f71cdb098ed/istio-proxy/0.log"
Jul 24 19:33:10.701759 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:33:10.701726    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-ltr4p_7aa274dc-a001-42aa-915c-7f71cdb098ed/istio-proxy/1.log"
Jul 24 19:33:11.644406 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:33:11.644377    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-b68cl_5f6614f2-4b6e-49c0-8a97-f3b8934a4080/serve-healthcheck-canary/0.log"
Jul 24 19:33:12.235410 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:33:12.235376    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-dcckq_0afd7f1b-febd-4ba1-aceb-b5cfd32f5ac9/kube-rbac-proxy/0.log"
Jul 24 19:33:12.257971 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:33:12.257939    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-dcckq_0afd7f1b-febd-4ba1-aceb-b5cfd32f5ac9/exporter/0.log"
Jul 24 19:33:12.281882 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:33:12.281857    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-dcckq_0afd7f1b-febd-4ba1-aceb-b5cfd32f5ac9/extractor/0.log"
Jul 24 19:33:13.594283 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:33:13.594252    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-rq44j/perf-node-gather-daemonset-kj5pb"
Jul 24 19:33:15.187643 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:33:15.187594    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6559d49d8b-kt7hq_35d74943-4e45-4265-9897-7c9c44077378/manager/0.log"
Jul 24 19:33:15.212198 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:33:15.212064    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6559d49d8b-kt7hq_35d74943-4e45-4265-9897-7c9c44077378/copy-manifests/0.log"
Jul 24 19:33:16.719087 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:33:16.719053    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-594d74945-6c6dl_01d4642b-4d62-4a18-8887-2d19fbcd020c/manager/0.log"
Jul 24 19:33:17.171495 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:33:17.171434    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-6dmlx_c38843e5-8c70-412b-a4d6-1ca77c080c8c/istio-proxy/0.log"
Jul 24 19:33:17.455857 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:33:17.455821    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7d65fbd68-ll8gb_32039b11-c36a-44ae-8bc0-879886c976ae/kube-auth-proxy/0.log"
Jul 24 19:33:17.476488 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:33:17.476454    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-ltr4p_7aa274dc-a001-42aa-915c-7f71cdb098ed/istio-proxy/0.log"
Jul 24 19:33:17.516492 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:33:17.516449    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-ltr4p_7aa274dc-a001-42aa-915c-7f71cdb098ed/istio-proxy/1.log"
Jul 24 19:33:18.978190 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:33:18.978106    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-6dmlx_c38843e5-8c70-412b-a4d6-1ca77c080c8c/istio-proxy/0.log"
Jul 24 19:33:19.275789 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:33:19.275709    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7d65fbd68-ll8gb_32039b11-c36a-44ae-8bc0-879886c976ae/kube-auth-proxy/0.log"
Jul 24 19:33:19.300779 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:33:19.300739    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-ltr4p_7aa274dc-a001-42aa-915c-7f71cdb098ed/istio-proxy/0.log"
Jul 24 19:33:19.338897 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:33:19.338862    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-ltr4p_7aa274dc-a001-42aa-915c-7f71cdb098ed/istio-proxy/1.log"
Jul 24 19:33:23.599928 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:33:23.599898    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pvjzc_5a4bc620-43ec-46ad-9438-c5265aa52de9/kube-multus-additional-cni-plugins/0.log"
Jul 24 19:33:23.621383 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:33:23.621356    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pvjzc_5a4bc620-43ec-46ad-9438-c5265aa52de9/egress-router-binary-copy/0.log"
Jul 24 19:33:23.642009 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:33:23.641976    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pvjzc_5a4bc620-43ec-46ad-9438-c5265aa52de9/cni-plugins/0.log"
Jul 24 19:33:23.665423 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:33:23.665392    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pvjzc_5a4bc620-43ec-46ad-9438-c5265aa52de9/bond-cni-plugin/0.log"
Jul 24 19:33:23.685816 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:33:23.685791    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pvjzc_5a4bc620-43ec-46ad-9438-c5265aa52de9/routeoverride-cni/0.log"
Jul 24 19:33:23.706983 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:33:23.706953    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pvjzc_5a4bc620-43ec-46ad-9438-c5265aa52de9/whereabouts-cni-bincopy/0.log"
Jul 24 19:33:23.728206 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:33:23.728176    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pvjzc_5a4bc620-43ec-46ad-9438-c5265aa52de9/whereabouts-cni/0.log"
Jul 24 19:33:24.000784 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:33:24.000743    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-mtsh4_a5c64a4d-9068-4079-a7cf-e4f591e50243/kube-multus/0.log"
Jul 24 19:33:24.075250 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:33:24.075212    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-nsc2s_34b58fb0-dbc2-49de-86e2-4bd31bb3250a/network-metrics-daemon/0.log"
Jul 24 19:33:24.095511 ip-10-0-141-146 kubenswrapper[2580]: I0724 19:33:24.095484    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-nsc2s_34b58fb0-dbc2-49de-86e2-4bd31bb3250a/kube-rbac-proxy/0.log"