Jul 17 19:54:11.223207 ip-10-0-141-177 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 17 19:54:11.223219 ip-10-0-141-177 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 17 19:54:11.223225 ip-10-0-141-177 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 17 19:54:11.223515 ip-10-0-141-177 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 17 19:54:21.471596 ip-10-0-141-177 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 17 19:54:21.471619 ip-10-0-141-177 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot f2bc2dde8f9a4eac87dea6ef107e4045 --
Jul 17 19:56:15.048369 ip-10-0-141-177 systemd[1]: Starting Kubernetes Kubelet...
Jul 17 19:56:15.419512 ip-10-0-141-177 kubenswrapper[2572]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 17 19:56:15.419512 ip-10-0-141-177 kubenswrapper[2572]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 17 19:56:15.419512 ip-10-0-141-177 kubenswrapper[2572]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 17 19:56:15.419512 ip-10-0-141-177 kubenswrapper[2572]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 17 19:56:15.419512 ip-10-0-141-177 kubenswrapper[2572]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 17 19:56:15.420447 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.420349    2572 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 17 19:56:15.427235 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.427219    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 17 19:56:15.427235 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.427235    2572 feature_gate.go:328] unrecognized feature gate: Example2
Jul 17 19:56:15.427294 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.427239    2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 17 19:56:15.427294 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.427243    2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 17 19:56:15.427294 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.427247    2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 17 19:56:15.427294 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.427250    2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 17 19:56:15.427294 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.427253    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 17 19:56:15.427294 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.427256    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 17 19:56:15.427294 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.427261    2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 17 19:56:15.427294 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.427265    2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 17 19:56:15.427294 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.427268    2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 17 19:56:15.427294 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.427271    2572 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 17 19:56:15.427294 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.427274    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 17 19:56:15.427294 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.427276    2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 17 19:56:15.427294 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.427279    2572 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 17 19:56:15.427294 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.427282    2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 17 19:56:15.427294 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.427284    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 17 19:56:15.427294 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.427287    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 17 19:56:15.427294 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.427289    2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 17 19:56:15.427294 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.427292    2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 17 19:56:15.427294 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.427295    2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 17 19:56:15.427294 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.427298    2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 17 19:56:15.427764 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.427300    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 17 19:56:15.427764 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.427303    2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 17 19:56:15.427764 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.427306    2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 17 19:56:15.427764 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.427310    2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 17 19:56:15.427764 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.427314    2572 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 17 19:56:15.427764 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.427317    2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 17 19:56:15.427764 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.427320    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 17 19:56:15.427764 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.427326    2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 17 19:56:15.427764 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.427329    2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 17 19:56:15.427764 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.427331    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 17 19:56:15.427764 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.427334    2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 17 19:56:15.427764 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.427337    2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 17 19:56:15.427764 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.427340    2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 17 19:56:15.427764 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.427343    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 17 19:56:15.427764 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.427345    2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 17 19:56:15.427764 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.427348    2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 17 19:56:15.427764 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.427350    2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 17 19:56:15.427764 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.427353    2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 17 19:56:15.427764 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.427356    2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 17 19:56:15.428248 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.427358    2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 17 19:56:15.428248 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.427361    2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 17 19:56:15.428248 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.427363    2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 17 19:56:15.428248 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.427365    2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 17 19:56:15.428248 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.427368    2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 17 19:56:15.428248 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.427372    2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 17 19:56:15.428248 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.427375    2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 17 19:56:15.428248 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.427378    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 17 19:56:15.428248 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.427381    2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 17 19:56:15.428248 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.427384    2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 17 19:56:15.428248 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.427386    2572 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 17 19:56:15.428248 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.427390    2572 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 17 19:56:15.428248 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.427393    2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 17 19:56:15.428248 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.427396    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 17 19:56:15.428248 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.427400    2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 17 19:56:15.428248 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.427403    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 17 19:56:15.428248 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.427406    2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 17 19:56:15.428248 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.427409    2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 17 19:56:15.428248 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.427412    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 17 19:56:15.428706 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.427414    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 17 19:56:15.428706 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.427418    2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 17 19:56:15.428706 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.427420    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 17 19:56:15.428706 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.427423    2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 17 19:56:15.428706 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.427426    2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 17 19:56:15.428706 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.427429    2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 17 19:56:15.428706 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.427431    2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 17 19:56:15.428706 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.427434    2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 17 19:56:15.428706 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.427437    2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 17 19:56:15.428706 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.427439    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 17 19:56:15.428706 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.427442    2572 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 17 19:56:15.428706 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.427444    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 17 19:56:15.428706 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.427447    2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 17 19:56:15.428706 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.427451    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 17 19:56:15.428706 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.427453    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 17 19:56:15.428706 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.427456    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 17 19:56:15.428706 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.427459    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 17 19:56:15.428706 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.427461    2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 17 19:56:15.428706 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.427464    2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 17 19:56:15.428706 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.427467    2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 17 19:56:15.429180 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.427469    2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 17 19:56:15.429180 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.427472    2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 17 19:56:15.429180 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.427475    2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 17 19:56:15.429180 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.427478    2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 17 19:56:15.429180 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.427481    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 17 19:56:15.429180 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.427483    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 17 19:56:15.429180 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.427486    2572 feature_gate.go:328] unrecognized feature gate: Example
Jul 17 19:56:15.429180 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.427489    2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 17 19:56:15.429180 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.427492    2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 17 19:56:15.429180 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.427495    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 17 19:56:15.429180 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.427498    2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 17 19:56:15.429180 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.427500    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 17 19:56:15.429180 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.427503    2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 17 19:56:15.429180 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.427505    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 17 19:56:15.429180 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.427508    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 17 19:56:15.429180 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.427510    2572 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 17 19:56:15.429180 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.427513    2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 17 19:56:15.429180 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.427516    2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 17 19:56:15.429180 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.427518    2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 17 19:56:15.429180 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.428272    2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 17 19:56:15.429639 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.428280    2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 17 19:56:15.429639 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.428283    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 17 19:56:15.429639 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.428286    2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 17 19:56:15.429639 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.428289    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 17 19:56:15.429639 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.428292    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 17 19:56:15.429639 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.428294    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 17 19:56:15.429639 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.428297    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 17 19:56:15.429639 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.428299    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 17 19:56:15.429639 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.428302    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 17 19:56:15.429639 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.428305    2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 17 19:56:15.429639 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.428308    2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 17 19:56:15.429639 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.428311    2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 17 19:56:15.429639 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.428313    2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 17 19:56:15.429639 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.428316    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 17 19:56:15.429639 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.428319    2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 17 19:56:15.429639 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.428322    2572 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 17 19:56:15.429639 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.428324    2572 feature_gate.go:328] unrecognized feature gate: Example2
Jul 17 19:56:15.429639 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.428327    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 17 19:56:15.429639 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.428330    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 17 19:56:15.429639 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.428332    2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 17 19:56:15.430135 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.428335    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 17 19:56:15.430135 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.428338    2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 17 19:56:15.430135 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.428340    2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 17 19:56:15.430135 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.428343    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 17 19:56:15.430135 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.428345    2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 17 19:56:15.430135 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.428348    2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 17 19:56:15.430135 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.428350    2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 17 19:56:15.430135 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.428353    2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 17 19:56:15.430135 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.428355    2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 17 19:56:15.430135 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.428358    2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 17 19:56:15.430135 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.428361    2572 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 17 19:56:15.430135 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.428364    2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 17 19:56:15.430135 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.428366    2572 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 17 19:56:15.430135 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.428369    2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 17 19:56:15.430135 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.428371    2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 17 19:56:15.430135 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.428374    2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 17 19:56:15.430135 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.428376    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 17 19:56:15.430135 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.428379    2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 17 19:56:15.430135 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.428381    2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 17 19:56:15.430135 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.428384    2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 17 19:56:15.430620 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.428388    2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 17 19:56:15.430620 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.428399    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 17 19:56:15.430620 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.428405    2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 17 19:56:15.430620 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.428409    2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 17 19:56:15.430620 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.428412    2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 17 19:56:15.430620 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.428415    2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 17 19:56:15.430620 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.428419    2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 17 19:56:15.430620 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.428421    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 17 19:56:15.430620 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.428424    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 17 19:56:15.430620 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.428427    2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 17 19:56:15.430620 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.428430    2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 17 19:56:15.430620 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.428433    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 17 19:56:15.430620 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.428436    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 17 19:56:15.430620 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.428439    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 17 19:56:15.430620 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.428442    2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 17 19:56:15.430620 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.428446    2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 17 19:56:15.430620 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.428449    2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 17 19:56:15.430620 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.428452    2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 17 19:56:15.430620 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.428455    2572 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 17 19:56:15.431085 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.428458    2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 17 19:56:15.431085 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.428460    2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 17 19:56:15.431085 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.428463    2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 17 19:56:15.431085 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.428465    2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 17 19:56:15.431085 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.428468    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 17 19:56:15.431085 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.428470    2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 17 19:56:15.431085 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.428473    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 17 19:56:15.431085 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.428476    2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 17 19:56:15.431085 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.428478    2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 17 19:56:15.431085 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.428480    2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 17 19:56:15.431085 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.428483    2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 17 19:56:15.431085 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.428487    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 17 19:56:15.431085 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.428489    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 17 19:56:15.431085 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.428492    2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 17 19:56:15.431085 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.428495    2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 17 19:56:15.431085 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.428497    2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 17 19:56:15.431085 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.428500    2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 17 19:56:15.431085 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.428503    2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 17 19:56:15.431085 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.428505    2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 17 19:56:15.431542 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.428508    2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 17 19:56:15.431542 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.428512    2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 17 19:56:15.431542 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.428514    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 17 19:56:15.431542 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.428517    2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 17 19:56:15.431542 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.428520    2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 17 19:56:15.431542 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.428522    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 17 19:56:15.431542 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.428525    2572 feature_gate.go:328] unrecognized feature gate: Example
Jul 17 19:56:15.431542 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.428527    2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 17 19:56:15.431542 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.428530    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 17 19:56:15.431542 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.428532    2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 17 19:56:15.431542 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.428535    2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 17 19:56:15.431542 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.428537    2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 17 19:56:15.431542 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.428539    2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 17 19:56:15.431542 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.428542    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 17 19:56:15.431542 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.428544    2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 17 19:56:15.431542 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.428546    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 17 19:56:15.431542 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.428549    2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 17 19:56:15.431542 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.428551    2572 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 17 19:56:15.431542 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.428554    2572 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 17 19:56:15.431542 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.428556    2572 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 17 19:56:15.432030 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.428949    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 17 19:56:15.432030 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.428954    2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 17 19:56:15.432030 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.428958    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 17 19:56:15.432030 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.428961    2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 17 19:56:15.432030 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.428964    2572 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 17 19:56:15.432030 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.428966    2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 17 19:56:15.432030 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.428970    2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 17 19:56:15.432030 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.428973    2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 17 19:56:15.432030 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.428976    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 17 19:56:15.432030 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.428979    2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 17 19:56:15.432030 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.428982    2572 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 17 19:56:15.432030 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.428985    2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 17 19:56:15.432030 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.428988    2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 17 19:56:15.432030 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.428991    2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 17 19:56:15.432030 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.428994    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 17 19:56:15.432030 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.428997    2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 17 19:56:15.432030 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.429000    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 17 19:56:15.432030 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.429003    2572 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 17 19:56:15.432030 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.429006    2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 17 19:56:15.432504 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.429009    2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 17 19:56:15.432504 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.429011    2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 17 19:56:15.432504 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.429014    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 17 19:56:15.432504 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.429016    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 17 19:56:15.432504 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.429019    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 17 19:56:15.432504 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.429021    2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 17 19:56:15.432504 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.429024    2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 17 19:56:15.432504 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.429027    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 17 19:56:15.432504 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.429029    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 17 19:56:15.432504 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.429032    2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 17 19:56:15.432504 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.429034    2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 17 19:56:15.432504 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.429037    2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 17 19:56:15.432504 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.429040    2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 17 19:56:15.432504 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.429042    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 17 19:56:15.432504 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.429045    2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 17 19:56:15.432504 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.429047    2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 17 19:56:15.432504 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.429049    2572 feature_gate.go:328] unrecognized feature gate: Example2
Jul 17 19:56:15.432504 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.429052    2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 17 19:56:15.432504 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.429055    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 17 19:56:15.432504 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.429058    2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 17 19:56:15.433006 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.429061    2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 17 19:56:15.433006 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.429081    2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 17 19:56:15.433006 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.429084    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 17 19:56:15.433006 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.429087    2572 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 17 19:56:15.433006 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.429089    2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 17 19:56:15.433006 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.429092    2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 17 19:56:15.433006 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.429095    2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 17 19:56:15.433006 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.429098    2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 17 19:56:15.433006 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.429101    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 17 19:56:15.433006 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.429104    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 17 19:56:15.433006 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.429107    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 17 19:56:15.433006 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.429109    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 17 19:56:15.433006 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.429112    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 17 19:56:15.433006 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.429114    2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 17 19:56:15.433006 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.429117    2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 17 19:56:15.433006 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.429120    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 17 19:56:15.433006 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.429122    2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 17 19:56:15.433006 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.429126    2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 17 19:56:15.433006 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.429130    2572 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 17 19:56:15.433006 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.429133    2572 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 17 19:56:15.433489 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.429137    2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 17 19:56:15.433489 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.429140    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 17 19:56:15.433489 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.429144    2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 17 19:56:15.433489 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.429147    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 17 19:56:15.433489 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.429149    2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 17 19:56:15.433489 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.429152    2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 17 19:56:15.433489 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.429155    2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 17 19:56:15.433489 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.429157    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 17 19:56:15.433489 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.429160    2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 17 19:56:15.433489 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.429162    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 17 19:56:15.433489 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.429165    2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 17 19:56:15.433489 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.429167    2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 17 19:56:15.433489 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.429170    2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 17 19:56:15.433489 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.429173    2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 17 19:56:15.433489 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.429177    2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 17 19:56:15.433489 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.429181    2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 17 19:56:15.433489 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.429184    2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 17 19:56:15.433489 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.429187    2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 17 19:56:15.433489 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.429189    2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 17 19:56:15.433489 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.429192    2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 17 19:56:15.433961 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.429195    2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 17 19:56:15.433961 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.429198    2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 17 19:56:15.433961 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.429201    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 17 19:56:15.433961 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.429203    2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 17 19:56:15.433961 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.429206    2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 17 19:56:15.433961 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.429209    2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 17 19:56:15.433961 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.429211    2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 17 19:56:15.433961 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.429213    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 17 19:56:15.433961 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.429216    2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 17 19:56:15.433961 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.429218    2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 17 19:56:15.433961 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.429221    2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 17 19:56:15.433961 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.429223    2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 17 19:56:15.433961 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.429226    2572 feature_gate.go:328] unrecognized feature gate: Example
Jul 17 19:56:15.433961 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.429228    2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 17 19:56:15.433961 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.429230    2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 17 19:56:15.433961 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.429233    2572 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 17 19:56:15.433961 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.429235    2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 17 19:56:15.433961 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.429238    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 17 19:56:15.433961 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.429240    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 17 19:56:15.433961 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.429243    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 17 19:56:15.434473 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.429306    2572 flags.go:64] FLAG: --address="0.0.0.0"
Jul 17 19:56:15.434473 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.429312    2572 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 17 19:56:15.434473 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.429318    2572 flags.go:64] FLAG: --anonymous-auth="true"
Jul 17 19:56:15.434473 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.429322    2572 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 17 19:56:15.434473 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.429326    2572 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 17 19:56:15.434473 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.429330    2572 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 17 19:56:15.434473 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.429334    2572 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 17 19:56:15.434473 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.429338    2572 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 17 19:56:15.434473 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.429343    2572 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 17 19:56:15.434473 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.429345    2572 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 17 19:56:15.434473 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.429349    2572 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 17 19:56:15.434473 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.429352    2572 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 17 19:56:15.434473 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.429355    2572 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 17 19:56:15.434473 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.429359    2572 flags.go:64] FLAG: --cgroup-root=""
Jul 17 19:56:15.434473 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.429362    2572 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 17 19:56:15.434473 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.429365    2572 flags.go:64] FLAG: --client-ca-file=""
Jul 17 19:56:15.434473 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.429368    2572 flags.go:64] FLAG: --cloud-provider="external"
Jul 17 19:56:15.434473 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.429371    2572 flags.go:64] FLAG: --cluster-dns="[]"
Jul 17 19:56:15.434473 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.429375    2572 flags.go:64] FLAG: --cluster-domain=""
Jul 17 19:56:15.434473 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.429378    2572 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 17 19:56:15.434473 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.429381    2572 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 17 19:56:15.434473 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.429386    2572 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 17 19:56:15.434473 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.429390    2572 flags.go:64] FLAG: --container-log-max-files="5"
Jul 17 19:56:15.434473 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.429393    2572 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 17 19:56:15.435035 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.429396    2572 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 17 19:56:15.435035 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.429399    2572 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 17 19:56:15.435035 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.429403    2572 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 17 19:56:15.435035 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.429406    2572 flags.go:64] FLAG: --contention-profiling="false"
Jul 17 19:56:15.435035 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.429409    2572 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 17 19:56:15.435035 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.429412    2572 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 17 19:56:15.435035 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.429415    2572 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 17 19:56:15.435035 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.429417    2572 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 17 19:56:15.435035 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.429421    2572 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 17 19:56:15.435035 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.429424    2572 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 17 19:56:15.435035 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.429427    2572 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 17 19:56:15.435035 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.429430    2572 flags.go:64] FLAG: --enable-load-reader="false"
Jul 17 19:56:15.435035 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.429433    2572 flags.go:64] FLAG: --enable-server="true"
Jul 17 19:56:15.435035 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.429436    2572 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 17 19:56:15.435035 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.429440    2572 flags.go:64] FLAG: --event-burst="100"
Jul 17 19:56:15.435035 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.429443    2572 flags.go:64] FLAG: --event-qps="50"
Jul 17 19:56:15.435035 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.429446    2572 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 17 19:56:15.435035 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.429449    2572 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 17 19:56:15.435035 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.429452    2572 flags.go:64] FLAG: --eviction-hard=""
Jul 17 19:56:15.435035 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.429455    2572 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 17 19:56:15.435035 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.429459    2572 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 17 19:56:15.435035 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.429463    2572 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 17 19:56:15.435035 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.429466    2572 flags.go:64] FLAG: --eviction-soft=""
Jul 17 19:56:15.435035 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.429469    2572 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 17 19:56:15.435035 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.429472    2572 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 17 19:56:15.435754 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.429475    2572 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 17 19:56:15.435754 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.429478    2572 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 17 19:56:15.435754 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.429480    2572 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 17 19:56:15.435754 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.429484    2572 flags.go:64] FLAG: --fail-swap-on="true"
Jul 17 19:56:15.435754 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.429488    2572 flags.go:64] FLAG: --feature-gates=""
Jul 17 19:56:15.435754 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.429491    2572 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 17 19:56:15.435754 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.429494    2572 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 17 19:56:15.435754 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.429497    2572 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 17 19:56:15.435754 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.429500    2572 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 17 19:56:15.435754 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.429503    2572 flags.go:64] FLAG: --healthz-port="10248"
Jul 17 19:56:15.435754 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.429506    2572 flags.go:64] FLAG: --help="false"
Jul 17 19:56:15.435754 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.429509    2572 flags.go:64] FLAG: --hostname-override="ip-10-0-141-177.ec2.internal"
Jul 17 19:56:15.435754 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.429512    2572 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 17 19:56:15.435754 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.429515    2572 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 17 19:56:15.435754 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.429518    2572 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 17 19:56:15.435754 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.429521    2572 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 17 19:56:15.435754 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.429525    2572 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 17 19:56:15.435754 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.429527    2572 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 17 19:56:15.435754 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.429530    2572 flags.go:64] FLAG: --image-service-endpoint=""
Jul 17 19:56:15.435754 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.429533    2572 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 17 19:56:15.435754 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.429536    2572 flags.go:64] FLAG: --kube-api-burst="100"
Jul 17 19:56:15.435754 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.429538    2572 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 17 19:56:15.435754 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.429541    2572 flags.go:64] FLAG: --kube-api-qps="50"
Jul 17 19:56:15.435754 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.429544    2572 flags.go:64] FLAG: --kube-reserved=""
Jul 17 19:56:15.436359 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.429547    2572 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 17 19:56:15.436359 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.429549    2572 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 17 19:56:15.436359 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.429552    2572 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 17 19:56:15.436359 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.429555    2572 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 17 19:56:15.436359 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.429559    2572 flags.go:64] FLAG: --lock-file=""
Jul 17 19:56:15.436359 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.429562    2572 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 17 19:56:15.436359 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.429565    2572 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 17 19:56:15.436359 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.429568    2572 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 17 19:56:15.436359 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.429573    2572 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 17 19:56:15.436359 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.429576    2572 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 17 19:56:15.436359 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.429579    2572 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 17 19:56:15.436359 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.429582    2572 flags.go:64] FLAG: --logging-format="text"
Jul 17 19:56:15.436359 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.429586    2572 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 17 19:56:15.436359 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.429589    2572 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 17 19:56:15.436359 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.429592    2572 flags.go:64] FLAG: --manifest-url=""
Jul 17 19:56:15.436359 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.429594    2572 flags.go:64] FLAG: --manifest-url-header=""
Jul 17 19:56:15.436359 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.429604    2572 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 17 19:56:15.436359 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.429607    2572 flags.go:64] FLAG: --max-open-files="1000000"
Jul 17 19:56:15.436359 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.429611    2572 flags.go:64] FLAG: --max-pods="110"
Jul 17 19:56:15.436359 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.429613    2572 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 17 19:56:15.436359 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.429616    2572 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 17 19:56:15.436359 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.429620    2572 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 17 19:56:15.436359 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.429622    2572 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 17 19:56:15.436359 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.429625    2572 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 17 19:56:15.436359 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.429628    2572 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 17 19:56:15.436970 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.429631    2572 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 17 19:56:15.436970 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.429638    2572 flags.go:64] FLAG: --node-status-max-images="50"
Jul 17 19:56:15.436970 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.429641    2572 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 17 19:56:15.436970 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.429644    2572 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 17 19:56:15.436970 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.429647    2572 flags.go:64] FLAG: --pod-cidr=""
Jul 17 19:56:15.436970 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.429650    2572 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0"
Jul 17 19:56:15.436970 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.429656    2572 flags.go:64] FLAG: --pod-manifest-path=""
Jul 17 19:56:15.436970 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.429658    2572 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 17 19:56:15.436970 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.429661    2572 flags.go:64] FLAG: --pods-per-core="0"
Jul 17 19:56:15.436970 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.429664    2572 flags.go:64] FLAG: --port="10250"
Jul 17 19:56:15.436970 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.429667    2572 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 17 19:56:15.436970 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.429670    2572 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-065d479cfcb02a379"
Jul 17 19:56:15.436970 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.429675    2572 flags.go:64] FLAG: --qos-reserved=""
Jul 17 19:56:15.436970 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.429678    2572 flags.go:64] FLAG: --read-only-port="10255"
Jul 17 19:56:15.436970 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.429682    2572 flags.go:64] FLAG: --register-node="true"
Jul 17 19:56:15.436970 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.429685    2572 flags.go:64] FLAG: --register-with-taints=""
Jul 17 19:56:15.436970 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.429688    2572 flags.go:64] FLAG: --registry-burst="10"
Jul 17 19:56:15.436970 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.429691    2572 flags.go:64] FLAG: --registry-qps="5"
Jul 17 19:56:15.436970 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.429694    2572 flags.go:64] FLAG: --reserved-cpus=""
Jul 17 19:56:15.436970 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.429698    2572 flags.go:64] FLAG: --reserved-memory=""
Jul 17 19:56:15.436970 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.429701    2572 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 17 19:56:15.436970 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.429704    2572 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 17 19:56:15.436970 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.429707    2572 flags.go:64] FLAG: --rotate-certificates="false"
Jul 17 19:56:15.436970 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.429710    2572 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 17 19:56:15.436970 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.429713    2572 flags.go:64] FLAG: --runonce="false"
Jul 17 19:56:15.437590 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.429716    2572 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 17 19:56:15.437590 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.429718    2572 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 17 19:56:15.437590 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.429721    2572 flags.go:64] FLAG: --seccomp-default="false"
Jul 17 19:56:15.437590 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.429724    2572 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 17 19:56:15.437590 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.429727    2572 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 17 19:56:15.437590 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.429730    2572 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 17 19:56:15.437590 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.429733    2572 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 17 19:56:15.437590 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.429736    2572 flags.go:64] FLAG: --storage-driver-password="root"
Jul 17 19:56:15.437590 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.429739    2572 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 17 19:56:15.437590 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.429742    2572 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 17 19:56:15.437590 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.429744    2572 flags.go:64] FLAG: --storage-driver-user="root"
Jul 17 19:56:15.437590 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.429747    2572 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 17 19:56:15.437590 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.429750    2572 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 17 19:56:15.437590 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.429753    2572 flags.go:64] FLAG: --system-cgroups=""
Jul 17 19:56:15.437590 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.429756    2572 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 17 19:56:15.437590 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.429761    2572 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 17 19:56:15.437590 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.429763    2572 flags.go:64] FLAG: --tls-cert-file=""
Jul 17 19:56:15.437590 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.429767    2572 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 17 19:56:15.437590 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.429771    2572 flags.go:64] FLAG: --tls-min-version=""
Jul 17 19:56:15.437590 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.429775    2572 flags.go:64] FLAG: --tls-private-key-file=""
Jul 17 19:56:15.437590 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.429778    2572 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 17 19:56:15.437590 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.429781    2572 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 17 19:56:15.437590 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.429784    2572 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 17 19:56:15.437590 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.429787    2572 flags.go:64] FLAG: --v="2"
Jul 17 19:56:15.437590 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.429791    2572 flags.go:64] FLAG: --version="false"
Jul 17 19:56:15.438250 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.429795    2572 flags.go:64] FLAG: --vmodule=""
Jul 17 19:56:15.438250 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.429799    2572 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 17 19:56:15.438250 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.429803    2572 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 17 19:56:15.438250 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.429916    2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 17 19:56:15.438250 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.429919    2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 17 19:56:15.438250 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.429924    2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 17 19:56:15.438250 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.429928    2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 17 19:56:15.438250 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.429931    2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 17 19:56:15.438250 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.429934    2572 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 17 19:56:15.438250 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.429937    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 17 19:56:15.438250 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.429940    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 17 19:56:15.438250 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.429943    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 17 19:56:15.438250 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.429946    2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 17 19:56:15.438250 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.429949    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 17 19:56:15.438250 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.429952    2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 17 19:56:15.438250 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.429954    2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 17 19:56:15.438250 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.429957    2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 17 19:56:15.438250 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.429960    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 17 19:56:15.438250 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.429962    2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 17 19:56:15.438709 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.429965    2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 17 19:56:15.438709 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.429968    2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 17 19:56:15.438709 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.429970    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 17 19:56:15.438709 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.429973    2572 feature_gate.go:328] unrecognized feature gate: Example
Jul 17 19:56:15.438709 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.429976    2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 17 19:56:15.438709 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.429979    2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 17 19:56:15.438709 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.429981    2572 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 17 19:56:15.438709 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.429985    2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 17 19:56:15.438709 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.429987    2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 17 19:56:15.438709 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.429990    2572 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 17 19:56:15.438709 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.429993    2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 17 19:56:15.438709 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.429996    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 17 19:56:15.438709 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.429998    2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 17 19:56:15.438709 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.430001    2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 17 19:56:15.438709 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.430005    2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 17 19:56:15.438709 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.430007    2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 17 19:56:15.438709 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.430010    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 17 19:56:15.438709 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.430012    2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 17 19:56:15.438709 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.430015    2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 17 19:56:15.438709 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.430018    2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 17 19:56:15.439206 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.430020    2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 17 19:56:15.439206 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.430023    2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 17 19:56:15.439206 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.430025    2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 17 19:56:15.439206 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.430028    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 17 19:56:15.439206 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.430031    2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 17 19:56:15.439206 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.430034    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 17 19:56:15.439206 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.430036    2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 17 19:56:15.439206 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.430039    2572 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 17 19:56:15.439206 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.430041    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 17 19:56:15.439206 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.430044    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 17 19:56:15.439206 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.430047    2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 17 19:56:15.439206 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.430051    2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 17 19:56:15.439206 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.430054    2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 17 19:56:15.439206 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.430056    2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 17 19:56:15.439206 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.430059    2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 17 19:56:15.439206 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.430061    2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 17 19:56:15.439206 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.430077    2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 17 19:56:15.439206 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.430080    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 17 19:56:15.439206 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.430083    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 17 19:56:15.439663 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.430087    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 17 19:56:15.439663 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.430089    2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 17 19:56:15.439663 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.430092    2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 17 19:56:15.439663 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.430095    2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 17 19:56:15.439663 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.430097    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 17 19:56:15.439663 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.430100    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 17 19:56:15.439663 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.430103    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 17 19:56:15.439663 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.430106    2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 17 19:56:15.439663 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.430109    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 17 19:56:15.439663 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.430112    2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 17 19:56:15.439663 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.430114    2572 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 17 19:56:15.439663 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.430118    2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 17 19:56:15.439663 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.430121    2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 17 19:56:15.439663 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.430124    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 17 19:56:15.439663 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.430127    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 17 19:56:15.439663 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.430129    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 17 19:56:15.439663 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.430132    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 17 19:56:15.439663 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.430135    2572 feature_gate.go:328] unrecognized feature gate: Example2
Jul 17 19:56:15.439663 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.430137    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 17 19:56:15.439663 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.430140    2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 17 19:56:15.440153 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.430143    2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 17 19:56:15.440153 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.430145    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 17 19:56:15.440153 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.430148    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 17 19:56:15.440153 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.430151    2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 17 19:56:15.440153 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.430153    2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 17 19:56:15.440153 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.430156    2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 17 19:56:15.440153 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.430158    2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 17 19:56:15.440153 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.430161    2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 17 19:56:15.440153 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.430163    2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 17 19:56:15.440153 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.430166    2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 17 19:56:15.440153 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.430169    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 17 19:56:15.440153 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.430171    2572 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 17 19:56:15.440153 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.430175    2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 17 19:56:15.440153 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.430177    2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 17 19:56:15.440153 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.430180    2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 17 19:56:15.440153 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.430183    2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 17 19:56:15.440153 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.430185    2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 17 19:56:15.440153 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.430188    2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 17 19:56:15.440153 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.430191    2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 17 19:56:15.440153 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.430195    2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 17 19:56:15.440626 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.430197    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 17 19:56:15.440626 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.430200    2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 17 19:56:15.440626 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.430203    2572 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 17 19:56:15.440626 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.430205    2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 17 19:56:15.440626 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.430211    2572 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 17 19:56:15.440626 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.436979    2572 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 17 19:56:15.440626 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.436995    2572 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 17 19:56:15.440626 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.437014    2572 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 17 19:56:15.440626 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.437020    2572 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 17 19:56:15.440626 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.437091    2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 17 19:56:15.440626 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.437097    2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 17 19:56:15.440626 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.437101    2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 17 19:56:15.440626 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.437104    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 17 19:56:15.440626 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.437107    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 17 19:56:15.440626 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.437109    2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 17 19:56:15.440992 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.437112    2572 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 17 19:56:15.440992 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.437115    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 17 19:56:15.440992 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.437117    2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 17 19:56:15.440992 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.437120    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 17 19:56:15.440992 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.437124    2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 17 19:56:15.440992 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.437127    2572 feature_gate.go:328] unrecognized feature gate: Example2
Jul 17 19:56:15.440992 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.437130    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 17 19:56:15.440992 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.437132    2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 17 19:56:15.440992 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.437135    2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 17 19:56:15.440992 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.437137    2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 17 19:56:15.440992 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.437140    2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 17 19:56:15.440992 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.437143    2572 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 17 19:56:15.440992 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.437146    2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 17 19:56:15.440992 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.437148    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 17 19:56:15.440992 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.437151    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 17 19:56:15.440992 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.437154    2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 17 19:56:15.440992 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.437157    2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 17 19:56:15.440992 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.437159    2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 17 19:56:15.440992 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.437162    2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 17 19:56:15.440992 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.437164    2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 17 19:56:15.441476 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.437167    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 17 19:56:15.441476 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.437169    2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 17 19:56:15.441476 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.437172    2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 17 19:56:15.441476 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.437175    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 17 19:56:15.441476 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.437179    2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 17 19:56:15.441476 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.437182    2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 17 19:56:15.441476 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.437187    2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 17 19:56:15.441476 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.437190    2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 17 19:56:15.441476 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.437192    2572 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 17 19:56:15.441476 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.437195    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 17 19:56:15.441476 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.437198    2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 17 19:56:15.441476 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.437201    2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 17 19:56:15.441476 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.437203    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 17 19:56:15.441476 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.437206    2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 17 19:56:15.441476 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.437209    2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 17 19:56:15.441476 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.437211    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 17 19:56:15.441476 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.437214    2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 17 19:56:15.441476 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.437216    2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 17 19:56:15.441476 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.437219    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 17 19:56:15.441932 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.437221    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 17 19:56:15.441932 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.437224    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 17 19:56:15.441932 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.437226    2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 17 19:56:15.441932 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.437229    2572 feature_gate.go:328] unrecognized feature gate: Example
Jul 17 19:56:15.441932 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.437231    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 17 19:56:15.441932 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.437234    2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 17 19:56:15.441932 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.437236    2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 17 19:56:15.441932 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.437239    2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 17 19:56:15.441932 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.437242    2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 17 19:56:15.441932 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.437245    2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 17 19:56:15.441932 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.437248    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 17 19:56:15.441932 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.437251    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 17 19:56:15.441932 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.437253    2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 17 19:56:15.441932 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.437256    2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 17 19:56:15.441932 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.437258    2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 17 19:56:15.441932 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.437261    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 17 19:56:15.441932 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.437264    2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 17 19:56:15.441932 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.437267    2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 17 19:56:15.441932 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.437269    2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 17 19:56:15.441932 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.437272    2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 17 19:56:15.442408 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.437274    2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 17 19:56:15.442408 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.437277    2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 17 19:56:15.442408 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.437279    2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 17 19:56:15.442408 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.437282    2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 17 19:56:15.442408 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.437285    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 17 19:56:15.442408 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.437287    2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 17 19:56:15.442408 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.437289    2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 17 19:56:15.442408 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.437292    2572 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 17 19:56:15.442408 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.437294    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 17 19:56:15.442408 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.437297    2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 17 19:56:15.442408 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.437300    2572 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 17 19:56:15.442408 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.437302    2572 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 17 19:56:15.442408 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.437305    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 17 19:56:15.442408 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.437307    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 17 19:56:15.442408 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.437310    2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 17 19:56:15.442408 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.437313    2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 17 19:56:15.442408 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.437317    2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 17 19:56:15.442408 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.437321    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 17 19:56:15.442408 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.437323    2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 17 19:56:15.443578 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.437326    2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 17 19:56:15.443578 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.437329    2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 17 19:56:15.443578 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.437331    2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 17 19:56:15.443578 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.437334    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 17 19:56:15.443578 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.437337    2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 17 19:56:15.443578 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.437341    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 17 19:56:15.443578 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.437344    2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 17 19:56:15.443578 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.437346    2572 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 17 19:56:15.443578 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.437349    2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 17 19:56:15.443578 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.437352    2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 17 19:56:15.443578 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.437355    2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 17 19:56:15.443578 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.437358    2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 17 19:56:15.443578 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.437360    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 17 19:56:15.443578 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.437363    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 17 19:56:15.443578 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.437365    2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 17 19:56:15.443942 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.437370    2572 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 17 19:56:15.443942 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.437477    2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 17 19:56:15.443942 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.437482    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 17 19:56:15.443942 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.437485    2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 17 19:56:15.443942 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.437487    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 17 19:56:15.443942 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.437490    2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 17 19:56:15.443942 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.437493    2572 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 17 19:56:15.443942 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.437495    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 17 19:56:15.443942 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.437498    2572 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 17 19:56:15.443942 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.437500    2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 17 19:56:15.443942 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.437503    2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 17 19:56:15.443942 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.437505    2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 17 19:56:15.443942 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.437508    2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 17 19:56:15.443942 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.437510    2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 17 19:56:15.443942 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.437513    2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 17 19:56:15.444323 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.437515    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 17 19:56:15.444323 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.437517    2572 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 17 19:56:15.444323 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.437520    2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 17 19:56:15.444323 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.437523    2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 17 19:56:15.444323 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.437525    2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 17 19:56:15.444323 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.437527    2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 17 19:56:15.444323 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.437530    2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 17 19:56:15.444323 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.437533    2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 17 19:56:15.444323 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.437536    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 17 19:56:15.444323 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.437538    2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 17 19:56:15.444323 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.437541    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 17 19:56:15.444323 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.437544    2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 17 19:56:15.444323 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.437546    2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 17 19:56:15.444323 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.437549    2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 17 19:56:15.444323 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.437551    2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 17 19:56:15.444323 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.437554    2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 17 19:56:15.444323 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.437556    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 17 19:56:15.444323 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.437559    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 17 19:56:15.444323 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.437561    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 17 19:56:15.444323 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.437564    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 17 19:56:15.444826 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.437567    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 17 19:56:15.444826 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.437569    2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 17 19:56:15.444826 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.437572    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 17 19:56:15.444826 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.437574    2572 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 17 19:56:15.444826 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.437577    2572 feature_gate.go:328] unrecognized feature gate: Example2
Jul 17 19:56:15.444826 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.437579    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 17 19:56:15.444826 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.437583    2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 17 19:56:15.444826 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.437586    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 17 19:56:15.444826 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.437588    2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 17 19:56:15.444826 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.437591    2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 17 19:56:15.444826 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.437594    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 17 19:56:15.444826 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.437597    2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 17 19:56:15.444826 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.437599    2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 17 19:56:15.444826 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.437602    2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 17 19:56:15.444826 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.437606    2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 17 19:56:15.444826 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.437609    2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 17 19:56:15.444826 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.437612    2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 17 19:56:15.444826 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.437615    2572 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 17 19:56:15.444826 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.437618    2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 17 19:56:15.444826 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.437621    2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 17 19:56:15.445344 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.437623    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 17 19:56:15.445344 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.437626    2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 17 19:56:15.445344 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.437628    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 17 19:56:15.445344 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.437631    2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 17 19:56:15.445344 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.437634    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 17 19:56:15.445344 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.437636    2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 17 19:56:15.445344 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.437638    2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 17 19:56:15.445344 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.437641    2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 17 19:56:15.445344 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.437643    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 17 19:56:15.445344 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.437646    2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 17 19:56:15.445344 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.437648    2572 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 17 19:56:15.445344 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.437652    2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 17 19:56:15.445344 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.437655    2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 17 19:56:15.445344 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.437658    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 17 19:56:15.445344 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.437661    2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 17 19:56:15.445344 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.437664    2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 17 19:56:15.445344 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.437666    2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 17 19:56:15.445344 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.437669    2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 17 19:56:15.445344 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.437672    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 17 19:56:15.446217 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.437675    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 17 19:56:15.446217 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.437678    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 17 19:56:15.446217 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.437680    2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 17 19:56:15.446217 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.437682    2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 17 19:56:15.446217 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.437685    2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 17 19:56:15.446217 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.437688    2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 17 19:56:15.446217 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.437690    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 17 19:56:15.446217 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.437693    2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 17 19:56:15.446217 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.437695    2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 17 19:56:15.446217 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.437697    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 17 19:56:15.446217 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.437700    2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 17 19:56:15.446217 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.437702    2572 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 17 19:56:15.446217 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.437705    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 17 19:56:15.446217 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.437708    2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 17 19:56:15.446217 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.437710    2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 17 19:56:15.446217 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.437713    2572 feature_gate.go:328] unrecognized feature gate: Example
Jul 17 19:56:15.446217 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.437718    2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 17 19:56:15.446217 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.437720    2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 17 19:56:15.446217 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.437723    2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 17 19:56:15.446217 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.437725    2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 17 19:56:15.446886 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.437728    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 17 19:56:15.446886 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.437730    2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 17 19:56:15.446886 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.437733    2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 17 19:56:15.446886 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.437735    2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 17 19:56:15.446886 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.437738    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 17 19:56:15.446886 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:15.437740    2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 17 19:56:15.446886 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.437746    2572 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 17 19:56:15.446886 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.437841    2572 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 17 19:56:15.446886 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.440650    2572 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 17 19:56:15.446886 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.442117    2572 server.go:1019] "Starting client certificate rotation"
Jul 17 19:56:15.446886 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.442231    2572 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 17 19:56:15.446886 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.442267    2572 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 17 19:56:15.446886 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.444563    2572 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 17 19:56:15.449492 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.449474    2572 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 17 19:56:15.460714 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.460697    2572 log.go:25] "Validated CRI v1 runtime API"
Jul 17 19:56:15.463000 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.462986    2572 log.go:25] "Validated CRI v1 image API"
Jul 17 19:56:15.464360 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.464346    2572 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 17 19:56:15.469009 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.468990    2572 fs.go:135] Filesystem UUIDs: map[0a43b31b-648c-43d5-997d-4df7e87ae45e:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 982d15b3-c0bb-43aa-b267-f7205e05c235:/dev/nvme0n1p4]
Jul 17 19:56:15.469092 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.469007    2572 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 17 19:56:15.473494 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.473474    2572 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 17 19:56:15.474276 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.474170    2572 manager.go:216] Machine: {Timestamp:2026-07-17 19:56:15.472896785 +0000 UTC m=+0.314392413 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3093602 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2ffc5721226f9f5c53b4ae70a55a5a SystemUUID:ec2ffc57-2122-6f9f-5c53-b4ae70a55a5a BootID:f2bc2dde-8f9a-4eac-87de-a6ef107e4045 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:54:38:dc:03:cd Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:54:38:dc:03:cd Speed:0 Mtu:9001} {Name:ovs-system MacAddress:0e:e1:00:8e:10:4d Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 17 19:56:15.474276 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.474274    2572 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 17 19:56:15.474385 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.474349    2572 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 17 19:56:15.477216 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.477188    2572 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 17 19:56:15.477345 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.477218    2572 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-141-177.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 17 19:56:15.478019 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.478009    2572 topology_manager.go:138] "Creating topology manager with none policy"
Jul 17 19:56:15.478050 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.478021    2572 container_manager_linux.go:309] "Creating device plugin manager"
Jul 17 19:56:15.478050 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.478028    2572 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 17 19:56:15.478675 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.478664    2572 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 17 19:56:15.480460 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.480450    2572 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 17 19:56:15.483878 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.483867    2572 state_mem.go:36] "Initialized new in-memory state store"
Jul 17 19:56:15.484001 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.483992    2572 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 17 19:56:15.484030 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.484024    2572 kubelet.go:486] "Attempting to sync node with API server"
Jul 17 19:56:15.484060 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.484036    2572 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 17 19:56:15.484060 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.484048    2572 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 17 19:56:15.484060 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.484057    2572 kubelet.go:398] "Adding apiserver pod source"
Jul 17 19:56:15.484200 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.484077    2572 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 17 19:56:15.484516 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.484505    2572 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 17 19:56:15.484581 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.484522    2572 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 17 19:56:15.487088 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.487048    2572 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 17 19:56:15.490500 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.490459    2572 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 17 19:56:15.490579 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.490526    2572 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 17 19:56:15.492183 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.492162    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 17 19:56:15.492262 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.492188    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 17 19:56:15.492262 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.492197    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 17 19:56:15.492262 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.492206    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 17 19:56:15.492262 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.492218    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 17 19:56:15.492262 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.492227    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 17 19:56:15.492262 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.492239    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 17 19:56:15.492262 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.492247    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 17 19:56:15.492262 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.492258    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 17 19:56:15.492474 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.492267    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 17 19:56:15.492474 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.492279    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 17 19:56:15.492474 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.492288    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 17 19:56:15.493095 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.493082    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 17 19:56:15.493126 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.493097    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 17 19:56:15.496483 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.496467    2572 server.go:1268] "Started kubelet"
Jul 17 19:56:15.496576 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.496536    2572 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 17 19:56:15.496694 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.496645    2572 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 17 19:56:15.496751 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.496718    2572 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 17 19:56:15.496812 ip-10-0-141-177 kubenswrapper[2572]: E0717 19:56:15.496789    2572 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-141-177.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 17 19:56:15.496867 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.496815    2572 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-141-177.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 17 19:56:15.496867 ip-10-0-141-177 kubenswrapper[2572]: E0717 19:56:15.496839    2572 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 17 19:56:15.497320 ip-10-0-141-177 systemd[1]: Started Kubernetes Kubelet.
Jul 17 19:56:15.498628 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.498613    2572 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 17 19:56:15.498743 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.498731    2572 server.go:310] "Adding debug handlers to kubelet server"
Jul 17 19:56:15.501424 ip-10-0-141-177 kubenswrapper[2572]: E0717 19:56:15.500545    2572 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-177.ec2.internal.18c32bed48bd0dff  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-177.ec2.internal,UID:ip-10-0-141-177.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-141-177.ec2.internal,},FirstTimestamp:2026-07-17 19:56:15.496441343 +0000 UTC m=+0.337936970,LastTimestamp:2026-07-17 19:56:15.496441343 +0000 UTC m=+0.337936970,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-177.ec2.internal,}"
Jul 17 19:56:15.503205 ip-10-0-141-177 kubenswrapper[2572]: E0717 19:56:15.503183    2572 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 17 19:56:15.506582 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.506568    2572 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 17 19:56:15.506656 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.506584    2572 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 17 19:56:15.506709 ip-10-0-141-177 kubenswrapper[2572]: E0717 19:56:15.506654    2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-177.ec2.internal\" not found"
Jul 17 19:56:15.507349 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.507299    2572 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 17 19:56:15.507349 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.507320    2572 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 17 19:56:15.507465 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.507299    2572 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 17 19:56:15.507465 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.507433    2572 reconstruct.go:97] "Volume reconstruction finished"
Jul 17 19:56:15.507465 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.507440    2572 reconciler.go:29] "Reconciler: start to sync state"
Jul 17 19:56:15.507799 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.507782    2572 factory.go:55] Registering systemd factory
Jul 17 19:56:15.507864 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.507810    2572 factory.go:223] Registration of the systemd container factory successfully
Jul 17 19:56:15.507928 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.507867    2572 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-6k9qx"
Jul 17 19:56:15.508105 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.508087    2572 factory.go:153] Registering CRI-O factory
Jul 17 19:56:15.508105 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.508103    2572 factory.go:223] Registration of the crio container factory successfully
Jul 17 19:56:15.508294 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.508141    2572 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 17 19:56:15.508294 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.508158    2572 factory.go:103] Registering Raw factory
Jul 17 19:56:15.508294 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.508169    2572 manager.go:1196] Started watching for new ooms in manager
Jul 17 19:56:15.509232 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.509216    2572 manager.go:349] Starting recovery of all containers
Jul 17 19:56:15.517488 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.517460    2572 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-6k9qx"
Jul 17 19:56:15.519568 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.519546    2572 manager.go:354] Recovery completed
Jul 17 19:56:15.521197 ip-10-0-141-177 kubenswrapper[2572]: E0717 19:56:15.521167    2572 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-141-177.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 17 19:56:15.521287 ip-10-0-141-177 kubenswrapper[2572]: E0717 19:56:15.521192    2572 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 17 19:56:15.524542 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.524529    2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 17 19:56:15.526338 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.526321    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-177.ec2.internal" event="NodeHasSufficientMemory"
Jul 17 19:56:15.526419 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.526349    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-177.ec2.internal" event="NodeHasNoDiskPressure"
Jul 17 19:56:15.526419 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.526359    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-177.ec2.internal" event="NodeHasSufficientPID"
Jul 17 19:56:15.526840 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.526819    2572 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 17 19:56:15.526840 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.526836    2572 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 17 19:56:15.526968 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.526839    2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 17 19:56:15.526968 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.526850    2572 state_mem.go:36] "Initialized new in-memory state store"
Jul 17 19:56:15.527529 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.527512    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-177.ec2.internal" event="NodeHasSufficientMemory"
Jul 17 19:56:15.527595 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.527545    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-177.ec2.internal" event="NodeHasNoDiskPressure"
Jul 17 19:56:15.527595 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.527558    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-177.ec2.internal" event="NodeHasSufficientPID"
Jul 17 19:56:15.527937 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.527924    2572 policy_none.go:49] "None policy: Start"
Jul 17 19:56:15.527981 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.527940    2572 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 17 19:56:15.527981 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.527953    2572 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 17 19:56:15.529115 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.529102    2572 policy_none.go:47] "Start"
Jul 17 19:56:15.563632 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.563615    2572 manager.go:337] "Starting Device Plugin manager"
Jul 17 19:56:15.563698 ip-10-0-141-177 kubenswrapper[2572]: E0717 19:56:15.563650    2572 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 17 19:56:15.563698 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.563661    2572 server.go:87] "Starting device plugin registration server"
Jul 17 19:56:15.563916 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.563905    2572 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 17 19:56:15.564094 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.563918    2572 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 17 19:56:15.564530 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.564161    2572 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 17 19:56:15.564530 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.564240    2572 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 17 19:56:15.564530 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.564250    2572 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 17 19:56:15.564703 ip-10-0-141-177 kubenswrapper[2572]: E0717 19:56:15.564611    2572 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 17 19:56:15.564703 ip-10-0-141-177 kubenswrapper[2572]: E0717 19:56:15.564660    2572 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-141-177.ec2.internal\" not found"
Jul 17 19:56:15.664236 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.664198    2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 17 19:56:15.665314 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.665136    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-177.ec2.internal" event="NodeHasSufficientMemory"
Jul 17 19:56:15.665314 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.665165    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-177.ec2.internal" event="NodeHasNoDiskPressure"
Jul 17 19:56:15.665314 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.665177    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-177.ec2.internal" event="NodeHasSufficientPID"
Jul 17 19:56:15.665314 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.665211    2572 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-141-177.ec2.internal"
Jul 17 19:56:15.674174 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.674091    2572 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-141-177.ec2.internal"
Jul 17 19:56:15.674174 ip-10-0-141-177 kubenswrapper[2572]: E0717 19:56:15.674118    2572 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-141-177.ec2.internal\": node \"ip-10-0-141-177.ec2.internal\" not found"
Jul 17 19:56:15.679456 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.679434    2572 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 17 19:56:15.680707 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.680688    2572 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 17 19:56:15.680783 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.680722    2572 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 17 19:56:15.680783 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.680741    2572 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 17 19:56:15.680783 ip-10-0-141-177 kubenswrapper[2572]: E0717 19:56:15.680778    2572 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 17 19:56:15.684576 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.684552    2572 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 17 19:56:15.686100 ip-10-0-141-177 kubenswrapper[2572]: E0717 19:56:15.686084    2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-177.ec2.internal\" not found"
Jul 17 19:56:15.781950 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.781888    2572 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-177.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-141-177.ec2.internal"]
Jul 17 19:56:15.782183 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.781993    2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 17 19:56:15.783229 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.783207    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-177.ec2.internal" event="NodeHasSufficientMemory"
Jul 17 19:56:15.783312 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.783247    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-177.ec2.internal" event="NodeHasNoDiskPressure"
Jul 17 19:56:15.783312 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.783258    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-177.ec2.internal" event="NodeHasSufficientPID"
Jul 17 19:56:15.784640 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.784627    2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 17 19:56:15.784780 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.784763    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-177.ec2.internal"
Jul 17 19:56:15.784818 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.784797    2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 17 19:56:15.785398 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.785380    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-177.ec2.internal" event="NodeHasSufficientMemory"
Jul 17 19:56:15.785455 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.785416    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-177.ec2.internal" event="NodeHasNoDiskPressure"
Jul 17 19:56:15.785455 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.785428    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-177.ec2.internal" event="NodeHasSufficientPID"
Jul 17 19:56:15.785519 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.785383    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-177.ec2.internal" event="NodeHasSufficientMemory"
Jul 17 19:56:15.785519 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.785495    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-177.ec2.internal" event="NodeHasNoDiskPressure"
Jul 17 19:56:15.785519 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.785505    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-177.ec2.internal" event="NodeHasSufficientPID"
Jul 17 19:56:15.786276 ip-10-0-141-177 kubenswrapper[2572]: E0717 19:56:15.786258    2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-177.ec2.internal\" not found"
Jul 17 19:56:15.786592 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.786565    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-177.ec2.internal"
Jul 17 19:56:15.786592 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.786590    2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 17 19:56:15.787302 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.787286    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-177.ec2.internal" event="NodeHasSufficientMemory"
Jul 17 19:56:15.787402 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.787314    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-177.ec2.internal" event="NodeHasNoDiskPressure"
Jul 17 19:56:15.787402 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.787325    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-177.ec2.internal" event="NodeHasSufficientPID"
Jul 17 19:56:15.809920 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.809895    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ff50bf0be7446e74adae658e6620efba-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-177.ec2.internal\" (UID: \"ff50bf0be7446e74adae658e6620efba\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-177.ec2.internal"
Jul 17 19:56:15.810007 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.809922    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ff50bf0be7446e74adae658e6620efba-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-177.ec2.internal\" (UID: \"ff50bf0be7446e74adae658e6620efba\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-177.ec2.internal"
Jul 17 19:56:15.810007 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.809940    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5d0ab5ce403b2c7eaf614aea64cc85b0-config\") pod \"kube-apiserver-proxy-ip-10-0-141-177.ec2.internal\" (UID: \"5d0ab5ce403b2c7eaf614aea64cc85b0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-177.ec2.internal"
Jul 17 19:56:15.811857 ip-10-0-141-177 kubenswrapper[2572]: E0717 19:56:15.811840    2572 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-177.ec2.internal\" not found" node="ip-10-0-141-177.ec2.internal"
Jul 17 19:56:15.816672 ip-10-0-141-177 kubenswrapper[2572]: E0717 19:56:15.816653    2572 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-177.ec2.internal\" not found" node="ip-10-0-141-177.ec2.internal"
Jul 17 19:56:15.886572 ip-10-0-141-177 kubenswrapper[2572]: E0717 19:56:15.886540    2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-177.ec2.internal\" not found"
Jul 17 19:56:15.910532 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.910514    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ff50bf0be7446e74adae658e6620efba-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-177.ec2.internal\" (UID: \"ff50bf0be7446e74adae658e6620efba\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-177.ec2.internal"
Jul 17 19:56:15.910625 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.910550    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ff50bf0be7446e74adae658e6620efba-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-177.ec2.internal\" (UID: \"ff50bf0be7446e74adae658e6620efba\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-177.ec2.internal"
Jul 17 19:56:15.910625 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.910568    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5d0ab5ce403b2c7eaf614aea64cc85b0-config\") pod \"kube-apiserver-proxy-ip-10-0-141-177.ec2.internal\" (UID: \"5d0ab5ce403b2c7eaf614aea64cc85b0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-177.ec2.internal"
Jul 17 19:56:15.910625 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.910595    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5d0ab5ce403b2c7eaf614aea64cc85b0-config\") pod \"kube-apiserver-proxy-ip-10-0-141-177.ec2.internal\" (UID: \"5d0ab5ce403b2c7eaf614aea64cc85b0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-177.ec2.internal"
Jul 17 19:56:15.910731 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.910621    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ff50bf0be7446e74adae658e6620efba-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-177.ec2.internal\" (UID: \"ff50bf0be7446e74adae658e6620efba\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-177.ec2.internal"
Jul 17 19:56:15.910731 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:15.910637    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ff50bf0be7446e74adae658e6620efba-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-177.ec2.internal\" (UID: \"ff50bf0be7446e74adae658e6620efba\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-177.ec2.internal"
Jul 17 19:56:15.987604 ip-10-0-141-177 kubenswrapper[2572]: E0717 19:56:15.987530    2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-177.ec2.internal\" not found"
Jul 17 19:56:16.089945 ip-10-0-141-177 kubenswrapper[2572]: E0717 19:56:16.089896    2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-177.ec2.internal\" not found"
Jul 17 19:56:16.116381 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.116357    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-177.ec2.internal"
Jul 17 19:56:16.120930 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.120723    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-177.ec2.internal"
Jul 17 19:56:16.190112 ip-10-0-141-177 kubenswrapper[2572]: E0717 19:56:16.190050    2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-177.ec2.internal\" not found"
Jul 17 19:56:16.296613 ip-10-0-141-177 kubenswrapper[2572]: E0717 19:56:16.296528    2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-177.ec2.internal\" not found"
Jul 17 19:56:16.351433 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.351401    2572 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 17 19:56:16.382043 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.382022    2572 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 17 19:56:16.407662 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.407627    2572 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-177.ec2.internal"
Jul 17 19:56:16.427159 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.427139    2572 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 17 19:56:16.428948 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.428933    2572 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-177.ec2.internal"
Jul 17 19:56:16.441437 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.441413    2572 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 17 19:56:16.441592 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.441569    2572 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 17 19:56:16.441592 ip-10-0-141-177 kubenswrapper[2572]: E0717 19:56:16.441573    2572 kubelet.go:3250] "Failed creating a mirror pod" err="Post \"https://acff40dcd9d5f4bca86860bacb44ba33-2c0d2d0832d429e0.elb.us-east-1.amazonaws.com:6443/api/v1/namespaces/openshift-machine-config-operator/pods\": read tcp 10.0.141.177:51804->100.61.65.56:6443: use of closed network connection" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-177.ec2.internal"
Jul 17 19:56:16.441683 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.441581    2572 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 17 19:56:16.441683 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.441581    2572 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 17 19:56:16.484674 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.484641    2572 apiserver.go:52] "Watching apiserver"
Jul 17 19:56:16.503255 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.503229    2572 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 17 19:56:16.503689 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.503669    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-177.ec2.internal","openshift-multus/multus-l7dr9","openshift-network-diagnostics/network-check-target-8gt8j","openshift-network-operator/iptables-alerter-crcsx","openshift-ovn-kubernetes/ovnkube-node-9glht","kube-system/global-pull-secret-syncer-nl98s","kube-system/konnectivity-agent-p8crz","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9lg9l","openshift-cluster-node-tuning-operator/tuned-rvz8c","openshift-dns/node-resolver-n5s75","openshift-image-registry/node-ca-ds9vw","openshift-multus/multus-additional-cni-plugins-vgxht","openshift-multus/network-metrics-daemon-wdqgw","kube-system/kube-apiserver-proxy-ip-10-0-141-177.ec2.internal"]
Jul 17 19:56:16.505033 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.505009    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-l7dr9"
Jul 17 19:56:16.508016 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.506877    2572 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 17 19:56:16.508016 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.507761    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8gt8j"
Jul 17 19:56:16.508016 ip-10-0-141-177 kubenswrapper[2572]: E0717 19:56:16.507909    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8gt8j" podUID="fbd19d68-8a8e-4110-a4fb-aac8086fc8cf"
Jul 17 19:56:16.508411 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.508388    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 17 19:56:16.508859 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.508837    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-ms2s8\""
Jul 17 19:56:16.508941 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.508869    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-crcsx"
Jul 17 19:56:16.509009 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.508957    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 17 19:56:16.509373 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.509345    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 17 19:56:16.509373 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.509359    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 17 19:56:16.510327 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.510311    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-9glht"
Jul 17 19:56:16.511489 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.511472    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nl98s"
Jul 17 19:56:16.511565 ip-10-0-141-177 kubenswrapper[2572]: E0717 19:56:16.511527    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nl98s" podUID="ad6bcb27-6b22-4d90-9c1a-065a78a17392"
Jul 17 19:56:16.512772 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.512755    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-p8crz"
Jul 17 19:56:16.513393 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.513370    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a53f7848-40a2-47e5-ada6-9f59ebcb300b-os-release\") pod \"multus-l7dr9\" (UID: \"a53f7848-40a2-47e5-ada6-9f59ebcb300b\") " pod="openshift-multus/multus-l7dr9"
Jul 17 19:56:16.513511 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.513399    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a53f7848-40a2-47e5-ada6-9f59ebcb300b-multus-conf-dir\") pod \"multus-l7dr9\" (UID: \"a53f7848-40a2-47e5-ada6-9f59ebcb300b\") " pod="openshift-multus/multus-l7dr9"
Jul 17 19:56:16.513511 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.513425    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a53f7848-40a2-47e5-ada6-9f59ebcb300b-host-run-multus-certs\") pod \"multus-l7dr9\" (UID: \"a53f7848-40a2-47e5-ada6-9f59ebcb300b\") " pod="openshift-multus/multus-l7dr9"
Jul 17 19:56:16.513511 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.513447    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a53f7848-40a2-47e5-ada6-9f59ebcb300b-etc-kubernetes\") pod \"multus-l7dr9\" (UID: \"a53f7848-40a2-47e5-ada6-9f59ebcb300b\") " pod="openshift-multus/multus-l7dr9"
Jul 17 19:56:16.513511 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.513463    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8gk8q\" (UniqueName: \"kubernetes.io/projected/a53f7848-40a2-47e5-ada6-9f59ebcb300b-kube-api-access-8gk8q\") pod \"multus-l7dr9\" (UID: \"a53f7848-40a2-47e5-ada6-9f59ebcb300b\") " pod="openshift-multus/multus-l7dr9"
Jul 17 19:56:16.513511 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.513481    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pqrl9\" (UniqueName: \"kubernetes.io/projected/fbd19d68-8a8e-4110-a4fb-aac8086fc8cf-kube-api-access-pqrl9\") pod \"network-check-target-8gt8j\" (UID: \"fbd19d68-8a8e-4110-a4fb-aac8086fc8cf\") " pod="openshift-network-diagnostics/network-check-target-8gt8j"
Jul 17 19:56:16.513812 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.513527    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1a02e531-1de5-45bf-89f8-3d00a7f37aa4-host-slash\") pod \"iptables-alerter-crcsx\" (UID: \"1a02e531-1de5-45bf-89f8-3d00a7f37aa4\") " pod="openshift-network-operator/iptables-alerter-crcsx"
Jul 17 19:56:16.513812 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.513561    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a53f7848-40a2-47e5-ada6-9f59ebcb300b-host-var-lib-cni-bin\") pod \"multus-l7dr9\" (UID: \"a53f7848-40a2-47e5-ada6-9f59ebcb300b\") " pod="openshift-multus/multus-l7dr9"
Jul 17 19:56:16.513812 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.513591    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a53f7848-40a2-47e5-ada6-9f59ebcb300b-system-cni-dir\") pod \"multus-l7dr9\" (UID: \"a53f7848-40a2-47e5-ada6-9f59ebcb300b\") " pod="openshift-multus/multus-l7dr9"
Jul 17 19:56:16.513812 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.513650    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a53f7848-40a2-47e5-ada6-9f59ebcb300b-host-run-netns\") pod \"multus-l7dr9\" (UID: \"a53f7848-40a2-47e5-ada6-9f59ebcb300b\") " pod="openshift-multus/multus-l7dr9"
Jul 17 19:56:16.513812 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.513678    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1a02e531-1de5-45bf-89f8-3d00a7f37aa4-iptables-alerter-script\") pod \"iptables-alerter-crcsx\" (UID: \"1a02e531-1de5-45bf-89f8-3d00a7f37aa4\") " pod="openshift-network-operator/iptables-alerter-crcsx"
Jul 17 19:56:16.513812 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.513707    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-srczv\" (UniqueName: \"kubernetes.io/projected/1a02e531-1de5-45bf-89f8-3d00a7f37aa4-kube-api-access-srczv\") pod \"iptables-alerter-crcsx\" (UID: \"1a02e531-1de5-45bf-89f8-3d00a7f37aa4\") " pod="openshift-network-operator/iptables-alerter-crcsx"
Jul 17 19:56:16.513812 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.513731    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a53f7848-40a2-47e5-ada6-9f59ebcb300b-cni-binary-copy\") pod \"multus-l7dr9\" (UID: \"a53f7848-40a2-47e5-ada6-9f59ebcb300b\") " pod="openshift-multus/multus-l7dr9"
Jul 17 19:56:16.513812 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.513755    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a53f7848-40a2-47e5-ada6-9f59ebcb300b-multus-daemon-config\") pod \"multus-l7dr9\" (UID: \"a53f7848-40a2-47e5-ada6-9f59ebcb300b\") " pod="openshift-multus/multus-l7dr9"
Jul 17 19:56:16.513812 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.513781    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a53f7848-40a2-47e5-ada6-9f59ebcb300b-host-var-lib-cni-multus\") pod \"multus-l7dr9\" (UID: \"a53f7848-40a2-47e5-ada6-9f59ebcb300b\") " pod="openshift-multus/multus-l7dr9"
Jul 17 19:56:16.514368 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.513817    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a53f7848-40a2-47e5-ada6-9f59ebcb300b-host-var-lib-kubelet\") pod \"multus-l7dr9\" (UID: \"a53f7848-40a2-47e5-ada6-9f59ebcb300b\") " pod="openshift-multus/multus-l7dr9"
Jul 17 19:56:16.514368 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.513863    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a53f7848-40a2-47e5-ada6-9f59ebcb300b-multus-cni-dir\") pod \"multus-l7dr9\" (UID: \"a53f7848-40a2-47e5-ada6-9f59ebcb300b\") " pod="openshift-multus/multus-l7dr9"
Jul 17 19:56:16.514368 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.513900    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a53f7848-40a2-47e5-ada6-9f59ebcb300b-cnibin\") pod \"multus-l7dr9\" (UID: \"a53f7848-40a2-47e5-ada6-9f59ebcb300b\") " pod="openshift-multus/multus-l7dr9"
Jul 17 19:56:16.514368 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.513925    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a53f7848-40a2-47e5-ada6-9f59ebcb300b-multus-socket-dir-parent\") pod \"multus-l7dr9\" (UID: \"a53f7848-40a2-47e5-ada6-9f59ebcb300b\") " pod="openshift-multus/multus-l7dr9"
Jul 17 19:56:16.514368 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.514008    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a53f7848-40a2-47e5-ada6-9f59ebcb300b-host-run-k8s-cni-cncf-io\") pod \"multus-l7dr9\" (UID: \"a53f7848-40a2-47e5-ada6-9f59ebcb300b\") " pod="openshift-multus/multus-l7dr9"
Jul 17 19:56:16.514368 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.514042    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a53f7848-40a2-47e5-ada6-9f59ebcb300b-hostroot\") pod \"multus-l7dr9\" (UID: \"a53f7848-40a2-47e5-ada6-9f59ebcb300b\") " pod="openshift-multus/multus-l7dr9"
Jul 17 19:56:16.514368 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.514142    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9lg9l"
Jul 17 19:56:16.515136 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.515116    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 17 19:56:16.515293 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.515238    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 17 19:56:16.515378 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.515306    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 17 19:56:16.515378 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.515328    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 17 19:56:16.515517 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.515463    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-rvz8c"
Jul 17 19:56:16.515582 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.515559    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 17 19:56:16.516836 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.516813    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-n5s75"
Jul 17 19:56:16.517265 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.517248    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 17 19:56:16.517387 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.517277    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 17 19:56:16.517443 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.517390    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-qqzn4\""
Jul 17 19:56:16.517498 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.517472    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 17 19:56:16.517498 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.517485    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 17 19:56:16.518248 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.518227    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-ds9vw"
Jul 17 19:56:16.519685 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.519666    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-vgxht"
Jul 17 19:56:16.520330 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.520313    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-pd9f4\""
Jul 17 19:56:16.521003 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.520987    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wdqgw"
Jul 17 19:56:16.521056 ip-10-0-141-177 kubenswrapper[2572]: E0717 19:56:16.521041    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wdqgw" podUID="c6e298d5-0e70-47eb-8f91-788894463bc3"
Jul 17 19:56:16.522987 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.522954    2572 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-16 19:51:16 +0000 UTC" deadline="2028-02-12 02:09:03.70162707 +0000 UTC"
Jul 17 19:56:16.523035 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.522987    2572 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13782h12m47.178642284s"
Jul 17 19:56:16.534783 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.534742    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 17 19:56:16.534783 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.534762    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 17 19:56:16.534783 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.534748    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 17 19:56:16.535063 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.534899    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 17 19:56:16.535063 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.534914    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 17 19:56:16.535215 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.535191    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 17 19:56:16.535299 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.535281    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 17 19:56:16.535368 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.535327    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 17 19:56:16.535368 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.535348    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 17 19:56:16.535495 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.535349    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 17 19:56:16.535622 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.535585    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-m2dmj\""
Jul 17 19:56:16.535699 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.535656    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 17 19:56:16.535699 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.535673    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 17 19:56:16.535815 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.535700    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 17 19:56:16.535815 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.535736    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 17 19:56:16.536288 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.536260    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-ntsh6\""
Jul 17 19:56:16.536384 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.536304    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-pw6p2\""
Jul 17 19:56:16.536446 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.536384    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-rmdcj\""
Jul 17 19:56:16.536508 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.536496    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-6hggz\""
Jul 17 19:56:16.536856 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.536838    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-lfk7w\""
Jul 17 19:56:16.537042 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.537024    2572 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 17 19:56:16.543017 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.542992    2572 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 17 19:56:16.580736 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.580715    2572 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-5rp8n"
Jul 17 19:56:16.592230 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.592206    2572 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-5rp8n"
Jul 17 19:56:16.609082 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.609062    2572 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 17 19:56:16.614791 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.614765    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ad6bcb27-6b22-4d90-9c1a-065a78a17392-original-pull-secret\") pod \"global-pull-secret-syncer-nl98s\" (UID: \"ad6bcb27-6b22-4d90-9c1a-065a78a17392\") " pod="kube-system/global-pull-secret-syncer-nl98s"
Jul 17 19:56:16.614895 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.614803    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a53f7848-40a2-47e5-ada6-9f59ebcb300b-cni-binary-copy\") pod \"multus-l7dr9\" (UID: \"a53f7848-40a2-47e5-ada6-9f59ebcb300b\") " pod="openshift-multus/multus-l7dr9"
Jul 17 19:56:16.614895 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.614824    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a53f7848-40a2-47e5-ada6-9f59ebcb300b-multus-daemon-config\") pod \"multus-l7dr9\" (UID: \"a53f7848-40a2-47e5-ada6-9f59ebcb300b\") " pod="openshift-multus/multus-l7dr9"
Jul 17 19:56:16.614895 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.614841    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f15bf309-b082-4e3b-aa4c-eb0b8762a967-log-socket\") pod \"ovnkube-node-9glht\" (UID: \"f15bf309-b082-4e3b-aa4c-eb0b8762a967\") " pod="openshift-ovn-kubernetes/ovnkube-node-9glht"
Jul 17 19:56:16.614895 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.614858    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f15bf309-b082-4e3b-aa4c-eb0b8762a967-host-run-ovn-kubernetes\") pod \"ovnkube-node-9glht\" (UID: \"f15bf309-b082-4e3b-aa4c-eb0b8762a967\") " pod="openshift-ovn-kubernetes/ovnkube-node-9glht"
Jul 17 19:56:16.615055 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.614913    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/18ce5467-c74e-4aff-9ce3-5605a18a2c01-run\") pod \"tuned-rvz8c\" (UID: \"18ce5467-c74e-4aff-9ce3-5605a18a2c01\") " pod="openshift-cluster-node-tuning-operator/tuned-rvz8c"
Jul 17 19:56:16.615055 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.614985    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9a15559c-d011-4add-8648-639549beb4ae-system-cni-dir\") pod \"multus-additional-cni-plugins-vgxht\" (UID: \"9a15559c-d011-4add-8648-639549beb4ae\") " pod="openshift-multus/multus-additional-cni-plugins-vgxht"
Jul 17 19:56:16.615055 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.615013    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l88pp\" (UniqueName: \"kubernetes.io/projected/9a15559c-d011-4add-8648-639549beb4ae-kube-api-access-l88pp\") pod \"multus-additional-cni-plugins-vgxht\" (UID: \"9a15559c-d011-4add-8648-639549beb4ae\") " pod="openshift-multus/multus-additional-cni-plugins-vgxht"
Jul 17 19:56:16.615055 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.615038    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pqrl9\" (UniqueName: \"kubernetes.io/projected/fbd19d68-8a8e-4110-a4fb-aac8086fc8cf-kube-api-access-pqrl9\") pod \"network-check-target-8gt8j\" (UID: \"fbd19d68-8a8e-4110-a4fb-aac8086fc8cf\") " pod="openshift-network-diagnostics/network-check-target-8gt8j"
Jul 17 19:56:16.615055 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.615054    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a53f7848-40a2-47e5-ada6-9f59ebcb300b-multus-cni-dir\") pod \"multus-l7dr9\" (UID: \"a53f7848-40a2-47e5-ada6-9f59ebcb300b\") " pod="openshift-multus/multus-l7dr9"
Jul 17 19:56:16.615313 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.615071    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a53f7848-40a2-47e5-ada6-9f59ebcb300b-multus-socket-dir-parent\") pod \"multus-l7dr9\" (UID: \"a53f7848-40a2-47e5-ada6-9f59ebcb300b\") " pod="openshift-multus/multus-l7dr9"
Jul 17 19:56:16.615313 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.615126    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f15bf309-b082-4e3b-aa4c-eb0b8762a967-var-lib-openvswitch\") pod \"ovnkube-node-9glht\" (UID: \"f15bf309-b082-4e3b-aa4c-eb0b8762a967\") " pod="openshift-ovn-kubernetes/ovnkube-node-9glht"
Jul 17 19:56:16.615313 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.615152    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/18ce5467-c74e-4aff-9ce3-5605a18a2c01-etc-sysctl-d\") pod \"tuned-rvz8c\" (UID: \"18ce5467-c74e-4aff-9ce3-5605a18a2c01\") " pod="openshift-cluster-node-tuning-operator/tuned-rvz8c"
Jul 17 19:56:16.615313 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.615178    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/18ce5467-c74e-4aff-9ce3-5605a18a2c01-var-lib-kubelet\") pod \"tuned-rvz8c\" (UID: \"18ce5467-c74e-4aff-9ce3-5605a18a2c01\") " pod="openshift-cluster-node-tuning-operator/tuned-rvz8c"
Jul 17 19:56:16.615313 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.615204    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a53f7848-40a2-47e5-ada6-9f59ebcb300b-multus-conf-dir\") pod \"multus-l7dr9\" (UID: \"a53f7848-40a2-47e5-ada6-9f59ebcb300b\") " pod="openshift-multus/multus-l7dr9"
Jul 17 19:56:16.615313 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.615240    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f15bf309-b082-4e3b-aa4c-eb0b8762a967-ovnkube-config\") pod \"ovnkube-node-9glht\" (UID: \"f15bf309-b082-4e3b-aa4c-eb0b8762a967\") " pod="openshift-ovn-kubernetes/ovnkube-node-9glht"
Jul 17 19:56:16.615313 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.615304    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a53f7848-40a2-47e5-ada6-9f59ebcb300b-multus-cni-dir\") pod \"multus-l7dr9\" (UID: \"a53f7848-40a2-47e5-ada6-9f59ebcb300b\") " pod="openshift-multus/multus-l7dr9"
Jul 17 19:56:16.615636 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.615323    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a53f7848-40a2-47e5-ada6-9f59ebcb300b-multus-conf-dir\") pod \"multus-l7dr9\" (UID: \"a53f7848-40a2-47e5-ada6-9f59ebcb300b\") " pod="openshift-multus/multus-l7dr9"
Jul 17 19:56:16.615636 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.615305    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a53f7848-40a2-47e5-ada6-9f59ebcb300b-multus-socket-dir-parent\") pod \"multus-l7dr9\" (UID: \"a53f7848-40a2-47e5-ada6-9f59ebcb300b\") " pod="openshift-multus/multus-l7dr9"
Jul 17 19:56:16.615636 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.615406    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f15bf309-b082-4e3b-aa4c-eb0b8762a967-env-overrides\") pod \"ovnkube-node-9glht\" (UID: \"f15bf309-b082-4e3b-aa4c-eb0b8762a967\") " pod="openshift-ovn-kubernetes/ovnkube-node-9glht"
Jul 17 19:56:16.615636 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.615442    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f15bf309-b082-4e3b-aa4c-eb0b8762a967-ovn-node-metrics-cert\") pod \"ovnkube-node-9glht\" (UID: \"f15bf309-b082-4e3b-aa4c-eb0b8762a967\") " pod="openshift-ovn-kubernetes/ovnkube-node-9glht"
Jul 17 19:56:16.615636 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.615470    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/18ce5467-c74e-4aff-9ce3-5605a18a2c01-sys\") pod \"tuned-rvz8c\" (UID: \"18ce5467-c74e-4aff-9ce3-5605a18a2c01\") " pod="openshift-cluster-node-tuning-operator/tuned-rvz8c"
Jul 17 19:56:16.615636 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.615496    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/41b71668-ce0c-48b1-b378-35caba808bbb-tmp-dir\") pod \"node-resolver-n5s75\" (UID: \"41b71668-ce0c-48b1-b378-35caba808bbb\") " pod="openshift-dns/node-resolver-n5s75"
Jul 17 19:56:16.615636 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.615522    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ad6bcb27-6b22-4d90-9c1a-065a78a17392-dbus\") pod \"global-pull-secret-syncer-nl98s\" (UID: \"ad6bcb27-6b22-4d90-9c1a-065a78a17392\") " pod="kube-system/global-pull-secret-syncer-nl98s"
Jul 17 19:56:16.615636 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.615551    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a53f7848-40a2-47e5-ada6-9f59ebcb300b-host-var-lib-cni-bin\") pod \"multus-l7dr9\" (UID: \"a53f7848-40a2-47e5-ada6-9f59ebcb300b\") " pod="openshift-multus/multus-l7dr9"
Jul 17 19:56:16.615636 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.615575    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a53f7848-40a2-47e5-ada6-9f59ebcb300b-cni-binary-copy\") pod \"multus-l7dr9\" (UID: \"a53f7848-40a2-47e5-ada6-9f59ebcb300b\") " pod="openshift-multus/multus-l7dr9"
Jul 17 19:56:16.615636 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.615587    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a53f7848-40a2-47e5-ada6-9f59ebcb300b-multus-daemon-config\") pod \"multus-l7dr9\" (UID: \"a53f7848-40a2-47e5-ada6-9f59ebcb300b\") " pod="openshift-multus/multus-l7dr9"
Jul 17 19:56:16.615636 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.615581    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/fed0de13-3c69-4706-8aad-c615780641a0-etc-selinux\") pod \"aws-ebs-csi-driver-node-9lg9l\" (UID: \"fed0de13-3c69-4706-8aad-c615780641a0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9lg9l"
Jul 17 19:56:16.615636 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.615635    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/95a783d7-db2c-4714-bd10-003a4d90aa3f-serviceca\") pod \"node-ca-ds9vw\" (UID: \"95a783d7-db2c-4714-bd10-003a4d90aa3f\") " pod="openshift-image-registry/node-ca-ds9vw"
Jul 17 19:56:16.616250 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.615657    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9a15559c-d011-4add-8648-639549beb4ae-cnibin\") pod \"multus-additional-cni-plugins-vgxht\" (UID: \"9a15559c-d011-4add-8648-639549beb4ae\") " pod="openshift-multus/multus-additional-cni-plugins-vgxht"
Jul 17 19:56:16.616250 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.615629    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a53f7848-40a2-47e5-ada6-9f59ebcb300b-host-var-lib-cni-bin\") pod \"multus-l7dr9\" (UID: \"a53f7848-40a2-47e5-ada6-9f59ebcb300b\") " pod="openshift-multus/multus-l7dr9"
Jul 17 19:56:16.616250 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.615675    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9a15559c-d011-4add-8648-639549beb4ae-cni-binary-copy\") pod \"multus-additional-cni-plugins-vgxht\" (UID: \"9a15559c-d011-4add-8648-639549beb4ae\") " pod="openshift-multus/multus-additional-cni-plugins-vgxht"
Jul 17 19:56:16.616250 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.615717    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f15bf309-b082-4e3b-aa4c-eb0b8762a967-run-ovn\") pod \"ovnkube-node-9glht\" (UID: \"f15bf309-b082-4e3b-aa4c-eb0b8762a967\") " pod="openshift-ovn-kubernetes/ovnkube-node-9glht"
Jul 17 19:56:16.616250 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.615746    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f15bf309-b082-4e3b-aa4c-eb0b8762a967-host-cni-bin\") pod \"ovnkube-node-9glht\" (UID: \"f15bf309-b082-4e3b-aa4c-eb0b8762a967\") " pod="openshift-ovn-kubernetes/ovnkube-node-9glht"
Jul 17 19:56:16.616250 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.615773    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/fed0de13-3c69-4706-8aad-c615780641a0-registration-dir\") pod \"aws-ebs-csi-driver-node-9lg9l\" (UID: \"fed0de13-3c69-4706-8aad-c615780641a0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9lg9l"
Jul 17 19:56:16.616250 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.615803    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zbd9g\" (UniqueName: \"kubernetes.io/projected/41b71668-ce0c-48b1-b378-35caba808bbb-kube-api-access-zbd9g\") pod \"node-resolver-n5s75\" (UID: \"41b71668-ce0c-48b1-b378-35caba808bbb\") " pod="openshift-dns/node-resolver-n5s75"
Jul 17 19:56:16.616250 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.615829    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0-konnectivity-ca\") pod \"konnectivity-agent-p8crz\" (UID: \"af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0\") " pod="kube-system/konnectivity-agent-p8crz"
Jul 17 19:56:16.616250 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.615856    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a53f7848-40a2-47e5-ada6-9f59ebcb300b-hostroot\") pod \"multus-l7dr9\" (UID: \"a53f7848-40a2-47e5-ada6-9f59ebcb300b\") " pod="openshift-multus/multus-l7dr9"
Jul 17 19:56:16.616250 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.615881    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/fed0de13-3c69-4706-8aad-c615780641a0-socket-dir\") pod \"aws-ebs-csi-driver-node-9lg9l\" (UID: \"fed0de13-3c69-4706-8aad-c615780641a0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9lg9l"
Jul 17 19:56:16.616250 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.615892    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a53f7848-40a2-47e5-ada6-9f59ebcb300b-hostroot\") pod \"multus-l7dr9\" (UID: \"a53f7848-40a2-47e5-ada6-9f59ebcb300b\") " pod="openshift-multus/multus-l7dr9"
Jul 17 19:56:16.616250 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.615905    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c6e298d5-0e70-47eb-8f91-788894463bc3-metrics-certs\") pod \"network-metrics-daemon-wdqgw\" (UID: \"c6e298d5-0e70-47eb-8f91-788894463bc3\") " pod="openshift-multus/network-metrics-daemon-wdqgw"
Jul 17 19:56:16.616250 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.615933    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f15bf309-b082-4e3b-aa4c-eb0b8762a967-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9glht\" (UID: \"f15bf309-b082-4e3b-aa4c-eb0b8762a967\") " pod="openshift-ovn-kubernetes/ovnkube-node-9glht"
Jul 17 19:56:16.616250 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.615971    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/fed0de13-3c69-4706-8aad-c615780641a0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9lg9l\" (UID: \"fed0de13-3c69-4706-8aad-c615780641a0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9lg9l"
Jul 17 19:56:16.616250 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.615995    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/fed0de13-3c69-4706-8aad-c615780641a0-device-dir\") pod \"aws-ebs-csi-driver-node-9lg9l\" (UID: \"fed0de13-3c69-4706-8aad-c615780641a0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9lg9l"
Jul 17 19:56:16.616250 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.616020    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f15bf309-b082-4e3b-aa4c-eb0b8762a967-systemd-units\") pod \"ovnkube-node-9glht\" (UID: \"f15bf309-b082-4e3b-aa4c-eb0b8762a967\") " pod="openshift-ovn-kubernetes/ovnkube-node-9glht"
Jul 17 19:56:16.617012 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.616057    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/18ce5467-c74e-4aff-9ce3-5605a18a2c01-etc-sysconfig\") pod \"tuned-rvz8c\" (UID: \"18ce5467-c74e-4aff-9ce3-5605a18a2c01\") " pod="openshift-cluster-node-tuning-operator/tuned-rvz8c"
Jul 17 19:56:16.617012 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.616082    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mvt7q\" (UniqueName: \"kubernetes.io/projected/95a783d7-db2c-4714-bd10-003a4d90aa3f-kube-api-access-mvt7q\") pod \"node-ca-ds9vw\" (UID: \"95a783d7-db2c-4714-bd10-003a4d90aa3f\") " pod="openshift-image-registry/node-ca-ds9vw"
Jul 17 19:56:16.617012 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.616124    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f15bf309-b082-4e3b-aa4c-eb0b8762a967-host-run-netns\") pod \"ovnkube-node-9glht\" (UID: \"f15bf309-b082-4e3b-aa4c-eb0b8762a967\") " pod="openshift-ovn-kubernetes/ovnkube-node-9glht"
Jul 17 19:56:16.617012 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.616150    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f15bf309-b082-4e3b-aa4c-eb0b8762a967-node-log\") pod \"ovnkube-node-9glht\" (UID: \"f15bf309-b082-4e3b-aa4c-eb0b8762a967\") " pod="openshift-ovn-kubernetes/ovnkube-node-9glht"
Jul 17 19:56:16.617012 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.616191    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/18ce5467-c74e-4aff-9ce3-5605a18a2c01-lib-modules\") pod \"tuned-rvz8c\" (UID: \"18ce5467-c74e-4aff-9ce3-5605a18a2c01\") " pod="openshift-cluster-node-tuning-operator/tuned-rvz8c"
Jul 17 19:56:16.617012 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.616230    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9a15559c-d011-4add-8648-639549beb4ae-os-release\") pod \"multus-additional-cni-plugins-vgxht\" (UID: \"9a15559c-d011-4add-8648-639549beb4ae\") " pod="openshift-multus/multus-additional-cni-plugins-vgxht"
Jul 17 19:56:16.617012 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.616277    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a53f7848-40a2-47e5-ada6-9f59ebcb300b-host-var-lib-cni-multus\") pod \"multus-l7dr9\" (UID: \"a53f7848-40a2-47e5-ada6-9f59ebcb300b\") " pod="openshift-multus/multus-l7dr9"
Jul 17 19:56:16.617012 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.616311    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a53f7848-40a2-47e5-ada6-9f59ebcb300b-host-var-lib-kubelet\") pod \"multus-l7dr9\" (UID: \"a53f7848-40a2-47e5-ada6-9f59ebcb300b\") " pod="openshift-multus/multus-l7dr9"
Jul 17 19:56:16.617012 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.616341    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a53f7848-40a2-47e5-ada6-9f59ebcb300b-cnibin\") pod \"multus-l7dr9\" (UID: \"a53f7848-40a2-47e5-ada6-9f59ebcb300b\") " pod="openshift-multus/multus-l7dr9"
Jul 17 19:56:16.617012 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.616364    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/18ce5467-c74e-4aff-9ce3-5605a18a2c01-tmp\") pod \"tuned-rvz8c\" (UID: \"18ce5467-c74e-4aff-9ce3-5605a18a2c01\") " pod="openshift-cluster-node-tuning-operator/tuned-rvz8c"
Jul 17 19:56:16.617012 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.616370    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a53f7848-40a2-47e5-ada6-9f59ebcb300b-host-var-lib-cni-multus\") pod \"multus-l7dr9\" (UID: \"a53f7848-40a2-47e5-ada6-9f59ebcb300b\") " pod="openshift-multus/multus-l7dr9"
Jul 17 19:56:16.617012 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.616374    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a53f7848-40a2-47e5-ada6-9f59ebcb300b-host-var-lib-kubelet\") pod \"multus-l7dr9\" (UID: \"a53f7848-40a2-47e5-ada6-9f59ebcb300b\") " pod="openshift-multus/multus-l7dr9"
Jul 17 19:56:16.617012 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.616391    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9a15559c-d011-4add-8648-639549beb4ae-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vgxht\" (UID: \"9a15559c-d011-4add-8648-639549beb4ae\") " pod="openshift-multus/multus-additional-cni-plugins-vgxht"
Jul 17 19:56:16.617012 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.616411    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a53f7848-40a2-47e5-ada6-9f59ebcb300b-cnibin\") pod \"multus-l7dr9\" (UID: \"a53f7848-40a2-47e5-ada6-9f59ebcb300b\") " pod="openshift-multus/multus-l7dr9"
Jul 17 19:56:16.617012 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.616419    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9a15559c-d011-4add-8648-639549beb4ae-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-vgxht\" (UID: \"9a15559c-d011-4add-8648-639549beb4ae\") " pod="openshift-multus/multus-additional-cni-plugins-vgxht"
Jul 17 19:56:16.617012 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.616461    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a53f7848-40a2-47e5-ada6-9f59ebcb300b-os-release\") pod \"multus-l7dr9\" (UID: \"a53f7848-40a2-47e5-ada6-9f59ebcb300b\") " pod="openshift-multus/multus-l7dr9"
Jul 17 19:56:16.617012 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.616494    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a53f7848-40a2-47e5-ada6-9f59ebcb300b-etc-kubernetes\") pod \"multus-l7dr9\" (UID: \"a53f7848-40a2-47e5-ada6-9f59ebcb300b\") " pod="openshift-multus/multus-l7dr9"
Jul 17 19:56:16.617726 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.616518    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f15bf309-b082-4e3b-aa4c-eb0b8762a967-run-systemd\") pod \"ovnkube-node-9glht\" (UID: \"f15bf309-b082-4e3b-aa4c-eb0b8762a967\") " pod="openshift-ovn-kubernetes/ovnkube-node-9glht"
Jul 17 19:56:16.617726 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.616525    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a53f7848-40a2-47e5-ada6-9f59ebcb300b-os-release\") pod \"multus-l7dr9\" (UID: \"a53f7848-40a2-47e5-ada6-9f59ebcb300b\") " pod="openshift-multus/multus-l7dr9"
Jul 17 19:56:16.617726 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.616546    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f15bf309-b082-4e3b-aa4c-eb0b8762a967-run-openvswitch\") pod \"ovnkube-node-9glht\" (UID: \"f15bf309-b082-4e3b-aa4c-eb0b8762a967\") " pod="openshift-ovn-kubernetes/ovnkube-node-9glht"
Jul 17 19:56:16.617726 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.616562    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a53f7848-40a2-47e5-ada6-9f59ebcb300b-etc-kubernetes\") pod \"multus-l7dr9\" (UID: \"a53f7848-40a2-47e5-ada6-9f59ebcb300b\") " pod="openshift-multus/multus-l7dr9"
Jul 17 19:56:16.617726 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.616570    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/18ce5467-c74e-4aff-9ce3-5605a18a2c01-etc-kubernetes\") pod \"tuned-rvz8c\" (UID: \"18ce5467-c74e-4aff-9ce3-5605a18a2c01\") " pod="openshift-cluster-node-tuning-operator/tuned-rvz8c"
Jul 17 19:56:16.617726 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.616596    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sxpw2\" (UniqueName: \"kubernetes.io/projected/18ce5467-c74e-4aff-9ce3-5605a18a2c01-kube-api-access-sxpw2\") pod \"tuned-rvz8c\" (UID: \"18ce5467-c74e-4aff-9ce3-5605a18a2c01\") " pod="openshift-cluster-node-tuning-operator/tuned-rvz8c"
Jul 17 19:56:16.617726 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.616622    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jpkxk\" (UniqueName: \"kubernetes.io/projected/c6e298d5-0e70-47eb-8f91-788894463bc3-kube-api-access-jpkxk\") pod \"network-metrics-daemon-wdqgw\" (UID: \"c6e298d5-0e70-47eb-8f91-788894463bc3\") " pod="openshift-multus/network-metrics-daemon-wdqgw"
Jul 17 19:56:16.617726 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.616646    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a53f7848-40a2-47e5-ada6-9f59ebcb300b-host-run-netns\") pod \"multus-l7dr9\" (UID: \"a53f7848-40a2-47e5-ada6-9f59ebcb300b\") " pod="openshift-multus/multus-l7dr9"
Jul 17 19:56:16.617726 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.616671    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a53f7848-40a2-47e5-ada6-9f59ebcb300b-host-run-netns\") pod \"multus-l7dr9\" (UID: \"a53f7848-40a2-47e5-ada6-9f59ebcb300b\") " pod="openshift-multus/multus-l7dr9"
Jul 17 19:56:16.617726 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.616687    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-srczv\" (UniqueName: \"kubernetes.io/projected/1a02e531-1de5-45bf-89f8-3d00a7f37aa4-kube-api-access-srczv\") pod \"iptables-alerter-crcsx\" (UID: \"1a02e531-1de5-45bf-89f8-3d00a7f37aa4\") " pod="openshift-network-operator/iptables-alerter-crcsx"
Jul 17 19:56:16.617726 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.616715    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f15bf309-b082-4e3b-aa4c-eb0b8762a967-ovnkube-script-lib\") pod \"ovnkube-node-9glht\" (UID: \"f15bf309-b082-4e3b-aa4c-eb0b8762a967\") " pod="openshift-ovn-kubernetes/ovnkube-node-9glht"
Jul 17 19:56:16.617726 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.616742    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/18ce5467-c74e-4aff-9ce3-5605a18a2c01-etc-sysctl-conf\") pod \"tuned-rvz8c\" (UID: \"18ce5467-c74e-4aff-9ce3-5605a18a2c01\") " pod="openshift-cluster-node-tuning-operator/tuned-rvz8c"
Jul 17 19:56:16.617726 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.616774    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/41b71668-ce0c-48b1-b378-35caba808bbb-hosts-file\") pod \"node-resolver-n5s75\" (UID: \"41b71668-ce0c-48b1-b378-35caba808bbb\") " pod="openshift-dns/node-resolver-n5s75"
Jul 17 19:56:16.617726 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.616791    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0-agent-certs\") pod \"konnectivity-agent-p8crz\" (UID: \"af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0\") " pod="kube-system/konnectivity-agent-p8crz"
Jul 17 19:56:16.617726 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.616807    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f15bf309-b082-4e3b-aa4c-eb0b8762a967-host-cni-netd\") pod \"ovnkube-node-9glht\" (UID: \"f15bf309-b082-4e3b-aa4c-eb0b8762a967\") " pod="openshift-ovn-kubernetes/ovnkube-node-9glht"
Jul 17 19:56:16.617726 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.616824    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2459c\" (UniqueName: \"kubernetes.io/projected/f15bf309-b082-4e3b-aa4c-eb0b8762a967-kube-api-access-2459c\") pod \"ovnkube-node-9glht\" (UID: \"f15bf309-b082-4e3b-aa4c-eb0b8762a967\") " pod="openshift-ovn-kubernetes/ovnkube-node-9glht"
Jul 17 19:56:16.617726 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.616875    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jnld4\" (UniqueName: \"kubernetes.io/projected/fed0de13-3c69-4706-8aad-c615780641a0-kube-api-access-jnld4\") pod \"aws-ebs-csi-driver-node-9lg9l\" (UID: \"fed0de13-3c69-4706-8aad-c615780641a0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9lg9l"
Jul 17 19:56:16.618248 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.616915    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/18ce5467-c74e-4aff-9ce3-5605a18a2c01-etc-modprobe-d\") pod \"tuned-rvz8c\" (UID: \"18ce5467-c74e-4aff-9ce3-5605a18a2c01\") " pod="openshift-cluster-node-tuning-operator/tuned-rvz8c"
Jul 17 19:56:16.618248 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.616940    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/18ce5467-c74e-4aff-9ce3-5605a18a2c01-etc-systemd\") pod \"tuned-rvz8c\" (UID: \"18ce5467-c74e-4aff-9ce3-5605a18a2c01\") " pod="openshift-cluster-node-tuning-operator/tuned-rvz8c"
Jul 17 19:56:16.618248 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.616965    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/18ce5467-c74e-4aff-9ce3-5605a18a2c01-host\") pod \"tuned-rvz8c\" (UID: \"18ce5467-c74e-4aff-9ce3-5605a18a2c01\") " pod="openshift-cluster-node-tuning-operator/tuned-rvz8c"
Jul 17 19:56:16.618248 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.616995    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a53f7848-40a2-47e5-ada6-9f59ebcb300b-host-run-multus-certs\") pod \"multus-l7dr9\" (UID: \"a53f7848-40a2-47e5-ada6-9f59ebcb300b\") " pod="openshift-multus/multus-l7dr9"
Jul 17 19:56:16.618248 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.617046    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a53f7848-40a2-47e5-ada6-9f59ebcb300b-host-run-multus-certs\") pod \"multus-l7dr9\" (UID: \"a53f7848-40a2-47e5-ada6-9f59ebcb300b\") " pod="openshift-multus/multus-l7dr9"
Jul 17 19:56:16.618248 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.617051    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8gk8q\" (UniqueName: \"kubernetes.io/projected/a53f7848-40a2-47e5-ada6-9f59ebcb300b-kube-api-access-8gk8q\") pod \"multus-l7dr9\" (UID: \"a53f7848-40a2-47e5-ada6-9f59ebcb300b\") " pod="openshift-multus/multus-l7dr9"
Jul 17 19:56:16.618248 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.617099    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1a02e531-1de5-45bf-89f8-3d00a7f37aa4-host-slash\") pod \"iptables-alerter-crcsx\" (UID: \"1a02e531-1de5-45bf-89f8-3d00a7f37aa4\") " pod="openshift-network-operator/iptables-alerter-crcsx"
Jul 17 19:56:16.618248 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.617133    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a53f7848-40a2-47e5-ada6-9f59ebcb300b-host-run-k8s-cni-cncf-io\") pod \"multus-l7dr9\" (UID: \"a53f7848-40a2-47e5-ada6-9f59ebcb300b\") " pod="openshift-multus/multus-l7dr9"
Jul 17 19:56:16.618248 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.617158    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ad6bcb27-6b22-4d90-9c1a-065a78a17392-kubelet-config\") pod \"global-pull-secret-syncer-nl98s\" (UID: \"ad6bcb27-6b22-4d90-9c1a-065a78a17392\") " pod="kube-system/global-pull-secret-syncer-nl98s"
Jul 17 19:56:16.618248 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.617175    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1a02e531-1de5-45bf-89f8-3d00a7f37aa4-host-slash\") pod \"iptables-alerter-crcsx\" (UID: \"1a02e531-1de5-45bf-89f8-3d00a7f37aa4\") " pod="openshift-network-operator/iptables-alerter-crcsx"
Jul 17 19:56:16.618248 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.617189    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9a15559c-d011-4add-8648-639549beb4ae-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-vgxht\" (UID: \"9a15559c-d011-4add-8648-639549beb4ae\") " pod="openshift-multus/multus-additional-cni-plugins-vgxht"
Jul 17 19:56:16.618248 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.617211    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a53f7848-40a2-47e5-ada6-9f59ebcb300b-host-run-k8s-cni-cncf-io\") pod \"multus-l7dr9\" (UID: \"a53f7848-40a2-47e5-ada6-9f59ebcb300b\") " pod="openshift-multus/multus-l7dr9"
Jul 17 19:56:16.618248 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.617231    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f15bf309-b082-4e3b-aa4c-eb0b8762a967-etc-openvswitch\") pod \"ovnkube-node-9glht\" (UID: \"f15bf309-b082-4e3b-aa4c-eb0b8762a967\") " pod="openshift-ovn-kubernetes/ovnkube-node-9glht"
Jul 17 19:56:16.618248 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.617257    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/18ce5467-c74e-4aff-9ce3-5605a18a2c01-etc-tuned\") pod \"tuned-rvz8c\" (UID: \"18ce5467-c74e-4aff-9ce3-5605a18a2c01\") " pod="openshift-cluster-node-tuning-operator/tuned-rvz8c"
Jul 17 19:56:16.618248 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.617282    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/95a783d7-db2c-4714-bd10-003a4d90aa3f-host\") pod \"node-ca-ds9vw\" (UID: \"95a783d7-db2c-4714-bd10-003a4d90aa3f\") " pod="openshift-image-registry/node-ca-ds9vw"
Jul 17 19:56:16.618248 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.617309    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a53f7848-40a2-47e5-ada6-9f59ebcb300b-system-cni-dir\") pod \"multus-l7dr9\" (UID: \"a53f7848-40a2-47e5-ada6-9f59ebcb300b\") " pod="openshift-multus/multus-l7dr9"
Jul 17 19:56:16.618248 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.617336    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1a02e531-1de5-45bf-89f8-3d00a7f37aa4-iptables-alerter-script\") pod \"iptables-alerter-crcsx\" (UID: \"1a02e531-1de5-45bf-89f8-3d00a7f37aa4\") " pod="openshift-network-operator/iptables-alerter-crcsx"
Jul 17 19:56:16.618747 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.617362    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f15bf309-b082-4e3b-aa4c-eb0b8762a967-host-kubelet\") pod \"ovnkube-node-9glht\" (UID: \"f15bf309-b082-4e3b-aa4c-eb0b8762a967\") " pod="openshift-ovn-kubernetes/ovnkube-node-9glht"
Jul 17 19:56:16.618747 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.617393    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f15bf309-b082-4e3b-aa4c-eb0b8762a967-host-slash\") pod \"ovnkube-node-9glht\" (UID: \"f15bf309-b082-4e3b-aa4c-eb0b8762a967\") " pod="openshift-ovn-kubernetes/ovnkube-node-9glht"
Jul 17 19:56:16.618747 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.617394    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a53f7848-40a2-47e5-ada6-9f59ebcb300b-system-cni-dir\") pod \"multus-l7dr9\" (UID: \"a53f7848-40a2-47e5-ada6-9f59ebcb300b\") " pod="openshift-multus/multus-l7dr9"
Jul 17 19:56:16.618747 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.617442    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/fed0de13-3c69-4706-8aad-c615780641a0-sys-fs\") pod \"aws-ebs-csi-driver-node-9lg9l\" (UID: \"fed0de13-3c69-4706-8aad-c615780641a0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9lg9l"
Jul 17 19:56:16.618747 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.617765    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1a02e531-1de5-45bf-89f8-3d00a7f37aa4-iptables-alerter-script\") pod \"iptables-alerter-crcsx\" (UID: \"1a02e531-1de5-45bf-89f8-3d00a7f37aa4\") " pod="openshift-network-operator/iptables-alerter-crcsx"
Jul 17 19:56:16.624568 ip-10-0-141-177 kubenswrapper[2572]: E0717 19:56:16.624547    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 17 19:56:16.624648 ip-10-0-141-177 kubenswrapper[2572]: E0717 19:56:16.624571    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 17 19:56:16.624648 ip-10-0-141-177 kubenswrapper[2572]: E0717 19:56:16.624581    2572 projected.go:196] Error preparing data for projected volume kube-api-access-pqrl9 for pod openshift-network-diagnostics/network-check-target-8gt8j: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 19:56:16.624648 ip-10-0-141-177 kubenswrapper[2572]: E0717 19:56:16.624636    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fbd19d68-8a8e-4110-a4fb-aac8086fc8cf-kube-api-access-pqrl9 podName:fbd19d68-8a8e-4110-a4fb-aac8086fc8cf nodeName:}" failed. No retries permitted until 2026-07-17 19:56:17.124616512 +0000 UTC m=+1.966112130 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-pqrl9" (UniqueName: "kubernetes.io/projected/fbd19d68-8a8e-4110-a4fb-aac8086fc8cf-kube-api-access-pqrl9") pod "network-check-target-8gt8j" (UID: "fbd19d68-8a8e-4110-a4fb-aac8086fc8cf") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 19:56:16.626394 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.626376    2572 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 17 19:56:16.629646 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.629625    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-srczv\" (UniqueName: \"kubernetes.io/projected/1a02e531-1de5-45bf-89f8-3d00a7f37aa4-kube-api-access-srczv\") pod \"iptables-alerter-crcsx\" (UID: \"1a02e531-1de5-45bf-89f8-3d00a7f37aa4\") " pod="openshift-network-operator/iptables-alerter-crcsx"
Jul 17 19:56:16.629729 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.629629    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8gk8q\" (UniqueName: \"kubernetes.io/projected/a53f7848-40a2-47e5-ada6-9f59ebcb300b-kube-api-access-8gk8q\") pod \"multus-l7dr9\" (UID: \"a53f7848-40a2-47e5-ada6-9f59ebcb300b\") " pod="openshift-multus/multus-l7dr9"
Jul 17 19:56:16.667540 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:16.667502    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d0ab5ce403b2c7eaf614aea64cc85b0.slice/crio-b6b60b25057c9853134a3c35bd5cc49ef53bed8f62861a0895f5c7f8f2c3fe7d WatchSource:0}: Error finding container b6b60b25057c9853134a3c35bd5cc49ef53bed8f62861a0895f5c7f8f2c3fe7d: Status 404 returned error can't find the container with id b6b60b25057c9853134a3c35bd5cc49ef53bed8f62861a0895f5c7f8f2c3fe7d
Jul 17 19:56:16.667790 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:16.667767    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff50bf0be7446e74adae658e6620efba.slice/crio-f1a834d2cb34f04a40674437bf4a9c43ace25862dbd8ef8530c78d8b96956fa1 WatchSource:0}: Error finding container f1a834d2cb34f04a40674437bf4a9c43ace25862dbd8ef8530c78d8b96956fa1: Status 404 returned error can't find the container with id f1a834d2cb34f04a40674437bf4a9c43ace25862dbd8ef8530c78d8b96956fa1
Jul 17 19:56:16.675549 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.675530    2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 17 19:56:16.684121 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.684063    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-177.ec2.internal" event={"ID":"ff50bf0be7446e74adae658e6620efba","Type":"ContainerStarted","Data":"f1a834d2cb34f04a40674437bf4a9c43ace25862dbd8ef8530c78d8b96956fa1"}
Jul 17 19:56:16.685019 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.684992    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-177.ec2.internal" event={"ID":"5d0ab5ce403b2c7eaf614aea64cc85b0","Type":"ContainerStarted","Data":"b6b60b25057c9853134a3c35bd5cc49ef53bed8f62861a0895f5c7f8f2c3fe7d"}
Jul 17 19:56:16.718565 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.718535    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9a15559c-d011-4add-8648-639549beb4ae-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vgxht\" (UID: \"9a15559c-d011-4add-8648-639549beb4ae\") " pod="openshift-multus/multus-additional-cni-plugins-vgxht"
Jul 17 19:56:16.718685 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.718581    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9a15559c-d011-4add-8648-639549beb4ae-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-vgxht\" (UID: \"9a15559c-d011-4add-8648-639549beb4ae\") " pod="openshift-multus/multus-additional-cni-plugins-vgxht"
Jul 17 19:56:16.718685 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.718615    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f15bf309-b082-4e3b-aa4c-eb0b8762a967-run-systemd\") pod \"ovnkube-node-9glht\" (UID: \"f15bf309-b082-4e3b-aa4c-eb0b8762a967\") " pod="openshift-ovn-kubernetes/ovnkube-node-9glht"
Jul 17 19:56:16.718685 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.718639    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f15bf309-b082-4e3b-aa4c-eb0b8762a967-run-openvswitch\") pod \"ovnkube-node-9glht\" (UID: \"f15bf309-b082-4e3b-aa4c-eb0b8762a967\") " pod="openshift-ovn-kubernetes/ovnkube-node-9glht"
Jul 17 19:56:16.718685 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.718663    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/18ce5467-c74e-4aff-9ce3-5605a18a2c01-etc-kubernetes\") pod \"tuned-rvz8c\" (UID: \"18ce5467-c74e-4aff-9ce3-5605a18a2c01\") " pod="openshift-cluster-node-tuning-operator/tuned-rvz8c"
Jul 17 19:56:16.718900 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.718686    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sxpw2\" (UniqueName: \"kubernetes.io/projected/18ce5467-c74e-4aff-9ce3-5605a18a2c01-kube-api-access-sxpw2\") pod \"tuned-rvz8c\" (UID: \"18ce5467-c74e-4aff-9ce3-5605a18a2c01\") " pod="openshift-cluster-node-tuning-operator/tuned-rvz8c"
Jul 17 19:56:16.718900 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.718725    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jpkxk\" (UniqueName: \"kubernetes.io/projected/c6e298d5-0e70-47eb-8f91-788894463bc3-kube-api-access-jpkxk\") pod \"network-metrics-daemon-wdqgw\" (UID: \"c6e298d5-0e70-47eb-8f91-788894463bc3\") " pod="openshift-multus/network-metrics-daemon-wdqgw"
Jul 17 19:56:16.718900 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.718738    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f15bf309-b082-4e3b-aa4c-eb0b8762a967-run-openvswitch\") pod \"ovnkube-node-9glht\" (UID: \"f15bf309-b082-4e3b-aa4c-eb0b8762a967\") " pod="openshift-ovn-kubernetes/ovnkube-node-9glht"
Jul 17 19:56:16.718900 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.718758    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f15bf309-b082-4e3b-aa4c-eb0b8762a967-run-systemd\") pod \"ovnkube-node-9glht\" (UID: \"f15bf309-b082-4e3b-aa4c-eb0b8762a967\") " pod="openshift-ovn-kubernetes/ovnkube-node-9glht"
Jul 17 19:56:16.718900 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.718758    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9a15559c-d011-4add-8648-639549beb4ae-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vgxht\" (UID: \"9a15559c-d011-4add-8648-639549beb4ae\") " pod="openshift-multus/multus-additional-cni-plugins-vgxht"
Jul 17 19:56:16.718900 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.718808    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f15bf309-b082-4e3b-aa4c-eb0b8762a967-ovnkube-script-lib\") pod \"ovnkube-node-9glht\" (UID: \"f15bf309-b082-4e3b-aa4c-eb0b8762a967\") " pod="openshift-ovn-kubernetes/ovnkube-node-9glht"
Jul 17 19:56:16.718900 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.718809    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/18ce5467-c74e-4aff-9ce3-5605a18a2c01-etc-kubernetes\") pod \"tuned-rvz8c\" (UID: \"18ce5467-c74e-4aff-9ce3-5605a18a2c01\") " pod="openshift-cluster-node-tuning-operator/tuned-rvz8c"
Jul 17 19:56:16.718900 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.718834    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/18ce5467-c74e-4aff-9ce3-5605a18a2c01-etc-sysctl-conf\") pod \"tuned-rvz8c\" (UID: \"18ce5467-c74e-4aff-9ce3-5605a18a2c01\") " pod="openshift-cluster-node-tuning-operator/tuned-rvz8c"
Jul 17 19:56:16.718900 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.718857    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/41b71668-ce0c-48b1-b378-35caba808bbb-hosts-file\") pod \"node-resolver-n5s75\" (UID: \"41b71668-ce0c-48b1-b378-35caba808bbb\") " pod="openshift-dns/node-resolver-n5s75"
Jul 17 19:56:16.718900 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.718883    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0-agent-certs\") pod \"konnectivity-agent-p8crz\" (UID: \"af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0\") " pod="kube-system/konnectivity-agent-p8crz"
Jul 17 19:56:16.719458 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.718923    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f15bf309-b082-4e3b-aa4c-eb0b8762a967-host-cni-netd\") pod \"ovnkube-node-9glht\" (UID: \"f15bf309-b082-4e3b-aa4c-eb0b8762a967\") " pod="openshift-ovn-kubernetes/ovnkube-node-9glht"
Jul 17 19:56:16.719458 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.718949    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2459c\" (UniqueName: \"kubernetes.io/projected/f15bf309-b082-4e3b-aa4c-eb0b8762a967-kube-api-access-2459c\") pod \"ovnkube-node-9glht\" (UID: \"f15bf309-b082-4e3b-aa4c-eb0b8762a967\") " pod="openshift-ovn-kubernetes/ovnkube-node-9glht"
Jul 17 19:56:16.719458 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.718982    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/41b71668-ce0c-48b1-b378-35caba808bbb-hosts-file\") pod \"node-resolver-n5s75\" (UID: \"41b71668-ce0c-48b1-b378-35caba808bbb\") " pod="openshift-dns/node-resolver-n5s75"
Jul 17 19:56:16.719458 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.718992    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/18ce5467-c74e-4aff-9ce3-5605a18a2c01-etc-sysctl-conf\") pod \"tuned-rvz8c\" (UID: \"18ce5467-c74e-4aff-9ce3-5605a18a2c01\") " pod="openshift-cluster-node-tuning-operator/tuned-rvz8c"
Jul 17 19:56:16.719458 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.718993    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jnld4\" (UniqueName: \"kubernetes.io/projected/fed0de13-3c69-4706-8aad-c615780641a0-kube-api-access-jnld4\") pod \"aws-ebs-csi-driver-node-9lg9l\" (UID: \"fed0de13-3c69-4706-8aad-c615780641a0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9lg9l"
Jul 17 19:56:16.719458 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.719035    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/18ce5467-c74e-4aff-9ce3-5605a18a2c01-etc-modprobe-d\") pod \"tuned-rvz8c\" (UID: \"18ce5467-c74e-4aff-9ce3-5605a18a2c01\") " pod="openshift-cluster-node-tuning-operator/tuned-rvz8c"
Jul 17 19:56:16.719458 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.719060    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/18ce5467-c74e-4aff-9ce3-5605a18a2c01-etc-systemd\") pod \"tuned-rvz8c\" (UID: \"18ce5467-c74e-4aff-9ce3-5605a18a2c01\") " pod="openshift-cluster-node-tuning-operator/tuned-rvz8c"
Jul 17 19:56:16.719458 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.719104    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/18ce5467-c74e-4aff-9ce3-5605a18a2c01-host\") pod \"tuned-rvz8c\" (UID: \"18ce5467-c74e-4aff-9ce3-5605a18a2c01\") " pod="openshift-cluster-node-tuning-operator/tuned-rvz8c"
Jul 17 19:56:16.719458 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.719160    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ad6bcb27-6b22-4d90-9c1a-065a78a17392-kubelet-config\") pod \"global-pull-secret-syncer-nl98s\" (UID: \"ad6bcb27-6b22-4d90-9c1a-065a78a17392\") " pod="kube-system/global-pull-secret-syncer-nl98s"
Jul 17 19:56:16.719458 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.719186    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9a15559c-d011-4add-8648-639549beb4ae-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-vgxht\" (UID: \"9a15559c-d011-4add-8648-639549beb4ae\") " pod="openshift-multus/multus-additional-cni-plugins-vgxht"
Jul 17 19:56:16.719458 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.719229    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/18ce5467-c74e-4aff-9ce3-5605a18a2c01-etc-systemd\") pod \"tuned-rvz8c\" (UID: \"18ce5467-c74e-4aff-9ce3-5605a18a2c01\") " pod="openshift-cluster-node-tuning-operator/tuned-rvz8c"
Jul 17 19:56:16.719458 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.719213    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f15bf309-b082-4e3b-aa4c-eb0b8762a967-etc-openvswitch\") pod \"ovnkube-node-9glht\" (UID: \"f15bf309-b082-4e3b-aa4c-eb0b8762a967\") " pod="openshift-ovn-kubernetes/ovnkube-node-9glht"
Jul 17 19:56:16.719458 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.719267    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/18ce5467-c74e-4aff-9ce3-5605a18a2c01-etc-tuned\") pod \"tuned-rvz8c\" (UID: \"18ce5467-c74e-4aff-9ce3-5605a18a2c01\") " pod="openshift-cluster-node-tuning-operator/tuned-rvz8c"
Jul 17 19:56:16.719458 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.719278    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f15bf309-b082-4e3b-aa4c-eb0b8762a967-etc-openvswitch\") pod \"ovnkube-node-9glht\" (UID: \"f15bf309-b082-4e3b-aa4c-eb0b8762a967\") " pod="openshift-ovn-kubernetes/ovnkube-node-9glht"
Jul 17 19:56:16.719458 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.719285    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/95a783d7-db2c-4714-bd10-003a4d90aa3f-host\") pod \"node-ca-ds9vw\" (UID: \"95a783d7-db2c-4714-bd10-003a4d90aa3f\") " pod="openshift-image-registry/node-ca-ds9vw"
Jul 17 19:56:16.719458 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.719311    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f15bf309-b082-4e3b-aa4c-eb0b8762a967-host-kubelet\") pod \"ovnkube-node-9glht\" (UID: \"f15bf309-b082-4e3b-aa4c-eb0b8762a967\") " pod="openshift-ovn-kubernetes/ovnkube-node-9glht"
Jul 17 19:56:16.719458 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.719389    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/18ce5467-c74e-4aff-9ce3-5605a18a2c01-etc-modprobe-d\") pod \"tuned-rvz8c\" (UID: \"18ce5467-c74e-4aff-9ce3-5605a18a2c01\") " pod="openshift-cluster-node-tuning-operator/tuned-rvz8c"
Jul 17 19:56:16.720301 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.719381    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/18ce5467-c74e-4aff-9ce3-5605a18a2c01-host\") pod \"tuned-rvz8c\" (UID: \"18ce5467-c74e-4aff-9ce3-5605a18a2c01\") " pod="openshift-cluster-node-tuning-operator/tuned-rvz8c"
Jul 17 19:56:16.720301 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.719438    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f15bf309-b082-4e3b-aa4c-eb0b8762a967-host-kubelet\") pod \"ovnkube-node-9glht\" (UID: \"f15bf309-b082-4e3b-aa4c-eb0b8762a967\") " pod="openshift-ovn-kubernetes/ovnkube-node-9glht"
Jul 17 19:56:16.720301 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.719490    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ad6bcb27-6b22-4d90-9c1a-065a78a17392-kubelet-config\") pod \"global-pull-secret-syncer-nl98s\" (UID: \"ad6bcb27-6b22-4d90-9c1a-065a78a17392\") " pod="kube-system/global-pull-secret-syncer-nl98s"
Jul 17 19:56:16.720301 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.719190    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9a15559c-d011-4add-8648-639549beb4ae-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-vgxht\" (UID: \"9a15559c-d011-4add-8648-639549beb4ae\") " pod="openshift-multus/multus-additional-cni-plugins-vgxht"
Jul 17 19:56:16.720301 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.719634    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/95a783d7-db2c-4714-bd10-003a4d90aa3f-host\") pod \"node-ca-ds9vw\" (UID: \"95a783d7-db2c-4714-bd10-003a4d90aa3f\") " pod="openshift-image-registry/node-ca-ds9vw"
Jul 17 19:56:16.720301 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.719666    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f15bf309-b082-4e3b-aa4c-eb0b8762a967-host-slash\") pod \"ovnkube-node-9glht\" (UID: \"f15bf309-b082-4e3b-aa4c-eb0b8762a967\") " pod="openshift-ovn-kubernetes/ovnkube-node-9glht"
Jul 17 19:56:16.720301 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.719730    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/fed0de13-3c69-4706-8aad-c615780641a0-sys-fs\") pod \"aws-ebs-csi-driver-node-9lg9l\" (UID: \"fed0de13-3c69-4706-8aad-c615780641a0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9lg9l"
Jul 17 19:56:16.720301 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.719736    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f15bf309-b082-4e3b-aa4c-eb0b8762a967-host-cni-netd\") pod \"ovnkube-node-9glht\" (UID: \"f15bf309-b082-4e3b-aa4c-eb0b8762a967\") " pod="openshift-ovn-kubernetes/ovnkube-node-9glht"
Jul 17 19:56:16.720301 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.719761    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ad6bcb27-6b22-4d90-9c1a-065a78a17392-original-pull-secret\") pod \"global-pull-secret-syncer-nl98s\" (UID: \"ad6bcb27-6b22-4d90-9c1a-065a78a17392\") " pod="kube-system/global-pull-secret-syncer-nl98s"
Jul 17 19:56:16.720301 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.719787    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f15bf309-b082-4e3b-aa4c-eb0b8762a967-host-slash\") pod \"ovnkube-node-9glht\" (UID: \"f15bf309-b082-4e3b-aa4c-eb0b8762a967\") " pod="openshift-ovn-kubernetes/ovnkube-node-9glht"
Jul 17 19:56:16.720301 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.719792    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f15bf309-b082-4e3b-aa4c-eb0b8762a967-log-socket\") pod \"ovnkube-node-9glht\" (UID: \"f15bf309-b082-4e3b-aa4c-eb0b8762a967\") " pod="openshift-ovn-kubernetes/ovnkube-node-9glht"
Jul 17 19:56:16.720301 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.719835    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f15bf309-b082-4e3b-aa4c-eb0b8762a967-host-run-ovn-kubernetes\") pod \"ovnkube-node-9glht\" (UID: \"f15bf309-b082-4e3b-aa4c-eb0b8762a967\") " pod="openshift-ovn-kubernetes/ovnkube-node-9glht"
Jul 17 19:56:16.720301 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.719847    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/fed0de13-3c69-4706-8aad-c615780641a0-sys-fs\") pod \"aws-ebs-csi-driver-node-9lg9l\" (UID: \"fed0de13-3c69-4706-8aad-c615780641a0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9lg9l"
Jul 17 19:56:16.720301 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.719867    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/18ce5467-c74e-4aff-9ce3-5605a18a2c01-run\") pod \"tuned-rvz8c\" (UID: \"18ce5467-c74e-4aff-9ce3-5605a18a2c01\") " pod="openshift-cluster-node-tuning-operator/tuned-rvz8c"
Jul 17 19:56:16.720301 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.719894    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9a15559c-d011-4add-8648-639549beb4ae-system-cni-dir\") pod \"multus-additional-cni-plugins-vgxht\" (UID: \"9a15559c-d011-4add-8648-639549beb4ae\") " pod="openshift-multus/multus-additional-cni-plugins-vgxht"
Jul 17 19:56:16.720301 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.719900    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f15bf309-b082-4e3b-aa4c-eb0b8762a967-log-socket\") pod \"ovnkube-node-9glht\" (UID: \"f15bf309-b082-4e3b-aa4c-eb0b8762a967\") " pod="openshift-ovn-kubernetes/ovnkube-node-9glht"
Jul 17 19:56:16.720301 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.719922    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l88pp\" (UniqueName: \"kubernetes.io/projected/9a15559c-d011-4add-8648-639549beb4ae-kube-api-access-l88pp\") pod \"multus-additional-cni-plugins-vgxht\" (UID: \"9a15559c-d011-4add-8648-639549beb4ae\") " pod="openshift-multus/multus-additional-cni-plugins-vgxht"
Jul 17 19:56:16.720889 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.719928    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f15bf309-b082-4e3b-aa4c-eb0b8762a967-host-run-ovn-kubernetes\") pod \"ovnkube-node-9glht\" (UID: \"f15bf309-b082-4e3b-aa4c-eb0b8762a967\") " pod="openshift-ovn-kubernetes/ovnkube-node-9glht"
Jul 17 19:56:16.720889 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.719981    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f15bf309-b082-4e3b-aa4c-eb0b8762a967-var-lib-openvswitch\") pod \"ovnkube-node-9glht\" (UID: \"f15bf309-b082-4e3b-aa4c-eb0b8762a967\") " pod="openshift-ovn-kubernetes/ovnkube-node-9glht"
Jul 17 19:56:16.720889 ip-10-0-141-177 kubenswrapper[2572]: E0717 19:56:16.719990    2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 17 19:56:16.720889 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.720011    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/18ce5467-c74e-4aff-9ce3-5605a18a2c01-etc-sysctl-d\") pod \"tuned-rvz8c\" (UID: \"18ce5467-c74e-4aff-9ce3-5605a18a2c01\") " pod="openshift-cluster-node-tuning-operator/tuned-rvz8c"
Jul 17 19:56:16.720889 ip-10-0-141-177 kubenswrapper[2572]: E0717 19:56:16.720456    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad6bcb27-6b22-4d90-9c1a-065a78a17392-original-pull-secret podName:ad6bcb27-6b22-4d90-9c1a-065a78a17392 nodeName:}" failed. No retries permitted until 2026-07-17 19:56:17.220430257 +0000 UTC m=+2.061925877 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ad6bcb27-6b22-4d90-9c1a-065a78a17392-original-pull-secret") pod "global-pull-secret-syncer-nl98s" (UID: "ad6bcb27-6b22-4d90-9c1a-065a78a17392") : object "kube-system"/"original-pull-secret" not registered
Jul 17 19:56:16.720889 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.720772    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f15bf309-b082-4e3b-aa4c-eb0b8762a967-ovnkube-script-lib\") pod \"ovnkube-node-9glht\" (UID: \"f15bf309-b082-4e3b-aa4c-eb0b8762a967\") " pod="openshift-ovn-kubernetes/ovnkube-node-9glht"
Jul 17 19:56:16.721109 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.720886    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/18ce5467-c74e-4aff-9ce3-5605a18a2c01-var-lib-kubelet\") pod \"tuned-rvz8c\" (UID: \"18ce5467-c74e-4aff-9ce3-5605a18a2c01\") " pod="openshift-cluster-node-tuning-operator/tuned-rvz8c"
Jul 17 19:56:16.721109 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.720930    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f15bf309-b082-4e3b-aa4c-eb0b8762a967-ovnkube-config\") pod \"ovnkube-node-9glht\" (UID: \"f15bf309-b082-4e3b-aa4c-eb0b8762a967\") " pod="openshift-ovn-kubernetes/ovnkube-node-9glht"
Jul 17 19:56:16.721109 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.720963    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f15bf309-b082-4e3b-aa4c-eb0b8762a967-env-overrides\") pod \"ovnkube-node-9glht\" (UID: \"f15bf309-b082-4e3b-aa4c-eb0b8762a967\") " pod="openshift-ovn-kubernetes/ovnkube-node-9glht"
Jul 17 19:56:16.721109 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.721001    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f15bf309-b082-4e3b-aa4c-eb0b8762a967-ovn-node-metrics-cert\") pod \"ovnkube-node-9glht\" (UID: \"f15bf309-b082-4e3b-aa4c-eb0b8762a967\") " pod="openshift-ovn-kubernetes/ovnkube-node-9glht"
Jul 17 19:56:16.721318 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.721266    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/18ce5467-c74e-4aff-9ce3-5605a18a2c01-run\") pod \"tuned-rvz8c\" (UID: \"18ce5467-c74e-4aff-9ce3-5605a18a2c01\") " pod="openshift-cluster-node-tuning-operator/tuned-rvz8c"
Jul 17 19:56:16.721509 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.721478    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9a15559c-d011-4add-8648-639549beb4ae-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-vgxht\" (UID: \"9a15559c-d011-4add-8648-639549beb4ae\") " pod="openshift-multus/multus-additional-cni-plugins-vgxht"
Jul 17 19:56:16.721509 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.721499    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f15bf309-b082-4e3b-aa4c-eb0b8762a967-var-lib-openvswitch\") pod \"ovnkube-node-9glht\" (UID: \"f15bf309-b082-4e3b-aa4c-eb0b8762a967\") " pod="openshift-ovn-kubernetes/ovnkube-node-9glht"
Jul 17 19:56:16.721620 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.721511    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9a15559c-d011-4add-8648-639549beb4ae-system-cni-dir\") pod \"multus-additional-cni-plugins-vgxht\" (UID: \"9a15559c-d011-4add-8648-639549beb4ae\") " pod="openshift-multus/multus-additional-cni-plugins-vgxht"
Jul 17 19:56:16.721803 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.721778    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/18ce5467-c74e-4aff-9ce3-5605a18a2c01-var-lib-kubelet\") pod \"tuned-rvz8c\" (UID: \"18ce5467-c74e-4aff-9ce3-5605a18a2c01\") " pod="openshift-cluster-node-tuning-operator/tuned-rvz8c"
Jul 17 19:56:16.721989 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.721957    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/18ce5467-c74e-4aff-9ce3-5605a18a2c01-etc-sysctl-d\") pod \"tuned-rvz8c\" (UID: \"18ce5467-c74e-4aff-9ce3-5605a18a2c01\") " pod="openshift-cluster-node-tuning-operator/tuned-rvz8c"
Jul 17 19:56:16.722095 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.722062    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/18ce5467-c74e-4aff-9ce3-5605a18a2c01-etc-tuned\") pod \"tuned-rvz8c\" (UID: \"18ce5467-c74e-4aff-9ce3-5605a18a2c01\") " pod="openshift-cluster-node-tuning-operator/tuned-rvz8c"
Jul 17 19:56:16.722280 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.722253    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/18ce5467-c74e-4aff-9ce3-5605a18a2c01-sys\") pod \"tuned-rvz8c\" (UID: \"18ce5467-c74e-4aff-9ce3-5605a18a2c01\") " pod="openshift-cluster-node-tuning-operator/tuned-rvz8c"
Jul 17 19:56:16.722400 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.722301    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/41b71668-ce0c-48b1-b378-35caba808bbb-tmp-dir\") pod \"node-resolver-n5s75\" (UID: \"41b71668-ce0c-48b1-b378-35caba808bbb\") " pod="openshift-dns/node-resolver-n5s75"
Jul 17 19:56:16.722400 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.722305    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f15bf309-b082-4e3b-aa4c-eb0b8762a967-env-overrides\") pod \"ovnkube-node-9glht\" (UID: \"f15bf309-b082-4e3b-aa4c-eb0b8762a967\") " pod="openshift-ovn-kubernetes/ovnkube-node-9glht"
Jul 17 19:56:16.722400 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.722332    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ad6bcb27-6b22-4d90-9c1a-065a78a17392-dbus\") pod \"global-pull-secret-syncer-nl98s\" (UID: \"ad6bcb27-6b22-4d90-9c1a-065a78a17392\") " pod="kube-system/global-pull-secret-syncer-nl98s"
Jul 17 19:56:16.722400 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.722366    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/fed0de13-3c69-4706-8aad-c615780641a0-etc-selinux\") pod \"aws-ebs-csi-driver-node-9lg9l\" (UID: \"fed0de13-3c69-4706-8aad-c615780641a0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9lg9l"
Jul 17 19:56:16.722400 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.722400    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/95a783d7-db2c-4714-bd10-003a4d90aa3f-serviceca\") pod \"node-ca-ds9vw\" (UID: \"95a783d7-db2c-4714-bd10-003a4d90aa3f\") " pod="openshift-image-registry/node-ca-ds9vw"
Jul 17 19:56:16.722741 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.722430    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9a15559c-d011-4add-8648-639549beb4ae-cnibin\") pod \"multus-additional-cni-plugins-vgxht\" (UID: \"9a15559c-d011-4add-8648-639549beb4ae\") " pod="openshift-multus/multus-additional-cni-plugins-vgxht"
Jul 17 19:56:16.722741 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.722461    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9a15559c-d011-4add-8648-639549beb4ae-cni-binary-copy\") pod \"multus-additional-cni-plugins-vgxht\" (UID: \"9a15559c-d011-4add-8648-639549beb4ae\") " pod="openshift-multus/multus-additional-cni-plugins-vgxht"
Jul 17 19:56:16.722741 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.722489    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f15bf309-b082-4e3b-aa4c-eb0b8762a967-run-ovn\") pod \"ovnkube-node-9glht\" (UID: \"f15bf309-b082-4e3b-aa4c-eb0b8762a967\") " pod="openshift-ovn-kubernetes/ovnkube-node-9glht"
Jul 17 19:56:16.722741 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.722510    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0-agent-certs\") pod \"konnectivity-agent-p8crz\" (UID: \"af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0\") " pod="kube-system/konnectivity-agent-p8crz"
Jul 17 19:56:16.722741 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.722522    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f15bf309-b082-4e3b-aa4c-eb0b8762a967-host-cni-bin\") pod \"ovnkube-node-9glht\" (UID: \"f15bf309-b082-4e3b-aa4c-eb0b8762a967\") " pod="openshift-ovn-kubernetes/ovnkube-node-9glht"
Jul 17 19:56:16.722741 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.722553    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/fed0de13-3c69-4706-8aad-c615780641a0-registration-dir\") pod \"aws-ebs-csi-driver-node-9lg9l\" (UID: \"fed0de13-3c69-4706-8aad-c615780641a0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9lg9l"
Jul 17 19:56:16.722741 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.722584    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zbd9g\" (UniqueName: \"kubernetes.io/projected/41b71668-ce0c-48b1-b378-35caba808bbb-kube-api-access-zbd9g\") pod \"node-resolver-n5s75\" (UID: \"41b71668-ce0c-48b1-b378-35caba808bbb\") " pod="openshift-dns/node-resolver-n5s75"
Jul 17 19:56:16.722741 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.722598    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9a15559c-d011-4add-8648-639549beb4ae-cnibin\") pod \"multus-additional-cni-plugins-vgxht\" (UID: \"9a15559c-d011-4add-8648-639549beb4ae\") " pod="openshift-multus/multus-additional-cni-plugins-vgxht"
Jul 17 19:56:16.722741 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.722615    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0-konnectivity-ca\") pod \"konnectivity-agent-p8crz\" (UID: \"af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0\") " pod="kube-system/konnectivity-agent-p8crz"
Jul 17 19:56:16.722741 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.722643    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/fed0de13-3c69-4706-8aad-c615780641a0-socket-dir\") pod \"aws-ebs-csi-driver-node-9lg9l\" (UID: \"fed0de13-3c69-4706-8aad-c615780641a0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9lg9l"
Jul 17 19:56:16.722741 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.722661    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ad6bcb27-6b22-4d90-9c1a-065a78a17392-dbus\") pod \"global-pull-secret-syncer-nl98s\" (UID: \"ad6bcb27-6b22-4d90-9c1a-065a78a17392\") " pod="kube-system/global-pull-secret-syncer-nl98s"
Jul 17 19:56:16.722741 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.722673    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c6e298d5-0e70-47eb-8f91-788894463bc3-metrics-certs\") pod \"network-metrics-daemon-wdqgw\" (UID: \"c6e298d5-0e70-47eb-8f91-788894463bc3\") " pod="openshift-multus/network-metrics-daemon-wdqgw"
Jul 17 19:56:16.722741 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.722674    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/41b71668-ce0c-48b1-b378-35caba808bbb-tmp-dir\") pod \"node-resolver-n5s75\" (UID: \"41b71668-ce0c-48b1-b378-35caba808bbb\") " pod="openshift-dns/node-resolver-n5s75"
Jul 17 19:56:16.722741 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.722734    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f15bf309-b082-4e3b-aa4c-eb0b8762a967-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9glht\" (UID: \"f15bf309-b082-4e3b-aa4c-eb0b8762a967\") " pod="openshift-ovn-kubernetes/ovnkube-node-9glht"
Jul 17 19:56:16.723446 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.722762    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/fed0de13-3c69-4706-8aad-c615780641a0-etc-selinux\") pod \"aws-ebs-csi-driver-node-9lg9l\" (UID: \"fed0de13-3c69-4706-8aad-c615780641a0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9lg9l"
Jul 17 19:56:16.723446 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.722825    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/fed0de13-3c69-4706-8aad-c615780641a0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9lg9l\" (UID: \"fed0de13-3c69-4706-8aad-c615780641a0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9lg9l"
Jul 17 19:56:16.723446 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.722897    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/fed0de13-3c69-4706-8aad-c615780641a0-device-dir\") pod \"aws-ebs-csi-driver-node-9lg9l\" (UID: \"fed0de13-3c69-4706-8aad-c615780641a0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9lg9l"
Jul 17 19:56:16.723446 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.722969    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f15bf309-b082-4e3b-aa4c-eb0b8762a967-systemd-units\") pod \"ovnkube-node-9glht\" (UID: \"f15bf309-b082-4e3b-aa4c-eb0b8762a967\") " pod="openshift-ovn-kubernetes/ovnkube-node-9glht"
Jul 17 19:56:16.723446 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.723015    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/18ce5467-c74e-4aff-9ce3-5605a18a2c01-etc-sysconfig\") pod \"tuned-rvz8c\" (UID: \"18ce5467-c74e-4aff-9ce3-5605a18a2c01\") " pod="openshift-cluster-node-tuning-operator/tuned-rvz8c"
Jul 17 19:56:16.723446 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.723053    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mvt7q\" (UniqueName: \"kubernetes.io/projected/95a783d7-db2c-4714-bd10-003a4d90aa3f-kube-api-access-mvt7q\") pod \"node-ca-ds9vw\" (UID: \"95a783d7-db2c-4714-bd10-003a4d90aa3f\") " pod="openshift-image-registry/node-ca-ds9vw"
Jul 17 19:56:16.723446 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.723089    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f15bf309-b082-4e3b-aa4c-eb0b8762a967-host-run-netns\") pod \"ovnkube-node-9glht\" (UID: \"f15bf309-b082-4e3b-aa4c-eb0b8762a967\") " pod="openshift-ovn-kubernetes/ovnkube-node-9glht"
Jul 17 19:56:16.723446 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.723159    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f15bf309-b082-4e3b-aa4c-eb0b8762a967-node-log\") pod \"ovnkube-node-9glht\" (UID: \"f15bf309-b082-4e3b-aa4c-eb0b8762a967\") " pod="openshift-ovn-kubernetes/ovnkube-node-9glht"
Jul 17 19:56:16.723446 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.723218    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/18ce5467-c74e-4aff-9ce3-5605a18a2c01-lib-modules\") pod \"tuned-rvz8c\" (UID: \"18ce5467-c74e-4aff-9ce3-5605a18a2c01\") " pod="openshift-cluster-node-tuning-operator/tuned-rvz8c"
Jul 17 19:56:16.723446 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.723246    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9a15559c-d011-4add-8648-639549beb4ae-cni-binary-copy\") pod \"multus-additional-cni-plugins-vgxht\" (UID: \"9a15559c-d011-4add-8648-639549beb4ae\") " pod="openshift-multus/multus-additional-cni-plugins-vgxht"
Jul 17 19:56:16.723446 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.723247    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9a15559c-d011-4add-8648-639549beb4ae-os-release\") pod \"multus-additional-cni-plugins-vgxht\" (UID: \"9a15559c-d011-4add-8648-639549beb4ae\") " pod="openshift-multus/multus-additional-cni-plugins-vgxht"
Jul 17 19:56:16.723446 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.723273    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/95a783d7-db2c-4714-bd10-003a4d90aa3f-serviceca\") pod \"node-ca-ds9vw\" (UID: \"95a783d7-db2c-4714-bd10-003a4d90aa3f\") " pod="openshift-image-registry/node-ca-ds9vw"
Jul 17 19:56:16.723446 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.723351    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/18ce5467-c74e-4aff-9ce3-5605a18a2c01-sys\") pod \"tuned-rvz8c\" (UID: \"18ce5467-c74e-4aff-9ce3-5605a18a2c01\") " pod="openshift-cluster-node-tuning-operator/tuned-rvz8c"
Jul 17 19:56:16.723446 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.723404    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f15bf309-b082-4e3b-aa4c-eb0b8762a967-host-cni-bin\") pod \"ovnkube-node-9glht\" (UID: \"f15bf309-b082-4e3b-aa4c-eb0b8762a967\") " pod="openshift-ovn-kubernetes/ovnkube-node-9glht"
Jul 17 19:56:16.723446 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.723451    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/18ce5467-c74e-4aff-9ce3-5605a18a2c01-etc-sysconfig\") pod \"tuned-rvz8c\" (UID: \"18ce5467-c74e-4aff-9ce3-5605a18a2c01\") " pod="openshift-cluster-node-tuning-operator/tuned-rvz8c"
Jul 17 19:56:16.724262 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.723451    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f15bf309-b082-4e3b-aa4c-eb0b8762a967-run-ovn\") pod \"ovnkube-node-9glht\" (UID: \"f15bf309-b082-4e3b-aa4c-eb0b8762a967\") " pod="openshift-ovn-kubernetes/ovnkube-node-9glht"
Jul 17 19:56:16.724262 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.723515    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9a15559c-d011-4add-8648-639549beb4ae-os-release\") pod \"multus-additional-cni-plugins-vgxht\" (UID: \"9a15559c-d011-4add-8648-639549beb4ae\") " pod="openshift-multus/multus-additional-cni-plugins-vgxht"
Jul 17 19:56:16.724262 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.723623    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/fed0de13-3c69-4706-8aad-c615780641a0-socket-dir\") pod \"aws-ebs-csi-driver-node-9lg9l\" (UID: \"fed0de13-3c69-4706-8aad-c615780641a0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9lg9l"
Jul 17 19:56:16.724262 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.722125    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f15bf309-b082-4e3b-aa4c-eb0b8762a967-ovnkube-config\") pod \"ovnkube-node-9glht\" (UID: \"f15bf309-b082-4e3b-aa4c-eb0b8762a967\") " pod="openshift-ovn-kubernetes/ovnkube-node-9glht"
Jul 17 19:56:16.724262 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.723713    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f15bf309-b082-4e3b-aa4c-eb0b8762a967-node-log\") pod \"ovnkube-node-9glht\" (UID: \"f15bf309-b082-4e3b-aa4c-eb0b8762a967\") " pod="openshift-ovn-kubernetes/ovnkube-node-9glht"
Jul 17 19:56:16.724262 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.723743    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/fed0de13-3c69-4706-8aad-c615780641a0-device-dir\") pod \"aws-ebs-csi-driver-node-9lg9l\" (UID: \"fed0de13-3c69-4706-8aad-c615780641a0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9lg9l"
Jul 17 19:56:16.724262 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.723787    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f15bf309-b082-4e3b-aa4c-eb0b8762a967-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9glht\" (UID: \"f15bf309-b082-4e3b-aa4c-eb0b8762a967\") " pod="openshift-ovn-kubernetes/ovnkube-node-9glht"
Jul 17 19:56:16.724262 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.723867    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/18ce5467-c74e-4aff-9ce3-5605a18a2c01-tmp\") pod \"tuned-rvz8c\" (UID: \"18ce5467-c74e-4aff-9ce3-5605a18a2c01\") " pod="openshift-cluster-node-tuning-operator/tuned-rvz8c"
Jul 17 19:56:16.724262 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.723888    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/18ce5467-c74e-4aff-9ce3-5605a18a2c01-lib-modules\") pod \"tuned-rvz8c\" (UID: \"18ce5467-c74e-4aff-9ce3-5605a18a2c01\") " pod="openshift-cluster-node-tuning-operator/tuned-rvz8c"
Jul 17 19:56:16.724262 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.723920    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f15bf309-b082-4e3b-aa4c-eb0b8762a967-ovn-node-metrics-cert\") pod \"ovnkube-node-9glht\" (UID: \"f15bf309-b082-4e3b-aa4c-eb0b8762a967\") " pod="openshift-ovn-kubernetes/ovnkube-node-9glht"
Jul 17 19:56:16.724262 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.723935    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f15bf309-b082-4e3b-aa4c-eb0b8762a967-host-run-netns\") pod \"ovnkube-node-9glht\" (UID: \"f15bf309-b082-4e3b-aa4c-eb0b8762a967\") " pod="openshift-ovn-kubernetes/ovnkube-node-9glht"
Jul 17 19:56:16.724262 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.723971    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/fed0de13-3c69-4706-8aad-c615780641a0-registration-dir\") pod \"aws-ebs-csi-driver-node-9lg9l\" (UID: \"fed0de13-3c69-4706-8aad-c615780641a0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9lg9l"
Jul 17 19:56:16.724262 ip-10-0-141-177 kubenswrapper[2572]: E0717 19:56:16.724048    2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 19:56:16.724262 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.724064    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f15bf309-b082-4e3b-aa4c-eb0b8762a967-systemd-units\") pod \"ovnkube-node-9glht\" (UID: \"f15bf309-b082-4e3b-aa4c-eb0b8762a967\") " pod="openshift-ovn-kubernetes/ovnkube-node-9glht"
Jul 17 19:56:16.724262 ip-10-0-141-177 kubenswrapper[2572]: E0717 19:56:16.724113    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c6e298d5-0e70-47eb-8f91-788894463bc3-metrics-certs podName:c6e298d5-0e70-47eb-8f91-788894463bc3 nodeName:}" failed. No retries permitted until 2026-07-17 19:56:17.224093538 +0000 UTC m=+2.065589156 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c6e298d5-0e70-47eb-8f91-788894463bc3-metrics-certs") pod "network-metrics-daemon-wdqgw" (UID: "c6e298d5-0e70-47eb-8f91-788894463bc3") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 19:56:16.725077 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.725031    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0-konnectivity-ca\") pod \"konnectivity-agent-p8crz\" (UID: \"af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0\") " pod="kube-system/konnectivity-agent-p8crz"
Jul 17 19:56:16.725687 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.725632    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/fed0de13-3c69-4706-8aad-c615780641a0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9lg9l\" (UID: \"fed0de13-3c69-4706-8aad-c615780641a0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9lg9l"
Jul 17 19:56:16.726383 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.726363    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/18ce5467-c74e-4aff-9ce3-5605a18a2c01-tmp\") pod \"tuned-rvz8c\" (UID: \"18ce5467-c74e-4aff-9ce3-5605a18a2c01\") " pod="openshift-cluster-node-tuning-operator/tuned-rvz8c"
Jul 17 19:56:16.728540 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.728514    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sxpw2\" (UniqueName: \"kubernetes.io/projected/18ce5467-c74e-4aff-9ce3-5605a18a2c01-kube-api-access-sxpw2\") pod \"tuned-rvz8c\" (UID: \"18ce5467-c74e-4aff-9ce3-5605a18a2c01\") " pod="openshift-cluster-node-tuning-operator/tuned-rvz8c"
Jul 17 19:56:16.728620 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.728594    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jpkxk\" (UniqueName: \"kubernetes.io/projected/c6e298d5-0e70-47eb-8f91-788894463bc3-kube-api-access-jpkxk\") pod \"network-metrics-daemon-wdqgw\" (UID: \"c6e298d5-0e70-47eb-8f91-788894463bc3\") " pod="openshift-multus/network-metrics-daemon-wdqgw"
Jul 17 19:56:16.728817 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.728798    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l88pp\" (UniqueName: \"kubernetes.io/projected/9a15559c-d011-4add-8648-639549beb4ae-kube-api-access-l88pp\") pod \"multus-additional-cni-plugins-vgxht\" (UID: \"9a15559c-d011-4add-8648-639549beb4ae\") " pod="openshift-multus/multus-additional-cni-plugins-vgxht"
Jul 17 19:56:16.739906 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.739888    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jnld4\" (UniqueName: \"kubernetes.io/projected/fed0de13-3c69-4706-8aad-c615780641a0-kube-api-access-jnld4\") pod \"aws-ebs-csi-driver-node-9lg9l\" (UID: \"fed0de13-3c69-4706-8aad-c615780641a0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9lg9l"
Jul 17 19:56:16.745157 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.745126    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zbd9g\" (UniqueName: \"kubernetes.io/projected/41b71668-ce0c-48b1-b378-35caba808bbb-kube-api-access-zbd9g\") pod \"node-resolver-n5s75\" (UID: \"41b71668-ce0c-48b1-b378-35caba808bbb\") " pod="openshift-dns/node-resolver-n5s75"
Jul 17 19:56:16.745601 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.745577    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2459c\" (UniqueName: \"kubernetes.io/projected/f15bf309-b082-4e3b-aa4c-eb0b8762a967-kube-api-access-2459c\") pod \"ovnkube-node-9glht\" (UID: \"f15bf309-b082-4e3b-aa4c-eb0b8762a967\") " pod="openshift-ovn-kubernetes/ovnkube-node-9glht"
Jul 17 19:56:16.745809 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.745791    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mvt7q\" (UniqueName: \"kubernetes.io/projected/95a783d7-db2c-4714-bd10-003a4d90aa3f-kube-api-access-mvt7q\") pod \"node-ca-ds9vw\" (UID: \"95a783d7-db2c-4714-bd10-003a4d90aa3f\") " pod="openshift-image-registry/node-ca-ds9vw"
Jul 17 19:56:16.832639 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.832558    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-l7dr9"
Jul 17 19:56:16.841319 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.841284    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-crcsx"
Jul 17 19:56:16.841416 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:16.841389    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda53f7848_40a2_47e5_ada6_9f59ebcb300b.slice/crio-cf947ac045c6717449c3843c5d68309547f6dc814d142c57be8b6bbdf465d9fc WatchSource:0}: Error finding container cf947ac045c6717449c3843c5d68309547f6dc814d142c57be8b6bbdf465d9fc: Status 404 returned error can't find the container with id cf947ac045c6717449c3843c5d68309547f6dc814d142c57be8b6bbdf465d9fc
Jul 17 19:56:16.859812 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.859791    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-9glht"
Jul 17 19:56:16.867216 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:16.867196    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf15bf309_b082_4e3b_aa4c_eb0b8762a967.slice/crio-40833957d0b0adbe661e0c7866fa77cbe142ab2a34d736bcb9d9ffad98cebca6 WatchSource:0}: Error finding container 40833957d0b0adbe661e0c7866fa77cbe142ab2a34d736bcb9d9ffad98cebca6: Status 404 returned error can't find the container with id 40833957d0b0adbe661e0c7866fa77cbe142ab2a34d736bcb9d9ffad98cebca6
Jul 17 19:56:16.869178 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.869154    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-p8crz"
Jul 17 19:56:16.876783 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:16.876759    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf4d8054_b7bc_47e6_9cc3_0e6d0df7a1a0.slice/crio-5aa2f13e78ac9722ffa9e1404334093231fc7435e2aafd3cf0c0f67053c7dd35 WatchSource:0}: Error finding container 5aa2f13e78ac9722ffa9e1404334093231fc7435e2aafd3cf0c0f67053c7dd35: Status 404 returned error can't find the container with id 5aa2f13e78ac9722ffa9e1404334093231fc7435e2aafd3cf0c0f67053c7dd35
Jul 17 19:56:16.886051 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.886033    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9lg9l"
Jul 17 19:56:16.893845 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:16.893819    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfed0de13_3c69_4706_8aad_c615780641a0.slice/crio-3197f105dc113a060743f096c438c39c41f1431b3005726a13203c57301bf542 WatchSource:0}: Error finding container 3197f105dc113a060743f096c438c39c41f1431b3005726a13203c57301bf542: Status 404 returned error can't find the container with id 3197f105dc113a060743f096c438c39c41f1431b3005726a13203c57301bf542
Jul 17 19:56:16.902445 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.902426    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-rvz8c"
Jul 17 19:56:16.910229 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:16.910204    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18ce5467_c74e_4aff_9ce3_5605a18a2c01.slice/crio-58d2b37b88127f4c23f3e3b44c8065ec6468b011be818267147fe2d7db27149d WatchSource:0}: Error finding container 58d2b37b88127f4c23f3e3b44c8065ec6468b011be818267147fe2d7db27149d: Status 404 returned error can't find the container with id 58d2b37b88127f4c23f3e3b44c8065ec6468b011be818267147fe2d7db27149d
Jul 17 19:56:16.917635 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.917619    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-n5s75"
Jul 17 19:56:16.924632 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:16.924610    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41b71668_ce0c_48b1_b378_35caba808bbb.slice/crio-3284687a2867c2385d455b7cb39f85b313b467da8f8124fa6d0f844818cb3503 WatchSource:0}: Error finding container 3284687a2867c2385d455b7cb39f85b313b467da8f8124fa6d0f844818cb3503: Status 404 returned error can't find the container with id 3284687a2867c2385d455b7cb39f85b313b467da8f8124fa6d0f844818cb3503
Jul 17 19:56:16.934655 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.934632    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-ds9vw"
Jul 17 19:56:16.940142 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:16.940118    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-vgxht"
Jul 17 19:56:16.943158 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:16.943126    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95a783d7_db2c_4714_bd10_003a4d90aa3f.slice/crio-244fc010655aa581c7a09e0aa467c80fa1fc55277a9600e2ad5a2891be41e8ee WatchSource:0}: Error finding container 244fc010655aa581c7a09e0aa467c80fa1fc55277a9600e2ad5a2891be41e8ee: Status 404 returned error can't find the container with id 244fc010655aa581c7a09e0aa467c80fa1fc55277a9600e2ad5a2891be41e8ee
Jul 17 19:56:16.948100 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:16.948079    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a15559c_d011_4add_8648_639549beb4ae.slice/crio-cfea0e836a44d219fad2a77b92f64b3282251d4cf0b1584c36afe874fa7432d7 WatchSource:0}: Error finding container cfea0e836a44d219fad2a77b92f64b3282251d4cf0b1584c36afe874fa7432d7: Status 404 returned error can't find the container with id cfea0e836a44d219fad2a77b92f64b3282251d4cf0b1584c36afe874fa7432d7
Jul 17 19:56:17.125974 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:17.125867    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pqrl9\" (UniqueName: \"kubernetes.io/projected/fbd19d68-8a8e-4110-a4fb-aac8086fc8cf-kube-api-access-pqrl9\") pod \"network-check-target-8gt8j\" (UID: \"fbd19d68-8a8e-4110-a4fb-aac8086fc8cf\") " pod="openshift-network-diagnostics/network-check-target-8gt8j"
Jul 17 19:56:17.126174 ip-10-0-141-177 kubenswrapper[2572]: E0717 19:56:17.126045    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 17 19:56:17.126174 ip-10-0-141-177 kubenswrapper[2572]: E0717 19:56:17.126073    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 17 19:56:17.126174 ip-10-0-141-177 kubenswrapper[2572]: E0717 19:56:17.126106    2572 projected.go:196] Error preparing data for projected volume kube-api-access-pqrl9 for pod openshift-network-diagnostics/network-check-target-8gt8j: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 19:56:17.126342 ip-10-0-141-177 kubenswrapper[2572]: E0717 19:56:17.126225    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fbd19d68-8a8e-4110-a4fb-aac8086fc8cf-kube-api-access-pqrl9 podName:fbd19d68-8a8e-4110-a4fb-aac8086fc8cf nodeName:}" failed. No retries permitted until 2026-07-17 19:56:18.126200513 +0000 UTC m=+2.967696152 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-pqrl9" (UniqueName: "kubernetes.io/projected/fbd19d68-8a8e-4110-a4fb-aac8086fc8cf-kube-api-access-pqrl9") pod "network-check-target-8gt8j" (UID: "fbd19d68-8a8e-4110-a4fb-aac8086fc8cf") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 19:56:17.226876 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:17.226838    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ad6bcb27-6b22-4d90-9c1a-065a78a17392-original-pull-secret\") pod \"global-pull-secret-syncer-nl98s\" (UID: \"ad6bcb27-6b22-4d90-9c1a-065a78a17392\") " pod="kube-system/global-pull-secret-syncer-nl98s"
Jul 17 19:56:17.227063 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:17.226930    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c6e298d5-0e70-47eb-8f91-788894463bc3-metrics-certs\") pod \"network-metrics-daemon-wdqgw\" (UID: \"c6e298d5-0e70-47eb-8f91-788894463bc3\") " pod="openshift-multus/network-metrics-daemon-wdqgw"
Jul 17 19:56:17.227063 ip-10-0-141-177 kubenswrapper[2572]: E0717 19:56:17.227016    2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 17 19:56:17.227283 ip-10-0-141-177 kubenswrapper[2572]: E0717 19:56:17.227092    2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 19:56:17.227283 ip-10-0-141-177 kubenswrapper[2572]: E0717 19:56:17.227116    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad6bcb27-6b22-4d90-9c1a-065a78a17392-original-pull-secret podName:ad6bcb27-6b22-4d90-9c1a-065a78a17392 nodeName:}" failed. No retries permitted until 2026-07-17 19:56:18.227079051 +0000 UTC m=+3.068574683 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ad6bcb27-6b22-4d90-9c1a-065a78a17392-original-pull-secret") pod "global-pull-secret-syncer-nl98s" (UID: "ad6bcb27-6b22-4d90-9c1a-065a78a17392") : object "kube-system"/"original-pull-secret" not registered
Jul 17 19:56:17.227381 ip-10-0-141-177 kubenswrapper[2572]: E0717 19:56:17.227289    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c6e298d5-0e70-47eb-8f91-788894463bc3-metrics-certs podName:c6e298d5-0e70-47eb-8f91-788894463bc3 nodeName:}" failed. No retries permitted until 2026-07-17 19:56:18.22726568 +0000 UTC m=+3.068761310 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c6e298d5-0e70-47eb-8f91-788894463bc3-metrics-certs") pod "network-metrics-daemon-wdqgw" (UID: "c6e298d5-0e70-47eb-8f91-788894463bc3") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 19:56:17.487272 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:17.486973    2572 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 17 19:56:17.594414 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:17.594313    2572 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-16 19:51:17 +0000 UTC" deadline="2028-02-28 05:13:08.865479984 +0000 UTC"
Jul 17 19:56:17.594414 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:17.594349    2572 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14169h16m51.271135531s"
Jul 17 19:56:17.709048 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:17.708924    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-crcsx" event={"ID":"1a02e531-1de5-45bf-89f8-3d00a7f37aa4","Type":"ContainerStarted","Data":"b23510dcc0a7dd10143d2dd830b0f2b2724e4b780bde7c94f0afe7ec737a93b4"}
Jul 17 19:56:17.726164 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:17.726110    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-rvz8c" event={"ID":"18ce5467-c74e-4aff-9ce3-5605a18a2c01","Type":"ContainerStarted","Data":"58d2b37b88127f4c23f3e3b44c8065ec6468b011be818267147fe2d7db27149d"}
Jul 17 19:56:17.747390 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:17.747304    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-l7dr9" event={"ID":"a53f7848-40a2-47e5-ada6-9f59ebcb300b","Type":"ContainerStarted","Data":"cf947ac045c6717449c3843c5d68309547f6dc814d142c57be8b6bbdf465d9fc"}
Jul 17 19:56:17.768569 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:17.768524    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vgxht" event={"ID":"9a15559c-d011-4add-8648-639549beb4ae","Type":"ContainerStarted","Data":"cfea0e836a44d219fad2a77b92f64b3282251d4cf0b1584c36afe874fa7432d7"}
Jul 17 19:56:17.789649 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:17.789594    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-ds9vw" event={"ID":"95a783d7-db2c-4714-bd10-003a4d90aa3f","Type":"ContainerStarted","Data":"244fc010655aa581c7a09e0aa467c80fa1fc55277a9600e2ad5a2891be41e8ee"}
Jul 17 19:56:17.817458 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:17.817408    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-n5s75" event={"ID":"41b71668-ce0c-48b1-b378-35caba808bbb","Type":"ContainerStarted","Data":"3284687a2867c2385d455b7cb39f85b313b467da8f8124fa6d0f844818cb3503"}
Jul 17 19:56:17.844869 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:17.844424    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9lg9l" event={"ID":"fed0de13-3c69-4706-8aad-c615780641a0","Type":"ContainerStarted","Data":"3197f105dc113a060743f096c438c39c41f1431b3005726a13203c57301bf542"}
Jul 17 19:56:17.864034 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:17.863993    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-p8crz" event={"ID":"af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0","Type":"ContainerStarted","Data":"5aa2f13e78ac9722ffa9e1404334093231fc7435e2aafd3cf0c0f67053c7dd35"}
Jul 17 19:56:17.877986 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:17.877864    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9glht" event={"ID":"f15bf309-b082-4e3b-aa4c-eb0b8762a967","Type":"ContainerStarted","Data":"40833957d0b0adbe661e0c7866fa77cbe142ab2a34d736bcb9d9ffad98cebca6"}
Jul 17 19:56:18.136613 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:18.136522    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pqrl9\" (UniqueName: \"kubernetes.io/projected/fbd19d68-8a8e-4110-a4fb-aac8086fc8cf-kube-api-access-pqrl9\") pod \"network-check-target-8gt8j\" (UID: \"fbd19d68-8a8e-4110-a4fb-aac8086fc8cf\") " pod="openshift-network-diagnostics/network-check-target-8gt8j"
Jul 17 19:56:18.136801 ip-10-0-141-177 kubenswrapper[2572]: E0717 19:56:18.136727    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 17 19:56:18.136801 ip-10-0-141-177 kubenswrapper[2572]: E0717 19:56:18.136759    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 17 19:56:18.136801 ip-10-0-141-177 kubenswrapper[2572]: E0717 19:56:18.136773    2572 projected.go:196] Error preparing data for projected volume kube-api-access-pqrl9 for pod openshift-network-diagnostics/network-check-target-8gt8j: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 19:56:18.136969 ip-10-0-141-177 kubenswrapper[2572]: E0717 19:56:18.136835    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fbd19d68-8a8e-4110-a4fb-aac8086fc8cf-kube-api-access-pqrl9 podName:fbd19d68-8a8e-4110-a4fb-aac8086fc8cf nodeName:}" failed. No retries permitted until 2026-07-17 19:56:20.136814975 +0000 UTC m=+4.978310616 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-pqrl9" (UniqueName: "kubernetes.io/projected/fbd19d68-8a8e-4110-a4fb-aac8086fc8cf-kube-api-access-pqrl9") pod "network-check-target-8gt8j" (UID: "fbd19d68-8a8e-4110-a4fb-aac8086fc8cf") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 19:56:18.237591 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:18.237381    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ad6bcb27-6b22-4d90-9c1a-065a78a17392-original-pull-secret\") pod \"global-pull-secret-syncer-nl98s\" (UID: \"ad6bcb27-6b22-4d90-9c1a-065a78a17392\") " pod="kube-system/global-pull-secret-syncer-nl98s"
Jul 17 19:56:18.237591 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:18.237462    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c6e298d5-0e70-47eb-8f91-788894463bc3-metrics-certs\") pod \"network-metrics-daemon-wdqgw\" (UID: \"c6e298d5-0e70-47eb-8f91-788894463bc3\") " pod="openshift-multus/network-metrics-daemon-wdqgw"
Jul 17 19:56:18.237895 ip-10-0-141-177 kubenswrapper[2572]: E0717 19:56:18.237611    2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 19:56:18.237895 ip-10-0-141-177 kubenswrapper[2572]: E0717 19:56:18.237675    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c6e298d5-0e70-47eb-8f91-788894463bc3-metrics-certs podName:c6e298d5-0e70-47eb-8f91-788894463bc3 nodeName:}" failed. No retries permitted until 2026-07-17 19:56:20.237655911 +0000 UTC m=+5.079151542 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c6e298d5-0e70-47eb-8f91-788894463bc3-metrics-certs") pod "network-metrics-daemon-wdqgw" (UID: "c6e298d5-0e70-47eb-8f91-788894463bc3") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 19:56:18.238230 ip-10-0-141-177 kubenswrapper[2572]: E0717 19:56:18.238108    2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 17 19:56:18.238230 ip-10-0-141-177 kubenswrapper[2572]: E0717 19:56:18.238188    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad6bcb27-6b22-4d90-9c1a-065a78a17392-original-pull-secret podName:ad6bcb27-6b22-4d90-9c1a-065a78a17392 nodeName:}" failed. No retries permitted until 2026-07-17 19:56:20.238171323 +0000 UTC m=+5.079666943 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ad6bcb27-6b22-4d90-9c1a-065a78a17392-original-pull-secret") pod "global-pull-secret-syncer-nl98s" (UID: "ad6bcb27-6b22-4d90-9c1a-065a78a17392") : object "kube-system"/"original-pull-secret" not registered
Jul 17 19:56:18.348387 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:18.348348    2572 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 17 19:56:18.595458 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:18.595325    2572 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-16 19:51:17 +0000 UTC" deadline="2028-03-15 23:27:51.937916061 +0000 UTC"
Jul 17 19:56:18.595458 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:18.595400    2572 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14571h31m33.3425212s"
Jul 17 19:56:18.683342 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:18.682065    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8gt8j"
Jul 17 19:56:18.683342 ip-10-0-141-177 kubenswrapper[2572]: E0717 19:56:18.682232    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8gt8j" podUID="fbd19d68-8a8e-4110-a4fb-aac8086fc8cf"
Jul 17 19:56:18.683342 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:18.682723    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nl98s"
Jul 17 19:56:18.683342 ip-10-0-141-177 kubenswrapper[2572]: E0717 19:56:18.682840    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nl98s" podUID="ad6bcb27-6b22-4d90-9c1a-065a78a17392"
Jul 17 19:56:18.683342 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:18.682926    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wdqgw"
Jul 17 19:56:18.683342 ip-10-0-141-177 kubenswrapper[2572]: E0717 19:56:18.683016    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wdqgw" podUID="c6e298d5-0e70-47eb-8f91-788894463bc3"
Jul 17 19:56:19.574217 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:19.574184    2572 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 17 19:56:20.156456 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:20.155617    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pqrl9\" (UniqueName: \"kubernetes.io/projected/fbd19d68-8a8e-4110-a4fb-aac8086fc8cf-kube-api-access-pqrl9\") pod \"network-check-target-8gt8j\" (UID: \"fbd19d68-8a8e-4110-a4fb-aac8086fc8cf\") " pod="openshift-network-diagnostics/network-check-target-8gt8j"
Jul 17 19:56:20.156456 ip-10-0-141-177 kubenswrapper[2572]: E0717 19:56:20.155977    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 17 19:56:20.156456 ip-10-0-141-177 kubenswrapper[2572]: E0717 19:56:20.156001    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 17 19:56:20.156456 ip-10-0-141-177 kubenswrapper[2572]: E0717 19:56:20.156015    2572 projected.go:196] Error preparing data for projected volume kube-api-access-pqrl9 for pod openshift-network-diagnostics/network-check-target-8gt8j: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 19:56:20.156456 ip-10-0-141-177 kubenswrapper[2572]: E0717 19:56:20.156088    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fbd19d68-8a8e-4110-a4fb-aac8086fc8cf-kube-api-access-pqrl9 podName:fbd19d68-8a8e-4110-a4fb-aac8086fc8cf nodeName:}" failed. No retries permitted until 2026-07-17 19:56:24.156065188 +0000 UTC m=+8.997560851 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-pqrl9" (UniqueName: "kubernetes.io/projected/fbd19d68-8a8e-4110-a4fb-aac8086fc8cf-kube-api-access-pqrl9") pod "network-check-target-8gt8j" (UID: "fbd19d68-8a8e-4110-a4fb-aac8086fc8cf") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 19:56:20.256762 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:20.256668    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ad6bcb27-6b22-4d90-9c1a-065a78a17392-original-pull-secret\") pod \"global-pull-secret-syncer-nl98s\" (UID: \"ad6bcb27-6b22-4d90-9c1a-065a78a17392\") " pod="kube-system/global-pull-secret-syncer-nl98s"
Jul 17 19:56:20.256762 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:20.256754    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c6e298d5-0e70-47eb-8f91-788894463bc3-metrics-certs\") pod \"network-metrics-daemon-wdqgw\" (UID: \"c6e298d5-0e70-47eb-8f91-788894463bc3\") " pod="openshift-multus/network-metrics-daemon-wdqgw"
Jul 17 19:56:20.256995 ip-10-0-141-177 kubenswrapper[2572]: E0717 19:56:20.256915    2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 19:56:20.256995 ip-10-0-141-177 kubenswrapper[2572]: E0717 19:56:20.256982    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c6e298d5-0e70-47eb-8f91-788894463bc3-metrics-certs podName:c6e298d5-0e70-47eb-8f91-788894463bc3 nodeName:}" failed. No retries permitted until 2026-07-17 19:56:24.256960449 +0000 UTC m=+9.098456081 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c6e298d5-0e70-47eb-8f91-788894463bc3-metrics-certs") pod "network-metrics-daemon-wdqgw" (UID: "c6e298d5-0e70-47eb-8f91-788894463bc3") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 19:56:20.257368 ip-10-0-141-177 kubenswrapper[2572]: E0717 19:56:20.257232    2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 17 19:56:20.257368 ip-10-0-141-177 kubenswrapper[2572]: E0717 19:56:20.257307    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad6bcb27-6b22-4d90-9c1a-065a78a17392-original-pull-secret podName:ad6bcb27-6b22-4d90-9c1a-065a78a17392 nodeName:}" failed. No retries permitted until 2026-07-17 19:56:24.257287263 +0000 UTC m=+9.098782934 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ad6bcb27-6b22-4d90-9c1a-065a78a17392-original-pull-secret") pod "global-pull-secret-syncer-nl98s" (UID: "ad6bcb27-6b22-4d90-9c1a-065a78a17392") : object "kube-system"/"original-pull-secret" not registered
Jul 17 19:56:20.681067 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:20.680940    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nl98s"
Jul 17 19:56:20.681245 ip-10-0-141-177 kubenswrapper[2572]: E0717 19:56:20.681099    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nl98s" podUID="ad6bcb27-6b22-4d90-9c1a-065a78a17392"
Jul 17 19:56:20.681245 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:20.681141    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8gt8j"
Jul 17 19:56:20.681245 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:20.681163    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wdqgw"
Jul 17 19:56:20.681245 ip-10-0-141-177 kubenswrapper[2572]: E0717 19:56:20.681239    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8gt8j" podUID="fbd19d68-8a8e-4110-a4fb-aac8086fc8cf"
Jul 17 19:56:20.681688 ip-10-0-141-177 kubenswrapper[2572]: E0717 19:56:20.681658    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wdqgw" podUID="c6e298d5-0e70-47eb-8f91-788894463bc3"
Jul 17 19:56:22.681596 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:22.681556    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8gt8j"
Jul 17 19:56:22.682083 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:22.681600    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wdqgw"
Jul 17 19:56:22.682083 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:22.681556    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nl98s"
Jul 17 19:56:22.682083 ip-10-0-141-177 kubenswrapper[2572]: E0717 19:56:22.681698    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8gt8j" podUID="fbd19d68-8a8e-4110-a4fb-aac8086fc8cf"
Jul 17 19:56:22.682083 ip-10-0-141-177 kubenswrapper[2572]: E0717 19:56:22.681771    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nl98s" podUID="ad6bcb27-6b22-4d90-9c1a-065a78a17392"
Jul 17 19:56:22.682083 ip-10-0-141-177 kubenswrapper[2572]: E0717 19:56:22.681896    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wdqgw" podUID="c6e298d5-0e70-47eb-8f91-788894463bc3"
Jul 17 19:56:24.189254 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:24.189150    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pqrl9\" (UniqueName: \"kubernetes.io/projected/fbd19d68-8a8e-4110-a4fb-aac8086fc8cf-kube-api-access-pqrl9\") pod \"network-check-target-8gt8j\" (UID: \"fbd19d68-8a8e-4110-a4fb-aac8086fc8cf\") " pod="openshift-network-diagnostics/network-check-target-8gt8j"
Jul 17 19:56:24.189829 ip-10-0-141-177 kubenswrapper[2572]: E0717 19:56:24.189324    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 17 19:56:24.189829 ip-10-0-141-177 kubenswrapper[2572]: E0717 19:56:24.189347    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 17 19:56:24.189829 ip-10-0-141-177 kubenswrapper[2572]: E0717 19:56:24.189362    2572 projected.go:196] Error preparing data for projected volume kube-api-access-pqrl9 for pod openshift-network-diagnostics/network-check-target-8gt8j: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 19:56:24.189829 ip-10-0-141-177 kubenswrapper[2572]: E0717 19:56:24.189422    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fbd19d68-8a8e-4110-a4fb-aac8086fc8cf-kube-api-access-pqrl9 podName:fbd19d68-8a8e-4110-a4fb-aac8086fc8cf nodeName:}" failed. No retries permitted until 2026-07-17 19:56:32.189404293 +0000 UTC m=+17.030899921 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-pqrl9" (UniqueName: "kubernetes.io/projected/fbd19d68-8a8e-4110-a4fb-aac8086fc8cf-kube-api-access-pqrl9") pod "network-check-target-8gt8j" (UID: "fbd19d68-8a8e-4110-a4fb-aac8086fc8cf") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 19:56:24.289550 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:24.289508    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ad6bcb27-6b22-4d90-9c1a-065a78a17392-original-pull-secret\") pod \"global-pull-secret-syncer-nl98s\" (UID: \"ad6bcb27-6b22-4d90-9c1a-065a78a17392\") " pod="kube-system/global-pull-secret-syncer-nl98s"
Jul 17 19:56:24.289741 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:24.289587    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c6e298d5-0e70-47eb-8f91-788894463bc3-metrics-certs\") pod \"network-metrics-daemon-wdqgw\" (UID: \"c6e298d5-0e70-47eb-8f91-788894463bc3\") " pod="openshift-multus/network-metrics-daemon-wdqgw"
Jul 17 19:56:24.289741 ip-10-0-141-177 kubenswrapper[2572]: E0717 19:56:24.289727    2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 19:56:24.289853 ip-10-0-141-177 kubenswrapper[2572]: E0717 19:56:24.289787    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c6e298d5-0e70-47eb-8f91-788894463bc3-metrics-certs podName:c6e298d5-0e70-47eb-8f91-788894463bc3 nodeName:}" failed. No retries permitted until 2026-07-17 19:56:32.28976962 +0000 UTC m=+17.131265239 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c6e298d5-0e70-47eb-8f91-788894463bc3-metrics-certs") pod "network-metrics-daemon-wdqgw" (UID: "c6e298d5-0e70-47eb-8f91-788894463bc3") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 19:56:24.289916 ip-10-0-141-177 kubenswrapper[2572]: E0717 19:56:24.289875    2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 17 19:56:24.289965 ip-10-0-141-177 kubenswrapper[2572]: E0717 19:56:24.289940    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad6bcb27-6b22-4d90-9c1a-065a78a17392-original-pull-secret podName:ad6bcb27-6b22-4d90-9c1a-065a78a17392 nodeName:}" failed. No retries permitted until 2026-07-17 19:56:32.289922713 +0000 UTC m=+17.131418347 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ad6bcb27-6b22-4d90-9c1a-065a78a17392-original-pull-secret") pod "global-pull-secret-syncer-nl98s" (UID: "ad6bcb27-6b22-4d90-9c1a-065a78a17392") : object "kube-system"/"original-pull-secret" not registered
Jul 17 19:56:24.681772 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:24.681693    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wdqgw"
Jul 17 19:56:24.681908 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:24.681693    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8gt8j"
Jul 17 19:56:24.681908 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:24.681843    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nl98s"
Jul 17 19:56:24.681908 ip-10-0-141-177 kubenswrapper[2572]: E0717 19:56:24.681837    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wdqgw" podUID="c6e298d5-0e70-47eb-8f91-788894463bc3"
Jul 17 19:56:24.682023 ip-10-0-141-177 kubenswrapper[2572]: E0717 19:56:24.681946    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8gt8j" podUID="fbd19d68-8a8e-4110-a4fb-aac8086fc8cf"
Jul 17 19:56:24.682118 ip-10-0-141-177 kubenswrapper[2572]: E0717 19:56:24.682038    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nl98s" podUID="ad6bcb27-6b22-4d90-9c1a-065a78a17392"
Jul 17 19:56:26.681801 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:26.681771    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wdqgw"
Jul 17 19:56:26.682299 ip-10-0-141-177 kubenswrapper[2572]: E0717 19:56:26.681917    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wdqgw" podUID="c6e298d5-0e70-47eb-8f91-788894463bc3"
Jul 17 19:56:26.682369 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:26.682324    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8gt8j"
Jul 17 19:56:26.682369 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:26.682346    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nl98s"
Jul 17 19:56:26.682469 ip-10-0-141-177 kubenswrapper[2572]: E0717 19:56:26.682427    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8gt8j" podUID="fbd19d68-8a8e-4110-a4fb-aac8086fc8cf"
Jul 17 19:56:26.682524 ip-10-0-141-177 kubenswrapper[2572]: E0717 19:56:26.682505    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nl98s" podUID="ad6bcb27-6b22-4d90-9c1a-065a78a17392"
Jul 17 19:56:28.681748 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:28.681707    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8gt8j"
Jul 17 19:56:28.682173 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:28.681820    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wdqgw"
Jul 17 19:56:28.682173 ip-10-0-141-177 kubenswrapper[2572]: E0717 19:56:28.681830    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8gt8j" podUID="fbd19d68-8a8e-4110-a4fb-aac8086fc8cf"
Jul 17 19:56:28.682173 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:28.681844    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nl98s"
Jul 17 19:56:28.682173 ip-10-0-141-177 kubenswrapper[2572]: E0717 19:56:28.681916    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wdqgw" podUID="c6e298d5-0e70-47eb-8f91-788894463bc3"
Jul 17 19:56:28.682173 ip-10-0-141-177 kubenswrapper[2572]: E0717 19:56:28.681977    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nl98s" podUID="ad6bcb27-6b22-4d90-9c1a-065a78a17392"
Jul 17 19:56:30.681959 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:30.681921    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8gt8j"
Jul 17 19:56:30.682410 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:30.681924    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wdqgw"
Jul 17 19:56:30.682410 ip-10-0-141-177 kubenswrapper[2572]: E0717 19:56:30.682059    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8gt8j" podUID="fbd19d68-8a8e-4110-a4fb-aac8086fc8cf"
Jul 17 19:56:30.682410 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:30.681924    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nl98s"
Jul 17 19:56:30.682410 ip-10-0-141-177 kubenswrapper[2572]: E0717 19:56:30.682164    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wdqgw" podUID="c6e298d5-0e70-47eb-8f91-788894463bc3"
Jul 17 19:56:30.682410 ip-10-0-141-177 kubenswrapper[2572]: E0717 19:56:30.682256    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nl98s" podUID="ad6bcb27-6b22-4d90-9c1a-065a78a17392"
Jul 17 19:56:32.249256 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:32.249217    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pqrl9\" (UniqueName: \"kubernetes.io/projected/fbd19d68-8a8e-4110-a4fb-aac8086fc8cf-kube-api-access-pqrl9\") pod \"network-check-target-8gt8j\" (UID: \"fbd19d68-8a8e-4110-a4fb-aac8086fc8cf\") " pod="openshift-network-diagnostics/network-check-target-8gt8j"
Jul 17 19:56:32.249780 ip-10-0-141-177 kubenswrapper[2572]: E0717 19:56:32.249371    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 17 19:56:32.249780 ip-10-0-141-177 kubenswrapper[2572]: E0717 19:56:32.249393    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 17 19:56:32.249780 ip-10-0-141-177 kubenswrapper[2572]: E0717 19:56:32.249407    2572 projected.go:196] Error preparing data for projected volume kube-api-access-pqrl9 for pod openshift-network-diagnostics/network-check-target-8gt8j: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 19:56:32.249780 ip-10-0-141-177 kubenswrapper[2572]: E0717 19:56:32.249473    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fbd19d68-8a8e-4110-a4fb-aac8086fc8cf-kube-api-access-pqrl9 podName:fbd19d68-8a8e-4110-a4fb-aac8086fc8cf nodeName:}" failed. No retries permitted until 2026-07-17 19:56:48.249455307 +0000 UTC m=+33.090950930 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-pqrl9" (UniqueName: "kubernetes.io/projected/fbd19d68-8a8e-4110-a4fb-aac8086fc8cf-kube-api-access-pqrl9") pod "network-check-target-8gt8j" (UID: "fbd19d68-8a8e-4110-a4fb-aac8086fc8cf") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 19:56:32.350121 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:32.350085    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ad6bcb27-6b22-4d90-9c1a-065a78a17392-original-pull-secret\") pod \"global-pull-secret-syncer-nl98s\" (UID: \"ad6bcb27-6b22-4d90-9c1a-065a78a17392\") " pod="kube-system/global-pull-secret-syncer-nl98s"
Jul 17 19:56:32.350293 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:32.350152    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c6e298d5-0e70-47eb-8f91-788894463bc3-metrics-certs\") pod \"network-metrics-daemon-wdqgw\" (UID: \"c6e298d5-0e70-47eb-8f91-788894463bc3\") " pod="openshift-multus/network-metrics-daemon-wdqgw"
Jul 17 19:56:32.350293 ip-10-0-141-177 kubenswrapper[2572]: E0717 19:56:32.350239    2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 17 19:56:32.350293 ip-10-0-141-177 kubenswrapper[2572]: E0717 19:56:32.350252    2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 19:56:32.350447 ip-10-0-141-177 kubenswrapper[2572]: E0717 19:56:32.350318    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad6bcb27-6b22-4d90-9c1a-065a78a17392-original-pull-secret podName:ad6bcb27-6b22-4d90-9c1a-065a78a17392 nodeName:}" failed. No retries permitted until 2026-07-17 19:56:48.350297182 +0000 UTC m=+33.191792816 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ad6bcb27-6b22-4d90-9c1a-065a78a17392-original-pull-secret") pod "global-pull-secret-syncer-nl98s" (UID: "ad6bcb27-6b22-4d90-9c1a-065a78a17392") : object "kube-system"/"original-pull-secret" not registered
Jul 17 19:56:32.350447 ip-10-0-141-177 kubenswrapper[2572]: E0717 19:56:32.350368    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c6e298d5-0e70-47eb-8f91-788894463bc3-metrics-certs podName:c6e298d5-0e70-47eb-8f91-788894463bc3 nodeName:}" failed. No retries permitted until 2026-07-17 19:56:48.350338295 +0000 UTC m=+33.191833927 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c6e298d5-0e70-47eb-8f91-788894463bc3-metrics-certs") pod "network-metrics-daemon-wdqgw" (UID: "c6e298d5-0e70-47eb-8f91-788894463bc3") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 19:56:32.681441 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:32.681367    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8gt8j"
Jul 17 19:56:32.681605 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:32.681478    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nl98s"
Jul 17 19:56:32.681605 ip-10-0-141-177 kubenswrapper[2572]: E0717 19:56:32.681485    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8gt8j" podUID="fbd19d68-8a8e-4110-a4fb-aac8086fc8cf"
Jul 17 19:56:32.681605 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:32.681514    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wdqgw"
Jul 17 19:56:32.681746 ip-10-0-141-177 kubenswrapper[2572]: E0717 19:56:32.681610    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nl98s" podUID="ad6bcb27-6b22-4d90-9c1a-065a78a17392"
Jul 17 19:56:32.681746 ip-10-0-141-177 kubenswrapper[2572]: E0717 19:56:32.681700    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wdqgw" podUID="c6e298d5-0e70-47eb-8f91-788894463bc3"
Jul 17 19:56:34.680959 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:34.680919    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8gt8j"
Jul 17 19:56:34.680959 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:34.680944    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nl98s"
Jul 17 19:56:34.681501 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:34.681043    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wdqgw"
Jul 17 19:56:34.681501 ip-10-0-141-177 kubenswrapper[2572]: E0717 19:56:34.681055    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8gt8j" podUID="fbd19d68-8a8e-4110-a4fb-aac8086fc8cf"
Jul 17 19:56:34.681501 ip-10-0-141-177 kubenswrapper[2572]: E0717 19:56:34.681165    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wdqgw" podUID="c6e298d5-0e70-47eb-8f91-788894463bc3"
Jul 17 19:56:34.681501 ip-10-0-141-177 kubenswrapper[2572]: E0717 19:56:34.681246    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nl98s" podUID="ad6bcb27-6b22-4d90-9c1a-065a78a17392"
Jul 17 19:56:36.681664 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:36.681616    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wdqgw"
Jul 17 19:56:36.681664 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:36.681654    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nl98s"
Jul 17 19:56:36.682148 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:36.681667    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8gt8j"
Jul 17 19:56:36.682148 ip-10-0-141-177 kubenswrapper[2572]: E0717 19:56:36.681761    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wdqgw" podUID="c6e298d5-0e70-47eb-8f91-788894463bc3"
Jul 17 19:56:36.682148 ip-10-0-141-177 kubenswrapper[2572]: E0717 19:56:36.681831    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nl98s" podUID="ad6bcb27-6b22-4d90-9c1a-065a78a17392"
Jul 17 19:56:36.682148 ip-10-0-141-177 kubenswrapper[2572]: E0717 19:56:36.681908    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8gt8j" podUID="fbd19d68-8a8e-4110-a4fb-aac8086fc8cf"
Jul 17 19:56:37.930826 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:37.930436    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9glht" event={"ID":"f15bf309-b082-4e3b-aa4c-eb0b8762a967","Type":"ContainerStarted","Data":"58ef906d27458caa9e1fde7f89f8887e1f4af355592d7e0d3f94803bda6e0fad"}
Jul 17 19:56:37.931488 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:37.930899    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9glht" event={"ID":"f15bf309-b082-4e3b-aa4c-eb0b8762a967","Type":"ContainerStarted","Data":"961b1147b281716e18b6de1c101be5bf59a206808299f9213a775d47b9129ac1"}
Jul 17 19:56:37.931488 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:37.930942    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9glht" event={"ID":"f15bf309-b082-4e3b-aa4c-eb0b8762a967","Type":"ContainerStarted","Data":"f71a31e5fbba4e1b5ad29960d08cc490f9a665c0b02f0ac056314966d5ee3ee4"}
Jul 17 19:56:37.931949 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:37.931924    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-177.ec2.internal" event={"ID":"5d0ab5ce403b2c7eaf614aea64cc85b0","Type":"ContainerStarted","Data":"ec1d3ea39920c28d5d6617f15d9363b1aa60a9d36641361bba786a51d254ac4c"}
Jul 17 19:56:37.933132 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:37.933054    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-rvz8c" event={"ID":"18ce5467-c74e-4aff-9ce3-5605a18a2c01","Type":"ContainerStarted","Data":"c24066eec93d3d0bce8cda561e740fb382e0a73a56b9d8dc66a25e3708b0156b"}
Jul 17 19:56:37.934449 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:37.934423    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-l7dr9" event={"ID":"a53f7848-40a2-47e5-ada6-9f59ebcb300b","Type":"ContainerStarted","Data":"277211c8916adaa9fac6d99ba942614784678fd6a5b9bfc18863c6f858c1bb27"}
Jul 17 19:56:37.935855 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:37.935831    2572 generic.go:356] "Generic (PLEG): container finished" podID="ff50bf0be7446e74adae658e6620efba" containerID="8a1c46712b105fb0f325499f1cac93e77ddb1845adb92a48f5e9a5bd293eeab1" exitCode=0
Jul 17 19:56:37.935926 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:37.935893    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-177.ec2.internal" event={"ID":"ff50bf0be7446e74adae658e6620efba","Type":"ContainerDied","Data":"8a1c46712b105fb0f325499f1cac93e77ddb1845adb92a48f5e9a5bd293eeab1"}
Jul 17 19:56:37.937378 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:37.937348    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vgxht" event={"ID":"9a15559c-d011-4add-8648-639549beb4ae","Type":"ContainerStarted","Data":"3b33e31b08b9398e5975d55e638ca75e8b8a818b0d170674d121b864488c92a7"}
Jul 17 19:56:37.938851 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:37.938830    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-ds9vw" event={"ID":"95a783d7-db2c-4714-bd10-003a4d90aa3f","Type":"ContainerStarted","Data":"a7b844a8b2924b166e92af92c78e63743e9dd6424bdc24134f7ec363b2cb16dc"}
Jul 17 19:56:37.940403 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:37.940379    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-n5s75" event={"ID":"41b71668-ce0c-48b1-b378-35caba808bbb","Type":"ContainerStarted","Data":"b9ddb0c54a3496a06cbeb29e9772d56a999d8afe7c7d5e47a7509c9f87dbcd37"}
Jul 17 19:56:37.941921 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:37.941898    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9lg9l" event={"ID":"fed0de13-3c69-4706-8aad-c615780641a0","Type":"ContainerStarted","Data":"859db5aa8a98add487f998ad7289af6e90707d10415df9253d6006f85e200875"}
Jul 17 19:56:37.943474 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:37.943455    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-p8crz" event={"ID":"af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0","Type":"ContainerStarted","Data":"4b20c40ddf1e34530eca46b8722a56b6fd1796c6227c74decee0f6c75c078bb6"}
Jul 17 19:56:37.946480 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:37.946442    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-177.ec2.internal" podStartSLOduration=21.946430163 podStartE2EDuration="21.946430163s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 19:56:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 19:56:37.945759341 +0000 UTC m=+22.787254992" watchObservedRunningTime="2026-07-17 19:56:37.946430163 +0000 UTC m=+22.787925800"
Jul 17 19:56:37.962262 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:37.962225    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-l7dr9" podStartSLOduration=1.24851293 podStartE2EDuration="21.962213237s" totalImagesPullingTime="20.713700307s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 19:56:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 19:56:37.961701606 +0000 UTC m=+22.803197243" watchObservedRunningTime="2026-07-17 19:56:37.962213237 +0000 UTC m=+22.803708877"
Jul 17 19:56:37.977143 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:37.977107    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-rvz8c" podStartSLOduration=1.422444551 podStartE2EDuration="21.97708487s" totalImagesPullingTime="20.554640319s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 19:56:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 19:56:37.976719791 +0000 UTC m=+22.818215427" watchObservedRunningTime="2026-07-17 19:56:37.97708487 +0000 UTC m=+22.818580707"
Jul 17 19:56:37.991148 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:37.990954    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-n5s75" podStartSLOduration=1.447227761 podStartE2EDuration="21.990941908s" totalImagesPullingTime="20.543714147s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 19:56:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 19:56:37.990289792 +0000 UTC m=+22.831785452" watchObservedRunningTime="2026-07-17 19:56:37.990941908 +0000 UTC m=+22.832437545"
Jul 17 19:56:38.019153 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:38.019119    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-p8crz" podStartSLOduration=9.667011070000001 podStartE2EDuration="22.019107235s" totalImagesPullingTime="12.352096165s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 19:56:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 19:56:38.018878727 +0000 UTC m=+22.860374365" watchObservedRunningTime="2026-07-17 19:56:38.019107235 +0000 UTC m=+22.860602877"
Jul 17 19:56:38.032554 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:38.032521    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-ds9vw" podStartSLOduration=1.542322255 podStartE2EDuration="22.032509865s" totalImagesPullingTime="20.49018761s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 19:56:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 19:56:38.032243004 +0000 UTC m=+22.873738640" watchObservedRunningTime="2026-07-17 19:56:38.032509865 +0000 UTC m=+22.874005501"
Jul 17 19:56:38.682128 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:38.681858    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8gt8j"
Jul 17 19:56:38.682393 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:38.681892    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nl98s"
Jul 17 19:56:38.682393 ip-10-0-141-177 kubenswrapper[2572]: E0717 19:56:38.682224    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8gt8j" podUID="fbd19d68-8a8e-4110-a4fb-aac8086fc8cf"
Jul 17 19:56:38.682393 ip-10-0-141-177 kubenswrapper[2572]: E0717 19:56:38.682321    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nl98s" podUID="ad6bcb27-6b22-4d90-9c1a-065a78a17392"
Jul 17 19:56:38.682393 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:38.681921    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wdqgw"
Jul 17 19:56:38.682609 ip-10-0-141-177 kubenswrapper[2572]: E0717 19:56:38.682432    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wdqgw" podUID="c6e298d5-0e70-47eb-8f91-788894463bc3"
Jul 17 19:56:38.947277 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:38.947250    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-177.ec2.internal" event={"ID":"ff50bf0be7446e74adae658e6620efba","Type":"ContainerStarted","Data":"f85fd2eef7a34d11b1982f8f2ae2089e6611c152867baf522701c6a0352f3ccf"}
Jul 17 19:56:38.948901 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:38.948879    2572 generic.go:356] "Generic (PLEG): container finished" podID="9a15559c-d011-4add-8648-639549beb4ae" containerID="3b33e31b08b9398e5975d55e638ca75e8b8a818b0d170674d121b864488c92a7" exitCode=0
Jul 17 19:56:38.949024 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:38.948947    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vgxht" event={"ID":"9a15559c-d011-4add-8648-639549beb4ae","Type":"ContainerDied","Data":"3b33e31b08b9398e5975d55e638ca75e8b8a818b0d170674d121b864488c92a7"}
Jul 17 19:56:38.952558 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:38.952533    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9glht" event={"ID":"f15bf309-b082-4e3b-aa4c-eb0b8762a967","Type":"ContainerStarted","Data":"e808b43eb6d4d28ee02d63b72661fb0466d451c684257ed2057dc18dac6cabe0"}
Jul 17 19:56:38.952681 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:38.952609    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9glht" event={"ID":"f15bf309-b082-4e3b-aa4c-eb0b8762a967","Type":"ContainerStarted","Data":"958efbc9780c6e0d7fd47e696319fbd6e0e7487a7d11e6fd581e9a4ac9283c28"}
Jul 17 19:56:38.952681 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:38.952662    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9glht" event={"ID":"f15bf309-b082-4e3b-aa4c-eb0b8762a967","Type":"ContainerStarted","Data":"bc941917aa3ca4d5bc19fab3f94e6c008c974286ca77b37871fe9f460606c97a"}
Jul 17 19:56:38.954033 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:38.953895    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-crcsx" event={"ID":"1a02e531-1de5-45bf-89f8-3d00a7f37aa4","Type":"ContainerStarted","Data":"b19e35e2f18d7f53d2d833ff2efb09dbea20c04645c6e6f6880a98951c6392b7"}
Jul 17 19:56:38.963308 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:38.963257    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-177.ec2.internal" podStartSLOduration=22.963239088999998 podStartE2EDuration="22.963239089s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 19:56:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 19:56:38.963034048 +0000 UTC m=+23.804529684" watchObservedRunningTime="2026-07-17 19:56:38.963239089 +0000 UTC m=+23.804734743"
Jul 17 19:56:38.978027 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:38.977985    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-crcsx" podStartSLOduration=2.375417971 podStartE2EDuration="22.977968613s" totalImagesPullingTime="20.602550642s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 19:56:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 19:56:38.977703763 +0000 UTC m=+23.819199400" watchObservedRunningTime="2026-07-17 19:56:38.977968613 +0000 UTC m=+23.819464249"
Jul 17 19:56:39.078271 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:39.078245    2572 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 17 19:56:39.579815 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:39.579672    2572 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-17T19:56:39.078265278Z","UUID":"1487988b-0739-4cfe-9e01-59333e355b8b","Handler":null,"Name":"","Endpoint":""}
Jul 17 19:56:39.581535 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:39.581509    2572 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 17 19:56:39.581670 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:39.581573    2572 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 17 19:56:39.958962 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:39.958883    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9lg9l" event={"ID":"fed0de13-3c69-4706-8aad-c615780641a0","Type":"ContainerStarted","Data":"7ca04c3e28ad9d2e2f16c724d58b645bec82375de6b37032c9d67627918588bb"}
Jul 17 19:56:40.681222 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:40.681183    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nl98s"
Jul 17 19:56:40.681388 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:40.681183    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8gt8j"
Jul 17 19:56:40.681388 ip-10-0-141-177 kubenswrapper[2572]: E0717 19:56:40.681314    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nl98s" podUID="ad6bcb27-6b22-4d90-9c1a-065a78a17392"
Jul 17 19:56:40.681493 ip-10-0-141-177 kubenswrapper[2572]: E0717 19:56:40.681402    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8gt8j" podUID="fbd19d68-8a8e-4110-a4fb-aac8086fc8cf"
Jul 17 19:56:40.681493 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:40.681193    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wdqgw"
Jul 17 19:56:40.681569 ip-10-0-141-177 kubenswrapper[2572]: E0717 19:56:40.681510    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wdqgw" podUID="c6e298d5-0e70-47eb-8f91-788894463bc3"
Jul 17 19:56:40.963700 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:40.963626    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9lg9l" event={"ID":"fed0de13-3c69-4706-8aad-c615780641a0","Type":"ContainerStarted","Data":"8b1bc5d97884665ca57c819907bce7ee0d097297caff826d091e4998aff22ea9"}
Jul 17 19:56:40.967182 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:40.967153    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9glht" event={"ID":"f15bf309-b082-4e3b-aa4c-eb0b8762a967","Type":"ContainerStarted","Data":"70db638be7eb74a158c67be6ec04adb3671942d440794f9fee3f2e3fe06c1876"}
Jul 17 19:56:40.983379 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:40.983326    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9lg9l" podStartSLOduration=2.354774423 podStartE2EDuration="24.983307777s" totalImagesPullingTime="22.628533354s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 19:56:16 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 19:56:40.982473341 +0000 UTC m=+25.823968988" watchObservedRunningTime="2026-07-17 19:56:40.983307777 +0000 UTC m=+25.824803439"
Jul 17 19:56:41.891842 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:41.891806    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-p8crz"
Jul 17 19:56:41.892336 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:41.892313    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-p8crz"
Jul 17 19:56:41.969133 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:41.969110    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-p8crz"
Jul 17 19:56:41.969525 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:41.969488    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-p8crz"
Jul 17 19:56:42.059226 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:42.059189    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 19:56:42.146686 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:42.146618    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 19:56:42.681769 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:42.681739    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wdqgw"
Jul 17 19:56:42.681931 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:42.681838    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8gt8j"
Jul 17 19:56:42.681931 ip-10-0-141-177 kubenswrapper[2572]: E0717 19:56:42.681844    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wdqgw" podUID="c6e298d5-0e70-47eb-8f91-788894463bc3"
Jul 17 19:56:42.681931 ip-10-0-141-177 kubenswrapper[2572]: E0717 19:56:42.681922    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8gt8j" podUID="fbd19d68-8a8e-4110-a4fb-aac8086fc8cf"
Jul 17 19:56:42.682114 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:42.681959    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nl98s"
Jul 17 19:56:42.682114 ip-10-0-141-177 kubenswrapper[2572]: E0717 19:56:42.682016    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nl98s" podUID="ad6bcb27-6b22-4d90-9c1a-065a78a17392"
Jul 17 19:56:42.974092 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:42.974046    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9glht" event={"ID":"f15bf309-b082-4e3b-aa4c-eb0b8762a967","Type":"ContainerStarted","Data":"9ae123fa02af09aa2dc373ccc68872cd8e0f9bc4eecf821785306b02c1f5bd6f"}
Jul 17 19:56:42.974745 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:42.974360    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-9glht"
Jul 17 19:56:42.976285 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:42.976264    2572 generic.go:356] "Generic (PLEG): container finished" podID="9a15559c-d011-4add-8648-639549beb4ae" containerID="4fa9f149da996eddad7453fb04241f924663c78c1e257b69a319825c9a7755be" exitCode=0
Jul 17 19:56:42.976413 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:42.976339    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vgxht" event={"ID":"9a15559c-d011-4add-8648-639549beb4ae","Type":"ContainerDied","Data":"4fa9f149da996eddad7453fb04241f924663c78c1e257b69a319825c9a7755be"}
Jul 17 19:56:42.990512 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:42.990495    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9glht"
Jul 17 19:56:43.005350 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:43.005302    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-9glht" podStartSLOduration=6.361941134 podStartE2EDuration="27.005288916s" totalImagesPullingTime="20.643347782s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 19:56:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 19:56:43.001979108 +0000 UTC m=+27.843474744" watchObservedRunningTime="2026-07-17 19:56:43.005288916 +0000 UTC m=+27.846784553"
Jul 17 19:56:43.978721 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:43.978655    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-9glht"
Jul 17 19:56:43.978721 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:43.978710    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-9glht"
Jul 17 19:56:43.992370 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:43.992349    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9glht"
Jul 17 19:56:44.210763 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:44.210567    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 19:56:44.314212 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:44.314188    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 19:56:44.415007 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:44.414976    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-8gt8j"]
Jul 17 19:56:44.415176 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:44.415115    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8gt8j"
Jul 17 19:56:44.415247 ip-10-0-141-177 kubenswrapper[2572]: E0717 19:56:44.415210    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8gt8j" podUID="fbd19d68-8a8e-4110-a4fb-aac8086fc8cf"
Jul 17 19:56:44.415778 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:44.415751    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-nl98s"]
Jul 17 19:56:44.415871 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:44.415832    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nl98s"
Jul 17 19:56:44.415927 ip-10-0-141-177 kubenswrapper[2572]: E0717 19:56:44.415908    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nl98s" podUID="ad6bcb27-6b22-4d90-9c1a-065a78a17392"
Jul 17 19:56:44.416369 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:44.416335    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-wdqgw"]
Jul 17 19:56:44.416479 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:44.416433    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wdqgw"
Jul 17 19:56:44.416568 ip-10-0-141-177 kubenswrapper[2572]: E0717 19:56:44.416528    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wdqgw" podUID="c6e298d5-0e70-47eb-8f91-788894463bc3"
Jul 17 19:56:44.585214 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:44.585146    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 19:56:44.685880 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:44.685849    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 19:56:44.733923 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:44.733898    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 19:56:44.982277 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:44.982203    2572 generic.go:356] "Generic (PLEG): container finished" podID="9a15559c-d011-4add-8648-639549beb4ae" containerID="ce0daed56d061fa22661f5a75556365f8b96f17ac7ae235eab08999b2d0e680d" exitCode=0
Jul 17 19:56:44.982277 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:44.982234    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vgxht" event={"ID":"9a15559c-d011-4add-8648-639549beb4ae","Type":"ContainerDied","Data":"ce0daed56d061fa22661f5a75556365f8b96f17ac7ae235eab08999b2d0e680d"}
Jul 17 19:56:45.278859 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:45.278827    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 19:56:45.332255 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:45.332227    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 19:56:46.681855 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:46.681786    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8gt8j"
Jul 17 19:56:46.682222 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:46.681878    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nl98s"
Jul 17 19:56:46.682222 ip-10-0-141-177 kubenswrapper[2572]: E0717 19:56:46.681887    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8gt8j" podUID="fbd19d68-8a8e-4110-a4fb-aac8086fc8cf"
Jul 17 19:56:46.682222 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:46.681902    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wdqgw"
Jul 17 19:56:46.682222 ip-10-0-141-177 kubenswrapper[2572]: E0717 19:56:46.681967    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nl98s" podUID="ad6bcb27-6b22-4d90-9c1a-065a78a17392"
Jul 17 19:56:46.682222 ip-10-0-141-177 kubenswrapper[2572]: E0717 19:56:46.682027    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wdqgw" podUID="c6e298d5-0e70-47eb-8f91-788894463bc3"
Jul 17 19:56:46.989544 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:46.989515    2572 generic.go:356] "Generic (PLEG): container finished" podID="9a15559c-d011-4add-8648-639549beb4ae" containerID="dc17b26253c13581363ee4138eb466f8c48032e648429931692507e2977ba98d" exitCode=0
Jul 17 19:56:46.989680 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:46.989576    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vgxht" event={"ID":"9a15559c-d011-4add-8648-639549beb4ae","Type":"ContainerDied","Data":"dc17b26253c13581363ee4138eb466f8c48032e648429931692507e2977ba98d"}
Jul 17 19:56:48.288629 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:48.288589    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pqrl9\" (UniqueName: \"kubernetes.io/projected/fbd19d68-8a8e-4110-a4fb-aac8086fc8cf-kube-api-access-pqrl9\") pod \"network-check-target-8gt8j\" (UID: \"fbd19d68-8a8e-4110-a4fb-aac8086fc8cf\") " pod="openshift-network-diagnostics/network-check-target-8gt8j"
Jul 17 19:56:48.289042 ip-10-0-141-177 kubenswrapper[2572]: E0717 19:56:48.288763    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 17 19:56:48.289042 ip-10-0-141-177 kubenswrapper[2572]: E0717 19:56:48.288791    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 17 19:56:48.289042 ip-10-0-141-177 kubenswrapper[2572]: E0717 19:56:48.288807    2572 projected.go:196] Error preparing data for projected volume kube-api-access-pqrl9 for pod openshift-network-diagnostics/network-check-target-8gt8j: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 19:56:48.289042 ip-10-0-141-177 kubenswrapper[2572]: E0717 19:56:48.288872    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fbd19d68-8a8e-4110-a4fb-aac8086fc8cf-kube-api-access-pqrl9 podName:fbd19d68-8a8e-4110-a4fb-aac8086fc8cf nodeName:}" failed. No retries permitted until 2026-07-17 19:57:20.288852376 +0000 UTC m=+65.130347995 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-pqrl9" (UniqueName: "kubernetes.io/projected/fbd19d68-8a8e-4110-a4fb-aac8086fc8cf-kube-api-access-pqrl9") pod "network-check-target-8gt8j" (UID: "fbd19d68-8a8e-4110-a4fb-aac8086fc8cf") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 19:56:48.389246 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:48.389213    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c6e298d5-0e70-47eb-8f91-788894463bc3-metrics-certs\") pod \"network-metrics-daemon-wdqgw\" (UID: \"c6e298d5-0e70-47eb-8f91-788894463bc3\") " pod="openshift-multus/network-metrics-daemon-wdqgw"
Jul 17 19:56:48.389417 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:48.389278    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ad6bcb27-6b22-4d90-9c1a-065a78a17392-original-pull-secret\") pod \"global-pull-secret-syncer-nl98s\" (UID: \"ad6bcb27-6b22-4d90-9c1a-065a78a17392\") " pod="kube-system/global-pull-secret-syncer-nl98s"
Jul 17 19:56:48.389417 ip-10-0-141-177 kubenswrapper[2572]: E0717 19:56:48.389383    2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 17 19:56:48.389417 ip-10-0-141-177 kubenswrapper[2572]: E0717 19:56:48.389386    2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 19:56:48.389582 ip-10-0-141-177 kubenswrapper[2572]: E0717 19:56:48.389427    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad6bcb27-6b22-4d90-9c1a-065a78a17392-original-pull-secret podName:ad6bcb27-6b22-4d90-9c1a-065a78a17392 nodeName:}" failed. No retries permitted until 2026-07-17 19:57:20.389415462 +0000 UTC m=+65.230911076 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ad6bcb27-6b22-4d90-9c1a-065a78a17392-original-pull-secret") pod "global-pull-secret-syncer-nl98s" (UID: "ad6bcb27-6b22-4d90-9c1a-065a78a17392") : object "kube-system"/"original-pull-secret" not registered
Jul 17 19:56:48.389582 ip-10-0-141-177 kubenswrapper[2572]: E0717 19:56:48.389446    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c6e298d5-0e70-47eb-8f91-788894463bc3-metrics-certs podName:c6e298d5-0e70-47eb-8f91-788894463bc3 nodeName:}" failed. No retries permitted until 2026-07-17 19:57:20.3894361 +0000 UTC m=+65.230931716 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c6e298d5-0e70-47eb-8f91-788894463bc3-metrics-certs") pod "network-metrics-daemon-wdqgw" (UID: "c6e298d5-0e70-47eb-8f91-788894463bc3") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 19:56:48.681211 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:48.681101    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nl98s"
Jul 17 19:56:48.681211 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:48.681132    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wdqgw"
Jul 17 19:56:48.681211 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:48.681101    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8gt8j"
Jul 17 19:56:48.681500 ip-10-0-141-177 kubenswrapper[2572]: E0717 19:56:48.681212    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nl98s" podUID="ad6bcb27-6b22-4d90-9c1a-065a78a17392"
Jul 17 19:56:48.681500 ip-10-0-141-177 kubenswrapper[2572]: E0717 19:56:48.681323    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8gt8j" podUID="fbd19d68-8a8e-4110-a4fb-aac8086fc8cf"
Jul 17 19:56:48.681500 ip-10-0-141-177 kubenswrapper[2572]: E0717 19:56:48.681422    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wdqgw" podUID="c6e298d5-0e70-47eb-8f91-788894463bc3"
Jul 17 19:56:49.664799 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:49.664763    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 19:56:49.770491 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:49.770454    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 19:56:50.127210 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:50.126955    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 19:56:50.206141 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:50.206107    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 19:56:50.544883 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:50.544855    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-177.ec2.internal" event="NodeReady"
Jul 17 19:56:50.545089 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:50.545015    2572 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 17 19:56:50.633446 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:50.633419    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-zsjgs"]
Jul 17 19:56:50.635870 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:50.635848    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-zsjgs"
Jul 17 19:56:50.639342 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:50.639107    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 17 19:56:50.639470 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:50.639427    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-4lxrh"]
Jul 17 19:56:50.639955 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:50.639678    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 17 19:56:50.639955 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:50.639696    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-c78df\""
Jul 17 19:56:50.639955 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:50.639794    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 19:56:50.643204 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:50.642173    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 17 19:56:50.645431 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:50.645412    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-4lxrh"
Jul 17 19:56:50.647803 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:50.647786    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-wkppg\""
Jul 17 19:56:50.654808 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:50.654789    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 17 19:56:50.656291 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:50.656271    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 17 19:56:50.661584 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:50.661567    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-zsjgs"]
Jul 17 19:56:50.663333 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:50.663138    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-4lxrh"]
Jul 17 19:56:50.681623 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:50.681589    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8gt8j"
Jul 17 19:56:50.681964 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:50.681694    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nl98s"
Jul 17 19:56:50.681964 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:50.681787    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wdqgw"
Jul 17 19:56:50.686983 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:50.686944    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-clqd4\""
Jul 17 19:56:50.689142 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:50.689123    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 17 19:56:50.689273 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:50.689248    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 17 19:56:50.689378 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:50.689365    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 17 19:56:50.689527 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:50.689502    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-pdp2d\""
Jul 17 19:56:50.697884 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:50.697866    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 17 19:56:50.755331 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:50.755304    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-rkrjc"]
Jul 17 19:56:50.757693 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:50.757666    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-rkrjc"
Jul 17 19:56:50.760583 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:50.760562    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 17 19:56:50.760903 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:50.760884    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-nmtpw\""
Jul 17 19:56:50.761032 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:50.760910    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 17 19:56:50.761211 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:50.761191    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 17 19:56:50.761318 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:50.761306    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 17 19:56:50.769417 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:50.769391    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 19:56:50.778246 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:50.778225    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-rkrjc"]
Jul 17 19:56:50.810810 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:50.810756    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5440c8ce-a1e1-4930-936f-550f113abe1a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rkrjc\" (UID: \"5440c8ce-a1e1-4930-936f-550f113abe1a\") " pod="openshift-insights/insights-runtime-extractor-rkrjc"
Jul 17 19:56:50.810810 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:50.810786    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6mtms\" (UniqueName: \"kubernetes.io/projected/357dfdb5-256c-4e3f-8859-c733e6dbc076-kube-api-access-6mtms\") pod \"dns-default-4lxrh\" (UID: \"357dfdb5-256c-4e3f-8859-c733e6dbc076\") " pod="openshift-dns/dns-default-4lxrh"
Jul 17 19:56:50.810967 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:50.810819    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h8bw2\" (UniqueName: \"kubernetes.io/projected/5440c8ce-a1e1-4930-936f-550f113abe1a-kube-api-access-h8bw2\") pod \"insights-runtime-extractor-rkrjc\" (UID: \"5440c8ce-a1e1-4930-936f-550f113abe1a\") " pod="openshift-insights/insights-runtime-extractor-rkrjc"
Jul 17 19:56:50.810967 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:50.810916    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/357dfdb5-256c-4e3f-8859-c733e6dbc076-metrics-tls\") pod \"dns-default-4lxrh\" (UID: \"357dfdb5-256c-4e3f-8859-c733e6dbc076\") " pod="openshift-dns/dns-default-4lxrh"
Jul 17 19:56:50.810967 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:50.810953    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5440c8ce-a1e1-4930-936f-550f113abe1a-data-volume\") pod \"insights-runtime-extractor-rkrjc\" (UID: \"5440c8ce-a1e1-4930-936f-550f113abe1a\") " pod="openshift-insights/insights-runtime-extractor-rkrjc"
Jul 17 19:56:50.811144 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:50.810983    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/357dfdb5-256c-4e3f-8859-c733e6dbc076-tmp-dir\") pod \"dns-default-4lxrh\" (UID: \"357dfdb5-256c-4e3f-8859-c733e6dbc076\") " pod="openshift-dns/dns-default-4lxrh"
Jul 17 19:56:50.811144 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:50.811041    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fp2c9\" (UniqueName: \"kubernetes.io/projected/a45b1c99-39f4-4e04-b920-ab30659bd943-kube-api-access-fp2c9\") pod \"ingress-canary-zsjgs\" (UID: \"a45b1c99-39f4-4e04-b920-ab30659bd943\") " pod="openshift-ingress-canary/ingress-canary-zsjgs"
Jul 17 19:56:50.811144 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:50.811087    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a45b1c99-39f4-4e04-b920-ab30659bd943-cert\") pod \"ingress-canary-zsjgs\" (UID: \"a45b1c99-39f4-4e04-b920-ab30659bd943\") " pod="openshift-ingress-canary/ingress-canary-zsjgs"
Jul 17 19:56:50.811144 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:50.811113    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/357dfdb5-256c-4e3f-8859-c733e6dbc076-config-volume\") pod \"dns-default-4lxrh\" (UID: \"357dfdb5-256c-4e3f-8859-c733e6dbc076\") " pod="openshift-dns/dns-default-4lxrh"
Jul 17 19:56:50.811340 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:50.811136    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5440c8ce-a1e1-4930-936f-550f113abe1a-crio-socket\") pod \"insights-runtime-extractor-rkrjc\" (UID: \"5440c8ce-a1e1-4930-936f-550f113abe1a\") " pod="openshift-insights/insights-runtime-extractor-rkrjc"
Jul 17 19:56:50.811340 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:50.811194    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5440c8ce-a1e1-4930-936f-550f113abe1a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rkrjc\" (UID: \"5440c8ce-a1e1-4930-936f-550f113abe1a\") " pod="openshift-insights/insights-runtime-extractor-rkrjc"
Jul 17 19:56:50.912079 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:50.912048    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h8bw2\" (UniqueName: \"kubernetes.io/projected/5440c8ce-a1e1-4930-936f-550f113abe1a-kube-api-access-h8bw2\") pod \"insights-runtime-extractor-rkrjc\" (UID: \"5440c8ce-a1e1-4930-936f-550f113abe1a\") " pod="openshift-insights/insights-runtime-extractor-rkrjc"
Jul 17 19:56:50.912249 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:50.912104    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/357dfdb5-256c-4e3f-8859-c733e6dbc076-metrics-tls\") pod \"dns-default-4lxrh\" (UID: \"357dfdb5-256c-4e3f-8859-c733e6dbc076\") " pod="openshift-dns/dns-default-4lxrh"
Jul 17 19:56:50.912249 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:50.912124    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5440c8ce-a1e1-4930-936f-550f113abe1a-data-volume\") pod \"insights-runtime-extractor-rkrjc\" (UID: \"5440c8ce-a1e1-4930-936f-550f113abe1a\") " pod="openshift-insights/insights-runtime-extractor-rkrjc"
Jul 17 19:56:50.912249 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:50.912148    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/357dfdb5-256c-4e3f-8859-c733e6dbc076-tmp-dir\") pod \"dns-default-4lxrh\" (UID: \"357dfdb5-256c-4e3f-8859-c733e6dbc076\") " pod="openshift-dns/dns-default-4lxrh"
Jul 17 19:56:50.912249 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:50.912204    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fp2c9\" (UniqueName: \"kubernetes.io/projected/a45b1c99-39f4-4e04-b920-ab30659bd943-kube-api-access-fp2c9\") pod \"ingress-canary-zsjgs\" (UID: \"a45b1c99-39f4-4e04-b920-ab30659bd943\") " pod="openshift-ingress-canary/ingress-canary-zsjgs"
Jul 17 19:56:50.912249 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:50.912230    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a45b1c99-39f4-4e04-b920-ab30659bd943-cert\") pod \"ingress-canary-zsjgs\" (UID: \"a45b1c99-39f4-4e04-b920-ab30659bd943\") " pod="openshift-ingress-canary/ingress-canary-zsjgs"
Jul 17 19:56:50.912495 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:50.912255    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/357dfdb5-256c-4e3f-8859-c733e6dbc076-config-volume\") pod \"dns-default-4lxrh\" (UID: \"357dfdb5-256c-4e3f-8859-c733e6dbc076\") " pod="openshift-dns/dns-default-4lxrh"
Jul 17 19:56:50.912495 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:50.912277    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5440c8ce-a1e1-4930-936f-550f113abe1a-crio-socket\") pod \"insights-runtime-extractor-rkrjc\" (UID: \"5440c8ce-a1e1-4930-936f-550f113abe1a\") " pod="openshift-insights/insights-runtime-extractor-rkrjc"
Jul 17 19:56:50.912495 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:50.912323    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5440c8ce-a1e1-4930-936f-550f113abe1a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rkrjc\" (UID: \"5440c8ce-a1e1-4930-936f-550f113abe1a\") " pod="openshift-insights/insights-runtime-extractor-rkrjc"
Jul 17 19:56:50.912495 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:50.912360    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5440c8ce-a1e1-4930-936f-550f113abe1a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rkrjc\" (UID: \"5440c8ce-a1e1-4930-936f-550f113abe1a\") " pod="openshift-insights/insights-runtime-extractor-rkrjc"
Jul 17 19:56:50.912495 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:50.912389    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6mtms\" (UniqueName: \"kubernetes.io/projected/357dfdb5-256c-4e3f-8859-c733e6dbc076-kube-api-access-6mtms\") pod \"dns-default-4lxrh\" (UID: \"357dfdb5-256c-4e3f-8859-c733e6dbc076\") " pod="openshift-dns/dns-default-4lxrh"
Jul 17 19:56:50.912495 ip-10-0-141-177 kubenswrapper[2572]: E0717 19:56:50.912279    2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 17 19:56:50.912495 ip-10-0-141-177 kubenswrapper[2572]: E0717 19:56:50.912491    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/357dfdb5-256c-4e3f-8859-c733e6dbc076-metrics-tls podName:357dfdb5-256c-4e3f-8859-c733e6dbc076 nodeName:}" failed. No retries permitted until 2026-07-17 19:56:51.412468872 +0000 UTC m=+36.253964487 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/357dfdb5-256c-4e3f-8859-c733e6dbc076-metrics-tls") pod "dns-default-4lxrh" (UID: "357dfdb5-256c-4e3f-8859-c733e6dbc076") : secret "dns-default-metrics-tls" not found
Jul 17 19:56:50.912823 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:50.912542    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5440c8ce-a1e1-4930-936f-550f113abe1a-data-volume\") pod \"insights-runtime-extractor-rkrjc\" (UID: \"5440c8ce-a1e1-4930-936f-550f113abe1a\") " pod="openshift-insights/insights-runtime-extractor-rkrjc"
Jul 17 19:56:50.912823 ip-10-0-141-177 kubenswrapper[2572]: E0717 19:56:50.912556    2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 17 19:56:50.912823 ip-10-0-141-177 kubenswrapper[2572]: E0717 19:56:50.912618    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5440c8ce-a1e1-4930-936f-550f113abe1a-insights-runtime-extractor-tls podName:5440c8ce-a1e1-4930-936f-550f113abe1a nodeName:}" failed. No retries permitted until 2026-07-17 19:56:51.412604027 +0000 UTC m=+36.254099658 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5440c8ce-a1e1-4930-936f-550f113abe1a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rkrjc" (UID: "5440c8ce-a1e1-4930-936f-550f113abe1a") : secret "insights-runtime-extractor-tls" not found
Jul 17 19:56:50.912823 ip-10-0-141-177 kubenswrapper[2572]: E0717 19:56:50.912654    2572 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 17 19:56:50.912823 ip-10-0-141-177 kubenswrapper[2572]: E0717 19:56:50.912695    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5440c8ce-a1e1-4930-936f-550f113abe1a-kube-rbac-proxy-cm podName:5440c8ce-a1e1-4930-936f-550f113abe1a nodeName:}" failed. No retries permitted until 2026-07-17 19:56:51.412684034 +0000 UTC m=+36.254179650 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/5440c8ce-a1e1-4930-936f-550f113abe1a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-rkrjc" (UID: "5440c8ce-a1e1-4930-936f-550f113abe1a") : configmap "kube-rbac-proxy" not found
Jul 17 19:56:50.912823 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:50.912763    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5440c8ce-a1e1-4930-936f-550f113abe1a-crio-socket\") pod \"insights-runtime-extractor-rkrjc\" (UID: \"5440c8ce-a1e1-4930-936f-550f113abe1a\") " pod="openshift-insights/insights-runtime-extractor-rkrjc"
Jul 17 19:56:50.912823 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:50.912762    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/357dfdb5-256c-4e3f-8859-c733e6dbc076-tmp-dir\") pod \"dns-default-4lxrh\" (UID: \"357dfdb5-256c-4e3f-8859-c733e6dbc076\") " pod="openshift-dns/dns-default-4lxrh"
Jul 17 19:56:50.912823 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:50.912815    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/357dfdb5-256c-4e3f-8859-c733e6dbc076-config-volume\") pod \"dns-default-4lxrh\" (UID: \"357dfdb5-256c-4e3f-8859-c733e6dbc076\") " pod="openshift-dns/dns-default-4lxrh"
Jul 17 19:56:50.917117 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:50.917088    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a45b1c99-39f4-4e04-b920-ab30659bd943-cert\") pod \"ingress-canary-zsjgs\" (UID: \"a45b1c99-39f4-4e04-b920-ab30659bd943\") " pod="openshift-ingress-canary/ingress-canary-zsjgs"
Jul 17 19:56:50.924266 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:50.924244    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6mtms\" (UniqueName: \"kubernetes.io/projected/357dfdb5-256c-4e3f-8859-c733e6dbc076-kube-api-access-6mtms\") pod \"dns-default-4lxrh\" (UID: \"357dfdb5-256c-4e3f-8859-c733e6dbc076\") " pod="openshift-dns/dns-default-4lxrh"
Jul 17 19:56:50.926811 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:50.926776    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h8bw2\" (UniqueName: \"kubernetes.io/projected/5440c8ce-a1e1-4930-936f-550f113abe1a-kube-api-access-h8bw2\") pod \"insights-runtime-extractor-rkrjc\" (UID: \"5440c8ce-a1e1-4930-936f-550f113abe1a\") " pod="openshift-insights/insights-runtime-extractor-rkrjc"
Jul 17 19:56:50.927234 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:50.927214    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fp2c9\" (UniqueName: \"kubernetes.io/projected/a45b1c99-39f4-4e04-b920-ab30659bd943-kube-api-access-fp2c9\") pod \"ingress-canary-zsjgs\" (UID: \"a45b1c99-39f4-4e04-b920-ab30659bd943\") " pod="openshift-ingress-canary/ingress-canary-zsjgs"
Jul 17 19:56:50.948785 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:50.948757    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-zsjgs"
Jul 17 19:56:51.004030 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:51.003995    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 19:56:51.102812 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:51.102732    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 19:56:51.411453 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:51.411424    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-zsjgs"]
Jul 17 19:56:51.414251 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:51.414231    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda45b1c99_39f4_4e04_b920_ab30659bd943.slice/crio-3e0047e9d21ce9030585d0cd8a7e5fc2dbe91e21c2d27e50e6260395faa241fa WatchSource:0}: Error finding container 3e0047e9d21ce9030585d0cd8a7e5fc2dbe91e21c2d27e50e6260395faa241fa: Status 404 returned error can't find the container with id 3e0047e9d21ce9030585d0cd8a7e5fc2dbe91e21c2d27e50e6260395faa241fa
Jul 17 19:56:51.416241 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:51.416223    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5440c8ce-a1e1-4930-936f-550f113abe1a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rkrjc\" (UID: \"5440c8ce-a1e1-4930-936f-550f113abe1a\") " pod="openshift-insights/insights-runtime-extractor-rkrjc"
Jul 17 19:56:51.416315 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:51.416270    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/357dfdb5-256c-4e3f-8859-c733e6dbc076-metrics-tls\") pod \"dns-default-4lxrh\" (UID: \"357dfdb5-256c-4e3f-8859-c733e6dbc076\") " pod="openshift-dns/dns-default-4lxrh"
Jul 17 19:56:51.416375 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:51.416318    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5440c8ce-a1e1-4930-936f-550f113abe1a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rkrjc\" (UID: \"5440c8ce-a1e1-4930-936f-550f113abe1a\") " pod="openshift-insights/insights-runtime-extractor-rkrjc"
Jul 17 19:56:51.416375 ip-10-0-141-177 kubenswrapper[2572]: E0717 19:56:51.416362    2572 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 17 19:56:51.416476 ip-10-0-141-177 kubenswrapper[2572]: E0717 19:56:51.416414    2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 17 19:56:51.416476 ip-10-0-141-177 kubenswrapper[2572]: E0717 19:56:51.416424    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5440c8ce-a1e1-4930-936f-550f113abe1a-kube-rbac-proxy-cm podName:5440c8ce-a1e1-4930-936f-550f113abe1a nodeName:}" failed. No retries permitted until 2026-07-17 19:56:52.416401457 +0000 UTC m=+37.257897089 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/5440c8ce-a1e1-4930-936f-550f113abe1a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-rkrjc" (UID: "5440c8ce-a1e1-4930-936f-550f113abe1a") : configmap "kube-rbac-proxy" not found
Jul 17 19:56:51.416476 ip-10-0-141-177 kubenswrapper[2572]: E0717 19:56:51.416434    2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 17 19:56:51.416476 ip-10-0-141-177 kubenswrapper[2572]: E0717 19:56:51.416461    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5440c8ce-a1e1-4930-936f-550f113abe1a-insights-runtime-extractor-tls podName:5440c8ce-a1e1-4930-936f-550f113abe1a nodeName:}" failed. No retries permitted until 2026-07-17 19:56:52.416444327 +0000 UTC m=+37.257939958 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5440c8ce-a1e1-4930-936f-550f113abe1a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rkrjc" (UID: "5440c8ce-a1e1-4930-936f-550f113abe1a") : secret "insights-runtime-extractor-tls" not found
Jul 17 19:56:51.416643 ip-10-0-141-177 kubenswrapper[2572]: E0717 19:56:51.416486    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/357dfdb5-256c-4e3f-8859-c733e6dbc076-metrics-tls podName:357dfdb5-256c-4e3f-8859-c733e6dbc076 nodeName:}" failed. No retries permitted until 2026-07-17 19:56:52.416472195 +0000 UTC m=+37.257967824 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/357dfdb5-256c-4e3f-8859-c733e6dbc076-metrics-tls") pod "dns-default-4lxrh" (UID: "357dfdb5-256c-4e3f-8859-c733e6dbc076") : secret "dns-default-metrics-tls" not found
Jul 17 19:56:51.952774 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:51.952740    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-lnlq9"]
Jul 17 19:56:51.955032 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:51.954850    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-lnlq9"
Jul 17 19:56:51.960729 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:51.960705    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 17 19:56:51.960898 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:51.960881    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 17 19:56:51.963909 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:51.963889    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-5s7q8\""
Jul 17 19:56:51.988692 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:51.988671    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-lnlq9"]
Jul 17 19:56:51.998158 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:51.998131    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 19:56:52.006647 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:52.006614    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-zsjgs" event={"ID":"a45b1c99-39f4-4e04-b920-ab30659bd943","Type":"ContainerStarted","Data":"3e0047e9d21ce9030585d0cd8a7e5fc2dbe91e21c2d27e50e6260395faa241fa"}
Jul 17 19:56:52.009739 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:52.009717    2572 generic.go:356] "Generic (PLEG): container finished" podID="9a15559c-d011-4add-8648-639549beb4ae" containerID="91488a92833a42b09fb63e3bdd53aa8628776fdaca085adb4231ed6b22fbc964" exitCode=0
Jul 17 19:56:52.009838 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:52.009752    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vgxht" event={"ID":"9a15559c-d011-4add-8648-639549beb4ae","Type":"ContainerDied","Data":"91488a92833a42b09fb63e3bdd53aa8628776fdaca085adb4231ed6b22fbc964"}
Jul 17 19:56:52.022439 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:52.022416    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r5974\" (UniqueName: \"kubernetes.io/projected/8e874537-2124-44d9-a714-a15aed94095f-kube-api-access-r5974\") pod \"migrator-7cc9c7ffd7-lnlq9\" (UID: \"8e874537-2124-44d9-a714-a15aed94095f\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-lnlq9"
Jul 17 19:56:52.106102 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:52.106051    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 19:56:52.123960 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:52.123928    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r5974\" (UniqueName: \"kubernetes.io/projected/8e874537-2124-44d9-a714-a15aed94095f-kube-api-access-r5974\") pod \"migrator-7cc9c7ffd7-lnlq9\" (UID: \"8e874537-2124-44d9-a714-a15aed94095f\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-lnlq9"
Jul 17 19:56:52.139160 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:52.139136    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r5974\" (UniqueName: \"kubernetes.io/projected/8e874537-2124-44d9-a714-a15aed94095f-kube-api-access-r5974\") pod \"migrator-7cc9c7ffd7-lnlq9\" (UID: \"8e874537-2124-44d9-a714-a15aed94095f\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-lnlq9"
Jul 17 19:56:52.265890 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:52.265853    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-lnlq9"
Jul 17 19:56:52.409137 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:52.409108    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-lnlq9"]
Jul 17 19:56:52.413421 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:52.413391    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e874537_2124_44d9_a714_a15aed94095f.slice/crio-8787f2dd5b428038e0a9811f15e6fa9cd6bcd3aa660a5c512cb260b45bd4c36f WatchSource:0}: Error finding container 8787f2dd5b428038e0a9811f15e6fa9cd6bcd3aa660a5c512cb260b45bd4c36f: Status 404 returned error can't find the container with id 8787f2dd5b428038e0a9811f15e6fa9cd6bcd3aa660a5c512cb260b45bd4c36f
Jul 17 19:56:52.427248 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:52.427223    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5440c8ce-a1e1-4930-936f-550f113abe1a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rkrjc\" (UID: \"5440c8ce-a1e1-4930-936f-550f113abe1a\") " pod="openshift-insights/insights-runtime-extractor-rkrjc"
Jul 17 19:56:52.427333 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:52.427267    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5440c8ce-a1e1-4930-936f-550f113abe1a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rkrjc\" (UID: \"5440c8ce-a1e1-4930-936f-550f113abe1a\") " pod="openshift-insights/insights-runtime-extractor-rkrjc"
Jul 17 19:56:52.427333 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:52.427306    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/357dfdb5-256c-4e3f-8859-c733e6dbc076-metrics-tls\") pod \"dns-default-4lxrh\" (UID: \"357dfdb5-256c-4e3f-8859-c733e6dbc076\") " pod="openshift-dns/dns-default-4lxrh"
Jul 17 19:56:52.427473 ip-10-0-141-177 kubenswrapper[2572]: E0717 19:56:52.427369    2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 17 19:56:52.427473 ip-10-0-141-177 kubenswrapper[2572]: E0717 19:56:52.427418    2572 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 17 19:56:52.427473 ip-10-0-141-177 kubenswrapper[2572]: E0717 19:56:52.427439    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5440c8ce-a1e1-4930-936f-550f113abe1a-insights-runtime-extractor-tls podName:5440c8ce-a1e1-4930-936f-550f113abe1a nodeName:}" failed. No retries permitted until 2026-07-17 19:56:54.427416331 +0000 UTC m=+39.268911949 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5440c8ce-a1e1-4930-936f-550f113abe1a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rkrjc" (UID: "5440c8ce-a1e1-4930-936f-550f113abe1a") : secret "insights-runtime-extractor-tls" not found
Jul 17 19:56:52.427473 ip-10-0-141-177 kubenswrapper[2572]: E0717 19:56:52.427457    2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 17 19:56:52.427473 ip-10-0-141-177 kubenswrapper[2572]: E0717 19:56:52.427469    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5440c8ce-a1e1-4930-936f-550f113abe1a-kube-rbac-proxy-cm podName:5440c8ce-a1e1-4930-936f-550f113abe1a nodeName:}" failed. No retries permitted until 2026-07-17 19:56:54.427453763 +0000 UTC m=+39.268949394 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/5440c8ce-a1e1-4930-936f-550f113abe1a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-rkrjc" (UID: "5440c8ce-a1e1-4930-936f-550f113abe1a") : configmap "kube-rbac-proxy" not found
Jul 17 19:56:52.427660 ip-10-0-141-177 kubenswrapper[2572]: E0717 19:56:52.427491    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/357dfdb5-256c-4e3f-8859-c733e6dbc076-metrics-tls podName:357dfdb5-256c-4e3f-8859-c733e6dbc076 nodeName:}" failed. No retries permitted until 2026-07-17 19:56:54.427481114 +0000 UTC m=+39.268976731 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/357dfdb5-256c-4e3f-8859-c733e6dbc076-metrics-tls") pod "dns-default-4lxrh" (UID: "357dfdb5-256c-4e3f-8859-c733e6dbc076") : secret "dns-default-metrics-tls" not found
Jul 17 19:56:52.470378 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:52.470352    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-58598695f7-mqjvj"]
Jul 17 19:56:52.473178 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:52.473156    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-58598695f7-mqjvj"
Jul 17 19:56:52.476371 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:52.476351    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 17 19:56:52.476478 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:52.476351    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 17 19:56:52.476478 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:52.476353    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-lndnk\""
Jul 17 19:56:52.476810 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:52.476791    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 17 19:56:52.476878 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:52.476846    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 17 19:56:52.486528 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:52.486510    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-58598695f7-mqjvj"]
Jul 17 19:56:52.511404 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:52.511381    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 19:56:52.527890 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:52.527821    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/74d68643-3541-4d32-9084-c1fd22778126-signing-key\") pod \"service-ca-58598695f7-mqjvj\" (UID: \"74d68643-3541-4d32-9084-c1fd22778126\") " pod="openshift-service-ca/service-ca-58598695f7-mqjvj"
Jul 17 19:56:52.528000 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:52.527890    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4mb44\" (UniqueName: \"kubernetes.io/projected/74d68643-3541-4d32-9084-c1fd22778126-kube-api-access-4mb44\") pod \"service-ca-58598695f7-mqjvj\" (UID: \"74d68643-3541-4d32-9084-c1fd22778126\") " pod="openshift-service-ca/service-ca-58598695f7-mqjvj"
Jul 17 19:56:52.528000 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:52.527974    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/74d68643-3541-4d32-9084-c1fd22778126-signing-cabundle\") pod \"service-ca-58598695f7-mqjvj\" (UID: \"74d68643-3541-4d32-9084-c1fd22778126\") " pod="openshift-service-ca/service-ca-58598695f7-mqjvj"
Jul 17 19:56:52.621595 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:52.621557    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 19:56:52.628752 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:52.628715    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/74d68643-3541-4d32-9084-c1fd22778126-signing-cabundle\") pod \"service-ca-58598695f7-mqjvj\" (UID: \"74d68643-3541-4d32-9084-c1fd22778126\") " pod="openshift-service-ca/service-ca-58598695f7-mqjvj"
Jul 17 19:56:52.628959 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:52.628785    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/74d68643-3541-4d32-9084-c1fd22778126-signing-key\") pod \"service-ca-58598695f7-mqjvj\" (UID: \"74d68643-3541-4d32-9084-c1fd22778126\") " pod="openshift-service-ca/service-ca-58598695f7-mqjvj"
Jul 17 19:56:52.628959 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:52.628836    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4mb44\" (UniqueName: \"kubernetes.io/projected/74d68643-3541-4d32-9084-c1fd22778126-kube-api-access-4mb44\") pod \"service-ca-58598695f7-mqjvj\" (UID: \"74d68643-3541-4d32-9084-c1fd22778126\") " pod="openshift-service-ca/service-ca-58598695f7-mqjvj"
Jul 17 19:56:52.629499 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:52.629476    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/74d68643-3541-4d32-9084-c1fd22778126-signing-cabundle\") pod \"service-ca-58598695f7-mqjvj\" (UID: \"74d68643-3541-4d32-9084-c1fd22778126\") " pod="openshift-service-ca/service-ca-58598695f7-mqjvj"
Jul 17 19:56:52.632210 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:52.632188    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/74d68643-3541-4d32-9084-c1fd22778126-signing-key\") pod \"service-ca-58598695f7-mqjvj\" (UID: \"74d68643-3541-4d32-9084-c1fd22778126\") " pod="openshift-service-ca/service-ca-58598695f7-mqjvj"
Jul 17 19:56:52.642559 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:52.642537    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4mb44\" (UniqueName: \"kubernetes.io/projected/74d68643-3541-4d32-9084-c1fd22778126-kube-api-access-4mb44\") pod \"service-ca-58598695f7-mqjvj\" (UID: \"74d68643-3541-4d32-9084-c1fd22778126\") " pod="openshift-service-ca/service-ca-58598695f7-mqjvj"
Jul 17 19:56:52.783941 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:52.783864    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-58598695f7-mqjvj"
Jul 17 19:56:52.898007 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:52.897977    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-n5s75_41b71668-ce0c-48b1-b378-35caba808bbb/dns-node-resolver/0.log"
Jul 17 19:56:52.935375 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:52.935344    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-58598695f7-mqjvj"]
Jul 17 19:56:53.017292 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:53.017181    2572 generic.go:356] "Generic (PLEG): container finished" podID="9a15559c-d011-4add-8648-639549beb4ae" containerID="1e4e89085ed34432a4cc18d15504a58a59cd731280ea40fc8a3f2aa9a2b01f07" exitCode=0
Jul 17 19:56:53.017725 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:53.017295    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vgxht" event={"ID":"9a15559c-d011-4add-8648-639549beb4ae","Type":"ContainerDied","Data":"1e4e89085ed34432a4cc18d15504a58a59cd731280ea40fc8a3f2aa9a2b01f07"}
Jul 17 19:56:53.018887 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:53.018860    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-lnlq9" event={"ID":"8e874537-2124-44d9-a714-a15aed94095f","Type":"ContainerStarted","Data":"8787f2dd5b428038e0a9811f15e6fa9cd6bcd3aa660a5c512cb260b45bd4c36f"}
Jul 17 19:56:53.521359 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:53.521317    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 19:56:53.615379 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:53.615352    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 19:56:53.645452 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:56:53.645415    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74d68643_3541_4d32_9084_c1fd22778126.slice/crio-7fa1bb6c54be18f99885598cd57b81eb497632c646ff2ca39dbba2360a073b53 WatchSource:0}: Error finding container 7fa1bb6c54be18f99885598cd57b81eb497632c646ff2ca39dbba2360a073b53: Status 404 returned error can't find the container with id 7fa1bb6c54be18f99885598cd57b81eb497632c646ff2ca39dbba2360a073b53
Jul 17 19:56:53.696432 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:53.696409    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-ds9vw_95a783d7-db2c-4714-bd10-003a4d90aa3f/node-ca/0.log"
Jul 17 19:56:53.749890 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:53.749861    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 19:56:54.021903 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:54.021872    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-58598695f7-mqjvj" event={"ID":"74d68643-3541-4d32-9084-c1fd22778126","Type":"ContainerStarted","Data":"7fa1bb6c54be18f99885598cd57b81eb497632c646ff2ca39dbba2360a073b53"}
Jul 17 19:56:54.445051 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:54.444798    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5440c8ce-a1e1-4930-936f-550f113abe1a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rkrjc\" (UID: \"5440c8ce-a1e1-4930-936f-550f113abe1a\") " pod="openshift-insights/insights-runtime-extractor-rkrjc"
Jul 17 19:56:54.445202 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:54.445056    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5440c8ce-a1e1-4930-936f-550f113abe1a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rkrjc\" (UID: \"5440c8ce-a1e1-4930-936f-550f113abe1a\") " pod="openshift-insights/insights-runtime-extractor-rkrjc"
Jul 17 19:56:54.445202 ip-10-0-141-177 kubenswrapper[2572]: E0717 19:56:54.444993    2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 17 19:56:54.445202 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:54.445151    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/357dfdb5-256c-4e3f-8859-c733e6dbc076-metrics-tls\") pod \"dns-default-4lxrh\" (UID: \"357dfdb5-256c-4e3f-8859-c733e6dbc076\") " pod="openshift-dns/dns-default-4lxrh"
Jul 17 19:56:54.445360 ip-10-0-141-177 kubenswrapper[2572]: E0717 19:56:54.445211    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5440c8ce-a1e1-4930-936f-550f113abe1a-insights-runtime-extractor-tls podName:5440c8ce-a1e1-4930-936f-550f113abe1a nodeName:}" failed. No retries permitted until 2026-07-17 19:56:58.445190965 +0000 UTC m=+43.286686580 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5440c8ce-a1e1-4930-936f-550f113abe1a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rkrjc" (UID: "5440c8ce-a1e1-4930-936f-550f113abe1a") : secret "insights-runtime-extractor-tls" not found
Jul 17 19:56:54.445360 ip-10-0-141-177 kubenswrapper[2572]: E0717 19:56:54.445272    2572 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 17 19:56:54.445360 ip-10-0-141-177 kubenswrapper[2572]: E0717 19:56:54.445316    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5440c8ce-a1e1-4930-936f-550f113abe1a-kube-rbac-proxy-cm podName:5440c8ce-a1e1-4930-936f-550f113abe1a nodeName:}" failed. No retries permitted until 2026-07-17 19:56:58.445304566 +0000 UTC m=+43.286800196 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/5440c8ce-a1e1-4930-936f-550f113abe1a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-rkrjc" (UID: "5440c8ce-a1e1-4930-936f-550f113abe1a") : configmap "kube-rbac-proxy" not found
Jul 17 19:56:54.445517 ip-10-0-141-177 kubenswrapper[2572]: E0717 19:56:54.445392    2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 17 19:56:54.445517 ip-10-0-141-177 kubenswrapper[2572]: E0717 19:56:54.445425    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/357dfdb5-256c-4e3f-8859-c733e6dbc076-metrics-tls podName:357dfdb5-256c-4e3f-8859-c733e6dbc076 nodeName:}" failed. No retries permitted until 2026-07-17 19:56:58.445414078 +0000 UTC m=+43.286909707 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/357dfdb5-256c-4e3f-8859-c733e6dbc076-metrics-tls") pod "dns-default-4lxrh" (UID: "357dfdb5-256c-4e3f-8859-c733e6dbc076") : secret "dns-default-metrics-tls" not found
Jul 17 19:56:55.025345 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:55.025311    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-zsjgs" event={"ID":"a45b1c99-39f4-4e04-b920-ab30659bd943","Type":"ContainerStarted","Data":"fbf3d5acae30a66097704cee36e69fbc3a0e2d60f625b944c92b6e42d6b110a9"}
Jul 17 19:56:55.026949 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:55.026920    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-lnlq9" event={"ID":"8e874537-2124-44d9-a714-a15aed94095f","Type":"ContainerStarted","Data":"ec5fb03654914863c1974fd3912d015a6b64c1ea34b42561187ed896d2abdd3f"}
Jul 17 19:56:55.027114 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:55.026967    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-lnlq9" event={"ID":"8e874537-2124-44d9-a714-a15aed94095f","Type":"ContainerStarted","Data":"3389cbc4fcb4bb581d875aa6ca2ff7d544a63f2cb371949ad15a301c274db3ab"}
Jul 17 19:56:55.029926 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:55.029905    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vgxht" event={"ID":"9a15559c-d011-4add-8648-639549beb4ae","Type":"ContainerStarted","Data":"b5d54bb4e5173bd732b9067245f1d2b1a327833bc85f93c810d5c3f6aca84d60"}
Jul 17 19:56:55.075290 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:55.075251    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-vgxht" podStartSLOduration=7.613575208 podStartE2EDuration="39.075237072s" totalImagesPullingTime="31.461661864s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 19:56:16 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 19:56:55.074476589 +0000 UTC m=+39.915972238" watchObservedRunningTime="2026-07-17 19:56:55.075237072 +0000 UTC m=+39.916732703"
Jul 17 19:56:55.075584 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:55.075562    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-zsjgs" podStartSLOduration=2.335040786 podStartE2EDuration="5.075553328s" totalImagesPullingTime="2.740512542s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 19:56:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 19:56:55.044933738 +0000 UTC m=+39.886429387" watchObservedRunningTime="2026-07-17 19:56:55.075553328 +0000 UTC m=+39.917048995"
Jul 17 19:56:55.095150 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:55.095107    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-lnlq9" podStartSLOduration=2.351692023 podStartE2EDuration="4.095091928s" totalImagesPullingTime="1.743399905s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 19:56:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 19:56:55.093214027 +0000 UTC m=+39.934709683" watchObservedRunningTime="2026-07-17 19:56:55.095091928 +0000 UTC m=+39.936587542"
Jul 17 19:56:55.230562 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:55.230529    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 19:56:55.327721 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:55.327628    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 19:56:56.153230 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:56.153198    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 19:56:57.036648 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:57.036605    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-58598695f7-mqjvj" event={"ID":"74d68643-3541-4d32-9084-c1fd22778126","Type":"ContainerStarted","Data":"4c01bbaa6ba45f9921df62ffa5762ab80eba764fd14038588a1aabc7b09f8e03"}
Jul 17 19:56:57.051834 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:57.051788    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-58598695f7-mqjvj" podStartSLOduration=2.742891584 podStartE2EDuration="5.051770467s" totalImagesPullingTime="2.308878883s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 19:56:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 19:56:57.050995564 +0000 UTC m=+41.892491215" watchObservedRunningTime="2026-07-17 19:56:57.051770467 +0000 UTC m=+41.893266104"
Jul 17 19:56:57.598532 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:57.598494    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 19:56:57.825968 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:57.825922    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 19:56:58.010174 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:58.010092    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 19:56:58.108841 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:58.108805    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 19:56:58.213908 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:58.213879    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 19:56:58.479594 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:58.479502    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5440c8ce-a1e1-4930-936f-550f113abe1a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rkrjc\" (UID: \"5440c8ce-a1e1-4930-936f-550f113abe1a\") " pod="openshift-insights/insights-runtime-extractor-rkrjc"
Jul 17 19:56:58.479594 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:58.479561    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5440c8ce-a1e1-4930-936f-550f113abe1a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rkrjc\" (UID: \"5440c8ce-a1e1-4930-936f-550f113abe1a\") " pod="openshift-insights/insights-runtime-extractor-rkrjc"
Jul 17 19:56:58.479787 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:58.479619    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/357dfdb5-256c-4e3f-8859-c733e6dbc076-metrics-tls\") pod \"dns-default-4lxrh\" (UID: \"357dfdb5-256c-4e3f-8859-c733e6dbc076\") " pod="openshift-dns/dns-default-4lxrh"
Jul 17 19:56:58.479787 ip-10-0-141-177 kubenswrapper[2572]: E0717 19:56:58.479647    2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 17 19:56:58.479787 ip-10-0-141-177 kubenswrapper[2572]: E0717 19:56:58.479709    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5440c8ce-a1e1-4930-936f-550f113abe1a-insights-runtime-extractor-tls podName:5440c8ce-a1e1-4930-936f-550f113abe1a nodeName:}" failed. No retries permitted until 2026-07-17 19:57:06.47969411 +0000 UTC m=+51.321189726 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5440c8ce-a1e1-4930-936f-550f113abe1a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rkrjc" (UID: "5440c8ce-a1e1-4930-936f-550f113abe1a") : secret "insights-runtime-extractor-tls" not found
Jul 17 19:56:58.479787 ip-10-0-141-177 kubenswrapper[2572]: E0717 19:56:58.479728    2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 17 19:56:58.479787 ip-10-0-141-177 kubenswrapper[2572]: E0717 19:56:58.479783    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/357dfdb5-256c-4e3f-8859-c733e6dbc076-metrics-tls podName:357dfdb5-256c-4e3f-8859-c733e6dbc076 nodeName:}" failed. No retries permitted until 2026-07-17 19:57:06.479769051 +0000 UTC m=+51.321264679 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/357dfdb5-256c-4e3f-8859-c733e6dbc076-metrics-tls") pod "dns-default-4lxrh" (UID: "357dfdb5-256c-4e3f-8859-c733e6dbc076") : secret "dns-default-metrics-tls" not found
Jul 17 19:56:58.480122 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:58.480104    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5440c8ce-a1e1-4930-936f-550f113abe1a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rkrjc\" (UID: \"5440c8ce-a1e1-4930-936f-550f113abe1a\") " pod="openshift-insights/insights-runtime-extractor-rkrjc"
Jul 17 19:56:58.727304 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:58.727268    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 19:56:59.325601 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:59.325534    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 19:56:59.716417 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:59.716334    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 19:56:59.916221 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:56:59.916184    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 19:57:00.555010 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:00.554985    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 19:57:00.923042 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:00.922966    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 19:57:01.318494 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:01.318456    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 19:57:01.512359 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:01.512321    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 19:57:01.565426 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:01.565396    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 19:57:01.841125 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:01.841082    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 19:57:01.941311 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:01.941271    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 19:57:02.525982 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:02.525953    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 19:57:03.125153 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:03.125121    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 19:57:03.340080 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:03.340035    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 19:57:03.517017 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:03.516984    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 19:57:03.617695 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:03.617666    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 19:57:03.718448 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:03.718413    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 19:57:03.818425 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:03.818353    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 19:57:04.029799 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:04.029771    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 19:57:04.718023 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:04.717991    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 19:57:04.919039 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:04.919010    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 19:57:05.124307 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:05.124277    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 19:57:05.318412 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:05.318377    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 19:57:05.517025 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:05.516999    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 19:57:05.920139 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:05.920052    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 19:57:06.524370 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:06.524329    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 19:57:06.543487 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:06.543460    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/357dfdb5-256c-4e3f-8859-c733e6dbc076-metrics-tls\") pod \"dns-default-4lxrh\" (UID: \"357dfdb5-256c-4e3f-8859-c733e6dbc076\") " pod="openshift-dns/dns-default-4lxrh"
Jul 17 19:57:06.543601 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:06.543520    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5440c8ce-a1e1-4930-936f-550f113abe1a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rkrjc\" (UID: \"5440c8ce-a1e1-4930-936f-550f113abe1a\") " pod="openshift-insights/insights-runtime-extractor-rkrjc"
Jul 17 19:57:06.546621 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:06.546598    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5440c8ce-a1e1-4930-936f-550f113abe1a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rkrjc\" (UID: \"5440c8ce-a1e1-4930-936f-550f113abe1a\") " pod="openshift-insights/insights-runtime-extractor-rkrjc"
Jul 17 19:57:06.546621 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:06.546620    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/357dfdb5-256c-4e3f-8859-c733e6dbc076-metrics-tls\") pod \"dns-default-4lxrh\" (UID: \"357dfdb5-256c-4e3f-8859-c733e6dbc076\") " pod="openshift-dns/dns-default-4lxrh"
Jul 17 19:57:06.556622 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:06.556603    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-4lxrh"
Jul 17 19:57:06.667702 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:06.667673    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-rkrjc"
Jul 17 19:57:06.686229 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:06.686202    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-4lxrh"]
Jul 17 19:57:06.689488 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:57:06.689458    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod357dfdb5_256c_4e3f_8859_c733e6dbc076.slice/crio-211fa8040dc8d6367b3a8322629d5e1bbdb7b5eaf7678139a24ee60e2852bf86 WatchSource:0}: Error finding container 211fa8040dc8d6367b3a8322629d5e1bbdb7b5eaf7678139a24ee60e2852bf86: Status 404 returned error can't find the container with id 211fa8040dc8d6367b3a8322629d5e1bbdb7b5eaf7678139a24ee60e2852bf86
Jul 17 19:57:06.801999 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:06.801914    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-rkrjc"]
Jul 17 19:57:06.804402 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:57:06.804380    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5440c8ce_a1e1_4930_936f_550f113abe1a.slice/crio-7e7cc793d0a8c7995181b43dbdbcf85a44eccb4dbcaa6795598c4a7f11f459a4 WatchSource:0}: Error finding container 7e7cc793d0a8c7995181b43dbdbcf85a44eccb4dbcaa6795598c4a7f11f459a4: Status 404 returned error can't find the container with id 7e7cc793d0a8c7995181b43dbdbcf85a44eccb4dbcaa6795598c4a7f11f459a4
Jul 17 19:57:06.930273 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:06.930240    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 19:57:07.062864 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:07.062786    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rkrjc" event={"ID":"5440c8ce-a1e1-4930-936f-550f113abe1a","Type":"ContainerStarted","Data":"7e7cc793d0a8c7995181b43dbdbcf85a44eccb4dbcaa6795598c4a7f11f459a4"}
Jul 17 19:57:07.063928 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:07.063903    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4lxrh" event={"ID":"357dfdb5-256c-4e3f-8859-c733e6dbc076","Type":"ContainerStarted","Data":"211fa8040dc8d6367b3a8322629d5e1bbdb7b5eaf7678139a24ee60e2852bf86"}
Jul 17 19:57:07.333604 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:07.333532    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 19:57:07.734061 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:07.733914    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 19:57:07.962583 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:07.962434    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 19:57:08.322095 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:08.322035    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 19:57:08.517896 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:08.517851    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 19:57:08.611698 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:08.611601    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 19:57:10.075181 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:10.075145    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4lxrh" event={"ID":"357dfdb5-256c-4e3f-8859-c733e6dbc076","Type":"ContainerStarted","Data":"eea7de4658fb6a65db4b175d7057b37a24aede4fd6c2f1c3dad6e3e49dc19490"}
Jul 17 19:57:10.075584 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:10.075206    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4lxrh" event={"ID":"357dfdb5-256c-4e3f-8859-c733e6dbc076","Type":"ContainerStarted","Data":"125f191d0957ed0f811ab3aa68e5b8c5fd6434cad4111fcdccc72fb97faec9d5"}
Jul 17 19:57:10.075584 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:10.075236    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-4lxrh"
Jul 17 19:57:10.093739 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:10.093697    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-4lxrh" podStartSLOduration=17.600663905 podStartE2EDuration="20.093682979s" totalImagesPullingTime="2.493019074s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 19:56:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 19:57:10.093267846 +0000 UTC m=+54.934763484" watchObservedRunningTime="2026-07-17 19:57:10.093682979 +0000 UTC m=+54.935178617"
Jul 17 19:57:12.086131 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:12.086096    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rkrjc" event={"ID":"5440c8ce-a1e1-4930-936f-550f113abe1a","Type":"ContainerStarted","Data":"7ca6096b0ed399f0a5ad39dff3eb68bc55d604c9665dbda6187c92257b1f0610"}
Jul 17 19:57:15.100559 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:15.100520    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9975dfc6-lzzs8"]
Jul 17 19:57:15.161308 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:15.161274    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 19:57:15.185329 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:15.185298    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9975dfc6-lzzs8"]
Jul 17 19:57:15.185467 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:15.185388    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9975dfc6-lzzs8"
Jul 17 19:57:15.188377 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:15.188355    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 17 19:57:15.189414 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:15.189293    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-7zwjk\""
Jul 17 19:57:15.189414 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:15.189315    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 17 19:57:15.189694 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:15.189669    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 17 19:57:15.189903 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:15.189680    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 17 19:57:15.199319 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:15.199299    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-784dddf6df-m4ss6"]
Jul 17 19:57:15.234806 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:15.234775    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-784dddf6df-m4ss6"]
Jul 17 19:57:15.234958 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:15.234873    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-784dddf6df-m4ss6"
Jul 17 19:57:15.237579 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:15.237554    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 17 19:57:15.237749 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:15.237595    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-wqfls\""
Jul 17 19:57:15.237749 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:15.237565    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 17 19:57:15.237929 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:15.237748    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 17 19:57:15.245551 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:15.245534    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 17 19:57:15.264193 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:15.264173    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 19:57:15.317874 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:15.317844    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c80c71a8-4f84-4865-b355-15a6d13eaacc-trusted-ca\") pod \"image-registry-784dddf6df-m4ss6\" (UID: \"c80c71a8-4f84-4865-b355-15a6d13eaacc\") " pod="openshift-image-registry/image-registry-784dddf6df-m4ss6"
Jul 17 19:57:15.318043 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:15.317906    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c80c71a8-4f84-4865-b355-15a6d13eaacc-installation-pull-secrets\") pod \"image-registry-784dddf6df-m4ss6\" (UID: \"c80c71a8-4f84-4865-b355-15a6d13eaacc\") " pod="openshift-image-registry/image-registry-784dddf6df-m4ss6"
Jul 17 19:57:15.318043 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:15.317975    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/337270b4-cf9d-490e-af34-a50263997f94-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-9975dfc6-lzzs8\" (UID: \"337270b4-cf9d-490e-af34-a50263997f94\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9975dfc6-lzzs8"
Jul 17 19:57:15.318043 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:15.317999    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c80c71a8-4f84-4865-b355-15a6d13eaacc-registry-tls\") pod \"image-registry-784dddf6df-m4ss6\" (UID: \"c80c71a8-4f84-4865-b355-15a6d13eaacc\") " pod="openshift-image-registry/image-registry-784dddf6df-m4ss6"
Jul 17 19:57:15.318043 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:15.318033    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c80c71a8-4f84-4865-b355-15a6d13eaacc-ca-trust-extracted\") pod \"image-registry-784dddf6df-m4ss6\" (UID: \"c80c71a8-4f84-4865-b355-15a6d13eaacc\") " pod="openshift-image-registry/image-registry-784dddf6df-m4ss6"
Jul 17 19:57:15.318194 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:15.318084    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hdgh6\" (UniqueName: \"kubernetes.io/projected/c80c71a8-4f84-4865-b355-15a6d13eaacc-kube-api-access-hdgh6\") pod \"image-registry-784dddf6df-m4ss6\" (UID: \"c80c71a8-4f84-4865-b355-15a6d13eaacc\") " pod="openshift-image-registry/image-registry-784dddf6df-m4ss6"
Jul 17 19:57:15.318194 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:15.318130    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c80c71a8-4f84-4865-b355-15a6d13eaacc-bound-sa-token\") pod \"image-registry-784dddf6df-m4ss6\" (UID: \"c80c71a8-4f84-4865-b355-15a6d13eaacc\") " pod="openshift-image-registry/image-registry-784dddf6df-m4ss6"
Jul 17 19:57:15.318254 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:15.318195    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c80c71a8-4f84-4865-b355-15a6d13eaacc-image-registry-private-configuration\") pod \"image-registry-784dddf6df-m4ss6\" (UID: \"c80c71a8-4f84-4865-b355-15a6d13eaacc\") " pod="openshift-image-registry/image-registry-784dddf6df-m4ss6"
Jul 17 19:57:15.318254 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:15.318242    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mk2w2\" (UniqueName: \"kubernetes.io/projected/337270b4-cf9d-490e-af34-a50263997f94-kube-api-access-mk2w2\") pod \"managed-serviceaccount-addon-agent-9975dfc6-lzzs8\" (UID: \"337270b4-cf9d-490e-af34-a50263997f94\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9975dfc6-lzzs8"
Jul 17 19:57:15.318322 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:15.318274    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c80c71a8-4f84-4865-b355-15a6d13eaacc-registry-certificates\") pod \"image-registry-784dddf6df-m4ss6\" (UID: \"c80c71a8-4f84-4865-b355-15a6d13eaacc\") " pod="openshift-image-registry/image-registry-784dddf6df-m4ss6"
Jul 17 19:57:15.363726 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:15.363627    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 19:57:15.419310 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:15.419280    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c80c71a8-4f84-4865-b355-15a6d13eaacc-installation-pull-secrets\") pod \"image-registry-784dddf6df-m4ss6\" (UID: \"c80c71a8-4f84-4865-b355-15a6d13eaacc\") " pod="openshift-image-registry/image-registry-784dddf6df-m4ss6"
Jul 17 19:57:15.419310 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:15.419312    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/337270b4-cf9d-490e-af34-a50263997f94-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-9975dfc6-lzzs8\" (UID: \"337270b4-cf9d-490e-af34-a50263997f94\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9975dfc6-lzzs8"
Jul 17 19:57:15.419538 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:15.419329    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c80c71a8-4f84-4865-b355-15a6d13eaacc-registry-tls\") pod \"image-registry-784dddf6df-m4ss6\" (UID: \"c80c71a8-4f84-4865-b355-15a6d13eaacc\") " pod="openshift-image-registry/image-registry-784dddf6df-m4ss6"
Jul 17 19:57:15.419538 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:15.419345    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c80c71a8-4f84-4865-b355-15a6d13eaacc-ca-trust-extracted\") pod \"image-registry-784dddf6df-m4ss6\" (UID: \"c80c71a8-4f84-4865-b355-15a6d13eaacc\") " pod="openshift-image-registry/image-registry-784dddf6df-m4ss6"
Jul 17 19:57:15.419538 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:15.419360    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hdgh6\" (UniqueName: \"kubernetes.io/projected/c80c71a8-4f84-4865-b355-15a6d13eaacc-kube-api-access-hdgh6\") pod \"image-registry-784dddf6df-m4ss6\" (UID: \"c80c71a8-4f84-4865-b355-15a6d13eaacc\") " pod="openshift-image-registry/image-registry-784dddf6df-m4ss6"
Jul 17 19:57:15.419538 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:15.419378    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c80c71a8-4f84-4865-b355-15a6d13eaacc-bound-sa-token\") pod \"image-registry-784dddf6df-m4ss6\" (UID: \"c80c71a8-4f84-4865-b355-15a6d13eaacc\") " pod="openshift-image-registry/image-registry-784dddf6df-m4ss6"
Jul 17 19:57:15.419538 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:15.419413    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c80c71a8-4f84-4865-b355-15a6d13eaacc-image-registry-private-configuration\") pod \"image-registry-784dddf6df-m4ss6\" (UID: \"c80c71a8-4f84-4865-b355-15a6d13eaacc\") " pod="openshift-image-registry/image-registry-784dddf6df-m4ss6"
Jul 17 19:57:15.419538 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:15.419432    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mk2w2\" (UniqueName: \"kubernetes.io/projected/337270b4-cf9d-490e-af34-a50263997f94-kube-api-access-mk2w2\") pod \"managed-serviceaccount-addon-agent-9975dfc6-lzzs8\" (UID: \"337270b4-cf9d-490e-af34-a50263997f94\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9975dfc6-lzzs8"
Jul 17 19:57:15.419538 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:15.419449    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c80c71a8-4f84-4865-b355-15a6d13eaacc-registry-certificates\") pod \"image-registry-784dddf6df-m4ss6\" (UID: \"c80c71a8-4f84-4865-b355-15a6d13eaacc\") " pod="openshift-image-registry/image-registry-784dddf6df-m4ss6"
Jul 17 19:57:15.419538 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:15.419505    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c80c71a8-4f84-4865-b355-15a6d13eaacc-trusted-ca\") pod \"image-registry-784dddf6df-m4ss6\" (UID: \"c80c71a8-4f84-4865-b355-15a6d13eaacc\") " pod="openshift-image-registry/image-registry-784dddf6df-m4ss6"
Jul 17 19:57:15.419900 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:15.419766    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c80c71a8-4f84-4865-b355-15a6d13eaacc-ca-trust-extracted\") pod \"image-registry-784dddf6df-m4ss6\" (UID: \"c80c71a8-4f84-4865-b355-15a6d13eaacc\") " pod="openshift-image-registry/image-registry-784dddf6df-m4ss6"
Jul 17 19:57:15.420651 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:15.420611    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c80c71a8-4f84-4865-b355-15a6d13eaacc-registry-certificates\") pod \"image-registry-784dddf6df-m4ss6\" (UID: \"c80c71a8-4f84-4865-b355-15a6d13eaacc\") " pod="openshift-image-registry/image-registry-784dddf6df-m4ss6"
Jul 17 19:57:15.420993 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:15.420969    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c80c71a8-4f84-4865-b355-15a6d13eaacc-trusted-ca\") pod \"image-registry-784dddf6df-m4ss6\" (UID: \"c80c71a8-4f84-4865-b355-15a6d13eaacc\") " pod="openshift-image-registry/image-registry-784dddf6df-m4ss6"
Jul 17 19:57:15.422155 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:15.422125    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c80c71a8-4f84-4865-b355-15a6d13eaacc-image-registry-private-configuration\") pod \"image-registry-784dddf6df-m4ss6\" (UID: \"c80c71a8-4f84-4865-b355-15a6d13eaacc\") " pod="openshift-image-registry/image-registry-784dddf6df-m4ss6"
Jul 17 19:57:15.422244 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:15.422196    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c80c71a8-4f84-4865-b355-15a6d13eaacc-installation-pull-secrets\") pod \"image-registry-784dddf6df-m4ss6\" (UID: \"c80c71a8-4f84-4865-b355-15a6d13eaacc\") " pod="openshift-image-registry/image-registry-784dddf6df-m4ss6"
Jul 17 19:57:15.422388 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:15.422372    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/337270b4-cf9d-490e-af34-a50263997f94-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-9975dfc6-lzzs8\" (UID: \"337270b4-cf9d-490e-af34-a50263997f94\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9975dfc6-lzzs8"
Jul 17 19:57:15.422542 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:15.422523    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c80c71a8-4f84-4865-b355-15a6d13eaacc-registry-tls\") pod \"image-registry-784dddf6df-m4ss6\" (UID: \"c80c71a8-4f84-4865-b355-15a6d13eaacc\") " pod="openshift-image-registry/image-registry-784dddf6df-m4ss6"
Jul 17 19:57:15.428869 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:15.428845    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hdgh6\" (UniqueName: \"kubernetes.io/projected/c80c71a8-4f84-4865-b355-15a6d13eaacc-kube-api-access-hdgh6\") pod \"image-registry-784dddf6df-m4ss6\" (UID: \"c80c71a8-4f84-4865-b355-15a6d13eaacc\") " pod="openshift-image-registry/image-registry-784dddf6df-m4ss6"
Jul 17 19:57:15.429919 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:15.429900    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mk2w2\" (UniqueName: \"kubernetes.io/projected/337270b4-cf9d-490e-af34-a50263997f94-kube-api-access-mk2w2\") pod \"managed-serviceaccount-addon-agent-9975dfc6-lzzs8\" (UID: \"337270b4-cf9d-490e-af34-a50263997f94\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9975dfc6-lzzs8"
Jul 17 19:57:15.430947 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:15.430931    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c80c71a8-4f84-4865-b355-15a6d13eaacc-bound-sa-token\") pod \"image-registry-784dddf6df-m4ss6\" (UID: \"c80c71a8-4f84-4865-b355-15a6d13eaacc\") " pod="openshift-image-registry/image-registry-784dddf6df-m4ss6"
Jul 17 19:57:15.459597 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:15.459571    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 19:57:15.510400 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:15.510378    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 17 19:57:15.520788 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:15.520766    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-7zwjk\""
Jul 17 19:57:15.528646 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:15.528626    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9975dfc6-lzzs8"
Jul 17 19:57:15.546469 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:15.546443    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-wqfls\""
Jul 17 19:57:15.554498 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:15.554478    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-784dddf6df-m4ss6"
Jul 17 19:57:15.559991 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:15.559971    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 19:57:15.625476 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:15.625429    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 19:57:15.665770 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:15.665708    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9975dfc6-lzzs8"]
Jul 17 19:57:15.713339 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:15.713267    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-784dddf6df-m4ss6"]
Jul 17 19:57:15.789046 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:57:15.789007    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod337270b4_cf9d_490e_af34_a50263997f94.slice/crio-a3b5e8761e53d69782eff614d00542539a9f7abd99e7b8a6058f7f410495eeb3 WatchSource:0}: Error finding container a3b5e8761e53d69782eff614d00542539a9f7abd99e7b8a6058f7f410495eeb3: Status 404 returned error can't find the container with id a3b5e8761e53d69782eff614d00542539a9f7abd99e7b8a6058f7f410495eeb3
Jul 17 19:57:15.789489 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:57:15.789466    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc80c71a8_4f84_4865_b355_15a6d13eaacc.slice/crio-8a40e8f89a86ce591439d965440f2a20b397defb916b6cd09b6eb23b65c53ddb WatchSource:0}: Error finding container 8a40e8f89a86ce591439d965440f2a20b397defb916b6cd09b6eb23b65c53ddb: Status 404 returned error can't find the container with id 8a40e8f89a86ce591439d965440f2a20b397defb916b6cd09b6eb23b65c53ddb
Jul 17 19:57:16.000124 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:16.000100    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9glht"
Jul 17 19:57:16.103040 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:16.102996    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rkrjc" event={"ID":"5440c8ce-a1e1-4930-936f-550f113abe1a","Type":"ContainerStarted","Data":"fac07bcd7229395f84daf7f867d0492d15be75f0c029070dd093dc302b6e5986"}
Jul 17 19:57:16.104517 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:16.104491    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-784dddf6df-m4ss6" event={"ID":"c80c71a8-4f84-4865-b355-15a6d13eaacc","Type":"ContainerStarted","Data":"7a7f0a9b480b441d597792d2666a0a4fb777256b44483cf09940a9c7fc1ba51f"}
Jul 17 19:57:16.104643 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:16.104533    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-784dddf6df-m4ss6" event={"ID":"c80c71a8-4f84-4865-b355-15a6d13eaacc","Type":"ContainerStarted","Data":"8a40e8f89a86ce591439d965440f2a20b397defb916b6cd09b6eb23b65c53ddb"}
Jul 17 19:57:16.104643 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:16.104604    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-784dddf6df-m4ss6"
Jul 17 19:57:16.105652 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:16.105630    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9975dfc6-lzzs8" event={"ID":"337270b4-cf9d-490e-af34-a50263997f94","Type":"ContainerStarted","Data":"a3b5e8761e53d69782eff614d00542539a9f7abd99e7b8a6058f7f410495eeb3"}
Jul 17 19:57:16.146457 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:16.146372    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-784dddf6df-m4ss6" podStartSLOduration=1.146357517 podStartE2EDuration="1.146357517s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 19:57:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 19:57:16.145358709 +0000 UTC m=+60.986854346" watchObservedRunningTime="2026-07-17 19:57:16.146357517 +0000 UTC m=+60.987853133"
Jul 17 19:57:16.159275 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:16.159242    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 19:57:16.226832 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:16.226805    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 19:57:16.451292 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:16.451211    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 19:57:16.551609 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:16.551575    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 19:57:19.309076 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:19.309037    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 19:57:19.409556 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:19.409522    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 19:57:19.650052 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:19.649969    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 19:57:19.725013 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:19.724983    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 19:57:19.870622 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:19.870586    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 19:57:19.888095 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:19.888054    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-bn2zk"]
Jul 17 19:57:19.904453 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:19.904383    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-bn2zk"]
Jul 17 19:57:19.904591 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:19.904479    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-bn2zk"
Jul 17 19:57:19.907385 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:19.907349    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-btpd7\""
Jul 17 19:57:19.907514 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:19.907349    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jul 17 19:57:19.946937 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:19.946905    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 19:57:20.060621 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:20.060582    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/155ab2ab-7deb-42d0-ba74-e443cb9f48a0-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-bn2zk\" (UID: \"155ab2ab-7deb-42d0-ba74-e443cb9f48a0\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-bn2zk"
Jul 17 19:57:20.081475 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:20.081451    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-4lxrh"
Jul 17 19:57:20.161249 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:20.161172    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/155ab2ab-7deb-42d0-ba74-e443cb9f48a0-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-bn2zk\" (UID: \"155ab2ab-7deb-42d0-ba74-e443cb9f48a0\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-bn2zk"
Jul 17 19:57:20.161483 ip-10-0-141-177 kubenswrapper[2572]: E0717 19:57:20.161463    2572 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found
Jul 17 19:57:20.161564 ip-10-0-141-177 kubenswrapper[2572]: E0717 19:57:20.161543    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/155ab2ab-7deb-42d0-ba74-e443cb9f48a0-tls-certificates podName:155ab2ab-7deb-42d0-ba74-e443cb9f48a0 nodeName:}" failed. No retries permitted until 2026-07-17 19:57:20.661520914 +0000 UTC m=+65.503016551 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/155ab2ab-7deb-42d0-ba74-e443cb9f48a0-tls-certificates") pod "prometheus-operator-admission-webhook-85574b5f49-bn2zk" (UID: "155ab2ab-7deb-42d0-ba74-e443cb9f48a0") : secret "prometheus-operator-admission-webhook-tls" not found
Jul 17 19:57:20.363289 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:20.363255    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pqrl9\" (UniqueName: \"kubernetes.io/projected/fbd19d68-8a8e-4110-a4fb-aac8086fc8cf-kube-api-access-pqrl9\") pod \"network-check-target-8gt8j\" (UID: \"fbd19d68-8a8e-4110-a4fb-aac8086fc8cf\") " pod="openshift-network-diagnostics/network-check-target-8gt8j"
Jul 17 19:57:20.365982 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:20.365965    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 17 19:57:20.376456 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:20.376439    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 17 19:57:20.387200 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:20.387177    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pqrl9\" (UniqueName: \"kubernetes.io/projected/fbd19d68-8a8e-4110-a4fb-aac8086fc8cf-kube-api-access-pqrl9\") pod \"network-check-target-8gt8j\" (UID: \"fbd19d68-8a8e-4110-a4fb-aac8086fc8cf\") " pod="openshift-network-diagnostics/network-check-target-8gt8j"
Jul 17 19:57:20.395029 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:20.395012    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-clqd4\""
Jul 17 19:57:20.397707 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:20.397682    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 19:57:20.403759 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:20.403745    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8gt8j"
Jul 17 19:57:20.464182 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:20.464148    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c6e298d5-0e70-47eb-8f91-788894463bc3-metrics-certs\") pod \"network-metrics-daemon-wdqgw\" (UID: \"c6e298d5-0e70-47eb-8f91-788894463bc3\") " pod="openshift-multus/network-metrics-daemon-wdqgw"
Jul 17 19:57:20.464311 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:20.464244    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ad6bcb27-6b22-4d90-9c1a-065a78a17392-original-pull-secret\") pod \"global-pull-secret-syncer-nl98s\" (UID: \"ad6bcb27-6b22-4d90-9c1a-065a78a17392\") " pod="kube-system/global-pull-secret-syncer-nl98s"
Jul 17 19:57:20.467481 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:20.467278    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 17 19:57:20.468097 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:20.468075    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 17 19:57:20.476785 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:20.476759    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ad6bcb27-6b22-4d90-9c1a-065a78a17392-original-pull-secret\") pod \"global-pull-secret-syncer-nl98s\" (UID: \"ad6bcb27-6b22-4d90-9c1a-065a78a17392\") " pod="kube-system/global-pull-secret-syncer-nl98s"
Jul 17 19:57:20.476870 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:20.476767    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c6e298d5-0e70-47eb-8f91-788894463bc3-metrics-certs\") pod \"network-metrics-daemon-wdqgw\" (UID: \"c6e298d5-0e70-47eb-8f91-788894463bc3\") " pod="openshift-multus/network-metrics-daemon-wdqgw"
Jul 17 19:57:20.521889 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:20.521867    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-8gt8j"]
Jul 17 19:57:20.524259 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:57:20.524232    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfbd19d68_8a8e_4110_a4fb_aac8086fc8cf.slice/crio-5f55bec5faae05c95be556e27a5e864fb920000517b682c71bda94656ce3f352 WatchSource:0}: Error finding container 5f55bec5faae05c95be556e27a5e864fb920000517b682c71bda94656ce3f352: Status 404 returned error can't find the container with id 5f55bec5faae05c95be556e27a5e864fb920000517b682c71bda94656ce3f352
Jul 17 19:57:20.666354 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:20.666275    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/155ab2ab-7deb-42d0-ba74-e443cb9f48a0-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-bn2zk\" (UID: \"155ab2ab-7deb-42d0-ba74-e443cb9f48a0\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-bn2zk"
Jul 17 19:57:20.667215 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:20.667187    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 19:57:20.668650 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:20.668628    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/155ab2ab-7deb-42d0-ba74-e443cb9f48a0-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-bn2zk\" (UID: \"155ab2ab-7deb-42d0-ba74-e443cb9f48a0\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-bn2zk"
Jul 17 19:57:20.699634 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:20.699610    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nl98s"
Jul 17 19:57:20.707684 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:20.707664    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-pdp2d\""
Jul 17 19:57:20.716546 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:20.716527    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wdqgw"
Jul 17 19:57:20.815776 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:20.815725    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-bn2zk"
Jul 17 19:57:20.827483 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:20.827452    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-nl98s"]
Jul 17 19:57:20.830052 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:57:20.830022    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad6bcb27_6b22_4d90_9c1a_065a78a17392.slice/crio-360ce31425c7b3d35cbfeeb02fad819b1df1e6077e5d98e85429b93d9d5fc918 WatchSource:0}: Error finding container 360ce31425c7b3d35cbfeeb02fad819b1df1e6077e5d98e85429b93d9d5fc918: Status 404 returned error can't find the container with id 360ce31425c7b3d35cbfeeb02fad819b1df1e6077e5d98e85429b93d9d5fc918
Jul 17 19:57:20.848617 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:20.848566    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-wdqgw"]
Jul 17 19:57:20.851034 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:57:20.851009    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6e298d5_0e70_47eb_8f91_788894463bc3.slice/crio-bb15317126fa7c752667e46bf2633b869cb9afd61671fdf90fc132a2053711ef WatchSource:0}: Error finding container bb15317126fa7c752667e46bf2633b869cb9afd61671fdf90fc132a2053711ef: Status 404 returned error can't find the container with id bb15317126fa7c752667e46bf2633b869cb9afd61671fdf90fc132a2053711ef
Jul 17 19:57:20.946049 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:20.945962    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-bn2zk"]
Jul 17 19:57:20.949060 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:57:20.949032    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod155ab2ab_7deb_42d0_ba74_e443cb9f48a0.slice/crio-1e24f9a7abc77086fbc4fbd2e97e10923f68da6588e4da9c0c7b7dedd0bed8de WatchSource:0}: Error finding container 1e24f9a7abc77086fbc4fbd2e97e10923f68da6588e4da9c0c7b7dedd0bed8de: Status 404 returned error can't find the container with id 1e24f9a7abc77086fbc4fbd2e97e10923f68da6588e4da9c0c7b7dedd0bed8de
Jul 17 19:57:21.067916 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:21.067879    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 19:57:21.129524 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:21.129478    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-bn2zk" event={"ID":"155ab2ab-7deb-42d0-ba74-e443cb9f48a0","Type":"ContainerStarted","Data":"1e24f9a7abc77086fbc4fbd2e97e10923f68da6588e4da9c0c7b7dedd0bed8de"}
Jul 17 19:57:21.131816 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:21.131786    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rkrjc" event={"ID":"5440c8ce-a1e1-4930-936f-550f113abe1a","Type":"ContainerStarted","Data":"16bdfec53d9c36f888e95a894c89dfb45ca16997842e3ef09a4823b658332f1a"}
Jul 17 19:57:21.133232 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:21.133201    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-wdqgw" event={"ID":"c6e298d5-0e70-47eb-8f91-788894463bc3","Type":"ContainerStarted","Data":"bb15317126fa7c752667e46bf2633b869cb9afd61671fdf90fc132a2053711ef"}
Jul 17 19:57:21.134384 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:21.134362    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-nl98s" event={"ID":"ad6bcb27-6b22-4d90-9c1a-065a78a17392","Type":"ContainerStarted","Data":"360ce31425c7b3d35cbfeeb02fad819b1df1e6077e5d98e85429b93d9d5fc918"}
Jul 17 19:57:21.135881 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:21.135855    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9975dfc6-lzzs8" event={"ID":"337270b4-cf9d-490e-af34-a50263997f94","Type":"ContainerStarted","Data":"bdc9d64d592527a0c43f1bb903cbfc64ca5687aa26ada8118ab791a34da9d9c2"}
Jul 17 19:57:21.137201 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:21.137176    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-8gt8j" event={"ID":"fbd19d68-8a8e-4110-a4fb-aac8086fc8cf","Type":"ContainerStarted","Data":"5f55bec5faae05c95be556e27a5e864fb920000517b682c71bda94656ce3f352"}
Jul 17 19:57:21.138894 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:21.138874    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 19:57:21.153457 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:21.153399    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-rkrjc" podStartSLOduration=17.891469816 podStartE2EDuration="31.153385035s" totalImagesPullingTime="13.261915219s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 19:56:50 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 19:57:21.153296935 +0000 UTC m=+65.994792603" watchObservedRunningTime="2026-07-17 19:57:21.153385035 +0000 UTC m=+65.994880672"
Jul 17 19:57:21.173581 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:21.173521    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-9975dfc6-lzzs8" podStartSLOduration=1.7734279339999999 podStartE2EDuration="6.173499875s" totalImagesPullingTime="4.400071941s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 19:57:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 19:57:21.172448763 +0000 UTC m=+66.013944402" watchObservedRunningTime="2026-07-17 19:57:21.173499875 +0000 UTC m=+66.014995513"
Jul 17 19:57:21.917728 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:21.917668    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 19:57:22.018792 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:22.018748    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 19:57:22.119343 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:22.119247    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 19:57:25.934979 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:25.934948    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-5bc67dcd46-fzddp"]
Jul 17 19:57:25.948189 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:25.948155    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 19:57:25.949621 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:25.949602    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5bc67dcd46-fzddp"]
Jul 17 19:57:25.949738 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:25.949717    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5bc67dcd46-fzddp"
Jul 17 19:57:25.952233 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:25.952170    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 17 19:57:25.952233 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:25.952210    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 17 19:57:25.952399 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:25.952214    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-sqrnm\""
Jul 17 19:57:26.045762 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:26.045732    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 19:57:26.109911 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:26.109887    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rlktv\" (UniqueName: \"kubernetes.io/projected/9e89f28b-5ef8-4da9-995d-418797b888aa-kube-api-access-rlktv\") pod \"downloads-5bc67dcd46-fzddp\" (UID: \"9e89f28b-5ef8-4da9-995d-418797b888aa\") " pod="openshift-console/downloads-5bc67dcd46-fzddp"
Jul 17 19:57:26.145894 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:26.145861    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 19:57:26.157827 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:26.157762    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-bn2zk" event={"ID":"155ab2ab-7deb-42d0-ba74-e443cb9f48a0","Type":"ContainerStarted","Data":"fdb5060fafb3631be2064f5e4c9933d2789044e4e98281210dbff24be9f00485"}
Jul 17 19:57:26.157951 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:26.157926    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-bn2zk"
Jul 17 19:57:26.159728 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:26.159705    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-wdqgw" event={"ID":"c6e298d5-0e70-47eb-8f91-788894463bc3","Type":"ContainerStarted","Data":"45543098295a5dcb23fdcadb997385f718fef5e459c2f6b05a3c2e9faf94a281"}
Jul 17 19:57:26.159914 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:26.159884    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-wdqgw" event={"ID":"c6e298d5-0e70-47eb-8f91-788894463bc3","Type":"ContainerStarted","Data":"d5d09fe67bb798bef434562dbe64bcbde4b0eb9ce1e2d9a8e2f65189696b3355"}
Jul 17 19:57:26.161215 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:26.161190    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-nl98s" event={"ID":"ad6bcb27-6b22-4d90-9c1a-065a78a17392","Type":"ContainerStarted","Data":"501e9180e9006f1495177280e2cfebfbc7c516a45cdb8ddefff5684825fd2ba5"}
Jul 17 19:57:26.162697 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:26.162678    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-8gt8j" event={"ID":"fbd19d68-8a8e-4110-a4fb-aac8086fc8cf","Type":"ContainerStarted","Data":"fc998d66d321f1780d4d4463567db9d0b0a30b7cd408316c51f054d869c5d11e"}
Jul 17 19:57:26.162830 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:26.162815    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-8gt8j"
Jul 17 19:57:26.163488 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:26.163472    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-bn2zk"
Jul 17 19:57:26.186984 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:26.186942    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-bn2zk" podStartSLOduration=5.455608983 podStartE2EDuration="7.186925547s" totalImagesPullingTime="1.731316564s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 19:57:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 19:57:26.173797566 +0000 UTC m=+71.015293226" watchObservedRunningTime="2026-07-17 19:57:26.186925547 +0000 UTC m=+71.028421185"
Jul 17 19:57:26.187623 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:26.187596    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-nl98s" podStartSLOduration=65.330718273 podStartE2EDuration="1m10.187589462s" totalImagesPullingTime="4.856871189s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 19:56:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 19:57:26.186759244 +0000 UTC m=+71.028254891" watchObservedRunningTime="2026-07-17 19:57:26.187589462 +0000 UTC m=+71.029085099"
Jul 17 19:57:26.200035 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:26.200001    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-8gt8j" podStartSLOduration=65.051249545 podStartE2EDuration="1m10.199989535s" totalImagesPullingTime="5.14873999s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 19:56:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 19:57:26.19958663 +0000 UTC m=+71.041082306" watchObservedRunningTime="2026-07-17 19:57:26.199989535 +0000 UTC m=+71.041485166"
Jul 17 19:57:26.210453 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:26.210435    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rlktv\" (UniqueName: \"kubernetes.io/projected/9e89f28b-5ef8-4da9-995d-418797b888aa-kube-api-access-rlktv\") pod \"downloads-5bc67dcd46-fzddp\" (UID: \"9e89f28b-5ef8-4da9-995d-418797b888aa\") " pod="openshift-console/downloads-5bc67dcd46-fzddp"
Jul 17 19:57:26.215023 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:26.214992    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-wdqgw" podStartSLOduration=68.386866289 podStartE2EDuration="1m10.214980581s" totalImagesPullingTime="1.828114292s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 19:56:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 19:57:26.214260124 +0000 UTC m=+71.055755761" watchObservedRunningTime="2026-07-17 19:57:26.214980581 +0000 UTC m=+71.056476219"
Jul 17 19:57:26.219037 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:26.219020    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rlktv\" (UniqueName: \"kubernetes.io/projected/9e89f28b-5ef8-4da9-995d-418797b888aa-kube-api-access-rlktv\") pod \"downloads-5bc67dcd46-fzddp\" (UID: \"9e89f28b-5ef8-4da9-995d-418797b888aa\") " pod="openshift-console/downloads-5bc67dcd46-fzddp"
Jul 17 19:57:26.260412 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:26.260384    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5bc67dcd46-fzddp"
Jul 17 19:57:26.270336 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:26.270311    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 19:57:26.331385 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:26.331356    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 19:57:26.388467 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:26.388436    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 19:57:26.405759 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:26.405657    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5bc67dcd46-fzddp"]
Jul 17 19:57:26.408228 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:57:26.408171    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e89f28b_5ef8_4da9_995d_418797b888aa.slice/crio-69075b61a6b42e5bec460ac346da1dffdf5398c1675a37efb62b3c51be548838 WatchSource:0}: Error finding container 69075b61a6b42e5bec460ac346da1dffdf5398c1675a37efb62b3c51be548838: Status 404 returned error can't find the container with id 69075b61a6b42e5bec460ac346da1dffdf5398c1675a37efb62b3c51be548838
Jul 17 19:57:26.610361 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:26.610308    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 19:57:26.658655 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:26.658562    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 19:57:26.901508 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:26.901470    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 19:57:26.968684 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:26.968604    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 19:57:27.023495 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:27.023449    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 19:57:27.167326 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:27.167292    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5bc67dcd46-fzddp" event={"ID":"9e89f28b-5ef8-4da9-995d-418797b888aa","Type":"ContainerStarted","Data":"69075b61a6b42e5bec460ac346da1dffdf5398c1675a37efb62b3c51be548838"}
Jul 17 19:57:27.545824 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:27.545794    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 19:57:27.823524 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:27.823417    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 19:57:28.021569 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:28.021534    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 19:57:28.122341 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:28.122261    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 19:57:28.439757 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:28.439680    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 19:57:28.540100 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:28.540051    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 19:57:29.262119 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:29.262088    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 19:57:29.491734 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:29.491689    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 19:57:32.046511 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:32.046479    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 19:57:32.260345 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:32.260270    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 19:57:32.276745 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:32.276714    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-txg94"]
Jul 17 19:57:32.279383 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:32.279278    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-txg94"
Jul 17 19:57:32.281974 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:32.281944    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 17 19:57:32.282197 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:32.282180    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 17 19:57:32.282374 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:32.282354    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 17 19:57:32.282844 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:32.282822    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 17 19:57:32.282941 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:32.282909    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-4p6nk\""
Jul 17 19:57:32.283052 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:32.283037    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 17 19:57:32.292998 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:32.292973    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-txg94"]
Jul 17 19:57:32.314662 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:32.314591    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-pwdw7"]
Jul 17 19:57:32.316980 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:32.316961    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-pwdw7"
Jul 17 19:57:32.319339 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:32.319317    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 17 19:57:32.319339 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:32.319328    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 17 19:57:32.319661 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:32.319637    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-bmrll\""
Jul 17 19:57:32.319766 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:32.319712    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 17 19:57:32.348261 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:32.348199    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 19:57:32.413728 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:32.413658    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 19:57:32.462099 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:32.462050    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a00d0a24-fedf-442b-93f4-661e223573b8-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-txg94\" (UID: \"a00d0a24-fedf-442b-93f4-661e223573b8\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-txg94"
Jul 17 19:57:32.462292 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:32.462108    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-77z95\" (UniqueName: \"kubernetes.io/projected/a00d0a24-fedf-442b-93f4-661e223573b8-kube-api-access-77z95\") pod \"openshift-state-metrics-79f6958cdf-txg94\" (UID: \"a00d0a24-fedf-442b-93f4-661e223573b8\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-txg94"
Jul 17 19:57:32.462292 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:32.462135    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a789aa14-a399-4ed6-886f-73a3813977db-node-exporter-textfile\") pod \"node-exporter-pwdw7\" (UID: \"a789aa14-a399-4ed6-886f-73a3813977db\") " pod="openshift-monitoring/node-exporter-pwdw7"
Jul 17 19:57:32.462292 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:32.462155    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a789aa14-a399-4ed6-886f-73a3813977db-root\") pod \"node-exporter-pwdw7\" (UID: \"a789aa14-a399-4ed6-886f-73a3813977db\") " pod="openshift-monitoring/node-exporter-pwdw7"
Jul 17 19:57:32.462292 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:32.462191    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a789aa14-a399-4ed6-886f-73a3813977db-node-exporter-tls\") pod \"node-exporter-pwdw7\" (UID: \"a789aa14-a399-4ed6-886f-73a3813977db\") " pod="openshift-monitoring/node-exporter-pwdw7"
Jul 17 19:57:32.462292 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:32.462219    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a00d0a24-fedf-442b-93f4-661e223573b8-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-txg94\" (UID: \"a00d0a24-fedf-442b-93f4-661e223573b8\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-txg94"
Jul 17 19:57:32.462292 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:32.462268    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a00d0a24-fedf-442b-93f4-661e223573b8-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-txg94\" (UID: \"a00d0a24-fedf-442b-93f4-661e223573b8\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-txg94"
Jul 17 19:57:32.462562 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:32.462357    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p52f4\" (UniqueName: \"kubernetes.io/projected/a789aa14-a399-4ed6-886f-73a3813977db-kube-api-access-p52f4\") pod \"node-exporter-pwdw7\" (UID: \"a789aa14-a399-4ed6-886f-73a3813977db\") " pod="openshift-monitoring/node-exporter-pwdw7"
Jul 17 19:57:32.462562 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:32.462395    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a789aa14-a399-4ed6-886f-73a3813977db-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-pwdw7\" (UID: \"a789aa14-a399-4ed6-886f-73a3813977db\") " pod="openshift-monitoring/node-exporter-pwdw7"
Jul 17 19:57:32.462562 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:32.462423    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a789aa14-a399-4ed6-886f-73a3813977db-sys\") pod \"node-exporter-pwdw7\" (UID: \"a789aa14-a399-4ed6-886f-73a3813977db\") " pod="openshift-monitoring/node-exporter-pwdw7"
Jul 17 19:57:32.462562 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:32.462465    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a789aa14-a399-4ed6-886f-73a3813977db-node-exporter-accelerators-collector-config\") pod \"node-exporter-pwdw7\" (UID: \"a789aa14-a399-4ed6-886f-73a3813977db\") " pod="openshift-monitoring/node-exporter-pwdw7"
Jul 17 19:57:32.462562 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:32.462522    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a789aa14-a399-4ed6-886f-73a3813977db-node-exporter-wtmp\") pod \"node-exporter-pwdw7\" (UID: \"a789aa14-a399-4ed6-886f-73a3813977db\") " pod="openshift-monitoring/node-exporter-pwdw7"
Jul 17 19:57:32.462562 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:32.462548    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a789aa14-a399-4ed6-886f-73a3813977db-metrics-client-ca\") pod \"node-exporter-pwdw7\" (UID: \"a789aa14-a399-4ed6-886f-73a3813977db\") " pod="openshift-monitoring/node-exporter-pwdw7"
Jul 17 19:57:32.516091 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:32.515271    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 19:57:32.563826 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:32.563794    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a789aa14-a399-4ed6-886f-73a3813977db-sys\") pod \"node-exporter-pwdw7\" (UID: \"a789aa14-a399-4ed6-886f-73a3813977db\") " pod="openshift-monitoring/node-exporter-pwdw7"
Jul 17 19:57:32.564000 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:32.563851    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a789aa14-a399-4ed6-886f-73a3813977db-node-exporter-accelerators-collector-config\") pod \"node-exporter-pwdw7\" (UID: \"a789aa14-a399-4ed6-886f-73a3813977db\") " pod="openshift-monitoring/node-exporter-pwdw7"
Jul 17 19:57:32.564000 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:32.563862    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a789aa14-a399-4ed6-886f-73a3813977db-sys\") pod \"node-exporter-pwdw7\" (UID: \"a789aa14-a399-4ed6-886f-73a3813977db\") " pod="openshift-monitoring/node-exporter-pwdw7"
Jul 17 19:57:32.564000 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:32.563894    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a789aa14-a399-4ed6-886f-73a3813977db-node-exporter-wtmp\") pod \"node-exporter-pwdw7\" (UID: \"a789aa14-a399-4ed6-886f-73a3813977db\") " pod="openshift-monitoring/node-exporter-pwdw7"
Jul 17 19:57:32.564000 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:32.563918    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a789aa14-a399-4ed6-886f-73a3813977db-metrics-client-ca\") pod \"node-exporter-pwdw7\" (UID: \"a789aa14-a399-4ed6-886f-73a3813977db\") " pod="openshift-monitoring/node-exporter-pwdw7"
Jul 17 19:57:32.564000 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:32.563953    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a00d0a24-fedf-442b-93f4-661e223573b8-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-txg94\" (UID: \"a00d0a24-fedf-442b-93f4-661e223573b8\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-txg94"
Jul 17 19:57:32.564000 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:32.563983    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-77z95\" (UniqueName: \"kubernetes.io/projected/a00d0a24-fedf-442b-93f4-661e223573b8-kube-api-access-77z95\") pod \"openshift-state-metrics-79f6958cdf-txg94\" (UID: \"a00d0a24-fedf-442b-93f4-661e223573b8\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-txg94"
Jul 17 19:57:32.564331 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:32.564004    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a789aa14-a399-4ed6-886f-73a3813977db-node-exporter-textfile\") pod \"node-exporter-pwdw7\" (UID: \"a789aa14-a399-4ed6-886f-73a3813977db\") " pod="openshift-monitoring/node-exporter-pwdw7"
Jul 17 19:57:32.564331 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:32.564023    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a789aa14-a399-4ed6-886f-73a3813977db-root\") pod \"node-exporter-pwdw7\" (UID: \"a789aa14-a399-4ed6-886f-73a3813977db\") " pod="openshift-monitoring/node-exporter-pwdw7"
Jul 17 19:57:32.564331 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:32.564061    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a789aa14-a399-4ed6-886f-73a3813977db-node-exporter-tls\") pod \"node-exporter-pwdw7\" (UID: \"a789aa14-a399-4ed6-886f-73a3813977db\") " pod="openshift-monitoring/node-exporter-pwdw7"
Jul 17 19:57:32.564331 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:32.564115    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a00d0a24-fedf-442b-93f4-661e223573b8-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-txg94\" (UID: \"a00d0a24-fedf-442b-93f4-661e223573b8\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-txg94"
Jul 17 19:57:32.564331 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:32.564142    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a00d0a24-fedf-442b-93f4-661e223573b8-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-txg94\" (UID: \"a00d0a24-fedf-442b-93f4-661e223573b8\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-txg94"
Jul 17 19:57:32.564331 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:32.564171    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p52f4\" (UniqueName: \"kubernetes.io/projected/a789aa14-a399-4ed6-886f-73a3813977db-kube-api-access-p52f4\") pod \"node-exporter-pwdw7\" (UID: \"a789aa14-a399-4ed6-886f-73a3813977db\") " pod="openshift-monitoring/node-exporter-pwdw7"
Jul 17 19:57:32.564331 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:32.564196    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a789aa14-a399-4ed6-886f-73a3813977db-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-pwdw7\" (UID: \"a789aa14-a399-4ed6-886f-73a3813977db\") " pod="openshift-monitoring/node-exporter-pwdw7"
Jul 17 19:57:32.564649 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:32.564493    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a789aa14-a399-4ed6-886f-73a3813977db-node-exporter-accelerators-collector-config\") pod \"node-exporter-pwdw7\" (UID: \"a789aa14-a399-4ed6-886f-73a3813977db\") " pod="openshift-monitoring/node-exporter-pwdw7"
Jul 17 19:57:32.564730 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:32.564685    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a789aa14-a399-4ed6-886f-73a3813977db-node-exporter-textfile\") pod \"node-exporter-pwdw7\" (UID: \"a789aa14-a399-4ed6-886f-73a3813977db\") " pod="openshift-monitoring/node-exporter-pwdw7"
Jul 17 19:57:32.565492 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:32.564979    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a789aa14-a399-4ed6-886f-73a3813977db-metrics-client-ca\") pod \"node-exporter-pwdw7\" (UID: \"a789aa14-a399-4ed6-886f-73a3813977db\") " pod="openshift-monitoring/node-exporter-pwdw7"
Jul 17 19:57:32.565492 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:32.565155    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a789aa14-a399-4ed6-886f-73a3813977db-node-exporter-wtmp\") pod \"node-exporter-pwdw7\" (UID: \"a789aa14-a399-4ed6-886f-73a3813977db\") " pod="openshift-monitoring/node-exporter-pwdw7"
Jul 17 19:57:32.565492 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:32.565378    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a00d0a24-fedf-442b-93f4-661e223573b8-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-txg94\" (UID: \"a00d0a24-fedf-442b-93f4-661e223573b8\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-txg94"
Jul 17 19:57:32.565492 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:32.565448    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a789aa14-a399-4ed6-886f-73a3813977db-root\") pod \"node-exporter-pwdw7\" (UID: \"a789aa14-a399-4ed6-886f-73a3813977db\") " pod="openshift-monitoring/node-exporter-pwdw7"
Jul 17 19:57:32.565767 ip-10-0-141-177 kubenswrapper[2572]: E0717 19:57:32.565521    2572 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 17 19:57:32.565767 ip-10-0-141-177 kubenswrapper[2572]: E0717 19:57:32.565588    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a789aa14-a399-4ed6-886f-73a3813977db-node-exporter-tls podName:a789aa14-a399-4ed6-886f-73a3813977db nodeName:}" failed. No retries permitted until 2026-07-17 19:57:33.065567402 +0000 UTC m=+77.907063023 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/a789aa14-a399-4ed6-886f-73a3813977db-node-exporter-tls") pod "node-exporter-pwdw7" (UID: "a789aa14-a399-4ed6-886f-73a3813977db") : secret "node-exporter-tls" not found
Jul 17 19:57:32.568160 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:32.568117    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a789aa14-a399-4ed6-886f-73a3813977db-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-pwdw7\" (UID: \"a789aa14-a399-4ed6-886f-73a3813977db\") " pod="openshift-monitoring/node-exporter-pwdw7"
Jul 17 19:57:32.568500 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:32.568459    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a00d0a24-fedf-442b-93f4-661e223573b8-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-txg94\" (UID: \"a00d0a24-fedf-442b-93f4-661e223573b8\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-txg94"
Jul 17 19:57:32.568605 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:32.568552    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a00d0a24-fedf-442b-93f4-661e223573b8-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-txg94\" (UID: \"a00d0a24-fedf-442b-93f4-661e223573b8\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-txg94"
Jul 17 19:57:32.577634 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:32.577588    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-77z95\" (UniqueName: \"kubernetes.io/projected/a00d0a24-fedf-442b-93f4-661e223573b8-kube-api-access-77z95\") pod \"openshift-state-metrics-79f6958cdf-txg94\" (UID: \"a00d0a24-fedf-442b-93f4-661e223573b8\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-txg94"
Jul 17 19:57:32.577742 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:32.577651    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p52f4\" (UniqueName: \"kubernetes.io/projected/a789aa14-a399-4ed6-886f-73a3813977db-kube-api-access-p52f4\") pod \"node-exporter-pwdw7\" (UID: \"a789aa14-a399-4ed6-886f-73a3813977db\") " pod="openshift-monitoring/node-exporter-pwdw7"
Jul 17 19:57:32.595993 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:32.595969    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-txg94"
Jul 17 19:57:32.612848 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:32.612773    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 19:57:32.664026 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:32.663899    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 19:57:32.720291 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:32.720251    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 19:57:32.744214 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:32.744188    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-txg94"]
Jul 17 19:57:32.746914 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:57:32.746883    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda00d0a24_fedf_442b_93f4_661e223573b8.slice/crio-abcb73f84169c2796bd6f0940d80bad842137293355d5bf9f7ec3faed66c7d83 WatchSource:0}: Error finding container abcb73f84169c2796bd6f0940d80bad842137293355d5bf9f7ec3faed66c7d83: Status 404 returned error can't find the container with id abcb73f84169c2796bd6f0940d80bad842137293355d5bf9f7ec3faed66c7d83
Jul 17 19:57:32.820209 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:32.820175    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 19:57:33.068853 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:33.068762    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a789aa14-a399-4ed6-886f-73a3813977db-node-exporter-tls\") pod \"node-exporter-pwdw7\" (UID: \"a789aa14-a399-4ed6-886f-73a3813977db\") " pod="openshift-monitoring/node-exporter-pwdw7"
Jul 17 19:57:33.071512 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:33.071484    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a789aa14-a399-4ed6-886f-73a3813977db-node-exporter-tls\") pod \"node-exporter-pwdw7\" (UID: \"a789aa14-a399-4ed6-886f-73a3813977db\") " pod="openshift-monitoring/node-exporter-pwdw7"
Jul 17 19:57:33.193334 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:33.193299    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-txg94" event={"ID":"a00d0a24-fedf-442b-93f4-661e223573b8","Type":"ContainerStarted","Data":"08c5b1cae7a337620bf60f972d382b9ab26afa8b1721285a8984978d87c45467"}
Jul 17 19:57:33.193499 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:33.193391    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-txg94" event={"ID":"a00d0a24-fedf-442b-93f4-661e223573b8","Type":"ContainerStarted","Data":"4350bd86f86f46e9f5fa3d71ffc9769213064883578121be701dd51a1ad50354"}
Jul 17 19:57:33.193499 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:33.193411    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-txg94" event={"ID":"a00d0a24-fedf-442b-93f4-661e223573b8","Type":"ContainerStarted","Data":"abcb73f84169c2796bd6f0940d80bad842137293355d5bf9f7ec3faed66c7d83"}
Jul 17 19:57:33.228339 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:33.228306    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-pwdw7"
Jul 17 19:57:33.245430 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:57:33.245395    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda789aa14_a399_4ed6_886f_73a3813977db.slice/crio-fd25146c9e5619d328db168e31998831d741901277f41eb479177b221bfd626d WatchSource:0}: Error finding container fd25146c9e5619d328db168e31998831d741901277f41eb479177b221bfd626d: Status 404 returned error can't find the container with id fd25146c9e5619d328db168e31998831d741901277f41eb479177b221bfd626d
Jul 17 19:57:33.266760 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:33.266731    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 19:57:33.339797 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:33.339722    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 19:57:33.757785 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:33.757747    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 19:57:34.199819 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:34.199782    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-txg94" event={"ID":"a00d0a24-fedf-442b-93f4-661e223573b8","Type":"ContainerStarted","Data":"e888db753d23ee932a2ccb9c82a346736664993676d722a0d3c92d6188701586"}
Jul 17 19:57:34.201773 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:34.201746    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pwdw7" event={"ID":"a789aa14-a399-4ed6-886f-73a3813977db","Type":"ContainerStarted","Data":"fd25146c9e5619d328db168e31998831d741901277f41eb479177b221bfd626d"}
Jul 17 19:57:34.219223 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:34.219165    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-txg94" podStartSLOduration=1.077344214 podStartE2EDuration="2.219144575s" totalImagesPullingTime="1.141800361s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 19:57:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 19:57:34.219099959 +0000 UTC m=+79.060595597" watchObservedRunningTime="2026-07-17 19:57:34.219144575 +0000 UTC m=+79.060640213"
Jul 17 19:57:34.279084 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:34.278986    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-5b5df5cf5f-6d7xn"]
Jul 17 19:57:34.283153 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:34.283127    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5b5df5cf5f-6d7xn"
Jul 17 19:57:34.285818 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:34.285514    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 17 19:57:34.285818 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:34.285514    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 17 19:57:34.285818 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:34.285742    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 17 19:57:34.286028 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:34.285991    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-3ujeb238rmml0\""
Jul 17 19:57:34.286028 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:34.286023    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-x5xmq\""
Jul 17 19:57:34.286148 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:34.286046    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 17 19:57:34.286148 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:34.286097    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 17 19:57:34.295325 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:34.295302    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5b5df5cf5f-6d7xn"]
Jul 17 19:57:34.379759 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:34.379725    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f8a07ea9-cdd2-4019-872f-a9e3596e2e56-secret-grpc-tls\") pod \"thanos-querier-5b5df5cf5f-6d7xn\" (UID: \"f8a07ea9-cdd2-4019-872f-a9e3596e2e56\") " pod="openshift-monitoring/thanos-querier-5b5df5cf5f-6d7xn"
Jul 17 19:57:34.379918 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:34.379772    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/f8a07ea9-cdd2-4019-872f-a9e3596e2e56-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5b5df5cf5f-6d7xn\" (UID: \"f8a07ea9-cdd2-4019-872f-a9e3596e2e56\") " pod="openshift-monitoring/thanos-querier-5b5df5cf5f-6d7xn"
Jul 17 19:57:34.379918 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:34.379808    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f8a07ea9-cdd2-4019-872f-a9e3596e2e56-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5b5df5cf5f-6d7xn\" (UID: \"f8a07ea9-cdd2-4019-872f-a9e3596e2e56\") " pod="openshift-monitoring/thanos-querier-5b5df5cf5f-6d7xn"
Jul 17 19:57:34.379918 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:34.379831    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j746s\" (UniqueName: \"kubernetes.io/projected/f8a07ea9-cdd2-4019-872f-a9e3596e2e56-kube-api-access-j746s\") pod \"thanos-querier-5b5df5cf5f-6d7xn\" (UID: \"f8a07ea9-cdd2-4019-872f-a9e3596e2e56\") " pod="openshift-monitoring/thanos-querier-5b5df5cf5f-6d7xn"
Jul 17 19:57:34.379918 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:34.379851    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/f8a07ea9-cdd2-4019-872f-a9e3596e2e56-secret-thanos-querier-tls\") pod \"thanos-querier-5b5df5cf5f-6d7xn\" (UID: \"f8a07ea9-cdd2-4019-872f-a9e3596e2e56\") " pod="openshift-monitoring/thanos-querier-5b5df5cf5f-6d7xn"
Jul 17 19:57:34.379918 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:34.379869    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f8a07ea9-cdd2-4019-872f-a9e3596e2e56-metrics-client-ca\") pod \"thanos-querier-5b5df5cf5f-6d7xn\" (UID: \"f8a07ea9-cdd2-4019-872f-a9e3596e2e56\") " pod="openshift-monitoring/thanos-querier-5b5df5cf5f-6d7xn"
Jul 17 19:57:34.379918 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:34.379887    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/f8a07ea9-cdd2-4019-872f-a9e3596e2e56-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5b5df5cf5f-6d7xn\" (UID: \"f8a07ea9-cdd2-4019-872f-a9e3596e2e56\") " pod="openshift-monitoring/thanos-querier-5b5df5cf5f-6d7xn"
Jul 17 19:57:34.379918 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:34.379908    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f8a07ea9-cdd2-4019-872f-a9e3596e2e56-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5b5df5cf5f-6d7xn\" (UID: \"f8a07ea9-cdd2-4019-872f-a9e3596e2e56\") " pod="openshift-monitoring/thanos-querier-5b5df5cf5f-6d7xn"
Jul 17 19:57:34.481106 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:34.481049    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f8a07ea9-cdd2-4019-872f-a9e3596e2e56-secret-grpc-tls\") pod \"thanos-querier-5b5df5cf5f-6d7xn\" (UID: \"f8a07ea9-cdd2-4019-872f-a9e3596e2e56\") " pod="openshift-monitoring/thanos-querier-5b5df5cf5f-6d7xn"
Jul 17 19:57:34.481292 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:34.481124    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/f8a07ea9-cdd2-4019-872f-a9e3596e2e56-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5b5df5cf5f-6d7xn\" (UID: \"f8a07ea9-cdd2-4019-872f-a9e3596e2e56\") " pod="openshift-monitoring/thanos-querier-5b5df5cf5f-6d7xn"
Jul 17 19:57:34.481292 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:34.481176    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f8a07ea9-cdd2-4019-872f-a9e3596e2e56-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5b5df5cf5f-6d7xn\" (UID: \"f8a07ea9-cdd2-4019-872f-a9e3596e2e56\") " pod="openshift-monitoring/thanos-querier-5b5df5cf5f-6d7xn"
Jul 17 19:57:34.481292 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:34.481210    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j746s\" (UniqueName: \"kubernetes.io/projected/f8a07ea9-cdd2-4019-872f-a9e3596e2e56-kube-api-access-j746s\") pod \"thanos-querier-5b5df5cf5f-6d7xn\" (UID: \"f8a07ea9-cdd2-4019-872f-a9e3596e2e56\") " pod="openshift-monitoring/thanos-querier-5b5df5cf5f-6d7xn"
Jul 17 19:57:34.481292 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:34.481239    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/f8a07ea9-cdd2-4019-872f-a9e3596e2e56-secret-thanos-querier-tls\") pod \"thanos-querier-5b5df5cf5f-6d7xn\" (UID: \"f8a07ea9-cdd2-4019-872f-a9e3596e2e56\") " pod="openshift-monitoring/thanos-querier-5b5df5cf5f-6d7xn"
Jul 17 19:57:34.481435 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:34.481367    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f8a07ea9-cdd2-4019-872f-a9e3596e2e56-metrics-client-ca\") pod \"thanos-querier-5b5df5cf5f-6d7xn\" (UID: \"f8a07ea9-cdd2-4019-872f-a9e3596e2e56\") " pod="openshift-monitoring/thanos-querier-5b5df5cf5f-6d7xn"
Jul 17 19:57:34.481435 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:34.481415    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/f8a07ea9-cdd2-4019-872f-a9e3596e2e56-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5b5df5cf5f-6d7xn\" (UID: \"f8a07ea9-cdd2-4019-872f-a9e3596e2e56\") " pod="openshift-monitoring/thanos-querier-5b5df5cf5f-6d7xn"
Jul 17 19:57:34.481512 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:34.481454    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f8a07ea9-cdd2-4019-872f-a9e3596e2e56-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5b5df5cf5f-6d7xn\" (UID: \"f8a07ea9-cdd2-4019-872f-a9e3596e2e56\") " pod="openshift-monitoring/thanos-querier-5b5df5cf5f-6d7xn"
Jul 17 19:57:34.482294 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:34.482265    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f8a07ea9-cdd2-4019-872f-a9e3596e2e56-metrics-client-ca\") pod \"thanos-querier-5b5df5cf5f-6d7xn\" (UID: \"f8a07ea9-cdd2-4019-872f-a9e3596e2e56\") " pod="openshift-monitoring/thanos-querier-5b5df5cf5f-6d7xn"
Jul 17 19:57:34.484335 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:34.484267    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/f8a07ea9-cdd2-4019-872f-a9e3596e2e56-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5b5df5cf5f-6d7xn\" (UID: \"f8a07ea9-cdd2-4019-872f-a9e3596e2e56\") " pod="openshift-monitoring/thanos-querier-5b5df5cf5f-6d7xn"
Jul 17 19:57:34.484676 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:34.484627    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f8a07ea9-cdd2-4019-872f-a9e3596e2e56-secret-grpc-tls\") pod \"thanos-querier-5b5df5cf5f-6d7xn\" (UID: \"f8a07ea9-cdd2-4019-872f-a9e3596e2e56\") " pod="openshift-monitoring/thanos-querier-5b5df5cf5f-6d7xn"
Jul 17 19:57:34.484765 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:34.484691    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f8a07ea9-cdd2-4019-872f-a9e3596e2e56-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5b5df5cf5f-6d7xn\" (UID: \"f8a07ea9-cdd2-4019-872f-a9e3596e2e56\") " pod="openshift-monitoring/thanos-querier-5b5df5cf5f-6d7xn"
Jul 17 19:57:34.485248 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:34.485228    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/f8a07ea9-cdd2-4019-872f-a9e3596e2e56-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5b5df5cf5f-6d7xn\" (UID: \"f8a07ea9-cdd2-4019-872f-a9e3596e2e56\") " pod="openshift-monitoring/thanos-querier-5b5df5cf5f-6d7xn"
Jul 17 19:57:34.485435 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:34.485411    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/f8a07ea9-cdd2-4019-872f-a9e3596e2e56-secret-thanos-querier-tls\") pod \"thanos-querier-5b5df5cf5f-6d7xn\" (UID: \"f8a07ea9-cdd2-4019-872f-a9e3596e2e56\") " pod="openshift-monitoring/thanos-querier-5b5df5cf5f-6d7xn"
Jul 17 19:57:34.485992 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:34.485964    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f8a07ea9-cdd2-4019-872f-a9e3596e2e56-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5b5df5cf5f-6d7xn\" (UID: \"f8a07ea9-cdd2-4019-872f-a9e3596e2e56\") " pod="openshift-monitoring/thanos-querier-5b5df5cf5f-6d7xn"
Jul 17 19:57:34.489255 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:34.489232    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j746s\" (UniqueName: \"kubernetes.io/projected/f8a07ea9-cdd2-4019-872f-a9e3596e2e56-kube-api-access-j746s\") pod \"thanos-querier-5b5df5cf5f-6d7xn\" (UID: \"f8a07ea9-cdd2-4019-872f-a9e3596e2e56\") " pod="openshift-monitoring/thanos-querier-5b5df5cf5f-6d7xn"
Jul 17 19:57:34.596406 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:34.596370    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5b5df5cf5f-6d7xn"
Jul 17 19:57:34.653932 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:34.653006    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6989f476cd-t28r6"]
Jul 17 19:57:34.656371 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:34.656216    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6989f476cd-t28r6"
Jul 17 19:57:34.659471 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:34.658875    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 17 19:57:34.659471 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:34.659214    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 17 19:57:34.659625 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:34.659550    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 17 19:57:34.659738 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:34.659686    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-qqnqn\""
Jul 17 19:57:34.660129 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:34.659854    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 17 19:57:34.660129 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:34.659883    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 17 19:57:34.669147 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:34.669120    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6989f476cd-t28r6"]
Jul 17 19:57:34.743935 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:34.743910    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5b5df5cf5f-6d7xn"]
Jul 17 19:57:34.746782 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:57:34.746748    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8a07ea9_cdd2_4019_872f_a9e3596e2e56.slice/crio-4081da6e155f73e2ae9b6d7bfa62740e77f2e1cee03fa420e1822019ae8bbfe2 WatchSource:0}: Error finding container 4081da6e155f73e2ae9b6d7bfa62740e77f2e1cee03fa420e1822019ae8bbfe2: Status 404 returned error can't find the container with id 4081da6e155f73e2ae9b6d7bfa62740e77f2e1cee03fa420e1822019ae8bbfe2
Jul 17 19:57:34.784014 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:34.783987    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f3acdce4-3c8f-4a07-ba84-d69fadc88c6c-service-ca\") pod \"console-6989f476cd-t28r6\" (UID: \"f3acdce4-3c8f-4a07-ba84-d69fadc88c6c\") " pod="openshift-console/console-6989f476cd-t28r6"
Jul 17 19:57:34.784147 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:34.784037    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f3acdce4-3c8f-4a07-ba84-d69fadc88c6c-console-oauth-config\") pod \"console-6989f476cd-t28r6\" (UID: \"f3acdce4-3c8f-4a07-ba84-d69fadc88c6c\") " pod="openshift-console/console-6989f476cd-t28r6"
Jul 17 19:57:34.784199 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:34.784152    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f3acdce4-3c8f-4a07-ba84-d69fadc88c6c-console-serving-cert\") pod \"console-6989f476cd-t28r6\" (UID: \"f3acdce4-3c8f-4a07-ba84-d69fadc88c6c\") " pod="openshift-console/console-6989f476cd-t28r6"
Jul 17 19:57:34.784235 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:34.784214    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f3acdce4-3c8f-4a07-ba84-d69fadc88c6c-console-config\") pod \"console-6989f476cd-t28r6\" (UID: \"f3acdce4-3c8f-4a07-ba84-d69fadc88c6c\") " pod="openshift-console/console-6989f476cd-t28r6"
Jul 17 19:57:34.784279 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:34.784250    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f3acdce4-3c8f-4a07-ba84-d69fadc88c6c-oauth-serving-cert\") pod \"console-6989f476cd-t28r6\" (UID: \"f3acdce4-3c8f-4a07-ba84-d69fadc88c6c\") " pod="openshift-console/console-6989f476cd-t28r6"
Jul 17 19:57:34.784312 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:34.784286    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zp2kj\" (UniqueName: \"kubernetes.io/projected/f3acdce4-3c8f-4a07-ba84-d69fadc88c6c-kube-api-access-zp2kj\") pod \"console-6989f476cd-t28r6\" (UID: \"f3acdce4-3c8f-4a07-ba84-d69fadc88c6c\") " pod="openshift-console/console-6989f476cd-t28r6"
Jul 17 19:57:34.885436 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:34.885355    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f3acdce4-3c8f-4a07-ba84-d69fadc88c6c-service-ca\") pod \"console-6989f476cd-t28r6\" (UID: \"f3acdce4-3c8f-4a07-ba84-d69fadc88c6c\") " pod="openshift-console/console-6989f476cd-t28r6"
Jul 17 19:57:34.885436 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:34.885414    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f3acdce4-3c8f-4a07-ba84-d69fadc88c6c-console-oauth-config\") pod \"console-6989f476cd-t28r6\" (UID: \"f3acdce4-3c8f-4a07-ba84-d69fadc88c6c\") " pod="openshift-console/console-6989f476cd-t28r6"
Jul 17 19:57:34.885659 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:34.885467    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f3acdce4-3c8f-4a07-ba84-d69fadc88c6c-console-serving-cert\") pod \"console-6989f476cd-t28r6\" (UID: \"f3acdce4-3c8f-4a07-ba84-d69fadc88c6c\") " pod="openshift-console/console-6989f476cd-t28r6"
Jul 17 19:57:34.885659 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:34.885503    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f3acdce4-3c8f-4a07-ba84-d69fadc88c6c-console-config\") pod \"console-6989f476cd-t28r6\" (UID: \"f3acdce4-3c8f-4a07-ba84-d69fadc88c6c\") " pod="openshift-console/console-6989f476cd-t28r6"
Jul 17 19:57:34.885659 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:34.885532    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f3acdce4-3c8f-4a07-ba84-d69fadc88c6c-oauth-serving-cert\") pod \"console-6989f476cd-t28r6\" (UID: \"f3acdce4-3c8f-4a07-ba84-d69fadc88c6c\") " pod="openshift-console/console-6989f476cd-t28r6"
Jul 17 19:57:34.885659 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:34.885562    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zp2kj\" (UniqueName: \"kubernetes.io/projected/f3acdce4-3c8f-4a07-ba84-d69fadc88c6c-kube-api-access-zp2kj\") pod \"console-6989f476cd-t28r6\" (UID: \"f3acdce4-3c8f-4a07-ba84-d69fadc88c6c\") " pod="openshift-console/console-6989f476cd-t28r6"
Jul 17 19:57:34.886241 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:34.886188    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f3acdce4-3c8f-4a07-ba84-d69fadc88c6c-service-ca\") pod \"console-6989f476cd-t28r6\" (UID: \"f3acdce4-3c8f-4a07-ba84-d69fadc88c6c\") " pod="openshift-console/console-6989f476cd-t28r6"
Jul 17 19:57:34.886241 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:34.886220    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f3acdce4-3c8f-4a07-ba84-d69fadc88c6c-console-config\") pod \"console-6989f476cd-t28r6\" (UID: \"f3acdce4-3c8f-4a07-ba84-d69fadc88c6c\") " pod="openshift-console/console-6989f476cd-t28r6"
Jul 17 19:57:34.886714 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:34.886666    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f3acdce4-3c8f-4a07-ba84-d69fadc88c6c-oauth-serving-cert\") pod \"console-6989f476cd-t28r6\" (UID: \"f3acdce4-3c8f-4a07-ba84-d69fadc88c6c\") " pod="openshift-console/console-6989f476cd-t28r6"
Jul 17 19:57:34.891309 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:34.888519    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f3acdce4-3c8f-4a07-ba84-d69fadc88c6c-console-oauth-config\") pod \"console-6989f476cd-t28r6\" (UID: \"f3acdce4-3c8f-4a07-ba84-d69fadc88c6c\") " pod="openshift-console/console-6989f476cd-t28r6"
Jul 17 19:57:34.891602 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:34.891579    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f3acdce4-3c8f-4a07-ba84-d69fadc88c6c-console-serving-cert\") pod \"console-6989f476cd-t28r6\" (UID: \"f3acdce4-3c8f-4a07-ba84-d69fadc88c6c\") " pod="openshift-console/console-6989f476cd-t28r6"
Jul 17 19:57:34.893896 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:34.893876    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zp2kj\" (UniqueName: \"kubernetes.io/projected/f3acdce4-3c8f-4a07-ba84-d69fadc88c6c-kube-api-access-zp2kj\") pod \"console-6989f476cd-t28r6\" (UID: \"f3acdce4-3c8f-4a07-ba84-d69fadc88c6c\") " pod="openshift-console/console-6989f476cd-t28r6"
Jul 17 19:57:34.971031 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:34.970995    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6989f476cd-t28r6"
Jul 17 19:57:35.104244 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:35.103866    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6989f476cd-t28r6"]
Jul 17 19:57:35.106737 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:57:35.106711    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3acdce4_3c8f_4a07_ba84_d69fadc88c6c.slice/crio-81fad6e800e443c6927b3b723cc8ad6985a45f9c9651527ef032ff7616381d6d WatchSource:0}: Error finding container 81fad6e800e443c6927b3b723cc8ad6985a45f9c9651527ef032ff7616381d6d: Status 404 returned error can't find the container with id 81fad6e800e443c6927b3b723cc8ad6985a45f9c9651527ef032ff7616381d6d
Jul 17 19:57:35.166352 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:35.166276    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 19:57:35.207918 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:35.207877    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6989f476cd-t28r6" event={"ID":"f3acdce4-3c8f-4a07-ba84-d69fadc88c6c","Type":"ContainerStarted","Data":"81fad6e800e443c6927b3b723cc8ad6985a45f9c9651527ef032ff7616381d6d"}
Jul 17 19:57:35.210301 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:35.210270    2572 generic.go:356] "Generic (PLEG): container finished" podID="a789aa14-a399-4ed6-886f-73a3813977db" containerID="443fb9c1a128be9a6ae54a63faf37d462703abd25e046e5945bd1942860b3309" exitCode=0
Jul 17 19:57:35.210427 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:35.210361    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pwdw7" event={"ID":"a789aa14-a399-4ed6-886f-73a3813977db","Type":"ContainerDied","Data":"443fb9c1a128be9a6ae54a63faf37d462703abd25e046e5945bd1942860b3309"}
Jul 17 19:57:35.212516 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:35.212475    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5b5df5cf5f-6d7xn" event={"ID":"f8a07ea9-cdd2-4019-872f-a9e3596e2e56","Type":"ContainerStarted","Data":"4081da6e155f73e2ae9b6d7bfa62740e77f2e1cee03fa420e1822019ae8bbfe2"}
Jul 17 19:57:35.234981 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:35.232911    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 19:57:35.294214 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:35.294183    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 19:57:35.568743 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:35.568627    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 19:57:36.119372 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:36.119326    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 19:57:36.221970 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:36.221933    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pwdw7" event={"ID":"a789aa14-a399-4ed6-886f-73a3813977db","Type":"ContainerStarted","Data":"d5911e6bc98c9617e9b7b2124ca3942ddac96bed3da1eda73ec8bd0ea33589f3"}
Jul 17 19:57:36.222374 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:36.222005    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pwdw7" event={"ID":"a789aa14-a399-4ed6-886f-73a3813977db","Type":"ContainerStarted","Data":"ad1dacb577998fc673a63c5d7e8b4aaffece5f22ba145e89827672c15fde58a2"}
Jul 17 19:57:36.243978 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:36.243921    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-pwdw7" podStartSLOduration=3.062325233 podStartE2EDuration="4.24390443s" totalImagesPullingTime="1.102568758s" totalInitContainerRuntime="79.010439ms" isStatefulPod=true podCreationTimestamp="2026-07-17 19:57:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 19:57:36.242635423 +0000 UTC m=+81.084131060" watchObservedRunningTime="2026-07-17 19:57:36.24390443 +0000 UTC m=+81.085400044"
Jul 17 19:57:36.592928 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:36.592772    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-5db89769cd-5n4bf"]
Jul 17 19:57:36.595601 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:36.595569    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5db89769cd-5n4bf"
Jul 17 19:57:36.598872 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:36.598822    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-bzkrv\""
Jul 17 19:57:36.599170 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:36.599150    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-5gvr48n8jeq5s\""
Jul 17 19:57:36.599901 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:36.599355    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 17 19:57:36.599901 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:36.599540    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 17 19:57:36.599901 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:36.599622    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 17 19:57:36.599901 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:36.599753    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 17 19:57:36.604549 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:36.604173    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5db89769cd-5n4bf"]
Jul 17 19:57:36.702286 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:36.702248    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jpfb5\" (UniqueName: \"kubernetes.io/projected/9ac0468a-db31-41bf-ad46-faa4e081b565-kube-api-access-jpfb5\") pod \"metrics-server-5db89769cd-5n4bf\" (UID: \"9ac0468a-db31-41bf-ad46-faa4e081b565\") " pod="openshift-monitoring/metrics-server-5db89769cd-5n4bf"
Jul 17 19:57:36.702452 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:36.702343    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/9ac0468a-db31-41bf-ad46-faa4e081b565-secret-metrics-server-client-certs\") pod \"metrics-server-5db89769cd-5n4bf\" (UID: \"9ac0468a-db31-41bf-ad46-faa4e081b565\") " pod="openshift-monitoring/metrics-server-5db89769cd-5n4bf"
Jul 17 19:57:36.702452 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:36.702379    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/9ac0468a-db31-41bf-ad46-faa4e081b565-secret-metrics-server-tls\") pod \"metrics-server-5db89769cd-5n4bf\" (UID: \"9ac0468a-db31-41bf-ad46-faa4e081b565\") " pod="openshift-monitoring/metrics-server-5db89769cd-5n4bf"
Jul 17 19:57:36.702452 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:36.702411    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/9ac0468a-db31-41bf-ad46-faa4e081b565-audit-log\") pod \"metrics-server-5db89769cd-5n4bf\" (UID: \"9ac0468a-db31-41bf-ad46-faa4e081b565\") " pod="openshift-monitoring/metrics-server-5db89769cd-5n4bf"
Jul 17 19:57:36.702452 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:36.702439    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/9ac0468a-db31-41bf-ad46-faa4e081b565-metrics-server-audit-profiles\") pod \"metrics-server-5db89769cd-5n4bf\" (UID: \"9ac0468a-db31-41bf-ad46-faa4e081b565\") " pod="openshift-monitoring/metrics-server-5db89769cd-5n4bf"
Jul 17 19:57:36.702658 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:36.702461    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9ac0468a-db31-41bf-ad46-faa4e081b565-client-ca-bundle\") pod \"metrics-server-5db89769cd-5n4bf\" (UID: \"9ac0468a-db31-41bf-ad46-faa4e081b565\") " pod="openshift-monitoring/metrics-server-5db89769cd-5n4bf"
Jul 17 19:57:36.702658 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:36.702570    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9ac0468a-db31-41bf-ad46-faa4e081b565-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5db89769cd-5n4bf\" (UID: \"9ac0468a-db31-41bf-ad46-faa4e081b565\") " pod="openshift-monitoring/metrics-server-5db89769cd-5n4bf"
Jul 17 19:57:36.803374 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:36.803285    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/9ac0468a-db31-41bf-ad46-faa4e081b565-secret-metrics-server-client-certs\") pod \"metrics-server-5db89769cd-5n4bf\" (UID: \"9ac0468a-db31-41bf-ad46-faa4e081b565\") " pod="openshift-monitoring/metrics-server-5db89769cd-5n4bf"
Jul 17 19:57:36.803552 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:36.803398    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/9ac0468a-db31-41bf-ad46-faa4e081b565-secret-metrics-server-tls\") pod \"metrics-server-5db89769cd-5n4bf\" (UID: \"9ac0468a-db31-41bf-ad46-faa4e081b565\") " pod="openshift-monitoring/metrics-server-5db89769cd-5n4bf"
Jul 17 19:57:36.803552 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:36.803430    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/9ac0468a-db31-41bf-ad46-faa4e081b565-audit-log\") pod \"metrics-server-5db89769cd-5n4bf\" (UID: \"9ac0468a-db31-41bf-ad46-faa4e081b565\") " pod="openshift-monitoring/metrics-server-5db89769cd-5n4bf"
Jul 17 19:57:36.803552 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:36.803458    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/9ac0468a-db31-41bf-ad46-faa4e081b565-metrics-server-audit-profiles\") pod \"metrics-server-5db89769cd-5n4bf\" (UID: \"9ac0468a-db31-41bf-ad46-faa4e081b565\") " pod="openshift-monitoring/metrics-server-5db89769cd-5n4bf"
Jul 17 19:57:36.803552 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:36.803481    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9ac0468a-db31-41bf-ad46-faa4e081b565-client-ca-bundle\") pod \"metrics-server-5db89769cd-5n4bf\" (UID: \"9ac0468a-db31-41bf-ad46-faa4e081b565\") " pod="openshift-monitoring/metrics-server-5db89769cd-5n4bf"
Jul 17 19:57:36.803552 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:36.803516    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9ac0468a-db31-41bf-ad46-faa4e081b565-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5db89769cd-5n4bf\" (UID: \"9ac0468a-db31-41bf-ad46-faa4e081b565\") " pod="openshift-monitoring/metrics-server-5db89769cd-5n4bf"
Jul 17 19:57:36.803792 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:36.803652    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jpfb5\" (UniqueName: \"kubernetes.io/projected/9ac0468a-db31-41bf-ad46-faa4e081b565-kube-api-access-jpfb5\") pod \"metrics-server-5db89769cd-5n4bf\" (UID: \"9ac0468a-db31-41bf-ad46-faa4e081b565\") " pod="openshift-monitoring/metrics-server-5db89769cd-5n4bf"
Jul 17 19:57:36.805174 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:36.805138    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9ac0468a-db31-41bf-ad46-faa4e081b565-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5db89769cd-5n4bf\" (UID: \"9ac0468a-db31-41bf-ad46-faa4e081b565\") " pod="openshift-monitoring/metrics-server-5db89769cd-5n4bf"
Jul 17 19:57:36.805337 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:36.805290    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/9ac0468a-db31-41bf-ad46-faa4e081b565-metrics-server-audit-profiles\") pod \"metrics-server-5db89769cd-5n4bf\" (UID: \"9ac0468a-db31-41bf-ad46-faa4e081b565\") " pod="openshift-monitoring/metrics-server-5db89769cd-5n4bf"
Jul 17 19:57:36.805519 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:36.805494    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/9ac0468a-db31-41bf-ad46-faa4e081b565-audit-log\") pod \"metrics-server-5db89769cd-5n4bf\" (UID: \"9ac0468a-db31-41bf-ad46-faa4e081b565\") " pod="openshift-monitoring/metrics-server-5db89769cd-5n4bf"
Jul 17 19:57:36.807549 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:36.807504    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/9ac0468a-db31-41bf-ad46-faa4e081b565-secret-metrics-server-tls\") pod \"metrics-server-5db89769cd-5n4bf\" (UID: \"9ac0468a-db31-41bf-ad46-faa4e081b565\") " pod="openshift-monitoring/metrics-server-5db89769cd-5n4bf"
Jul 17 19:57:36.808159 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:36.808117    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9ac0468a-db31-41bf-ad46-faa4e081b565-client-ca-bundle\") pod \"metrics-server-5db89769cd-5n4bf\" (UID: \"9ac0468a-db31-41bf-ad46-faa4e081b565\") " pod="openshift-monitoring/metrics-server-5db89769cd-5n4bf"
Jul 17 19:57:36.808260 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:36.808247    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/9ac0468a-db31-41bf-ad46-faa4e081b565-secret-metrics-server-client-certs\") pod \"metrics-server-5db89769cd-5n4bf\" (UID: \"9ac0468a-db31-41bf-ad46-faa4e081b565\") " pod="openshift-monitoring/metrics-server-5db89769cd-5n4bf"
Jul 17 19:57:36.811677 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:36.811653    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jpfb5\" (UniqueName: \"kubernetes.io/projected/9ac0468a-db31-41bf-ad46-faa4e081b565-kube-api-access-jpfb5\") pod \"metrics-server-5db89769cd-5n4bf\" (UID: \"9ac0468a-db31-41bf-ad46-faa4e081b565\") " pod="openshift-monitoring/metrics-server-5db89769cd-5n4bf"
Jul 17 19:57:36.916250 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:36.916172    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5db89769cd-5n4bf"
Jul 17 19:57:37.055522 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:37.055490    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 19:57:37.112800 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:37.112761    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 19:57:37.122094 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:37.122055    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-784dddf6df-m4ss6"
Jul 17 19:57:37.258162 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:37.258134    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 19:57:37.536871 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:37.536713    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 19:57:37.635537 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:37.635508    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 19:57:38.504727 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:38.504693    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 19:57:38.524034 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:38.524010    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 17 19:57:38.529883 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:38.529862    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 19:57:38.538310 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:38.538233    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 17 19:57:38.538310 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:38.538304    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 17 19:57:38.539269 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:38.539251    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 17 19:57:38.539738 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:38.539712    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 17 19:57:38.539978 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:38.539958    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 17 19:57:38.540102 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:38.539960    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 17 19:57:38.540102 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:38.540094    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-7h5n6\""
Jul 17 19:57:38.540989 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:38.540971    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 17 19:57:38.543536 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:38.543517    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 17 19:57:38.544152 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:38.544127    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 17 19:57:38.544385 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:38.544370    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 17 19:57:38.545218 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:38.545199    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 17 19:57:38.547599 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:38.547580    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 17 19:57:38.548475 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:38.548454    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-bcugik0ql658u\""
Jul 17 19:57:38.550527 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:38.550508    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 17 19:57:38.554256 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:38.554238    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 17 19:57:38.580251 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:38.580231    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 17 19:57:38.636180 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:38.636149    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 19:57:38.719689 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:38.719652    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f-config\") pod \"prometheus-k8s-0\" (UID: \"2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 19:57:38.719868 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:38.719702    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 19:57:38.719868 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:38.719729    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 19:57:38.719868 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:38.719762    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 19:57:38.719868 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:38.719788    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 19:57:38.719868 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:38.719816    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 19:57:38.719868 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:38.719839    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 19:57:38.719868 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:38.719868    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 19:57:38.720232 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:38.719933    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 19:57:38.720232 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:38.719982    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f-web-config\") pod \"prometheus-k8s-0\" (UID: \"2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 19:57:38.720232 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:38.720004    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 19:57:38.720232 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:38.720040    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 19:57:38.720232 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:38.720095    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 19:57:38.720232 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:38.720124    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 19:57:38.720232 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:38.720148    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 19:57:38.720539 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:38.720245    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f-config-out\") pod \"prometheus-k8s-0\" (UID: \"2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 19:57:38.720539 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:38.720279    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 19:57:38.720539 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:38.720332    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 19:57:38.720539 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:38.720379    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lcnlh\" (UniqueName: \"kubernetes.io/projected/2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f-kube-api-access-lcnlh\") pod \"prometheus-k8s-0\" (UID: \"2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 19:57:38.720539 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:38.720475    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 19:57:38.822050 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:38.821962    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lcnlh\" (UniqueName: \"kubernetes.io/projected/2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f-kube-api-access-lcnlh\") pod \"prometheus-k8s-0\" (UID: \"2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 19:57:38.822050 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:38.822022    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 19:57:38.822288 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:38.822083    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f-config\") pod \"prometheus-k8s-0\" (UID: \"2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 19:57:38.822288 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:38.822107    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 19:57:38.822288 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:38.822130    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 19:57:38.822288 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:38.822168    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 19:57:38.822288 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:38.822196    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 19:57:38.822546 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:38.822401    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 19:57:38.822546 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:38.822442    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 19:57:38.822546 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:38.822476    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 19:57:38.822546 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:38.822504    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 19:57:38.822546 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:38.822537    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f-web-config\") pod \"prometheus-k8s-0\" (UID: \"2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 19:57:38.822775 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:38.822563    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 19:57:38.822775 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:38.822594    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 19:57:38.822775 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:38.822620    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 19:57:38.822775 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:38.822653    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 19:57:38.822775 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:38.822709    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 19:57:38.822775 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:38.822756    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f-config-out\") pod \"prometheus-k8s-0\" (UID: \"2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 19:57:38.823052 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:38.822784    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 19:57:38.823052 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:38.822823    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 19:57:38.823052 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:38.822947    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 19:57:38.824176 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:38.823314    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 19:57:38.824176 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:38.823549    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 19:57:38.824176 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:38.823996    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 19:57:38.829058 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:38.826297    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 19:57:38.829058 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:38.826582    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 19:57:38.829058 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:38.826616    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 19:57:38.829058 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:38.826729    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 19:57:38.829058 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:38.827095    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 19:57:38.829058 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:38.827248    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 19:57:38.829058 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:38.827743    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 19:57:38.829058 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:38.827900    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f-config\") pod \"prometheus-k8s-0\" (UID: \"2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 19:57:38.829058 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:38.827908    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 19:57:38.829058 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:38.828711    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 19:57:38.829789 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:38.829761    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 19:57:38.830699 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:38.830674    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 19:57:38.830820 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:38.830678    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f-config-out\") pod \"prometheus-k8s-0\" (UID: \"2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 19:57:38.830883 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:38.830870    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 19:57:38.835187 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:38.835165    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lcnlh\" (UniqueName: \"kubernetes.io/projected/2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f-kube-api-access-lcnlh\") pod \"prometheus-k8s-0\" (UID: \"2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 19:57:38.836303 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:38.836283    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f-web-config\") pod \"prometheus-k8s-0\" (UID: \"2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 19:57:38.839828 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:38.839759    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 19:57:38.840529 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:38.840509    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 19:57:38.929264 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:38.929232    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 19:57:39.042498 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:39.042463    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 19:57:39.853310 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:39.853268    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 19:57:39.958433 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:39.958393    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 19:57:42.703975 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:42.703938    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 19:57:42.804325 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:42.804292    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 19:57:43.105762 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:43.105728    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 19:57:43.165122 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:43.165081    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 19:57:43.252110 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:43.252081    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 19:57:43.350872 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:43.350841    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 19:57:46.209149 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:46.209124    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5db89769cd-5n4bf"]
Jul 17 19:57:46.213867 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:57:46.213844    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ac0468a_db31_41bf_ad46_faa4e081b565.slice/crio-287bc2831e1a680aee9e4a601de33c91513a7607d0c5247d64002ced9d7eb093 WatchSource:0}: Error finding container 287bc2831e1a680aee9e4a601de33c91513a7607d0c5247d64002ced9d7eb093: Status 404 returned error can't find the container with id 287bc2831e1a680aee9e4a601de33c91513a7607d0c5247d64002ced9d7eb093
Jul 17 19:57:46.244795 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:46.244754    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 17 19:57:46.250029 ip-10-0-141-177 kubenswrapper[2572]: W0717 19:57:46.249999    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2de2f4ec_bc75_4d2f_b3cd_126ffb3fa12f.slice/crio-6a59c9a7be391492cd3ec855b507b3e6c74acda0ff4e4fe10f13a742d9c1b3c9 WatchSource:0}: Error finding container 6a59c9a7be391492cd3ec855b507b3e6c74acda0ff4e4fe10f13a742d9c1b3c9: Status 404 returned error can't find the container with id 6a59c9a7be391492cd3ec855b507b3e6c74acda0ff4e4fe10f13a742d9c1b3c9
Jul 17 19:57:46.264774 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:46.264750    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5b5df5cf5f-6d7xn" event={"ID":"f8a07ea9-cdd2-4019-872f-a9e3596e2e56","Type":"ContainerStarted","Data":"0fdf7403724c06ad5a14c935fa898189e350b5cf3b5fd3424fcec42cb8b71d3e"}
Jul 17 19:57:46.265992 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:46.265971    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5db89769cd-5n4bf" event={"ID":"9ac0468a-db31-41bf-ad46-faa4e081b565","Type":"ContainerStarted","Data":"287bc2831e1a680aee9e4a601de33c91513a7607d0c5247d64002ced9d7eb093"}
Jul 17 19:57:46.267177 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:46.267154    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f","Type":"ContainerStarted","Data":"6a59c9a7be391492cd3ec855b507b3e6c74acda0ff4e4fe10f13a742d9c1b3c9"}
Jul 17 19:57:46.268494 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:46.268470    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5bc67dcd46-fzddp" event={"ID":"9e89f28b-5ef8-4da9-995d-418797b888aa","Type":"ContainerStarted","Data":"98d62c022f54a1f27dcdd44bad7e1429f82146a010c042948a2075388262a7cb"}
Jul 17 19:57:46.268633 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:46.268616    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-5bc67dcd46-fzddp"
Jul 17 19:57:46.269963 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:46.269941    2572 patch_prober.go:28] interesting pod/downloads-5bc67dcd46-fzddp container/download-server namespace/openshift-console: Readiness probe status=failure output="Get \"http://10.134.0.14:8080/\": dial tcp 10.134.0.14:8080: connect: connection refused" start-of-body=
Jul 17 19:57:46.270047 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:46.269983    2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/downloads-5bc67dcd46-fzddp" podUID="9e89f28b-5ef8-4da9-995d-418797b888aa" containerName="download-server" probeResult="failure" output="Get \"http://10.134.0.14:8080/\": dial tcp 10.134.0.14:8080: connect: connection refused"
Jul 17 19:57:46.270244 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:46.270226    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6989f476cd-t28r6" event={"ID":"f3acdce4-3c8f-4a07-ba84-d69fadc88c6c","Type":"ContainerStarted","Data":"24a50556cff759f7f8b4b4e298ec32a914541ab83d48dc5cc14e7e78081b3fbe"}
Jul 17 19:57:46.300427 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:46.300361    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-5bc67dcd46-fzddp" podStartSLOduration=1.628958732 podStartE2EDuration="21.300343899s" totalImagesPullingTime="19.671385167s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 19:57:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 19:57:46.299242324 +0000 UTC m=+91.140737953" watchObservedRunningTime="2026-07-17 19:57:46.300343899 +0000 UTC m=+91.141839536"
Jul 17 19:57:46.332360 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:46.331160    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6989f476cd-t28r6" podStartSLOduration=1.397027221 podStartE2EDuration="12.331141839s" totalImagesPullingTime="10.934114618s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 19:57:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 19:57:46.330679324 +0000 UTC m=+91.172174961" watchObservedRunningTime="2026-07-17 19:57:46.331141839 +0000 UTC m=+91.172637476"
Jul 17 19:57:47.280583 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:47.279568    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5b5df5cf5f-6d7xn" event={"ID":"f8a07ea9-cdd2-4019-872f-a9e3596e2e56","Type":"ContainerStarted","Data":"469e6b9835c72da3bc319db8ab9097523c713dc944a70dca421c2b0e416c2ca7"}
Jul 17 19:57:47.280583 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:47.279645    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5b5df5cf5f-6d7xn" event={"ID":"f8a07ea9-cdd2-4019-872f-a9e3596e2e56","Type":"ContainerStarted","Data":"b8825722887f3cf3a9634ff10c80a6ba91a979b0dba52de21eb741459a18cf04"}
Jul 17 19:57:47.297357 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:47.297262    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-5bc67dcd46-fzddp"
Jul 17 19:57:47.853785 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:47.853745    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 19:57:49.268823 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:49.268786    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 19:57:49.293779 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:49.293640    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5b5df5cf5f-6d7xn" event={"ID":"f8a07ea9-cdd2-4019-872f-a9e3596e2e56","Type":"ContainerStarted","Data":"5d3f86fd8e1e1ab13fb81e4236a3e2604a7417ae02579f3e8b3382b77745570a"}
Jul 17 19:57:49.293779 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:49.293719    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5b5df5cf5f-6d7xn" event={"ID":"f8a07ea9-cdd2-4019-872f-a9e3596e2e56","Type":"ContainerStarted","Data":"d61ab694b98a185a992a3f2242c7c3c51aaac828472700dff167c89edf3b3b82"}
Jul 17 19:57:49.295178 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:49.295154    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5db89769cd-5n4bf" event={"ID":"9ac0468a-db31-41bf-ad46-faa4e081b565","Type":"ContainerStarted","Data":"9dcabff2b82e9e1dcbb839c9e7a0672804db816a8117fbd7a554c96ab10cb7ef"}
Jul 17 19:57:49.297484 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:49.297458    2572 generic.go:356] "Generic (PLEG): container finished" podID="2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f" containerID="7420d5e30207cd5b4c718646eda2399ed3b5e0e2fd559887d16a10e61232e455" exitCode=0
Jul 17 19:57:49.297589 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:49.297496    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f","Type":"ContainerDied","Data":"7420d5e30207cd5b4c718646eda2399ed3b5e0e2fd559887d16a10e61232e455"}
Jul 17 19:57:49.342861 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:49.342372    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-5db89769cd-5n4bf" podStartSLOduration=10.622647491 podStartE2EDuration="13.342347375s" totalImagesPullingTime="2.719699884s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 19:57:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 19:57:49.31386795 +0000 UTC m=+94.155363589" watchObservedRunningTime="2026-07-17 19:57:49.342347375 +0000 UTC m=+94.183843013"
Jul 17 19:57:49.344728 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:49.344695    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 19:57:50.308041 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:50.307844    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5b5df5cf5f-6d7xn" event={"ID":"f8a07ea9-cdd2-4019-872f-a9e3596e2e56","Type":"ContainerStarted","Data":"2030c75bc7853bb682aa4c7b60f2352ea30f655d220fe1e68df44ea1e39d62e2"}
Jul 17 19:57:50.308961 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:50.308526    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-5b5df5cf5f-6d7xn"
Jul 17 19:57:50.330644 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:50.330591    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-5b5df5cf5f-6d7xn" podStartSLOduration=2.505558496 podStartE2EDuration="16.330574633s" totalImagesPullingTime="13.825016137s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 19:57:34 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 19:57:50.329430569 +0000 UTC m=+95.170926207" watchObservedRunningTime="2026-07-17 19:57:50.330574633 +0000 UTC m=+95.172070271"
Jul 17 19:57:50.869438 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:50.869353    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 19:57:50.970526 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:50.970492    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 19:57:51.321150 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:51.321059    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-5b5df5cf5f-6d7xn"
Jul 17 19:57:51.811749 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:51.811595    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 19:57:51.864444 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:51.864411    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 19:57:53.492679 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:53.492648    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 19:57:53.600362 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:53.600317    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 19:57:53.933859 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:53.933830    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6989f476cd-t28r6"]
Jul 17 19:57:54.028498 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:54.028466    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 19:57:54.129489 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:54.129459    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 19:57:54.181704 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:54.181668    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 19:57:54.331898 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:54.331862    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f","Type":"ContainerStarted","Data":"f43e82ecbcc8333ddbfe8256a54500f12b7715a51fe4f939e21d7bdc12953c88"}
Jul 17 19:57:54.332087 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:54.331946    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f","Type":"ContainerStarted","Data":"a8df4a420a410ad48f873450d02227561589aed21cb3a6c16c842ae1018585d6"}
Jul 17 19:57:54.332087 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:54.331986    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f","Type":"ContainerStarted","Data":"61d4ec78000c63ad753c50f6162843e066b873e364fd5a57987b0046c8c876e0"}
Jul 17 19:57:54.332087 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:54.332026    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f","Type":"ContainerStarted","Data":"5f968204046273dc04e78e0e46d5b5ba0b9ede8239f1b175a7a687d5758ff731"}
Jul 17 19:57:54.332254 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:54.332088    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f","Type":"ContainerStarted","Data":"c79c0db42a24421714b1abc3551f62ae4c877c7914151e434fc0159bad6b3fd2"}
Jul 17 19:57:54.332254 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:54.332127    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f","Type":"ContainerStarted","Data":"7425a03cbf04c92fd8d7b5494ecd8a4d7e1a7862fdc9b9bdb3dfa654ee3f94a7"}
Jul 17 19:57:54.361877 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:54.361766    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=9.658991529 podStartE2EDuration="16.361743971s" totalImagesPullingTime="6.665161414s" totalInitContainerRuntime="37.591028ms" isStatefulPod=false podCreationTimestamp="2026-07-17 19:57:38 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 19:57:54.359407142 +0000 UTC m=+99.200902782" watchObservedRunningTime="2026-07-17 19:57:54.361743971 +0000 UTC m=+99.203239610"
Jul 17 19:57:54.971264 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:54.971228    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6989f476cd-t28r6"
Jul 17 19:57:56.916701 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:56.916669    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-5db89769cd-5n4bf"
Jul 17 19:57:56.917161 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:56.916757    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-5db89769cd-5n4bf"
Jul 17 19:57:57.170366 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:57.170283    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-8gt8j"
Jul 17 19:57:57.920272 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:57.920237    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 19:57:58.020501 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:58.020466    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 19:57:58.841552 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:57:58.841509    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 19:58:08.491633 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:08.491599    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 19:58:08.550135 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:08.550108    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 19:58:16.921872 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:16.921843    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-5db89769cd-5n4bf"
Jul 17 19:58:16.925627 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:16.925605    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-5db89769cd-5n4bf"
Jul 17 19:58:18.957737 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:18.957689    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6989f476cd-t28r6" podUID="f3acdce4-3c8f-4a07-ba84-d69fadc88c6c" containerName="console" containerID="cri-o://24a50556cff759f7f8b4b4e298ec32a914541ab83d48dc5cc14e7e78081b3fbe" gracePeriod=15
Jul 17 19:58:19.208809 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:19.208759    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6989f476cd-t28r6"
Jul 17 19:58:19.304185 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:19.304151    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zp2kj\" (UniqueName: \"kubernetes.io/projected/f3acdce4-3c8f-4a07-ba84-d69fadc88c6c-kube-api-access-zp2kj\") pod \"f3acdce4-3c8f-4a07-ba84-d69fadc88c6c\" (UID: \"f3acdce4-3c8f-4a07-ba84-d69fadc88c6c\") "
Jul 17 19:58:19.304185 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:19.304188    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f3acdce4-3c8f-4a07-ba84-d69fadc88c6c-oauth-serving-cert\") pod \"f3acdce4-3c8f-4a07-ba84-d69fadc88c6c\" (UID: \"f3acdce4-3c8f-4a07-ba84-d69fadc88c6c\") "
Jul 17 19:58:19.304425 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:19.304220    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f3acdce4-3c8f-4a07-ba84-d69fadc88c6c-console-config\") pod \"f3acdce4-3c8f-4a07-ba84-d69fadc88c6c\" (UID: \"f3acdce4-3c8f-4a07-ba84-d69fadc88c6c\") "
Jul 17 19:58:19.304425 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:19.304256    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f3acdce4-3c8f-4a07-ba84-d69fadc88c6c-console-oauth-config\") pod \"f3acdce4-3c8f-4a07-ba84-d69fadc88c6c\" (UID: \"f3acdce4-3c8f-4a07-ba84-d69fadc88c6c\") "
Jul 17 19:58:19.304425 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:19.304279    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f3acdce4-3c8f-4a07-ba84-d69fadc88c6c-service-ca\") pod \"f3acdce4-3c8f-4a07-ba84-d69fadc88c6c\" (UID: \"f3acdce4-3c8f-4a07-ba84-d69fadc88c6c\") "
Jul 17 19:58:19.304425 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:19.304301    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f3acdce4-3c8f-4a07-ba84-d69fadc88c6c-console-serving-cert\") pod \"f3acdce4-3c8f-4a07-ba84-d69fadc88c6c\" (UID: \"f3acdce4-3c8f-4a07-ba84-d69fadc88c6c\") "
Jul 17 19:58:19.304676 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:19.304643    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f3acdce4-3c8f-4a07-ba84-d69fadc88c6c-service-ca" (OuterVolumeSpecName: "service-ca") pod "f3acdce4-3c8f-4a07-ba84-d69fadc88c6c" (UID: "f3acdce4-3c8f-4a07-ba84-d69fadc88c6c"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 19:58:19.304676 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:19.304650    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f3acdce4-3c8f-4a07-ba84-d69fadc88c6c-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "f3acdce4-3c8f-4a07-ba84-d69fadc88c6c" (UID: "f3acdce4-3c8f-4a07-ba84-d69fadc88c6c"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 19:58:19.304818 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:19.304656    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f3acdce4-3c8f-4a07-ba84-d69fadc88c6c-console-config" (OuterVolumeSpecName: "console-config") pod "f3acdce4-3c8f-4a07-ba84-d69fadc88c6c" (UID: "f3acdce4-3c8f-4a07-ba84-d69fadc88c6c"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 19:58:19.306484 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:19.306455    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f3acdce4-3c8f-4a07-ba84-d69fadc88c6c-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "f3acdce4-3c8f-4a07-ba84-d69fadc88c6c" (UID: "f3acdce4-3c8f-4a07-ba84-d69fadc88c6c"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 19:58:19.306571 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:19.306500    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f3acdce4-3c8f-4a07-ba84-d69fadc88c6c-kube-api-access-zp2kj" (OuterVolumeSpecName: "kube-api-access-zp2kj") pod "f3acdce4-3c8f-4a07-ba84-d69fadc88c6c" (UID: "f3acdce4-3c8f-4a07-ba84-d69fadc88c6c"). InnerVolumeSpecName "kube-api-access-zp2kj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 19:58:19.306571 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:19.306500    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f3acdce4-3c8f-4a07-ba84-d69fadc88c6c-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "f3acdce4-3c8f-4a07-ba84-d69fadc88c6c" (UID: "f3acdce4-3c8f-4a07-ba84-d69fadc88c6c"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 19:58:19.405169 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:19.405139    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zp2kj\" (UniqueName: \"kubernetes.io/projected/f3acdce4-3c8f-4a07-ba84-d69fadc88c6c-kube-api-access-zp2kj\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Jul 17 19:58:19.405169 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:19.405164    2572 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f3acdce4-3c8f-4a07-ba84-d69fadc88c6c-oauth-serving-cert\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Jul 17 19:58:19.405169 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:19.405173    2572 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f3acdce4-3c8f-4a07-ba84-d69fadc88c6c-console-config\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Jul 17 19:58:19.405391 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:19.405182    2572 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f3acdce4-3c8f-4a07-ba84-d69fadc88c6c-console-oauth-config\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Jul 17 19:58:19.405391 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:19.405190    2572 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f3acdce4-3c8f-4a07-ba84-d69fadc88c6c-service-ca\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Jul 17 19:58:19.405391 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:19.405199    2572 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f3acdce4-3c8f-4a07-ba84-d69fadc88c6c-console-serving-cert\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Jul 17 19:58:19.432686 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:19.432658    2572 generic.go:356] "Generic (PLEG): container finished" podID="f3acdce4-3c8f-4a07-ba84-d69fadc88c6c" containerID="24a50556cff759f7f8b4b4e298ec32a914541ab83d48dc5cc14e7e78081b3fbe" exitCode=0
Jul 17 19:58:19.432805 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:19.432697    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6989f476cd-t28r6"
Jul 17 19:58:19.432805 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:19.432738    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6989f476cd-t28r6" event={"ID":"f3acdce4-3c8f-4a07-ba84-d69fadc88c6c","Type":"ContainerDied","Data":"24a50556cff759f7f8b4b4e298ec32a914541ab83d48dc5cc14e7e78081b3fbe"}
Jul 17 19:58:19.432805 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:19.432793    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6989f476cd-t28r6" event={"ID":"f3acdce4-3c8f-4a07-ba84-d69fadc88c6c","Type":"ContainerDied","Data":"81fad6e800e443c6927b3b723cc8ad6985a45f9c9651527ef032ff7616381d6d"}
Jul 17 19:58:19.433389 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:19.433370    2572 scope.go:117] "RemoveContainer" containerID="24a50556cff759f7f8b4b4e298ec32a914541ab83d48dc5cc14e7e78081b3fbe"
Jul 17 19:58:19.442014 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:19.441995    2572 scope.go:117] "RemoveContainer" containerID="24a50556cff759f7f8b4b4e298ec32a914541ab83d48dc5cc14e7e78081b3fbe"
Jul 17 19:58:19.442279 ip-10-0-141-177 kubenswrapper[2572]: E0717 19:58:19.442260    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"24a50556cff759f7f8b4b4e298ec32a914541ab83d48dc5cc14e7e78081b3fbe\": container with ID starting with 24a50556cff759f7f8b4b4e298ec32a914541ab83d48dc5cc14e7e78081b3fbe not found: ID does not exist" containerID="24a50556cff759f7f8b4b4e298ec32a914541ab83d48dc5cc14e7e78081b3fbe"
Jul 17 19:58:19.442348 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:19.442291    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"24a50556cff759f7f8b4b4e298ec32a914541ab83d48dc5cc14e7e78081b3fbe"} err="failed to get container status \"24a50556cff759f7f8b4b4e298ec32a914541ab83d48dc5cc14e7e78081b3fbe\": rpc error: code = NotFound desc = could not find container \"24a50556cff759f7f8b4b4e298ec32a914541ab83d48dc5cc14e7e78081b3fbe\": container with ID starting with 24a50556cff759f7f8b4b4e298ec32a914541ab83d48dc5cc14e7e78081b3fbe not found: ID does not exist"
Jul 17 19:58:19.452297 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:19.452274    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6989f476cd-t28r6"]
Jul 17 19:58:19.456437 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:19.456419    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6989f476cd-t28r6"]
Jul 17 19:58:19.685522 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:19.685492    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f3acdce4-3c8f-4a07-ba84-d69fadc88c6c" path="/var/lib/kubelet/pods/f3acdce4-3c8f-4a07-ba84-d69fadc88c6c/volumes"
Jul 17 19:58:38.840903 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:38.840865    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 19:58:38.900172 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:38.900148    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 19:58:39.518707 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:39.518681    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 19:58:51.519747 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:51.519707    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 19:58:51.721289 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:51.721249    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 19:58:56.916135 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:56.916103    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 17 19:58:56.916718 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:56.916419    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f" containerName="prometheus" containerID="cri-o://7425a03cbf04c92fd8d7b5494ecd8a4d7e1a7862fdc9b9bdb3dfa654ee3f94a7" gracePeriod=600
Jul 17 19:58:56.916718 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:56.916454    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f" containerName="kube-rbac-proxy" containerID="cri-o://a8df4a420a410ad48f873450d02227561589aed21cb3a6c16c842ae1018585d6" gracePeriod=600
Jul 17 19:58:56.916718 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:56.916471    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f" containerName="kube-rbac-proxy-thanos" containerID="cri-o://f43e82ecbcc8333ddbfe8256a54500f12b7715a51fe4f939e21d7bdc12953c88" gracePeriod=600
Jul 17 19:58:56.916718 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:56.916501    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f" containerName="kube-rbac-proxy-web" containerID="cri-o://61d4ec78000c63ad753c50f6162843e066b873e364fd5a57987b0046c8c876e0" gracePeriod=600
Jul 17 19:58:56.916718 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:56.916514    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f" containerName="config-reloader" containerID="cri-o://c79c0db42a24421714b1abc3551f62ae4c877c7914151e434fc0159bad6b3fd2" gracePeriod=600
Jul 17 19:58:56.916718 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:56.916513    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f" containerName="thanos-sidecar" containerID="cri-o://5f968204046273dc04e78e0e46d5b5ba0b9ede8239f1b175a7a687d5758ff731" gracePeriod=600
Jul 17 19:58:57.160421 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.160398    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 19:58:57.290136 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.290105    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f\" (UID: \"2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f\") "
Jul 17 19:58:57.290136 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.290141    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f-tls-assets\") pod \"2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f\" (UID: \"2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f\") "
Jul 17 19:58:57.290346 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.290162    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f-prometheus-k8s-db\") pod \"2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f\" (UID: \"2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f\") "
Jul 17 19:58:57.290346 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.290191    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f-config\") pod \"2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f\" (UID: \"2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f\") "
Jul 17 19:58:57.290346 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.290269    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f-configmap-serving-certs-ca-bundle\") pod \"2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f\" (UID: \"2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f\") "
Jul 17 19:58:57.290346 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.290317    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f-configmap-kubelet-serving-ca-bundle\") pod \"2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f\" (UID: \"2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f\") "
Jul 17 19:58:57.290538 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.290345    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f-prometheus-k8s-rulefiles-2\") pod \"2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f\" (UID: \"2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f\") "
Jul 17 19:58:57.290538 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.290371    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f-secret-prometheus-k8s-tls\") pod \"2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f\" (UID: \"2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f\") "
Jul 17 19:58:57.290538 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.290403    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f-secret-grpc-tls\") pod \"2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f\" (UID: \"2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f\") "
Jul 17 19:58:57.290538 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.290443    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f-prometheus-k8s-rulefiles-1\") pod \"2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f\" (UID: \"2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f\") "
Jul 17 19:58:57.290538 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.290488    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f-prometheus-k8s-rulefiles-0\") pod \"2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f\" (UID: \"2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f\") "
Jul 17 19:58:57.290538 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.290517    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f-secret-metrics-client-certs\") pod \"2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f\" (UID: \"2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f\") "
Jul 17 19:58:57.290827 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.290544    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f-config-out\") pod \"2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f\" (UID: \"2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f\") "
Jul 17 19:58:57.290827 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.290585    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f-web-config\") pod \"2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f\" (UID: \"2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f\") "
Jul 17 19:58:57.290827 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.290618    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f-secret-kube-rbac-proxy\") pod \"2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f\" (UID: \"2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f\") "
Jul 17 19:58:57.290827 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.290681    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f-configmap-metrics-client-ca\") pod \"2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f\" (UID: \"2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f\") "
Jul 17 19:58:57.290827 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.290688    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f" (UID: "2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 19:58:57.290827 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.290711    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f-prometheus-trusted-ca-bundle\") pod \"2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f\" (UID: \"2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f\") "
Jul 17 19:58:57.290827 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.290736    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f\" (UID: \"2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f\") "
Jul 17 19:58:57.290827 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.290746    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f" (UID: "2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 19:58:57.290827 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.290762    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f-thanos-prometheus-http-client-file\") pod \"2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f\" (UID: \"2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f\") "
Jul 17 19:58:57.290827 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.290786    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lcnlh\" (UniqueName: \"kubernetes.io/projected/2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f-kube-api-access-lcnlh\") pod \"2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f\" (UID: \"2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f\") "
Jul 17 19:58:57.291342 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.290961    2572 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Jul 17 19:58:57.291342 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.290975    2572 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Jul 17 19:58:57.291342 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.291009    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f" (UID: "2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 19:58:57.291539 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.291510    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f" (UID: "2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 19:58:57.291877 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.291848    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f" (UID: "2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 19:58:57.291996 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.291946    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f" (UID: "2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 19:58:57.293008 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.292975    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f-config" (OuterVolumeSpecName: "config") pod "2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f" (UID: "2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 19:58:57.293170 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.293146    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f-config-out" (OuterVolumeSpecName: "config-out") pod "2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f" (UID: "2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 19:58:57.293245 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.293157    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f-kube-api-access-lcnlh" (OuterVolumeSpecName: "kube-api-access-lcnlh") pod "2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f" (UID: "2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f"). InnerVolumeSpecName "kube-api-access-lcnlh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 19:58:57.293330 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.293280    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f" (UID: "2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 19:58:57.293432 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.293415    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f" (UID: "2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 19:58:57.293973 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.293940    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f" (UID: "2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 19:58:57.294602 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.294536    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f" (UID: "2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 19:58:57.294707 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.294664    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f" (UID: "2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 19:58:57.294760 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.294699    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f" (UID: "2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 19:58:57.295437 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.295419    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f" (UID: "2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 19:58:57.295510 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.295465    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f" (UID: "2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 19:58:57.295558 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.295509    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f" (UID: "2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 19:58:57.295836 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.295813    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f" (UID: "2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 19:58:57.304050 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.304030    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f-web-config" (OuterVolumeSpecName: "web-config") pod "2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f" (UID: "2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 19:58:57.391599 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.391564    2572 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Jul 17 19:58:57.391599 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.391594    2572 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f-tls-assets\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Jul 17 19:58:57.391599 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.391604    2572 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f-prometheus-k8s-db\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Jul 17 19:58:57.391814 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.391612    2572 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f-config\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Jul 17 19:58:57.391814 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.391621    2572 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Jul 17 19:58:57.391814 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.391640    2572 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f-secret-prometheus-k8s-tls\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Jul 17 19:58:57.391814 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.391649    2572 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f-secret-grpc-tls\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Jul 17 19:58:57.391814 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.391657    2572 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Jul 17 19:58:57.391814 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.391665    2572 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Jul 17 19:58:57.391814 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.391674    2572 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f-secret-metrics-client-certs\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Jul 17 19:58:57.391814 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.391682    2572 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f-config-out\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Jul 17 19:58:57.391814 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.391690    2572 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f-web-config\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Jul 17 19:58:57.391814 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.391697    2572 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f-secret-kube-rbac-proxy\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Jul 17 19:58:57.391814 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.391709    2572 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f-configmap-metrics-client-ca\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Jul 17 19:58:57.391814 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.391718    2572 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f-prometheus-trusted-ca-bundle\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Jul 17 19:58:57.391814 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.391727    2572 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Jul 17 19:58:57.391814 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.391735    2572 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f-thanos-prometheus-http-client-file\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Jul 17 19:58:57.391814 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.391743    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lcnlh\" (UniqueName: \"kubernetes.io/projected/2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f-kube-api-access-lcnlh\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Jul 17 19:58:57.572238 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.572155    2572 generic.go:356] "Generic (PLEG): container finished" podID="2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f" containerID="f43e82ecbcc8333ddbfe8256a54500f12b7715a51fe4f939e21d7bdc12953c88" exitCode=0
Jul 17 19:58:57.572238 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.572179    2572 generic.go:356] "Generic (PLEG): container finished" podID="2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f" containerID="a8df4a420a410ad48f873450d02227561589aed21cb3a6c16c842ae1018585d6" exitCode=0
Jul 17 19:58:57.572238 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.572192    2572 generic.go:356] "Generic (PLEG): container finished" podID="2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f" containerID="61d4ec78000c63ad753c50f6162843e066b873e364fd5a57987b0046c8c876e0" exitCode=0
Jul 17 19:58:57.572238 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.572199    2572 generic.go:356] "Generic (PLEG): container finished" podID="2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f" containerID="5f968204046273dc04e78e0e46d5b5ba0b9ede8239f1b175a7a687d5758ff731" exitCode=0
Jul 17 19:58:57.572238 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.572203    2572 generic.go:356] "Generic (PLEG): container finished" podID="2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f" containerID="c79c0db42a24421714b1abc3551f62ae4c877c7914151e434fc0159bad6b3fd2" exitCode=0
Jul 17 19:58:57.572238 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.572208    2572 generic.go:356] "Generic (PLEG): container finished" podID="2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f" containerID="7425a03cbf04c92fd8d7b5494ecd8a4d7e1a7862fdc9b9bdb3dfa654ee3f94a7" exitCode=0
Jul 17 19:58:57.572238 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.572234    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 19:58:57.572530 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.572239    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f","Type":"ContainerDied","Data":"f43e82ecbcc8333ddbfe8256a54500f12b7715a51fe4f939e21d7bdc12953c88"}
Jul 17 19:58:57.572530 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.572307    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f","Type":"ContainerDied","Data":"a8df4a420a410ad48f873450d02227561589aed21cb3a6c16c842ae1018585d6"}
Jul 17 19:58:57.572530 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.572335    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f","Type":"ContainerDied","Data":"61d4ec78000c63ad753c50f6162843e066b873e364fd5a57987b0046c8c876e0"}
Jul 17 19:58:57.572530 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.572358    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f","Type":"ContainerDied","Data":"5f968204046273dc04e78e0e46d5b5ba0b9ede8239f1b175a7a687d5758ff731"}
Jul 17 19:58:57.572530 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.572375    2572 scope.go:117] "RemoveContainer" containerID="f43e82ecbcc8333ddbfe8256a54500f12b7715a51fe4f939e21d7bdc12953c88"
Jul 17 19:58:57.572530 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.572381    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f","Type":"ContainerDied","Data":"c79c0db42a24421714b1abc3551f62ae4c877c7914151e434fc0159bad6b3fd2"}
Jul 17 19:58:57.572530 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.572407    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f","Type":"ContainerDied","Data":"7425a03cbf04c92fd8d7b5494ecd8a4d7e1a7862fdc9b9bdb3dfa654ee3f94a7"}
Jul 17 19:58:57.572530 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.572430    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f","Type":"ContainerDied","Data":"6a59c9a7be391492cd3ec855b507b3e6c74acda0ff4e4fe10f13a742d9c1b3c9"}
Jul 17 19:58:57.581003 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.580933    2572 scope.go:117] "RemoveContainer" containerID="a8df4a420a410ad48f873450d02227561589aed21cb3a6c16c842ae1018585d6"
Jul 17 19:58:57.587808 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.587795    2572 scope.go:117] "RemoveContainer" containerID="61d4ec78000c63ad753c50f6162843e066b873e364fd5a57987b0046c8c876e0"
Jul 17 19:58:57.594325 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.594291    2572 scope.go:117] "RemoveContainer" containerID="5f968204046273dc04e78e0e46d5b5ba0b9ede8239f1b175a7a687d5758ff731"
Jul 17 19:58:57.596391 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.596370    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 17 19:58:57.599848 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.599826    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 17 19:58:57.601469 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.601453    2572 scope.go:117] "RemoveContainer" containerID="c79c0db42a24421714b1abc3551f62ae4c877c7914151e434fc0159bad6b3fd2"
Jul 17 19:58:57.607744 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.607728    2572 scope.go:117] "RemoveContainer" containerID="7425a03cbf04c92fd8d7b5494ecd8a4d7e1a7862fdc9b9bdb3dfa654ee3f94a7"
Jul 17 19:58:57.614642 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.614626    2572 scope.go:117] "RemoveContainer" containerID="7420d5e30207cd5b4c718646eda2399ed3b5e0e2fd559887d16a10e61232e455"
Jul 17 19:58:57.620902 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.620886    2572 scope.go:117] "RemoveContainer" containerID="f43e82ecbcc8333ddbfe8256a54500f12b7715a51fe4f939e21d7bdc12953c88"
Jul 17 19:58:57.621177 ip-10-0-141-177 kubenswrapper[2572]: E0717 19:58:57.621150    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f43e82ecbcc8333ddbfe8256a54500f12b7715a51fe4f939e21d7bdc12953c88\": container with ID starting with f43e82ecbcc8333ddbfe8256a54500f12b7715a51fe4f939e21d7bdc12953c88 not found: ID does not exist" containerID="f43e82ecbcc8333ddbfe8256a54500f12b7715a51fe4f939e21d7bdc12953c88"
Jul 17 19:58:57.621226 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.621176    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f43e82ecbcc8333ddbfe8256a54500f12b7715a51fe4f939e21d7bdc12953c88"} err="failed to get container status \"f43e82ecbcc8333ddbfe8256a54500f12b7715a51fe4f939e21d7bdc12953c88\": rpc error: code = NotFound desc = could not find container \"f43e82ecbcc8333ddbfe8256a54500f12b7715a51fe4f939e21d7bdc12953c88\": container with ID starting with f43e82ecbcc8333ddbfe8256a54500f12b7715a51fe4f939e21d7bdc12953c88 not found: ID does not exist"
Jul 17 19:58:57.621226 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.621201    2572 scope.go:117] "RemoveContainer" containerID="a8df4a420a410ad48f873450d02227561589aed21cb3a6c16c842ae1018585d6"
Jul 17 19:58:57.621437 ip-10-0-141-177 kubenswrapper[2572]: E0717 19:58:57.621419    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a8df4a420a410ad48f873450d02227561589aed21cb3a6c16c842ae1018585d6\": container with ID starting with a8df4a420a410ad48f873450d02227561589aed21cb3a6c16c842ae1018585d6 not found: ID does not exist" containerID="a8df4a420a410ad48f873450d02227561589aed21cb3a6c16c842ae1018585d6"
Jul 17 19:58:57.621627 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.621447    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a8df4a420a410ad48f873450d02227561589aed21cb3a6c16c842ae1018585d6"} err="failed to get container status \"a8df4a420a410ad48f873450d02227561589aed21cb3a6c16c842ae1018585d6\": rpc error: code = NotFound desc = could not find container \"a8df4a420a410ad48f873450d02227561589aed21cb3a6c16c842ae1018585d6\": container with ID starting with a8df4a420a410ad48f873450d02227561589aed21cb3a6c16c842ae1018585d6 not found: ID does not exist"
Jul 17 19:58:57.621627 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.621472    2572 scope.go:117] "RemoveContainer" containerID="61d4ec78000c63ad753c50f6162843e066b873e364fd5a57987b0046c8c876e0"
Jul 17 19:58:57.621817 ip-10-0-141-177 kubenswrapper[2572]: E0717 19:58:57.621747    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"61d4ec78000c63ad753c50f6162843e066b873e364fd5a57987b0046c8c876e0\": container with ID starting with 61d4ec78000c63ad753c50f6162843e066b873e364fd5a57987b0046c8c876e0 not found: ID does not exist" containerID="61d4ec78000c63ad753c50f6162843e066b873e364fd5a57987b0046c8c876e0"
Jul 17 19:58:57.621817 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.621783    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"61d4ec78000c63ad753c50f6162843e066b873e364fd5a57987b0046c8c876e0"} err="failed to get container status \"61d4ec78000c63ad753c50f6162843e066b873e364fd5a57987b0046c8c876e0\": rpc error: code = NotFound desc = could not find container \"61d4ec78000c63ad753c50f6162843e066b873e364fd5a57987b0046c8c876e0\": container with ID starting with 61d4ec78000c63ad753c50f6162843e066b873e364fd5a57987b0046c8c876e0 not found: ID does not exist"
Jul 17 19:58:57.621817 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.621803    2572 scope.go:117] "RemoveContainer" containerID="5f968204046273dc04e78e0e46d5b5ba0b9ede8239f1b175a7a687d5758ff731"
Jul 17 19:58:57.622136 ip-10-0-141-177 kubenswrapper[2572]: E0717 19:58:57.622112    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5f968204046273dc04e78e0e46d5b5ba0b9ede8239f1b175a7a687d5758ff731\": container with ID starting with 5f968204046273dc04e78e0e46d5b5ba0b9ede8239f1b175a7a687d5758ff731 not found: ID does not exist" containerID="5f968204046273dc04e78e0e46d5b5ba0b9ede8239f1b175a7a687d5758ff731"
Jul 17 19:58:57.622189 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.622146    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5f968204046273dc04e78e0e46d5b5ba0b9ede8239f1b175a7a687d5758ff731"} err="failed to get container status \"5f968204046273dc04e78e0e46d5b5ba0b9ede8239f1b175a7a687d5758ff731\": rpc error: code = NotFound desc = could not find container \"5f968204046273dc04e78e0e46d5b5ba0b9ede8239f1b175a7a687d5758ff731\": container with ID starting with 5f968204046273dc04e78e0e46d5b5ba0b9ede8239f1b175a7a687d5758ff731 not found: ID does not exist"
Jul 17 19:58:57.622189 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.622167    2572 scope.go:117] "RemoveContainer" containerID="c79c0db42a24421714b1abc3551f62ae4c877c7914151e434fc0159bad6b3fd2"
Jul 17 19:58:57.622486 ip-10-0-141-177 kubenswrapper[2572]: E0717 19:58:57.622466    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c79c0db42a24421714b1abc3551f62ae4c877c7914151e434fc0159bad6b3fd2\": container with ID starting with c79c0db42a24421714b1abc3551f62ae4c877c7914151e434fc0159bad6b3fd2 not found: ID does not exist" containerID="c79c0db42a24421714b1abc3551f62ae4c877c7914151e434fc0159bad6b3fd2"
Jul 17 19:58:57.622590 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.622493    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c79c0db42a24421714b1abc3551f62ae4c877c7914151e434fc0159bad6b3fd2"} err="failed to get container status \"c79c0db42a24421714b1abc3551f62ae4c877c7914151e434fc0159bad6b3fd2\": rpc error: code = NotFound desc = could not find container \"c79c0db42a24421714b1abc3551f62ae4c877c7914151e434fc0159bad6b3fd2\": container with ID starting with c79c0db42a24421714b1abc3551f62ae4c877c7914151e434fc0159bad6b3fd2 not found: ID does not exist"
Jul 17 19:58:57.622590 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.622510    2572 scope.go:117] "RemoveContainer" containerID="7425a03cbf04c92fd8d7b5494ecd8a4d7e1a7862fdc9b9bdb3dfa654ee3f94a7"
Jul 17 19:58:57.622801 ip-10-0-141-177 kubenswrapper[2572]: E0717 19:58:57.622785    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7425a03cbf04c92fd8d7b5494ecd8a4d7e1a7862fdc9b9bdb3dfa654ee3f94a7\": container with ID starting with 7425a03cbf04c92fd8d7b5494ecd8a4d7e1a7862fdc9b9bdb3dfa654ee3f94a7 not found: ID does not exist" containerID="7425a03cbf04c92fd8d7b5494ecd8a4d7e1a7862fdc9b9bdb3dfa654ee3f94a7"
Jul 17 19:58:57.622841 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.622805    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7425a03cbf04c92fd8d7b5494ecd8a4d7e1a7862fdc9b9bdb3dfa654ee3f94a7"} err="failed to get container status \"7425a03cbf04c92fd8d7b5494ecd8a4d7e1a7862fdc9b9bdb3dfa654ee3f94a7\": rpc error: code = NotFound desc = could not find container \"7425a03cbf04c92fd8d7b5494ecd8a4d7e1a7862fdc9b9bdb3dfa654ee3f94a7\": container with ID starting with 7425a03cbf04c92fd8d7b5494ecd8a4d7e1a7862fdc9b9bdb3dfa654ee3f94a7 not found: ID does not exist"
Jul 17 19:58:57.622841 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.622819    2572 scope.go:117] "RemoveContainer" containerID="7420d5e30207cd5b4c718646eda2399ed3b5e0e2fd559887d16a10e61232e455"
Jul 17 19:58:57.623105 ip-10-0-141-177 kubenswrapper[2572]: E0717 19:58:57.623057    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7420d5e30207cd5b4c718646eda2399ed3b5e0e2fd559887d16a10e61232e455\": container with ID starting with 7420d5e30207cd5b4c718646eda2399ed3b5e0e2fd559887d16a10e61232e455 not found: ID does not exist" containerID="7420d5e30207cd5b4c718646eda2399ed3b5e0e2fd559887d16a10e61232e455"
Jul 17 19:58:57.623105 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.623100    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7420d5e30207cd5b4c718646eda2399ed3b5e0e2fd559887d16a10e61232e455"} err="failed to get container status \"7420d5e30207cd5b4c718646eda2399ed3b5e0e2fd559887d16a10e61232e455\": rpc error: code = NotFound desc = could not find container \"7420d5e30207cd5b4c718646eda2399ed3b5e0e2fd559887d16a10e61232e455\": container with ID starting with 7420d5e30207cd5b4c718646eda2399ed3b5e0e2fd559887d16a10e61232e455 not found: ID does not exist"
Jul 17 19:58:57.623213 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.623115    2572 scope.go:117] "RemoveContainer" containerID="f43e82ecbcc8333ddbfe8256a54500f12b7715a51fe4f939e21d7bdc12953c88"
Jul 17 19:58:57.623346 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.623330    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f43e82ecbcc8333ddbfe8256a54500f12b7715a51fe4f939e21d7bdc12953c88"} err="failed to get container status \"f43e82ecbcc8333ddbfe8256a54500f12b7715a51fe4f939e21d7bdc12953c88\": rpc error: code = NotFound desc = could not find container \"f43e82ecbcc8333ddbfe8256a54500f12b7715a51fe4f939e21d7bdc12953c88\": container with ID starting with f43e82ecbcc8333ddbfe8256a54500f12b7715a51fe4f939e21d7bdc12953c88 not found: ID does not exist"
Jul 17 19:58:57.623387 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.623346    2572 scope.go:117] "RemoveContainer" containerID="a8df4a420a410ad48f873450d02227561589aed21cb3a6c16c842ae1018585d6"
Jul 17 19:58:57.623599 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.623570    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a8df4a420a410ad48f873450d02227561589aed21cb3a6c16c842ae1018585d6"} err="failed to get container status \"a8df4a420a410ad48f873450d02227561589aed21cb3a6c16c842ae1018585d6\": rpc error: code = NotFound desc = could not find container \"a8df4a420a410ad48f873450d02227561589aed21cb3a6c16c842ae1018585d6\": container with ID starting with a8df4a420a410ad48f873450d02227561589aed21cb3a6c16c842ae1018585d6 not found: ID does not exist"
Jul 17 19:58:57.623642 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.623600    2572 scope.go:117] "RemoveContainer" containerID="61d4ec78000c63ad753c50f6162843e066b873e364fd5a57987b0046c8c876e0"
Jul 17 19:58:57.623687 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.623638    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 17 19:58:57.623830 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.623812    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"61d4ec78000c63ad753c50f6162843e066b873e364fd5a57987b0046c8c876e0"} err="failed to get container status \"61d4ec78000c63ad753c50f6162843e066b873e364fd5a57987b0046c8c876e0\": rpc error: code = NotFound desc = could not find container \"61d4ec78000c63ad753c50f6162843e066b873e364fd5a57987b0046c8c876e0\": container with ID starting with 61d4ec78000c63ad753c50f6162843e066b873e364fd5a57987b0046c8c876e0 not found: ID does not exist"
Jul 17 19:58:57.623876 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.623830    2572 scope.go:117] "RemoveContainer" containerID="5f968204046273dc04e78e0e46d5b5ba0b9ede8239f1b175a7a687d5758ff731"
Jul 17 19:58:57.623932 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.623919    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f3acdce4-3c8f-4a07-ba84-d69fadc88c6c" containerName="console"
Jul 17 19:58:57.623975 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.623936    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="f3acdce4-3c8f-4a07-ba84-d69fadc88c6c" containerName="console"
Jul 17 19:58:57.623975 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.623948    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f" containerName="kube-rbac-proxy"
Jul 17 19:58:57.623975 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.623958    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f" containerName="kube-rbac-proxy"
Jul 17 19:58:57.624087 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.623974    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f" containerName="init-config-reloader"
Jul 17 19:58:57.624087 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.623983    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f" containerName="init-config-reloader"
Jul 17 19:58:57.624087 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.623994    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f" containerName="config-reloader"
Jul 17 19:58:57.624087 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.623999    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f" containerName="config-reloader"
Jul 17 19:58:57.624087 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.624007    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f" containerName="prometheus"
Jul 17 19:58:57.624087 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.624012    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f" containerName="prometheus"
Jul 17 19:58:57.624087 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.624022    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f" containerName="thanos-sidecar"
Jul 17 19:58:57.624087 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.624028    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f" containerName="thanos-sidecar"
Jul 17 19:58:57.624087 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.624037    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f" containerName="kube-rbac-proxy-thanos"
Jul 17 19:58:57.624087 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.624045    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f" containerName="kube-rbac-proxy-thanos"
Jul 17 19:58:57.624087 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.624055    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f" containerName="kube-rbac-proxy-web"
Jul 17 19:58:57.624087 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.624052    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5f968204046273dc04e78e0e46d5b5ba0b9ede8239f1b175a7a687d5758ff731"} err="failed to get container status \"5f968204046273dc04e78e0e46d5b5ba0b9ede8239f1b175a7a687d5758ff731\": rpc error: code = NotFound desc = could not find container \"5f968204046273dc04e78e0e46d5b5ba0b9ede8239f1b175a7a687d5758ff731\": container with ID starting with 5f968204046273dc04e78e0e46d5b5ba0b9ede8239f1b175a7a687d5758ff731 not found: ID does not exist"
Jul 17 19:58:57.624545 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.624090    2572 scope.go:117] "RemoveContainer" containerID="c79c0db42a24421714b1abc3551f62ae4c877c7914151e434fc0159bad6b3fd2"
Jul 17 19:58:57.624545 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.624061    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f" containerName="kube-rbac-proxy-web"
Jul 17 19:58:57.624545 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.624217    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f" containerName="kube-rbac-proxy"
Jul 17 19:58:57.624545 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.624229    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f" containerName="kube-rbac-proxy-thanos"
Jul 17 19:58:57.624545 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.624237    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f" containerName="prometheus"
Jul 17 19:58:57.624545 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.624241    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f" containerName="config-reloader"
Jul 17 19:58:57.624545 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.624247    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f" containerName="thanos-sidecar"
Jul 17 19:58:57.624545 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.624256    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="f3acdce4-3c8f-4a07-ba84-d69fadc88c6c" containerName="console"
Jul 17 19:58:57.624545 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.624265    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f" containerName="kube-rbac-proxy-web"
Jul 17 19:58:57.624545 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.624325    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c79c0db42a24421714b1abc3551f62ae4c877c7914151e434fc0159bad6b3fd2"} err="failed to get container status \"c79c0db42a24421714b1abc3551f62ae4c877c7914151e434fc0159bad6b3fd2\": rpc error: code = NotFound desc = could not find container \"c79c0db42a24421714b1abc3551f62ae4c877c7914151e434fc0159bad6b3fd2\": container with ID starting with c79c0db42a24421714b1abc3551f62ae4c877c7914151e434fc0159bad6b3fd2 not found: ID does not exist"
Jul 17 19:58:57.624545 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.624341    2572 scope.go:117] "RemoveContainer" containerID="7425a03cbf04c92fd8d7b5494ecd8a4d7e1a7862fdc9b9bdb3dfa654ee3f94a7"
Jul 17 19:58:57.624899 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.624547    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7425a03cbf04c92fd8d7b5494ecd8a4d7e1a7862fdc9b9bdb3dfa654ee3f94a7"} err="failed to get container status \"7425a03cbf04c92fd8d7b5494ecd8a4d7e1a7862fdc9b9bdb3dfa654ee3f94a7\": rpc error: code = NotFound desc = could not find container \"7425a03cbf04c92fd8d7b5494ecd8a4d7e1a7862fdc9b9bdb3dfa654ee3f94a7\": container with ID starting with 7425a03cbf04c92fd8d7b5494ecd8a4d7e1a7862fdc9b9bdb3dfa654ee3f94a7 not found: ID does not exist"
Jul 17 19:58:57.624899 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.624566    2572 scope.go:117] "RemoveContainer" containerID="7420d5e30207cd5b4c718646eda2399ed3b5e0e2fd559887d16a10e61232e455"
Jul 17 19:58:57.624899 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.624784    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7420d5e30207cd5b4c718646eda2399ed3b5e0e2fd559887d16a10e61232e455"} err="failed to get container status \"7420d5e30207cd5b4c718646eda2399ed3b5e0e2fd559887d16a10e61232e455\": rpc error: code = NotFound desc = could not find container \"7420d5e30207cd5b4c718646eda2399ed3b5e0e2fd559887d16a10e61232e455\": container with ID starting with 7420d5e30207cd5b4c718646eda2399ed3b5e0e2fd559887d16a10e61232e455 not found: ID does not exist"
Jul 17 19:58:57.624899 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.624802    2572 scope.go:117] "RemoveContainer" containerID="f43e82ecbcc8333ddbfe8256a54500f12b7715a51fe4f939e21d7bdc12953c88"
Jul 17 19:58:57.625044 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.625008    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f43e82ecbcc8333ddbfe8256a54500f12b7715a51fe4f939e21d7bdc12953c88"} err="failed to get container status \"f43e82ecbcc8333ddbfe8256a54500f12b7715a51fe4f939e21d7bdc12953c88\": rpc error: code = NotFound desc = could not find container \"f43e82ecbcc8333ddbfe8256a54500f12b7715a51fe4f939e21d7bdc12953c88\": container with ID starting with f43e82ecbcc8333ddbfe8256a54500f12b7715a51fe4f939e21d7bdc12953c88 not found: ID does not exist"
Jul 17 19:58:57.625044 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.625024    2572 scope.go:117] "RemoveContainer" containerID="a8df4a420a410ad48f873450d02227561589aed21cb3a6c16c842ae1018585d6"
Jul 17 19:58:57.625277 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.625259    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a8df4a420a410ad48f873450d02227561589aed21cb3a6c16c842ae1018585d6"} err="failed to get container status \"a8df4a420a410ad48f873450d02227561589aed21cb3a6c16c842ae1018585d6\": rpc error: code = NotFound desc = could not find container \"a8df4a420a410ad48f873450d02227561589aed21cb3a6c16c842ae1018585d6\": container with ID starting with a8df4a420a410ad48f873450d02227561589aed21cb3a6c16c842ae1018585d6 not found: ID does not exist"
Jul 17 19:58:57.625344 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.625277    2572 scope.go:117] "RemoveContainer" containerID="61d4ec78000c63ad753c50f6162843e066b873e364fd5a57987b0046c8c876e0"
Jul 17 19:58:57.625504 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.625487    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"61d4ec78000c63ad753c50f6162843e066b873e364fd5a57987b0046c8c876e0"} err="failed to get container status \"61d4ec78000c63ad753c50f6162843e066b873e364fd5a57987b0046c8c876e0\": rpc error: code = NotFound desc = could not find container \"61d4ec78000c63ad753c50f6162843e066b873e364fd5a57987b0046c8c876e0\": container with ID starting with 61d4ec78000c63ad753c50f6162843e066b873e364fd5a57987b0046c8c876e0 not found: ID does not exist"
Jul 17 19:58:57.625557 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.625504    2572 scope.go:117] "RemoveContainer" containerID="5f968204046273dc04e78e0e46d5b5ba0b9ede8239f1b175a7a687d5758ff731"
Jul 17 19:58:57.625725 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.625708    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5f968204046273dc04e78e0e46d5b5ba0b9ede8239f1b175a7a687d5758ff731"} err="failed to get container status \"5f968204046273dc04e78e0e46d5b5ba0b9ede8239f1b175a7a687d5758ff731\": rpc error: code = NotFound desc = could not find container \"5f968204046273dc04e78e0e46d5b5ba0b9ede8239f1b175a7a687d5758ff731\": container with ID starting with 5f968204046273dc04e78e0e46d5b5ba0b9ede8239f1b175a7a687d5758ff731 not found: ID does not exist"
Jul 17 19:58:57.625725 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.625724    2572 scope.go:117] "RemoveContainer" containerID="c79c0db42a24421714b1abc3551f62ae4c877c7914151e434fc0159bad6b3fd2"
Jul 17 19:58:57.625917 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.625897    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c79c0db42a24421714b1abc3551f62ae4c877c7914151e434fc0159bad6b3fd2"} err="failed to get container status \"c79c0db42a24421714b1abc3551f62ae4c877c7914151e434fc0159bad6b3fd2\": rpc error: code = NotFound desc = could not find container \"c79c0db42a24421714b1abc3551f62ae4c877c7914151e434fc0159bad6b3fd2\": container with ID starting with c79c0db42a24421714b1abc3551f62ae4c877c7914151e434fc0159bad6b3fd2 not found: ID does not exist"
Jul 17 19:58:57.625960 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.625918    2572 scope.go:117] "RemoveContainer" containerID="7425a03cbf04c92fd8d7b5494ecd8a4d7e1a7862fdc9b9bdb3dfa654ee3f94a7"
Jul 17 19:58:57.626115 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.626097    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7425a03cbf04c92fd8d7b5494ecd8a4d7e1a7862fdc9b9bdb3dfa654ee3f94a7"} err="failed to get container status \"7425a03cbf04c92fd8d7b5494ecd8a4d7e1a7862fdc9b9bdb3dfa654ee3f94a7\": rpc error: code = NotFound desc = could not find container \"7425a03cbf04c92fd8d7b5494ecd8a4d7e1a7862fdc9b9bdb3dfa654ee3f94a7\": container with ID starting with 7425a03cbf04c92fd8d7b5494ecd8a4d7e1a7862fdc9b9bdb3dfa654ee3f94a7 not found: ID does not exist"
Jul 17 19:58:57.626202 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.626115    2572 scope.go:117] "RemoveContainer" containerID="7420d5e30207cd5b4c718646eda2399ed3b5e0e2fd559887d16a10e61232e455"
Jul 17 19:58:57.626270 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.626249    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7420d5e30207cd5b4c718646eda2399ed3b5e0e2fd559887d16a10e61232e455"} err="failed to get container status \"7420d5e30207cd5b4c718646eda2399ed3b5e0e2fd559887d16a10e61232e455\": rpc error: code = NotFound desc = could not find container \"7420d5e30207cd5b4c718646eda2399ed3b5e0e2fd559887d16a10e61232e455\": container with ID starting with 7420d5e30207cd5b4c718646eda2399ed3b5e0e2fd559887d16a10e61232e455 not found: ID does not exist"
Jul 17 19:58:57.626320 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.626271    2572 scope.go:117] "RemoveContainer" containerID="f43e82ecbcc8333ddbfe8256a54500f12b7715a51fe4f939e21d7bdc12953c88"
Jul 17 19:58:57.626460 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.626442    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f43e82ecbcc8333ddbfe8256a54500f12b7715a51fe4f939e21d7bdc12953c88"} err="failed to get container status \"f43e82ecbcc8333ddbfe8256a54500f12b7715a51fe4f939e21d7bdc12953c88\": rpc error: code = NotFound desc = could not find container \"f43e82ecbcc8333ddbfe8256a54500f12b7715a51fe4f939e21d7bdc12953c88\": container with ID starting with f43e82ecbcc8333ddbfe8256a54500f12b7715a51fe4f939e21d7bdc12953c88 not found: ID does not exist"
Jul 17 19:58:57.626508 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.626461    2572 scope.go:117] "RemoveContainer" containerID="a8df4a420a410ad48f873450d02227561589aed21cb3a6c16c842ae1018585d6"
Jul 17 19:58:57.626685 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.626670    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a8df4a420a410ad48f873450d02227561589aed21cb3a6c16c842ae1018585d6"} err="failed to get container status \"a8df4a420a410ad48f873450d02227561589aed21cb3a6c16c842ae1018585d6\": rpc error: code = NotFound desc = could not find container \"a8df4a420a410ad48f873450d02227561589aed21cb3a6c16c842ae1018585d6\": container with ID starting with a8df4a420a410ad48f873450d02227561589aed21cb3a6c16c842ae1018585d6 not found: ID does not exist"
Jul 17 19:58:57.626726 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.626685    2572 scope.go:117] "RemoveContainer" containerID="61d4ec78000c63ad753c50f6162843e066b873e364fd5a57987b0046c8c876e0"
Jul 17 19:58:57.626900 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.626884    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"61d4ec78000c63ad753c50f6162843e066b873e364fd5a57987b0046c8c876e0"} err="failed to get container status \"61d4ec78000c63ad753c50f6162843e066b873e364fd5a57987b0046c8c876e0\": rpc error: code = NotFound desc = could not find container \"61d4ec78000c63ad753c50f6162843e066b873e364fd5a57987b0046c8c876e0\": container with ID starting with 61d4ec78000c63ad753c50f6162843e066b873e364fd5a57987b0046c8c876e0 not found: ID does not exist"
Jul 17 19:58:57.626941 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.626902    2572 scope.go:117] "RemoveContainer" containerID="5f968204046273dc04e78e0e46d5b5ba0b9ede8239f1b175a7a687d5758ff731"
Jul 17 19:58:57.627150 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.627109    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5f968204046273dc04e78e0e46d5b5ba0b9ede8239f1b175a7a687d5758ff731"} err="failed to get container status \"5f968204046273dc04e78e0e46d5b5ba0b9ede8239f1b175a7a687d5758ff731\": rpc error: code = NotFound desc = could not find container \"5f968204046273dc04e78e0e46d5b5ba0b9ede8239f1b175a7a687d5758ff731\": container with ID starting with 5f968204046273dc04e78e0e46d5b5ba0b9ede8239f1b175a7a687d5758ff731 not found: ID does not exist"
Jul 17 19:58:57.627150 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.627132    2572 scope.go:117] "RemoveContainer" containerID="c79c0db42a24421714b1abc3551f62ae4c877c7914151e434fc0159bad6b3fd2"
Jul 17 19:58:57.627341 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.627325    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c79c0db42a24421714b1abc3551f62ae4c877c7914151e434fc0159bad6b3fd2"} err="failed to get container status \"c79c0db42a24421714b1abc3551f62ae4c877c7914151e434fc0159bad6b3fd2\": rpc error: code = NotFound desc = could not find container \"c79c0db42a24421714b1abc3551f62ae4c877c7914151e434fc0159bad6b3fd2\": container with ID starting with c79c0db42a24421714b1abc3551f62ae4c877c7914151e434fc0159bad6b3fd2 not found: ID does not exist"
Jul 17 19:58:57.627386 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.627344    2572 scope.go:117] "RemoveContainer" containerID="7425a03cbf04c92fd8d7b5494ecd8a4d7e1a7862fdc9b9bdb3dfa654ee3f94a7"
Jul 17 19:58:57.627553 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.627537    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7425a03cbf04c92fd8d7b5494ecd8a4d7e1a7862fdc9b9bdb3dfa654ee3f94a7"} err="failed to get container status \"7425a03cbf04c92fd8d7b5494ecd8a4d7e1a7862fdc9b9bdb3dfa654ee3f94a7\": rpc error: code = NotFound desc = could not find container \"7425a03cbf04c92fd8d7b5494ecd8a4d7e1a7862fdc9b9bdb3dfa654ee3f94a7\": container with ID starting with 7425a03cbf04c92fd8d7b5494ecd8a4d7e1a7862fdc9b9bdb3dfa654ee3f94a7 not found: ID does not exist"
Jul 17 19:58:57.627592 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.627554    2572 scope.go:117] "RemoveContainer" containerID="7420d5e30207cd5b4c718646eda2399ed3b5e0e2fd559887d16a10e61232e455"
Jul 17 19:58:57.627741 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.627722    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7420d5e30207cd5b4c718646eda2399ed3b5e0e2fd559887d16a10e61232e455"} err="failed to get container status \"7420d5e30207cd5b4c718646eda2399ed3b5e0e2fd559887d16a10e61232e455\": rpc error: code = NotFound desc = could not find container \"7420d5e30207cd5b4c718646eda2399ed3b5e0e2fd559887d16a10e61232e455\": container with ID starting with 7420d5e30207cd5b4c718646eda2399ed3b5e0e2fd559887d16a10e61232e455 not found: ID does not exist"
Jul 17 19:58:57.627777 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.627742    2572 scope.go:117] "RemoveContainer" containerID="f43e82ecbcc8333ddbfe8256a54500f12b7715a51fe4f939e21d7bdc12953c88"
Jul 17 19:58:57.627921 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.627907    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f43e82ecbcc8333ddbfe8256a54500f12b7715a51fe4f939e21d7bdc12953c88"} err="failed to get container status \"f43e82ecbcc8333ddbfe8256a54500f12b7715a51fe4f939e21d7bdc12953c88\": rpc error: code = NotFound desc = could not find container \"f43e82ecbcc8333ddbfe8256a54500f12b7715a51fe4f939e21d7bdc12953c88\": container with ID starting with f43e82ecbcc8333ddbfe8256a54500f12b7715a51fe4f939e21d7bdc12953c88 not found: ID does not exist"
Jul 17 19:58:57.627963 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.627921    2572 scope.go:117] "RemoveContainer" containerID="a8df4a420a410ad48f873450d02227561589aed21cb3a6c16c842ae1018585d6"
Jul 17 19:58:57.628168 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.628148    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a8df4a420a410ad48f873450d02227561589aed21cb3a6c16c842ae1018585d6"} err="failed to get container status \"a8df4a420a410ad48f873450d02227561589aed21cb3a6c16c842ae1018585d6\": rpc error: code = NotFound desc = could not find container \"a8df4a420a410ad48f873450d02227561589aed21cb3a6c16c842ae1018585d6\": container with ID starting with a8df4a420a410ad48f873450d02227561589aed21cb3a6c16c842ae1018585d6 not found: ID does not exist"
Jul 17 19:58:57.628210 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.628172    2572 scope.go:117] "RemoveContainer" containerID="61d4ec78000c63ad753c50f6162843e066b873e364fd5a57987b0046c8c876e0"
Jul 17 19:58:57.628239 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.628214    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 19:58:57.628589 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.628365    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"61d4ec78000c63ad753c50f6162843e066b873e364fd5a57987b0046c8c876e0"} err="failed to get container status \"61d4ec78000c63ad753c50f6162843e066b873e364fd5a57987b0046c8c876e0\": rpc error: code = NotFound desc = could not find container \"61d4ec78000c63ad753c50f6162843e066b873e364fd5a57987b0046c8c876e0\": container with ID starting with 61d4ec78000c63ad753c50f6162843e066b873e364fd5a57987b0046c8c876e0 not found: ID does not exist"
Jul 17 19:58:57.628589 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.628386    2572 scope.go:117] "RemoveContainer" containerID="5f968204046273dc04e78e0e46d5b5ba0b9ede8239f1b175a7a687d5758ff731"
Jul 17 19:58:57.628742 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.628626    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5f968204046273dc04e78e0e46d5b5ba0b9ede8239f1b175a7a687d5758ff731"} err="failed to get container status \"5f968204046273dc04e78e0e46d5b5ba0b9ede8239f1b175a7a687d5758ff731\": rpc error: code = NotFound desc = could not find container \"5f968204046273dc04e78e0e46d5b5ba0b9ede8239f1b175a7a687d5758ff731\": container with ID starting with 5f968204046273dc04e78e0e46d5b5ba0b9ede8239f1b175a7a687d5758ff731 not found: ID does not exist"
Jul 17 19:58:57.628742 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.628651    2572 scope.go:117] "RemoveContainer" containerID="c79c0db42a24421714b1abc3551f62ae4c877c7914151e434fc0159bad6b3fd2"
Jul 17 19:58:57.628912 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.628891    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c79c0db42a24421714b1abc3551f62ae4c877c7914151e434fc0159bad6b3fd2"} err="failed to get container status \"c79c0db42a24421714b1abc3551f62ae4c877c7914151e434fc0159bad6b3fd2\": rpc error: code = NotFound desc = could not find container \"c79c0db42a24421714b1abc3551f62ae4c877c7914151e434fc0159bad6b3fd2\": container with ID starting with c79c0db42a24421714b1abc3551f62ae4c877c7914151e434fc0159bad6b3fd2 not found: ID does not exist"
Jul 17 19:58:57.628951 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.628915    2572 scope.go:117] "RemoveContainer" containerID="7425a03cbf04c92fd8d7b5494ecd8a4d7e1a7862fdc9b9bdb3dfa654ee3f94a7"
Jul 17 19:58:57.629206 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.629187    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7425a03cbf04c92fd8d7b5494ecd8a4d7e1a7862fdc9b9bdb3dfa654ee3f94a7"} err="failed to get container status \"7425a03cbf04c92fd8d7b5494ecd8a4d7e1a7862fdc9b9bdb3dfa654ee3f94a7\": rpc error: code = NotFound desc = could not find container \"7425a03cbf04c92fd8d7b5494ecd8a4d7e1a7862fdc9b9bdb3dfa654ee3f94a7\": container with ID starting with 7425a03cbf04c92fd8d7b5494ecd8a4d7e1a7862fdc9b9bdb3dfa654ee3f94a7 not found: ID does not exist"
Jul 17 19:58:57.629206 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.629207    2572 scope.go:117] "RemoveContainer" containerID="7420d5e30207cd5b4c718646eda2399ed3b5e0e2fd559887d16a10e61232e455"
Jul 17 19:58:57.629445 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.629422    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7420d5e30207cd5b4c718646eda2399ed3b5e0e2fd559887d16a10e61232e455"} err="failed to get container status \"7420d5e30207cd5b4c718646eda2399ed3b5e0e2fd559887d16a10e61232e455\": rpc error: code = NotFound desc = could not find container \"7420d5e30207cd5b4c718646eda2399ed3b5e0e2fd559887d16a10e61232e455\": container with ID starting with 7420d5e30207cd5b4c718646eda2399ed3b5e0e2fd559887d16a10e61232e455 not found: ID does not exist"
Jul 17 19:58:57.629491 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.629447    2572 scope.go:117] "RemoveContainer" containerID="f43e82ecbcc8333ddbfe8256a54500f12b7715a51fe4f939e21d7bdc12953c88"
Jul 17 19:58:57.629684 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.629664    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f43e82ecbcc8333ddbfe8256a54500f12b7715a51fe4f939e21d7bdc12953c88"} err="failed to get container status \"f43e82ecbcc8333ddbfe8256a54500f12b7715a51fe4f939e21d7bdc12953c88\": rpc error: code = NotFound desc = could not find container \"f43e82ecbcc8333ddbfe8256a54500f12b7715a51fe4f939e21d7bdc12953c88\": container with ID starting with f43e82ecbcc8333ddbfe8256a54500f12b7715a51fe4f939e21d7bdc12953c88 not found: ID does not exist"
Jul 17 19:58:57.629738 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.629687    2572 scope.go:117] "RemoveContainer" containerID="a8df4a420a410ad48f873450d02227561589aed21cb3a6c16c842ae1018585d6"
Jul 17 19:58:57.629907 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.629884    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a8df4a420a410ad48f873450d02227561589aed21cb3a6c16c842ae1018585d6"} err="failed to get container status \"a8df4a420a410ad48f873450d02227561589aed21cb3a6c16c842ae1018585d6\": rpc error: code = NotFound desc = could not find container \"a8df4a420a410ad48f873450d02227561589aed21cb3a6c16c842ae1018585d6\": container with ID starting with a8df4a420a410ad48f873450d02227561589aed21cb3a6c16c842ae1018585d6 not found: ID does not exist"
Jul 17 19:58:57.630002 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.629909    2572 scope.go:117] "RemoveContainer" containerID="61d4ec78000c63ad753c50f6162843e066b873e364fd5a57987b0046c8c876e0"
Jul 17 19:58:57.630173 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.630154    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"61d4ec78000c63ad753c50f6162843e066b873e364fd5a57987b0046c8c876e0"} err="failed to get container status \"61d4ec78000c63ad753c50f6162843e066b873e364fd5a57987b0046c8c876e0\": rpc error: code = NotFound desc = could not find container \"61d4ec78000c63ad753c50f6162843e066b873e364fd5a57987b0046c8c876e0\": container with ID starting with 61d4ec78000c63ad753c50f6162843e066b873e364fd5a57987b0046c8c876e0 not found: ID does not exist"
Jul 17 19:58:57.630249 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.630175    2572 scope.go:117] "RemoveContainer" containerID="5f968204046273dc04e78e0e46d5b5ba0b9ede8239f1b175a7a687d5758ff731"
Jul 17 19:58:57.630415 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.630387    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5f968204046273dc04e78e0e46d5b5ba0b9ede8239f1b175a7a687d5758ff731"} err="failed to get container status \"5f968204046273dc04e78e0e46d5b5ba0b9ede8239f1b175a7a687d5758ff731\": rpc error: code = NotFound desc = could not find container \"5f968204046273dc04e78e0e46d5b5ba0b9ede8239f1b175a7a687d5758ff731\": container with ID starting with 5f968204046273dc04e78e0e46d5b5ba0b9ede8239f1b175a7a687d5758ff731 not found: ID does not exist"
Jul 17 19:58:57.630415 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.630415    2572 scope.go:117] "RemoveContainer" containerID="c79c0db42a24421714b1abc3551f62ae4c877c7914151e434fc0159bad6b3fd2"
Jul 17 19:58:57.630641 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.630614    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c79c0db42a24421714b1abc3551f62ae4c877c7914151e434fc0159bad6b3fd2"} err="failed to get container status \"c79c0db42a24421714b1abc3551f62ae4c877c7914151e434fc0159bad6b3fd2\": rpc error: code = NotFound desc = could not find container \"c79c0db42a24421714b1abc3551f62ae4c877c7914151e434fc0159bad6b3fd2\": container with ID starting with c79c0db42a24421714b1abc3551f62ae4c877c7914151e434fc0159bad6b3fd2 not found: ID does not exist"
Jul 17 19:58:57.630641 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.630641    2572 scope.go:117] "RemoveContainer" containerID="7425a03cbf04c92fd8d7b5494ecd8a4d7e1a7862fdc9b9bdb3dfa654ee3f94a7"
Jul 17 19:58:57.630814 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.630798    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-bcugik0ql658u\""
Jul 17 19:58:57.630857 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.630833    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 17 19:58:57.630906 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.630854    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 17 19:58:57.630906 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.630898    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 17 19:58:57.631029 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.631004    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7425a03cbf04c92fd8d7b5494ecd8a4d7e1a7862fdc9b9bdb3dfa654ee3f94a7"} err="failed to get container status \"7425a03cbf04c92fd8d7b5494ecd8a4d7e1a7862fdc9b9bdb3dfa654ee3f94a7\": rpc error: code = NotFound desc = could not find container \"7425a03cbf04c92fd8d7b5494ecd8a4d7e1a7862fdc9b9bdb3dfa654ee3f94a7\": container with ID starting with 7425a03cbf04c92fd8d7b5494ecd8a4d7e1a7862fdc9b9bdb3dfa654ee3f94a7 not found: ID does not exist"
Jul 17 19:58:57.631114 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.631031    2572 scope.go:117] "RemoveContainer" containerID="7420d5e30207cd5b4c718646eda2399ed3b5e0e2fd559887d16a10e61232e455"
Jul 17 19:58:57.631114 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.631020    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 17 19:58:57.631216 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.631200    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 17 19:58:57.631270 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.631219    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 17 19:58:57.631270 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.631243    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 17 19:58:57.631661 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.631370    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7420d5e30207cd5b4c718646eda2399ed3b5e0e2fd559887d16a10e61232e455"} err="failed to get container status \"7420d5e30207cd5b4c718646eda2399ed3b5e0e2fd559887d16a10e61232e455\": rpc error: code = NotFound desc = could not find container \"7420d5e30207cd5b4c718646eda2399ed3b5e0e2fd559887d16a10e61232e455\": container with ID starting with 7420d5e30207cd5b4c718646eda2399ed3b5e0e2fd559887d16a10e61232e455 not found: ID does not exist"
Jul 17 19:58:57.631661 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.631467    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 17 19:58:57.631661 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.631478    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 17 19:58:57.631661 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.631499    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 17 19:58:57.631661 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.631467    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 17 19:58:57.631661 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.631566    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 17 19:58:57.631661 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.631618    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-7h5n6\""
Jul 17 19:58:57.633601 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.633584    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 17 19:58:57.636529 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.636510    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 17 19:58:57.641487 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.641469    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 17 19:58:57.687272 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.687242    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f" path="/var/lib/kubelet/pods/2de2f4ec-bc75-4d2f-b3cd-126ffb3fa12f/volumes"
Jul 17 19:58:57.694116 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.694097    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/febd94c4-f75a-440d-a9f3-4063865393e3-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"febd94c4-f75a-440d-a9f3-4063865393e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 19:58:57.694223 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.694124    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/febd94c4-f75a-440d-a9f3-4063865393e3-config-out\") pod \"prometheus-k8s-0\" (UID: \"febd94c4-f75a-440d-a9f3-4063865393e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 19:58:57.694223 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.694149    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/febd94c4-f75a-440d-a9f3-4063865393e3-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"febd94c4-f75a-440d-a9f3-4063865393e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 19:58:57.694223 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.694172    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/febd94c4-f75a-440d-a9f3-4063865393e3-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"febd94c4-f75a-440d-a9f3-4063865393e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 19:58:57.694346 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.694250    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/febd94c4-f75a-440d-a9f3-4063865393e3-web-config\") pod \"prometheus-k8s-0\" (UID: \"febd94c4-f75a-440d-a9f3-4063865393e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 19:58:57.694346 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.694278    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/febd94c4-f75a-440d-a9f3-4063865393e3-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"febd94c4-f75a-440d-a9f3-4063865393e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 19:58:57.694346 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.694297    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/febd94c4-f75a-440d-a9f3-4063865393e3-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"febd94c4-f75a-440d-a9f3-4063865393e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 19:58:57.694346 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.694313    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fhblt\" (UniqueName: \"kubernetes.io/projected/febd94c4-f75a-440d-a9f3-4063865393e3-kube-api-access-fhblt\") pod \"prometheus-k8s-0\" (UID: \"febd94c4-f75a-440d-a9f3-4063865393e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 19:58:57.694491 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.694358    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/febd94c4-f75a-440d-a9f3-4063865393e3-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"febd94c4-f75a-440d-a9f3-4063865393e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 19:58:57.694491 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.694392    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/febd94c4-f75a-440d-a9f3-4063865393e3-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"febd94c4-f75a-440d-a9f3-4063865393e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 19:58:57.694491 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.694467    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/febd94c4-f75a-440d-a9f3-4063865393e3-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"febd94c4-f75a-440d-a9f3-4063865393e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 19:58:57.694641 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.694504    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/febd94c4-f75a-440d-a9f3-4063865393e3-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"febd94c4-f75a-440d-a9f3-4063865393e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 19:58:57.694641 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.694535    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/febd94c4-f75a-440d-a9f3-4063865393e3-config\") pod \"prometheus-k8s-0\" (UID: \"febd94c4-f75a-440d-a9f3-4063865393e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 19:58:57.694641 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.694564    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/febd94c4-f75a-440d-a9f3-4063865393e3-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"febd94c4-f75a-440d-a9f3-4063865393e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 19:58:57.694641 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.694593    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/febd94c4-f75a-440d-a9f3-4063865393e3-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"febd94c4-f75a-440d-a9f3-4063865393e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 19:58:57.694641 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.694627    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/febd94c4-f75a-440d-a9f3-4063865393e3-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"febd94c4-f75a-440d-a9f3-4063865393e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 19:58:57.694851 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.694671    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/febd94c4-f75a-440d-a9f3-4063865393e3-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"febd94c4-f75a-440d-a9f3-4063865393e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 19:58:57.694851 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.694697    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/febd94c4-f75a-440d-a9f3-4063865393e3-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"febd94c4-f75a-440d-a9f3-4063865393e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 19:58:57.694851 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.694724    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/febd94c4-f75a-440d-a9f3-4063865393e3-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"febd94c4-f75a-440d-a9f3-4063865393e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 19:58:57.694851 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.694758    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/febd94c4-f75a-440d-a9f3-4063865393e3-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"febd94c4-f75a-440d-a9f3-4063865393e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 19:58:57.795899 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.795865    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/febd94c4-f75a-440d-a9f3-4063865393e3-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"febd94c4-f75a-440d-a9f3-4063865393e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 19:58:57.795899 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.795902    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/febd94c4-f75a-440d-a9f3-4063865393e3-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"febd94c4-f75a-440d-a9f3-4063865393e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 19:58:57.796134 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.795921    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/febd94c4-f75a-440d-a9f3-4063865393e3-config-out\") pod \"prometheus-k8s-0\" (UID: \"febd94c4-f75a-440d-a9f3-4063865393e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 19:58:57.796134 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.796033    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/febd94c4-f75a-440d-a9f3-4063865393e3-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"febd94c4-f75a-440d-a9f3-4063865393e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 19:58:57.796134 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.796090    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/febd94c4-f75a-440d-a9f3-4063865393e3-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"febd94c4-f75a-440d-a9f3-4063865393e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 19:58:57.796134 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.796124    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/febd94c4-f75a-440d-a9f3-4063865393e3-web-config\") pod \"prometheus-k8s-0\" (UID: \"febd94c4-f75a-440d-a9f3-4063865393e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 19:58:57.796318 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.796160    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/febd94c4-f75a-440d-a9f3-4063865393e3-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"febd94c4-f75a-440d-a9f3-4063865393e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 19:58:57.796318 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.796187    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/febd94c4-f75a-440d-a9f3-4063865393e3-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"febd94c4-f75a-440d-a9f3-4063865393e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 19:58:57.796318 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.796210    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fhblt\" (UniqueName: \"kubernetes.io/projected/febd94c4-f75a-440d-a9f3-4063865393e3-kube-api-access-fhblt\") pod \"prometheus-k8s-0\" (UID: \"febd94c4-f75a-440d-a9f3-4063865393e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 19:58:57.796318 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.796246    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/febd94c4-f75a-440d-a9f3-4063865393e3-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"febd94c4-f75a-440d-a9f3-4063865393e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 19:58:57.796318 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.796271    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/febd94c4-f75a-440d-a9f3-4063865393e3-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"febd94c4-f75a-440d-a9f3-4063865393e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 19:58:57.796318 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.796301    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/febd94c4-f75a-440d-a9f3-4063865393e3-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"febd94c4-f75a-440d-a9f3-4063865393e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 19:58:57.796600 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.796331    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/febd94c4-f75a-440d-a9f3-4063865393e3-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"febd94c4-f75a-440d-a9f3-4063865393e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 19:58:57.796600 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.796360    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/febd94c4-f75a-440d-a9f3-4063865393e3-config\") pod \"prometheus-k8s-0\" (UID: \"febd94c4-f75a-440d-a9f3-4063865393e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 19:58:57.796600 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.796384    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/febd94c4-f75a-440d-a9f3-4063865393e3-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"febd94c4-f75a-440d-a9f3-4063865393e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 19:58:57.796600 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.796421    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/febd94c4-f75a-440d-a9f3-4063865393e3-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"febd94c4-f75a-440d-a9f3-4063865393e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 19:58:57.796600 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.796452    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/febd94c4-f75a-440d-a9f3-4063865393e3-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"febd94c4-f75a-440d-a9f3-4063865393e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 19:58:57.796600 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.796503    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/febd94c4-f75a-440d-a9f3-4063865393e3-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"febd94c4-f75a-440d-a9f3-4063865393e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 19:58:57.796600 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.796530    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/febd94c4-f75a-440d-a9f3-4063865393e3-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"febd94c4-f75a-440d-a9f3-4063865393e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 19:58:57.796600 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.796559    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/febd94c4-f75a-440d-a9f3-4063865393e3-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"febd94c4-f75a-440d-a9f3-4063865393e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 19:58:57.796600 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.796565    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/febd94c4-f75a-440d-a9f3-4063865393e3-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"febd94c4-f75a-440d-a9f3-4063865393e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 19:58:57.797247 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.797222    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/febd94c4-f75a-440d-a9f3-4063865393e3-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"febd94c4-f75a-440d-a9f3-4063865393e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 19:58:57.798727 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.797937    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/febd94c4-f75a-440d-a9f3-4063865393e3-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"febd94c4-f75a-440d-a9f3-4063865393e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 19:58:57.798727 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.798605    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/febd94c4-f75a-440d-a9f3-4063865393e3-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"febd94c4-f75a-440d-a9f3-4063865393e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 19:58:57.799015 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.798989    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/febd94c4-f75a-440d-a9f3-4063865393e3-config-out\") pod \"prometheus-k8s-0\" (UID: \"febd94c4-f75a-440d-a9f3-4063865393e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 19:58:57.799110 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.799023    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/febd94c4-f75a-440d-a9f3-4063865393e3-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"febd94c4-f75a-440d-a9f3-4063865393e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 19:58:57.799195 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.799174    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/febd94c4-f75a-440d-a9f3-4063865393e3-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"febd94c4-f75a-440d-a9f3-4063865393e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 19:58:57.799262 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.799208    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/febd94c4-f75a-440d-a9f3-4063865393e3-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"febd94c4-f75a-440d-a9f3-4063865393e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 19:58:57.799319 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.799275    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/febd94c4-f75a-440d-a9f3-4063865393e3-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"febd94c4-f75a-440d-a9f3-4063865393e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 19:58:57.799574 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.799554    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/febd94c4-f75a-440d-a9f3-4063865393e3-web-config\") pod \"prometheus-k8s-0\" (UID: \"febd94c4-f75a-440d-a9f3-4063865393e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 19:58:57.799724 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.799676    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/febd94c4-f75a-440d-a9f3-4063865393e3-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"febd94c4-f75a-440d-a9f3-4063865393e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 19:58:57.800218 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.799999    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/febd94c4-f75a-440d-a9f3-4063865393e3-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"febd94c4-f75a-440d-a9f3-4063865393e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 19:58:57.800218 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.800186    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/febd94c4-f75a-440d-a9f3-4063865393e3-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"febd94c4-f75a-440d-a9f3-4063865393e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 19:58:57.800365 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.800331    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/febd94c4-f75a-440d-a9f3-4063865393e3-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"febd94c4-f75a-440d-a9f3-4063865393e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 19:58:57.801624 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.801599    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/febd94c4-f75a-440d-a9f3-4063865393e3-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"febd94c4-f75a-440d-a9f3-4063865393e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 19:58:57.801730 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.801666    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/febd94c4-f75a-440d-a9f3-4063865393e3-config\") pod \"prometheus-k8s-0\" (UID: \"febd94c4-f75a-440d-a9f3-4063865393e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 19:58:57.801730 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.801675    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/febd94c4-f75a-440d-a9f3-4063865393e3-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"febd94c4-f75a-440d-a9f3-4063865393e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 19:58:57.801852 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.801742    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/febd94c4-f75a-440d-a9f3-4063865393e3-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"febd94c4-f75a-440d-a9f3-4063865393e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 19:58:57.802104 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.802089    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/febd94c4-f75a-440d-a9f3-4063865393e3-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"febd94c4-f75a-440d-a9f3-4063865393e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 19:58:57.807410 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.807394    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fhblt\" (UniqueName: \"kubernetes.io/projected/febd94c4-f75a-440d-a9f3-4063865393e3-kube-api-access-fhblt\") pod \"prometheus-k8s-0\" (UID: \"febd94c4-f75a-440d-a9f3-4063865393e3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 19:58:57.939036 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:57.939013    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 19:58:58.073940 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:58.073915    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 17 19:58:58.577229 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:58.577197    2572 generic.go:356] "Generic (PLEG): container finished" podID="febd94c4-f75a-440d-a9f3-4063865393e3" containerID="15704a944e7093ed6a6b507f3c396d32cc821fc5e429b321fcf54e31af3471a6" exitCode=0
Jul 17 19:58:58.577443 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:58.577288    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"febd94c4-f75a-440d-a9f3-4063865393e3","Type":"ContainerDied","Data":"15704a944e7093ed6a6b507f3c396d32cc821fc5e429b321fcf54e31af3471a6"}
Jul 17 19:58:58.577443 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:58.577374    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"febd94c4-f75a-440d-a9f3-4063865393e3","Type":"ContainerStarted","Data":"d9850da347587d88f2303f0de5fcd0bea1365a29985ef398c102160764fe6964"}
Jul 17 19:58:59.585525 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:59.585491    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"febd94c4-f75a-440d-a9f3-4063865393e3","Type":"ContainerStarted","Data":"27fb708f75f4b1adbefd6a06248cddf4d7ba436e591d781d4fcd4e8c36194996"}
Jul 17 19:58:59.585870 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:59.585554    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"febd94c4-f75a-440d-a9f3-4063865393e3","Type":"ContainerStarted","Data":"0168646ada238058efe567a30060a17bf6d1a4319241365873998e706a9dbf5c"}
Jul 17 19:58:59.585870 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:59.585580    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"febd94c4-f75a-440d-a9f3-4063865393e3","Type":"ContainerStarted","Data":"13e720aae07cc6a8deb0643db5d3b7602275998a2d5cabfeecc00a55f8b99661"}
Jul 17 19:58:59.585870 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:59.585603    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"febd94c4-f75a-440d-a9f3-4063865393e3","Type":"ContainerStarted","Data":"37dfba1e45be50f0f98b538ea774c93e54f5d51ab283a252f6efc72c7c75c535"}
Jul 17 19:58:59.585870 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:59.585631    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"febd94c4-f75a-440d-a9f3-4063865393e3","Type":"ContainerStarted","Data":"68885e160a83894cd83b9b620bd78556f5d0eb17204b9bc07aea99743cb6d165"}
Jul 17 19:58:59.585870 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:59.585656    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"febd94c4-f75a-440d-a9f3-4063865393e3","Type":"ContainerStarted","Data":"55874a8d82e280ede1fcc719343c28464e6cd0760f04a2c29efcc667015681cc"}
Jul 17 19:58:59.618213 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:59.618155    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.598680721 podStartE2EDuration="2.618133922s" totalImagesPullingTime="0s" totalInitContainerRuntime="19.453201ms" isStatefulPod=false podCreationTimestamp="2026-07-17 19:58:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 19:58:59.616757236 +0000 UTC m=+164.458252872" watchObservedRunningTime="2026-07-17 19:58:59.618133922 +0000 UTC m=+164.459629560"
Jul 17 19:58:59.922062 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:58:59.921983    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 19:59:00.956034 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:59:00.956001    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 19:59:01.209589 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:59:01.209513    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 19:59:01.309485 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:59:01.309449    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 19:59:01.700047 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:59:01.700007    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 19:59:01.748500 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:59:01.748466    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 19:59:02.940038 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:59:02.939988    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 19:59:12.376427 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:59:12.376349    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 19:59:12.428429 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:59:12.428395    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 19:59:12.479157 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:59:12.479122    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 19:59:20.520285 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:59:20.520243    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 19:59:35.224972 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:59:35.224929    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 19:59:57.939795 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:59:57.939766    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 19:59:57.955202 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:59:57.955179    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 19:59:58.818315 ip-10-0-141-177 kubenswrapper[2572]: I0717 19:59:58.818287    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 17 20:00:06.739930 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:00:06.739896    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:00:06.798109 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:00:06.798062    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:00:18.559912 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:00:18.559874    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:00:18.612744 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:00:18.612707    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:00:23.492314 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:00:23.492276    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:00:23.595205 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:00:23.595171    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:00:26.210785 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:00:26.210754    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:00:36.716508 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:00:36.716476    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:00:36.766031 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:00:36.766003    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:00:36.894378 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:00:36.894337    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:00:54.962770 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:00:54.962732    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:00:55.059158 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:00:55.059124    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:01:15.534956 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:01:15.534929    2572 kubelet.go:1648] "Image garbage collection succeeded"
Jul 17 20:01:21.574615 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:01:21.574555    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:01:23.132786 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:01:23.132740    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:01:25.151699 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:01:25.151664    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:01:25.200134 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:01:25.200100    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:01:26.590840 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:01:26.590806    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:01:26.691324 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:01:26.691286    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:01:27.382022 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:01:27.381984    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:01:27.485432 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:01:27.485401    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:01:29.398854 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:01:29.398824    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:01:29.801890 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:01:29.801859    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:01:31.953380 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:01:31.953351    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:01:32.053534 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:01:32.053504    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:01:37.993124 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:01:37.993091    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:01:39.443520 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:01:39.443490    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:01:39.539460 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:01:39.539427    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:01:41.159417 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:01:41.159384    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pkq24"]
Jul 17 20:01:41.161664 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:01:41.161648    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pkq24"
Jul 17 20:01:41.163868 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:01:41.163847    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 17 20:01:41.165217 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:01:41.164939    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 17 20:01:41.165217 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:01:41.164965    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-vdmd2\""
Jul 17 20:01:41.173332 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:01:41.173309    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pkq24"]
Jul 17 20:01:41.237704 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:01:41.237680    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fe506038-7a75-42b1-b807-9bbd4a0b4faa-tmp\") pod \"openshift-lws-operator-fd8ccff4c-pkq24\" (UID: \"fe506038-7a75-42b1-b807-9bbd4a0b4faa\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pkq24"
Jul 17 20:01:41.237829 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:01:41.237726    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sdmgj\" (UniqueName: \"kubernetes.io/projected/fe506038-7a75-42b1-b807-9bbd4a0b4faa-kube-api-access-sdmgj\") pod \"openshift-lws-operator-fd8ccff4c-pkq24\" (UID: \"fe506038-7a75-42b1-b807-9bbd4a0b4faa\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pkq24"
Jul 17 20:01:41.338918 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:01:41.338886    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sdmgj\" (UniqueName: \"kubernetes.io/projected/fe506038-7a75-42b1-b807-9bbd4a0b4faa-kube-api-access-sdmgj\") pod \"openshift-lws-operator-fd8ccff4c-pkq24\" (UID: \"fe506038-7a75-42b1-b807-9bbd4a0b4faa\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pkq24"
Jul 17 20:01:41.339059 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:01:41.338952    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fe506038-7a75-42b1-b807-9bbd4a0b4faa-tmp\") pod \"openshift-lws-operator-fd8ccff4c-pkq24\" (UID: \"fe506038-7a75-42b1-b807-9bbd4a0b4faa\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pkq24"
Jul 17 20:01:41.339308 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:01:41.339291    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fe506038-7a75-42b1-b807-9bbd4a0b4faa-tmp\") pod \"openshift-lws-operator-fd8ccff4c-pkq24\" (UID: \"fe506038-7a75-42b1-b807-9bbd4a0b4faa\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pkq24"
Jul 17 20:01:41.347196 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:01:41.347175    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sdmgj\" (UniqueName: \"kubernetes.io/projected/fe506038-7a75-42b1-b807-9bbd4a0b4faa-kube-api-access-sdmgj\") pod \"openshift-lws-operator-fd8ccff4c-pkq24\" (UID: \"fe506038-7a75-42b1-b807-9bbd4a0b4faa\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pkq24"
Jul 17 20:01:41.473767 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:01:41.473685    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pkq24"
Jul 17 20:01:41.593407 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:01:41.593378    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pkq24"]
Jul 17 20:01:41.596184 ip-10-0-141-177 kubenswrapper[2572]: W0717 20:01:41.596157    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfe506038_7a75_42b1_b807_9bbd4a0b4faa.slice/crio-7ea189b33c69b30027bb798492914414f4869ca6f626b13fe1ef6e726e022d79 WatchSource:0}: Error finding container 7ea189b33c69b30027bb798492914414f4869ca6f626b13fe1ef6e726e022d79: Status 404 returned error can't find the container with id 7ea189b33c69b30027bb798492914414f4869ca6f626b13fe1ef6e726e022d79
Jul 17 20:01:41.598054 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:01:41.598036    2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 17 20:01:42.180963 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:01:42.180929    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pkq24" event={"ID":"fe506038-7a75-42b1-b807-9bbd4a0b4faa","Type":"ContainerStarted","Data":"7ea189b33c69b30027bb798492914414f4869ca6f626b13fe1ef6e726e022d79"}
Jul 17 20:01:45.196715 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:01:45.196680    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pkq24" event={"ID":"fe506038-7a75-42b1-b807-9bbd4a0b4faa","Type":"ContainerStarted","Data":"bf88e81fb89b9ac6f0020582e1f92bcf6a7493a3fea8a13a1ad6b05b376d86b7"}
Jul 17 20:01:45.211665 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:01:45.211602    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pkq24" podStartSLOduration=1.419548778 podStartE2EDuration="4.211584495s" totalImagesPullingTime="2.792035717s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 20:01:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 20:01:45.21076272 +0000 UTC m=+330.052258392" watchObservedRunningTime="2026-07-17 20:01:45.211584495 +0000 UTC m=+330.053080132"
Jul 17 20:01:45.885665 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:01:45.885631    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:01:45.984182 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:01:45.984149    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:01:48.127244 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:01:48.127210    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:02:01.201094 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:02:01.201036    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:02:01.303596 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:02:01.303549    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:02:03.612864 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:02:03.612829    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:02:03.711422 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:02:03.711390    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:02:04.200562 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:02:04.200532    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:02:04.400792 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:02:04.400758    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:02:04.494687 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:02:04.494659    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:02:04.535604 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:02:04.535569    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-67bdc7ddc4-8w6gc"]
Jul 17 20:02:04.538132 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:02:04.538114    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-67bdc7ddc4-8w6gc"
Jul 17 20:02:04.541210 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:02:04.541191    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 17 20:02:04.541349 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:02:04.541324    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 17 20:02:04.541421 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:02:04.541366    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 17 20:02:04.541421 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:02:04.541375    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 17 20:02:04.541518 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:02:04.541494    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-rss4j\""
Jul 17 20:02:04.551899 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:02:04.551881    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-67bdc7ddc4-8w6gc"]
Jul 17 20:02:04.634385 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:02:04.634357    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/93200790-ba58-4f95-a32c-9e90388a7a50-webhook-cert\") pod \"opendatahub-operator-controller-manager-67bdc7ddc4-8w6gc\" (UID: \"93200790-ba58-4f95-a32c-9e90388a7a50\") " pod="opendatahub/opendatahub-operator-controller-manager-67bdc7ddc4-8w6gc"
Jul 17 20:02:04.634782 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:02:04.634412    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/93200790-ba58-4f95-a32c-9e90388a7a50-apiservice-cert\") pod \"opendatahub-operator-controller-manager-67bdc7ddc4-8w6gc\" (UID: \"93200790-ba58-4f95-a32c-9e90388a7a50\") " pod="opendatahub/opendatahub-operator-controller-manager-67bdc7ddc4-8w6gc"
Jul 17 20:02:04.634782 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:02:04.634479    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/93200790-ba58-4f95-a32c-9e90388a7a50-manifests\") pod \"opendatahub-operator-controller-manager-67bdc7ddc4-8w6gc\" (UID: \"93200790-ba58-4f95-a32c-9e90388a7a50\") " pod="opendatahub/opendatahub-operator-controller-manager-67bdc7ddc4-8w6gc"
Jul 17 20:02:04.634782 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:02:04.634521    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/93200790-ba58-4f95-a32c-9e90388a7a50-tmp\") pod \"opendatahub-operator-controller-manager-67bdc7ddc4-8w6gc\" (UID: \"93200790-ba58-4f95-a32c-9e90388a7a50\") " pod="opendatahub/opendatahub-operator-controller-manager-67bdc7ddc4-8w6gc"
Jul 17 20:02:04.634782 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:02:04.634549    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j5nwx\" (UniqueName: \"kubernetes.io/projected/93200790-ba58-4f95-a32c-9e90388a7a50-kube-api-access-j5nwx\") pod \"opendatahub-operator-controller-manager-67bdc7ddc4-8w6gc\" (UID: \"93200790-ba58-4f95-a32c-9e90388a7a50\") " pod="opendatahub/opendatahub-operator-controller-manager-67bdc7ddc4-8w6gc"
Jul 17 20:02:04.647995 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:02:04.647959    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:02:04.735044 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:02:04.735018    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/93200790-ba58-4f95-a32c-9e90388a7a50-tmp\") pod \"opendatahub-operator-controller-manager-67bdc7ddc4-8w6gc\" (UID: \"93200790-ba58-4f95-a32c-9e90388a7a50\") " pod="opendatahub/opendatahub-operator-controller-manager-67bdc7ddc4-8w6gc"
Jul 17 20:02:04.735167 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:02:04.735049    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j5nwx\" (UniqueName: \"kubernetes.io/projected/93200790-ba58-4f95-a32c-9e90388a7a50-kube-api-access-j5nwx\") pod \"opendatahub-operator-controller-manager-67bdc7ddc4-8w6gc\" (UID: \"93200790-ba58-4f95-a32c-9e90388a7a50\") " pod="opendatahub/opendatahub-operator-controller-manager-67bdc7ddc4-8w6gc"
Jul 17 20:02:04.735167 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:02:04.735114    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/93200790-ba58-4f95-a32c-9e90388a7a50-webhook-cert\") pod \"opendatahub-operator-controller-manager-67bdc7ddc4-8w6gc\" (UID: \"93200790-ba58-4f95-a32c-9e90388a7a50\") " pod="opendatahub/opendatahub-operator-controller-manager-67bdc7ddc4-8w6gc"
Jul 17 20:02:04.735167 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:02:04.735148    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/93200790-ba58-4f95-a32c-9e90388a7a50-apiservice-cert\") pod \"opendatahub-operator-controller-manager-67bdc7ddc4-8w6gc\" (UID: \"93200790-ba58-4f95-a32c-9e90388a7a50\") " pod="opendatahub/opendatahub-operator-controller-manager-67bdc7ddc4-8w6gc"
Jul 17 20:02:04.735361 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:02:04.735186    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/93200790-ba58-4f95-a32c-9e90388a7a50-manifests\") pod \"opendatahub-operator-controller-manager-67bdc7ddc4-8w6gc\" (UID: \"93200790-ba58-4f95-a32c-9e90388a7a50\") " pod="opendatahub/opendatahub-operator-controller-manager-67bdc7ddc4-8w6gc"
Jul 17 20:02:04.735516 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:02:04.735494    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/93200790-ba58-4f95-a32c-9e90388a7a50-manifests\") pod \"opendatahub-operator-controller-manager-67bdc7ddc4-8w6gc\" (UID: \"93200790-ba58-4f95-a32c-9e90388a7a50\") " pod="opendatahub/opendatahub-operator-controller-manager-67bdc7ddc4-8w6gc"
Jul 17 20:02:04.737250 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:02:04.737231    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/93200790-ba58-4f95-a32c-9e90388a7a50-tmp\") pod \"opendatahub-operator-controller-manager-67bdc7ddc4-8w6gc\" (UID: \"93200790-ba58-4f95-a32c-9e90388a7a50\") " pod="opendatahub/opendatahub-operator-controller-manager-67bdc7ddc4-8w6gc"
Jul 17 20:02:04.737534 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:02:04.737520    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/93200790-ba58-4f95-a32c-9e90388a7a50-apiservice-cert\") pod \"opendatahub-operator-controller-manager-67bdc7ddc4-8w6gc\" (UID: \"93200790-ba58-4f95-a32c-9e90388a7a50\") " pod="opendatahub/opendatahub-operator-controller-manager-67bdc7ddc4-8w6gc"
Jul 17 20:02:04.737575 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:02:04.737561    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/93200790-ba58-4f95-a32c-9e90388a7a50-webhook-cert\") pod \"opendatahub-operator-controller-manager-67bdc7ddc4-8w6gc\" (UID: \"93200790-ba58-4f95-a32c-9e90388a7a50\") " pod="opendatahub/opendatahub-operator-controller-manager-67bdc7ddc4-8w6gc"
Jul 17 20:02:04.742771 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:02:04.742746    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j5nwx\" (UniqueName: \"kubernetes.io/projected/93200790-ba58-4f95-a32c-9e90388a7a50-kube-api-access-j5nwx\") pod \"opendatahub-operator-controller-manager-67bdc7ddc4-8w6gc\" (UID: \"93200790-ba58-4f95-a32c-9e90388a7a50\") " pod="opendatahub/opendatahub-operator-controller-manager-67bdc7ddc4-8w6gc"
Jul 17 20:02:04.747721 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:02:04.747673    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:02:04.848798 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:02:04.848767    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-67bdc7ddc4-8w6gc"
Jul 17 20:02:04.853694 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:02:04.853665    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:02:04.962467 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:02:04.962433    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:02:04.974877 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:02:04.974797    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-67bdc7ddc4-8w6gc"]
Jul 17 20:02:04.977724 ip-10-0-141-177 kubenswrapper[2572]: W0717 20:02:04.977698    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93200790_ba58_4f95_a32c_9e90388a7a50.slice/crio-18607abb70bf4744f0235d8d7c8dbae8a837ddaeb00ea2358a4b0d1bdeba12fc WatchSource:0}: Error finding container 18607abb70bf4744f0235d8d7c8dbae8a837ddaeb00ea2358a4b0d1bdeba12fc: Status 404 returned error can't find the container with id 18607abb70bf4744f0235d8d7c8dbae8a837ddaeb00ea2358a4b0d1bdeba12fc
Jul 17 20:02:05.066988 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:02:05.066931    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:02:05.160529 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:02:05.160501    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:02:05.275296 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:02:05.275260    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-67bdc7ddc4-8w6gc" event={"ID":"93200790-ba58-4f95-a32c-9e90388a7a50","Type":"ContainerStarted","Data":"18607abb70bf4744f0235d8d7c8dbae8a837ddaeb00ea2358a4b0d1bdeba12fc"}
Jul 17 20:02:08.290609 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:02:08.290579    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-67bdc7ddc4-8w6gc" event={"ID":"93200790-ba58-4f95-a32c-9e90388a7a50","Type":"ContainerStarted","Data":"973caa3e5fa28789fc88e5040c5afa5f5a3c0a4109113195120a80e442278bd8"}
Jul 17 20:02:09.295807 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:02:09.295767    2572 generic.go:356] "Generic (PLEG): container finished" podID="93200790-ba58-4f95-a32c-9e90388a7a50" containerID="973caa3e5fa28789fc88e5040c5afa5f5a3c0a4109113195120a80e442278bd8" exitCode=0
Jul 17 20:02:09.296288 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:02:09.295824    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-67bdc7ddc4-8w6gc" event={"ID":"93200790-ba58-4f95-a32c-9e90388a7a50","Type":"ContainerDied","Data":"973caa3e5fa28789fc88e5040c5afa5f5a3c0a4109113195120a80e442278bd8"}
Jul 17 20:02:10.301768 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:02:10.301733    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-67bdc7ddc4-8w6gc" event={"ID":"93200790-ba58-4f95-a32c-9e90388a7a50","Type":"ContainerStarted","Data":"f5d8e19e6e63abc9866a936981805adb0f70daeead7ed0c43d25f48d5bfb7894"}
Jul 17 20:02:10.302166 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:02:10.301883    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-67bdc7ddc4-8w6gc"
Jul 17 20:02:10.323998 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:02:10.323949    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-67bdc7ddc4-8w6gc" podStartSLOduration=1.671234261 podStartE2EDuration="6.323934319s" totalImagesPullingTime="3.635674065s" totalInitContainerRuntime="1.017025993s" isStatefulPod=false podCreationTimestamp="2026-07-17 20:02:04 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 20:02:10.321936144 +0000 UTC m=+355.163431804" watchObservedRunningTime="2026-07-17 20:02:10.323934319 +0000 UTC m=+355.165429956"
Jul 17 20:02:16.639484 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:02:16.639447    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:02:16.733186 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:02:16.733155    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:02:16.840083 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:02:16.840042    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:02:21.308252 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:02:21.308223    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-67bdc7ddc4-8w6gc"
Jul 17 20:02:22.369667 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:02:22.369634    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:02:22.470863 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:02:22.470828    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:02:23.483680 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:02:23.483642    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:02:23.864019 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:02:23.863988    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:02:24.176452 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:02:24.176379    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:02:24.273657 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:02:24.273627    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:02:24.528738 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:02:24.528705    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:02:24.716034 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:02:24.716007    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:02:24.816656 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:02:24.816582    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:02:31.615052 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:02:31.615014    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-7c54c94474-59v64"]
Jul 17 20:02:31.627354 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:02:31.627312    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7c54c94474-59v64"
Jul 17 20:02:31.631690 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:02:31.631662    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-dq5kt\""
Jul 17 20:02:31.632149 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:02:31.632126    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 17 20:02:31.632881 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:02:31.632863    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 17 20:02:31.633116 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:02:31.633101    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 17 20:02:31.636276 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:02:31.636253    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7c54c94474-59v64"]
Jul 17 20:02:31.755661 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:02:31.755626    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/0943fc6c-a80a-4611-a6e0-96565d1cc33c-manager-config\") pod \"lws-controller-manager-7c54c94474-59v64\" (UID: \"0943fc6c-a80a-4611-a6e0-96565d1cc33c\") " pod="openshift-lws-operator/lws-controller-manager-7c54c94474-59v64"
Jul 17 20:02:31.755867 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:02:31.755740    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vln9p\" (UniqueName: \"kubernetes.io/projected/0943fc6c-a80a-4611-a6e0-96565d1cc33c-kube-api-access-vln9p\") pod \"lws-controller-manager-7c54c94474-59v64\" (UID: \"0943fc6c-a80a-4611-a6e0-96565d1cc33c\") " pod="openshift-lws-operator/lws-controller-manager-7c54c94474-59v64"
Jul 17 20:02:31.755867 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:02:31.755776    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/0943fc6c-a80a-4611-a6e0-96565d1cc33c-metrics-cert\") pod \"lws-controller-manager-7c54c94474-59v64\" (UID: \"0943fc6c-a80a-4611-a6e0-96565d1cc33c\") " pod="openshift-lws-operator/lws-controller-manager-7c54c94474-59v64"
Jul 17 20:02:31.755867 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:02:31.755805    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0943fc6c-a80a-4611-a6e0-96565d1cc33c-cert\") pod \"lws-controller-manager-7c54c94474-59v64\" (UID: \"0943fc6c-a80a-4611-a6e0-96565d1cc33c\") " pod="openshift-lws-operator/lws-controller-manager-7c54c94474-59v64"
Jul 17 20:02:31.856464 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:02:31.856433    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/0943fc6c-a80a-4611-a6e0-96565d1cc33c-manager-config\") pod \"lws-controller-manager-7c54c94474-59v64\" (UID: \"0943fc6c-a80a-4611-a6e0-96565d1cc33c\") " pod="openshift-lws-operator/lws-controller-manager-7c54c94474-59v64"
Jul 17 20:02:31.856464 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:02:31.856466    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vln9p\" (UniqueName: \"kubernetes.io/projected/0943fc6c-a80a-4611-a6e0-96565d1cc33c-kube-api-access-vln9p\") pod \"lws-controller-manager-7c54c94474-59v64\" (UID: \"0943fc6c-a80a-4611-a6e0-96565d1cc33c\") " pod="openshift-lws-operator/lws-controller-manager-7c54c94474-59v64"
Jul 17 20:02:31.856675 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:02:31.856496    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/0943fc6c-a80a-4611-a6e0-96565d1cc33c-metrics-cert\") pod \"lws-controller-manager-7c54c94474-59v64\" (UID: \"0943fc6c-a80a-4611-a6e0-96565d1cc33c\") " pod="openshift-lws-operator/lws-controller-manager-7c54c94474-59v64"
Jul 17 20:02:31.856742 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:02:31.856681    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0943fc6c-a80a-4611-a6e0-96565d1cc33c-cert\") pod \"lws-controller-manager-7c54c94474-59v64\" (UID: \"0943fc6c-a80a-4611-a6e0-96565d1cc33c\") " pod="openshift-lws-operator/lws-controller-manager-7c54c94474-59v64"
Jul 17 20:02:31.857205 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:02:31.857185    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/0943fc6c-a80a-4611-a6e0-96565d1cc33c-manager-config\") pod \"lws-controller-manager-7c54c94474-59v64\" (UID: \"0943fc6c-a80a-4611-a6e0-96565d1cc33c\") " pod="openshift-lws-operator/lws-controller-manager-7c54c94474-59v64"
Jul 17 20:02:31.858804 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:02:31.858783    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/0943fc6c-a80a-4611-a6e0-96565d1cc33c-metrics-cert\") pod \"lws-controller-manager-7c54c94474-59v64\" (UID: \"0943fc6c-a80a-4611-a6e0-96565d1cc33c\") " pod="openshift-lws-operator/lws-controller-manager-7c54c94474-59v64"
Jul 17 20:02:31.858912 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:02:31.858895    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0943fc6c-a80a-4611-a6e0-96565d1cc33c-cert\") pod \"lws-controller-manager-7c54c94474-59v64\" (UID: \"0943fc6c-a80a-4611-a6e0-96565d1cc33c\") " pod="openshift-lws-operator/lws-controller-manager-7c54c94474-59v64"
Jul 17 20:02:31.869057 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:02:31.868999    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vln9p\" (UniqueName: \"kubernetes.io/projected/0943fc6c-a80a-4611-a6e0-96565d1cc33c-kube-api-access-vln9p\") pod \"lws-controller-manager-7c54c94474-59v64\" (UID: \"0943fc6c-a80a-4611-a6e0-96565d1cc33c\") " pod="openshift-lws-operator/lws-controller-manager-7c54c94474-59v64"
Jul 17 20:02:31.942399 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:02:31.942377    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7c54c94474-59v64"
Jul 17 20:02:32.067486 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:02:32.067462    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7c54c94474-59v64"]
Jul 17 20:02:32.069836 ip-10-0-141-177 kubenswrapper[2572]: W0717 20:02:32.069812    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0943fc6c_a80a_4611_a6e0_96565d1cc33c.slice/crio-065701ccfaab47d62146029393df8df2bd8f6016c238e8b1d8b0933ab23d61dc WatchSource:0}: Error finding container 065701ccfaab47d62146029393df8df2bd8f6016c238e8b1d8b0933ab23d61dc: Status 404 returned error can't find the container with id 065701ccfaab47d62146029393df8df2bd8f6016c238e8b1d8b0933ab23d61dc
Jul 17 20:02:32.393381 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:02:32.393342    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7c54c94474-59v64" event={"ID":"0943fc6c-a80a-4611-a6e0-96565d1cc33c","Type":"ContainerStarted","Data":"065701ccfaab47d62146029393df8df2bd8f6016c238e8b1d8b0933ab23d61dc"}
Jul 17 20:02:33.631740 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:02:33.631668    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:02:33.729978 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:02:33.729938    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:02:33.975729 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:02:33.975705    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:02:34.331108 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:02:34.331061    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:02:34.405736 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:02:34.405697    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7c54c94474-59v64" event={"ID":"0943fc6c-a80a-4611-a6e0-96565d1cc33c","Type":"ContainerStarted","Data":"d5488282c4e8b6dd70b879e0d021541b3ea0c7f271a7a2ba5b9fe3128fef11da"}
Jul 17 20:02:34.405907 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:02:34.405767    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-7c54c94474-59v64"
Jul 17 20:02:34.444701 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:02:34.444655    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-7c54c94474-59v64" podStartSLOduration=1.543907789 podStartE2EDuration="3.444640751s" totalImagesPullingTime="1.900732962s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 20:02:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 20:02:34.442595107 +0000 UTC m=+379.284090763" watchObservedRunningTime="2026-07-17 20:02:34.444640751 +0000 UTC m=+379.286136388"
Jul 17 20:02:34.487523 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:02:34.487495    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:02:34.674614 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:02:34.674535    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:02:35.191827 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:02:35.191796    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:02:35.290962 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:02:35.290930    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:02:35.393204 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:02:35.393170    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:02:35.852834 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:02:35.852803    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:02:36.193457 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:02:36.193387    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:02:36.247034 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:02:36.247008    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:02:37.225169 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:02:37.225130    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:02:41.173330 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:02:41.173301    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:02:41.272851 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:02:41.272798    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:02:41.767236 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:02:41.767198    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf449w7z"]
Jul 17 20:02:41.775638 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:02:41.775600    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf449w7z"]
Jul 17 20:02:41.775771 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:02:41.775709    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf449w7z"
Jul 17 20:02:41.778299 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:02:41.778266    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 17 20:02:41.778408 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:02:41.778337    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 17 20:02:41.778477 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:02:41.778424    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-7s8dv\""
Jul 17 20:02:41.778477 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:02:41.778445    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 17 20:02:41.785378 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:02:41.785358    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:02:41.837444 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:02:41.837422    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b045a938-3e18-4ad7-9da2-4fdcfa627a54-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf449w7z\" (UID: \"b045a938-3e18-4ad7-9da2-4fdcfa627a54\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf449w7z"
Jul 17 20:02:41.837571 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:02:41.837455    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w9cpt\" (UniqueName: \"kubernetes.io/projected/b045a938-3e18-4ad7-9da2-4fdcfa627a54-kube-api-access-w9cpt\") pod \"data-science-gateway-data-science-gateway-class-6576859cf449w7z\" (UID: \"b045a938-3e18-4ad7-9da2-4fdcfa627a54\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf449w7z"
Jul 17 20:02:41.837571 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:02:41.837483    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b045a938-3e18-4ad7-9da2-4fdcfa627a54-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf449w7z\" (UID: \"b045a938-3e18-4ad7-9da2-4fdcfa627a54\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf449w7z"
Jul 17 20:02:41.837675 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:02:41.837565    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b045a938-3e18-4ad7-9da2-4fdcfa627a54-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf449w7z\" (UID: \"b045a938-3e18-4ad7-9da2-4fdcfa627a54\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf449w7z"
Jul 17 20:02:41.837675 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:02:41.837600    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b045a938-3e18-4ad7-9da2-4fdcfa627a54-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf449w7z\" (UID: \"b045a938-3e18-4ad7-9da2-4fdcfa627a54\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf449w7z"
Jul 17 20:02:41.837675 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:02:41.837627    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b045a938-3e18-4ad7-9da2-4fdcfa627a54-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf449w7z\" (UID: \"b045a938-3e18-4ad7-9da2-4fdcfa627a54\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf449w7z"
Jul 17 20:02:41.837768 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:02:41.837689    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b045a938-3e18-4ad7-9da2-4fdcfa627a54-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf449w7z\" (UID: \"b045a938-3e18-4ad7-9da2-4fdcfa627a54\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf449w7z"
Jul 17 20:02:41.837768 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:02:41.837739    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b045a938-3e18-4ad7-9da2-4fdcfa627a54-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf449w7z\" (UID: \"b045a938-3e18-4ad7-9da2-4fdcfa627a54\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf449w7z"
Jul 17 20:02:41.837831 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:02:41.837773    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b045a938-3e18-4ad7-9da2-4fdcfa627a54-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf449w7z\" (UID: \"b045a938-3e18-4ad7-9da2-4fdcfa627a54\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf449w7z"
Jul 17 20:02:41.938921 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:02:41.938885    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b045a938-3e18-4ad7-9da2-4fdcfa627a54-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf449w7z\" (UID: \"b045a938-3e18-4ad7-9da2-4fdcfa627a54\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf449w7z"
Jul 17 20:02:41.939208 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:02:41.938929    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w9cpt\" (UniqueName: \"kubernetes.io/projected/b045a938-3e18-4ad7-9da2-4fdcfa627a54-kube-api-access-w9cpt\") pod \"data-science-gateway-data-science-gateway-class-6576859cf449w7z\" (UID: \"b045a938-3e18-4ad7-9da2-4fdcfa627a54\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf449w7z"
Jul 17 20:02:41.939208 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:02:41.939043    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b045a938-3e18-4ad7-9da2-4fdcfa627a54-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf449w7z\" (UID: \"b045a938-3e18-4ad7-9da2-4fdcfa627a54\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf449w7z"
Jul 17 20:02:41.939208 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:02:41.939149    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b045a938-3e18-4ad7-9da2-4fdcfa627a54-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf449w7z\" (UID: \"b045a938-3e18-4ad7-9da2-4fdcfa627a54\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf449w7z"
Jul 17 20:02:41.939208 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:02:41.939178    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b045a938-3e18-4ad7-9da2-4fdcfa627a54-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf449w7z\" (UID: \"b045a938-3e18-4ad7-9da2-4fdcfa627a54\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf449w7z"
Jul 17 20:02:41.939208 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:02:41.939195    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b045a938-3e18-4ad7-9da2-4fdcfa627a54-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf449w7z\" (UID: \"b045a938-3e18-4ad7-9da2-4fdcfa627a54\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf449w7z"
Jul 17 20:02:41.939477 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:02:41.939234    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b045a938-3e18-4ad7-9da2-4fdcfa627a54-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf449w7z\" (UID: \"b045a938-3e18-4ad7-9da2-4fdcfa627a54\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf449w7z"
Jul 17 20:02:41.939477 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:02:41.939281    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b045a938-3e18-4ad7-9da2-4fdcfa627a54-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf449w7z\" (UID: \"b045a938-3e18-4ad7-9da2-4fdcfa627a54\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf449w7z"
Jul 17 20:02:41.939477 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:02:41.939333    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b045a938-3e18-4ad7-9da2-4fdcfa627a54-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf449w7z\" (UID: \"b045a938-3e18-4ad7-9da2-4fdcfa627a54\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf449w7z"
Jul 17 20:02:41.939632 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:02:41.939621    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b045a938-3e18-4ad7-9da2-4fdcfa627a54-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf449w7z\" (UID: \"b045a938-3e18-4ad7-9da2-4fdcfa627a54\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf449w7z"
Jul 17 20:02:41.939682 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:02:41.939664    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b045a938-3e18-4ad7-9da2-4fdcfa627a54-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf449w7z\" (UID: \"b045a938-3e18-4ad7-9da2-4fdcfa627a54\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf449w7z"
Jul 17 20:02:41.939682 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:02:41.939672    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b045a938-3e18-4ad7-9da2-4fdcfa627a54-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf449w7z\" (UID: \"b045a938-3e18-4ad7-9da2-4fdcfa627a54\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf449w7z"
Jul 17 20:02:41.939870 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:02:41.939851    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b045a938-3e18-4ad7-9da2-4fdcfa627a54-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf449w7z\" (UID: \"b045a938-3e18-4ad7-9da2-4fdcfa627a54\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf449w7z"
Jul 17 20:02:41.939972 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:02:41.939946    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b045a938-3e18-4ad7-9da2-4fdcfa627a54-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf449w7z\" (UID: \"b045a938-3e18-4ad7-9da2-4fdcfa627a54\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf449w7z"
Jul 17 20:02:41.941609 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:02:41.941588    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b045a938-3e18-4ad7-9da2-4fdcfa627a54-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf449w7z\" (UID: \"b045a938-3e18-4ad7-9da2-4fdcfa627a54\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf449w7z"
Jul 17 20:02:41.941690 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:02:41.941645    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b045a938-3e18-4ad7-9da2-4fdcfa627a54-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf449w7z\" (UID: \"b045a938-3e18-4ad7-9da2-4fdcfa627a54\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf449w7z"
Jul 17 20:02:41.947113 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:02:41.947058    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b045a938-3e18-4ad7-9da2-4fdcfa627a54-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf449w7z\" (UID: \"b045a938-3e18-4ad7-9da2-4fdcfa627a54\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf449w7z"
Jul 17 20:02:41.947787 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:02:41.947749    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w9cpt\" (UniqueName: \"kubernetes.io/projected/b045a938-3e18-4ad7-9da2-4fdcfa627a54-kube-api-access-w9cpt\") pod \"data-science-gateway-data-science-gateway-class-6576859cf449w7z\" (UID: \"b045a938-3e18-4ad7-9da2-4fdcfa627a54\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf449w7z"
Jul 17 20:02:41.978299 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:02:41.978270    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:02:42.088879 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:02:42.088801    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf449w7z"
Jul 17 20:02:42.219777 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:02:42.219749    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf449w7z"]
Jul 17 20:02:42.221790 ip-10-0-141-177 kubenswrapper[2572]: W0717 20:02:42.221763    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb045a938_3e18_4ad7_9da2_4fdcfa627a54.slice/crio-eac61c3f885a3c5f016cf6d07ebdd7bfd7bc86574803f9d48dfa886cf6106b8c WatchSource:0}: Error finding container eac61c3f885a3c5f016cf6d07ebdd7bfd7bc86574803f9d48dfa886cf6106b8c: Status 404 returned error can't find the container with id eac61c3f885a3c5f016cf6d07ebdd7bfd7bc86574803f9d48dfa886cf6106b8c
Jul 17 20:02:42.327935 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:02:42.327908    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:02:42.439870 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:02:42.439784    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf449w7z" event={"ID":"b045a938-3e18-4ad7-9da2-4fdcfa627a54","Type":"ContainerStarted","Data":"eac61c3f885a3c5f016cf6d07ebdd7bfd7bc86574803f9d48dfa886cf6106b8c"}
Jul 17 20:02:44.816699 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:02:44.816655    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 17 20:02:44.816931 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:02:44.816755    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 17 20:02:44.816931 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:02:44.816798    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 17 20:02:45.412448 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:02:45.412413    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-7c54c94474-59v64"
Jul 17 20:02:45.457746 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:02:45.457715    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf449w7z" event={"ID":"b045a938-3e18-4ad7-9da2-4fdcfa627a54","Type":"ContainerStarted","Data":"370bd0dcbae0938a6651734a186e032a5dcd8b78ceddc0398fc217db064b26cf"}
Jul 17 20:02:45.474483 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:02:45.474428    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf449w7z" podStartSLOduration=1.881828088 podStartE2EDuration="4.474410352s" totalImagesPullingTime="2.592582264s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 20:02:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 20:02:45.472985778 +0000 UTC m=+390.314481453" watchObservedRunningTime="2026-07-17 20:02:45.474410352 +0000 UTC m=+390.315905991"
Jul 17 20:02:46.089863 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:02:46.089838    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf449w7z"
Jul 17 20:02:46.094405 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:02:46.094381    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf449w7z"
Jul 17 20:02:46.462055 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:02:46.461973    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf449w7z"
Jul 17 20:02:46.462938 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:02:46.462918    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf449w7z"
Jul 17 20:03:24.875118 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:03:24.875059    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:03:24.986135 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:03:24.986102    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:03:25.069786 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:03:25.069757    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-v2k2h"]
Jul 17 20:03:25.076051 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:03:25.076027    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-v2k2h"
Jul 17 20:03:25.079292 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:03:25.079267    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-bz865\""
Jul 17 20:03:25.079410 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:03:25.079385    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 17 20:03:25.080271 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:03:25.080251    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 17 20:03:25.090151 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:03:25.090128    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-v2k2h"]
Jul 17 20:03:25.126530 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:03:25.126460    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:03:25.179774 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:03:25.179749    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8xwfw\" (UniqueName: \"kubernetes.io/projected/c716e31e-0b16-49eb-92de-334498c36476-kube-api-access-8xwfw\") pod \"kuadrant-operator-catalog-v2k2h\" (UID: \"c716e31e-0b16-49eb-92de-334498c36476\") " pod="kuadrant-system/kuadrant-operator-catalog-v2k2h"
Jul 17 20:03:25.280851 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:03:25.280812    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8xwfw\" (UniqueName: \"kubernetes.io/projected/c716e31e-0b16-49eb-92de-334498c36476-kube-api-access-8xwfw\") pod \"kuadrant-operator-catalog-v2k2h\" (UID: \"c716e31e-0b16-49eb-92de-334498c36476\") " pod="kuadrant-system/kuadrant-operator-catalog-v2k2h"
Jul 17 20:03:25.293857 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:03:25.293823    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8xwfw\" (UniqueName: \"kubernetes.io/projected/c716e31e-0b16-49eb-92de-334498c36476-kube-api-access-8xwfw\") pod \"kuadrant-operator-catalog-v2k2h\" (UID: \"c716e31e-0b16-49eb-92de-334498c36476\") " pod="kuadrant-system/kuadrant-operator-catalog-v2k2h"
Jul 17 20:03:25.377921 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:03:25.377844    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-v2k2h"]
Jul 17 20:03:25.378176 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:03:25.378163    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-v2k2h"
Jul 17 20:03:25.499471 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:03:25.499448    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-v2k2h"]
Jul 17 20:03:25.501765 ip-10-0-141-177 kubenswrapper[2572]: W0717 20:03:25.501734    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc716e31e_0b16_49eb_92de_334498c36476.slice/crio-1d79c3d266b0348b615895a0f6bde371607c6861545cc03a979f137cc1f85cb7 WatchSource:0}: Error finding container 1d79c3d266b0348b615895a0f6bde371607c6861545cc03a979f137cc1f85cb7: Status 404 returned error can't find the container with id 1d79c3d266b0348b615895a0f6bde371607c6861545cc03a979f137cc1f85cb7
Jul 17 20:03:25.587542 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:03:25.587517    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-tn9zq"]
Jul 17 20:03:25.590339 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:03:25.590325    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-tn9zq"
Jul 17 20:03:25.598144 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:03:25.598126    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-tn9zq"]
Jul 17 20:03:25.631407 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:03:25.631351    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-v2k2h" event={"ID":"c716e31e-0b16-49eb-92de-334498c36476","Type":"ContainerStarted","Data":"1d79c3d266b0348b615895a0f6bde371607c6861545cc03a979f137cc1f85cb7"}
Jul 17 20:03:25.683658 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:03:25.683636    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7qkvc\" (UniqueName: \"kubernetes.io/projected/04c98bd2-cfbf-46ff-b46e-26bf47d77323-kube-api-access-7qkvc\") pod \"kuadrant-operator-catalog-tn9zq\" (UID: \"04c98bd2-cfbf-46ff-b46e-26bf47d77323\") " pod="kuadrant-system/kuadrant-operator-catalog-tn9zq"
Jul 17 20:03:25.784008 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:03:25.783979    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7qkvc\" (UniqueName: \"kubernetes.io/projected/04c98bd2-cfbf-46ff-b46e-26bf47d77323-kube-api-access-7qkvc\") pod \"kuadrant-operator-catalog-tn9zq\" (UID: \"04c98bd2-cfbf-46ff-b46e-26bf47d77323\") " pod="kuadrant-system/kuadrant-operator-catalog-tn9zq"
Jul 17 20:03:25.791699 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:03:25.791670    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7qkvc\" (UniqueName: \"kubernetes.io/projected/04c98bd2-cfbf-46ff-b46e-26bf47d77323-kube-api-access-7qkvc\") pod \"kuadrant-operator-catalog-tn9zq\" (UID: \"04c98bd2-cfbf-46ff-b46e-26bf47d77323\") " pod="kuadrant-system/kuadrant-operator-catalog-tn9zq"
Jul 17 20:03:25.807353 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:03:25.807329    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:03:25.900057 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:03:25.899991    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-tn9zq"
Jul 17 20:03:26.020144 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:03:26.020105    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:03:26.024543 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:03:26.024493    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-tn9zq"]
Jul 17 20:03:26.027639 ip-10-0-141-177 kubenswrapper[2572]: W0717 20:03:26.027614    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04c98bd2_cfbf_46ff_b46e_26bf47d77323.slice/crio-922db62a8f6a7f4440fd29186cf570399350d0a02c636058c8939f5bdbd104d9 WatchSource:0}: Error finding container 922db62a8f6a7f4440fd29186cf570399350d0a02c636058c8939f5bdbd104d9: Status 404 returned error can't find the container with id 922db62a8f6a7f4440fd29186cf570399350d0a02c636058c8939f5bdbd104d9
Jul 17 20:03:26.637219 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:03:26.637184    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-tn9zq" event={"ID":"04c98bd2-cfbf-46ff-b46e-26bf47d77323","Type":"ContainerStarted","Data":"922db62a8f6a7f4440fd29186cf570399350d0a02c636058c8939f5bdbd104d9"}
Jul 17 20:03:28.648551 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:03:28.648517    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-tn9zq" event={"ID":"04c98bd2-cfbf-46ff-b46e-26bf47d77323","Type":"ContainerStarted","Data":"37424a5de542c1213516cbed9b1804b04e72c5827441d30c98e1d5b880ab439b"}
Jul 17 20:03:28.649975 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:03:28.649952    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-v2k2h" event={"ID":"c716e31e-0b16-49eb-92de-334498c36476","Type":"ContainerStarted","Data":"0f4eda68fc6d77c8c685479d37ea7a1ce7adbd5ab4954e6072ca84171d991049"}
Jul 17 20:03:28.650105 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:03:28.650021    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-v2k2h" podUID="c716e31e-0b16-49eb-92de-334498c36476" containerName="registry-server" containerID="cri-o://0f4eda68fc6d77c8c685479d37ea7a1ce7adbd5ab4954e6072ca84171d991049" gracePeriod=2
Jul 17 20:03:28.664036 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:03:28.663987    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-tn9zq" podStartSLOduration=1.916397306 podStartE2EDuration="3.663968455s" totalImagesPullingTime="1.747571149s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 20:03:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 20:03:28.662379168 +0000 UTC m=+433.503874812" watchObservedRunningTime="2026-07-17 20:03:28.663968455 +0000 UTC m=+433.505464093"
Jul 17 20:03:28.675981 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:03:28.675946    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-v2k2h" podStartSLOduration=1.405387743 podStartE2EDuration="3.675935124s" totalImagesPullingTime="2.270547381s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 20:03:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 20:03:28.675376938 +0000 UTC m=+433.516872594" watchObservedRunningTime="2026-07-17 20:03:28.675935124 +0000 UTC m=+433.517430762"
Jul 17 20:03:28.901756 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:03:28.901696    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-v2k2h"
Jul 17 20:03:29.012270 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:03:29.012230    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8xwfw\" (UniqueName: \"kubernetes.io/projected/c716e31e-0b16-49eb-92de-334498c36476-kube-api-access-8xwfw\") pod \"c716e31e-0b16-49eb-92de-334498c36476\" (UID: \"c716e31e-0b16-49eb-92de-334498c36476\") "
Jul 17 20:03:29.014417 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:03:29.014385    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c716e31e-0b16-49eb-92de-334498c36476-kube-api-access-8xwfw" (OuterVolumeSpecName: "kube-api-access-8xwfw") pod "c716e31e-0b16-49eb-92de-334498c36476" (UID: "c716e31e-0b16-49eb-92de-334498c36476"). InnerVolumeSpecName "kube-api-access-8xwfw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 20:03:29.112954 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:03:29.112911    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8xwfw\" (UniqueName: \"kubernetes.io/projected/c716e31e-0b16-49eb-92de-334498c36476-kube-api-access-8xwfw\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Jul 17 20:03:29.655368 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:03:29.655330    2572 generic.go:356] "Generic (PLEG): container finished" podID="c716e31e-0b16-49eb-92de-334498c36476" containerID="0f4eda68fc6d77c8c685479d37ea7a1ce7adbd5ab4954e6072ca84171d991049" exitCode=0
Jul 17 20:03:29.655368 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:03:29.655372    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-v2k2h"
Jul 17 20:03:29.655835 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:03:29.655413    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-v2k2h" event={"ID":"c716e31e-0b16-49eb-92de-334498c36476","Type":"ContainerDied","Data":"0f4eda68fc6d77c8c685479d37ea7a1ce7adbd5ab4954e6072ca84171d991049"}
Jul 17 20:03:29.655835 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:03:29.655484    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-v2k2h" event={"ID":"c716e31e-0b16-49eb-92de-334498c36476","Type":"ContainerDied","Data":"1d79c3d266b0348b615895a0f6bde371607c6861545cc03a979f137cc1f85cb7"}
Jul 17 20:03:29.655835 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:03:29.655513    2572 scope.go:117] "RemoveContainer" containerID="0f4eda68fc6d77c8c685479d37ea7a1ce7adbd5ab4954e6072ca84171d991049"
Jul 17 20:03:29.664929 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:03:29.664912    2572 scope.go:117] "RemoveContainer" containerID="0f4eda68fc6d77c8c685479d37ea7a1ce7adbd5ab4954e6072ca84171d991049"
Jul 17 20:03:29.665192 ip-10-0-141-177 kubenswrapper[2572]: E0717 20:03:29.665171    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0f4eda68fc6d77c8c685479d37ea7a1ce7adbd5ab4954e6072ca84171d991049\": container with ID starting with 0f4eda68fc6d77c8c685479d37ea7a1ce7adbd5ab4954e6072ca84171d991049 not found: ID does not exist" containerID="0f4eda68fc6d77c8c685479d37ea7a1ce7adbd5ab4954e6072ca84171d991049"
Jul 17 20:03:29.665271 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:03:29.665205    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0f4eda68fc6d77c8c685479d37ea7a1ce7adbd5ab4954e6072ca84171d991049"} err="failed to get container status \"0f4eda68fc6d77c8c685479d37ea7a1ce7adbd5ab4954e6072ca84171d991049\": rpc error: code = NotFound desc = could not find container \"0f4eda68fc6d77c8c685479d37ea7a1ce7adbd5ab4954e6072ca84171d991049\": container with ID starting with 0f4eda68fc6d77c8c685479d37ea7a1ce7adbd5ab4954e6072ca84171d991049 not found: ID does not exist"
Jul 17 20:03:29.677019 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:03:29.676999    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-v2k2h"]
Jul 17 20:03:29.681106 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:03:29.681086    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-v2k2h"]
Jul 17 20:03:29.686645 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:03:29.686623    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c716e31e-0b16-49eb-92de-334498c36476" path="/var/lib/kubelet/pods/c716e31e-0b16-49eb-92de-334498c36476/volumes"
Jul 17 20:03:35.900864 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:03:35.900831    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-tn9zq"
Jul 17 20:03:35.901308 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:03:35.900887    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-tn9zq"
Jul 17 20:03:35.923538 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:03:35.923513    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-tn9zq"
Jul 17 20:03:36.711372 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:03:36.711347    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-tn9zq"
Jul 17 20:03:48.582896 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:03:48.582804    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:03:48.637407 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:03:48.637367    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:03:55.472632 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:03:55.472598    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:03:58.118176 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:03:58.118140    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-pq6pt"]
Jul 17 20:03:58.118750 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:03:58.118455    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c716e31e-0b16-49eb-92de-334498c36476" containerName="registry-server"
Jul 17 20:03:58.118750 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:03:58.118465    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="c716e31e-0b16-49eb-92de-334498c36476" containerName="registry-server"
Jul 17 20:03:58.118750 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:03:58.118536    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="c716e31e-0b16-49eb-92de-334498c36476" containerName="registry-server"
Jul 17 20:03:58.121469 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:03:58.121453    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-pq6pt"
Jul 17 20:03:58.124869 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:03:58.124848    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 17 20:03:58.125027 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:03:58.124901    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-zftq5\""
Jul 17 20:03:58.135912 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:03:58.135889    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-pq6pt"]
Jul 17 20:03:58.257888 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:03:58.257855    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-997ql\" (UniqueName: \"kubernetes.io/projected/ff23bc85-800a-48e3-b4aa-57c576dab652-kube-api-access-997ql\") pod \"dns-operator-controller-manager-864dd78c4c-pq6pt\" (UID: \"ff23bc85-800a-48e3-b4aa-57c576dab652\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-pq6pt"
Jul 17 20:03:58.358760 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:03:58.358720    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-997ql\" (UniqueName: \"kubernetes.io/projected/ff23bc85-800a-48e3-b4aa-57c576dab652-kube-api-access-997ql\") pod \"dns-operator-controller-manager-864dd78c4c-pq6pt\" (UID: \"ff23bc85-800a-48e3-b4aa-57c576dab652\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-pq6pt"
Jul 17 20:03:58.367106 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:03:58.367056    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-997ql\" (UniqueName: \"kubernetes.io/projected/ff23bc85-800a-48e3-b4aa-57c576dab652-kube-api-access-997ql\") pod \"dns-operator-controller-manager-864dd78c4c-pq6pt\" (UID: \"ff23bc85-800a-48e3-b4aa-57c576dab652\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-pq6pt"
Jul 17 20:03:58.431201 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:03:58.431119    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-pq6pt"
Jul 17 20:03:58.555875 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:03:58.555853    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-pq6pt"]
Jul 17 20:03:58.558233 ip-10-0-141-177 kubenswrapper[2572]: W0717 20:03:58.558206    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff23bc85_800a_48e3_b4aa_57c576dab652.slice/crio-7c05129ed41afadb15e97fada89b5471ff82754266c295f0b383f3258785eb76 WatchSource:0}: Error finding container 7c05129ed41afadb15e97fada89b5471ff82754266c295f0b383f3258785eb76: Status 404 returned error can't find the container with id 7c05129ed41afadb15e97fada89b5471ff82754266c295f0b383f3258785eb76
Jul 17 20:03:58.779987 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:03:58.779955    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-pq6pt" event={"ID":"ff23bc85-800a-48e3-b4aa-57c576dab652","Type":"ContainerStarted","Data":"7c05129ed41afadb15e97fada89b5471ff82754266c295f0b383f3258785eb76"}
Jul 17 20:03:58.861426 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:03:58.861396    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:03:59.531379 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:03:59.531349    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:04:00.887857 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:04:00.887830    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:04:01.795596 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:04:01.795561    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-pq6pt" event={"ID":"ff23bc85-800a-48e3-b4aa-57c576dab652","Type":"ContainerStarted","Data":"f41061d9141b282374123894400f66d263b1d103725de23c59f1e8e3dadfb1d3"}
Jul 17 20:04:01.795757 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:04:01.795691    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-pq6pt"
Jul 17 20:04:01.811530 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:04:01.811477    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-pq6pt" podStartSLOduration=1.549257892 podStartE2EDuration="3.811460758s" totalImagesPullingTime="2.262202866s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 20:03:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 20:04:01.811252658 +0000 UTC m=+466.652748308" watchObservedRunningTime="2026-07-17 20:04:01.811460758 +0000 UTC m=+466.652956395"
Jul 17 20:04:02.178063 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:04:02.177975    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-xm6z5"]
Jul 17 20:04:02.182759 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:04:02.182736    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-xm6z5"
Jul 17 20:04:02.185356 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:04:02.185332    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-p7ztw\""
Jul 17 20:04:02.195792 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:04:02.195768    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-xm6z5"]
Jul 17 20:04:02.292114 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:04:02.292056    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xx2sq\" (UniqueName: \"kubernetes.io/projected/f4c42bc9-1ec6-4675-8741-966bde69c503-kube-api-access-xx2sq\") pod \"authorino-operator-75cc8d5cb7-xm6z5\" (UID: \"f4c42bc9-1ec6-4675-8741-966bde69c503\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-xm6z5"
Jul 17 20:04:02.393031 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:04:02.392995    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xx2sq\" (UniqueName: \"kubernetes.io/projected/f4c42bc9-1ec6-4675-8741-966bde69c503-kube-api-access-xx2sq\") pod \"authorino-operator-75cc8d5cb7-xm6z5\" (UID: \"f4c42bc9-1ec6-4675-8741-966bde69c503\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-xm6z5"
Jul 17 20:04:02.406895 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:04:02.406859    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xx2sq\" (UniqueName: \"kubernetes.io/projected/f4c42bc9-1ec6-4675-8741-966bde69c503-kube-api-access-xx2sq\") pod \"authorino-operator-75cc8d5cb7-xm6z5\" (UID: \"f4c42bc9-1ec6-4675-8741-966bde69c503\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-xm6z5"
Jul 17 20:04:02.492930 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:04:02.492903    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-xm6z5"
Jul 17 20:04:02.621341 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:04:02.621310    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-xm6z5"]
Jul 17 20:04:02.624707 ip-10-0-141-177 kubenswrapper[2572]: W0717 20:04:02.624677    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4c42bc9_1ec6_4675_8741_966bde69c503.slice/crio-6d995257e9c4b4b69ac25e98753958b6db4dfcbfd059e1a9226692839419a489 WatchSource:0}: Error finding container 6d995257e9c4b4b69ac25e98753958b6db4dfcbfd059e1a9226692839419a489: Status 404 returned error can't find the container with id 6d995257e9c4b4b69ac25e98753958b6db4dfcbfd059e1a9226692839419a489
Jul 17 20:04:02.801225 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:04:02.801137    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-xm6z5" event={"ID":"f4c42bc9-1ec6-4675-8741-966bde69c503","Type":"ContainerStarted","Data":"6d995257e9c4b4b69ac25e98753958b6db4dfcbfd059e1a9226692839419a489"}
Jul 17 20:04:02.959048 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:04:02.959019    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:04:03.288297 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:04:03.288263    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:04:05.327825 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:04:05.327749    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-88bcd8cf7-wrcr8"]
Jul 17 20:04:05.330030 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:04:05.330012    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-88bcd8cf7-wrcr8"
Jul 17 20:04:05.332714 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:04:05.332694    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-qqnqn\""
Jul 17 20:04:05.333179 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:04:05.333161    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 17 20:04:05.333273 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:04:05.333249    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 17 20:04:05.333483 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:04:05.333467    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 17 20:04:05.333557 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:04:05.333546    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 17 20:04:05.334360 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:04:05.334341    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 17 20:04:05.337882 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:04:05.337865    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 17 20:04:05.341517 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:04:05.341495    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-88bcd8cf7-wrcr8"]
Jul 17 20:04:05.397900 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:04:05.397869    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:04:05.420356 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:04:05.420326    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/41f9908d-ea61-4b65-8bb3-29894bf05754-trusted-ca-bundle\") pod \"console-88bcd8cf7-wrcr8\" (UID: \"41f9908d-ea61-4b65-8bb3-29894bf05754\") " pod="openshift-console/console-88bcd8cf7-wrcr8"
Jul 17 20:04:05.420466 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:04:05.420374    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/41f9908d-ea61-4b65-8bb3-29894bf05754-console-serving-cert\") pod \"console-88bcd8cf7-wrcr8\" (UID: \"41f9908d-ea61-4b65-8bb3-29894bf05754\") " pod="openshift-console/console-88bcd8cf7-wrcr8"
Jul 17 20:04:05.420466 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:04:05.420445    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/41f9908d-ea61-4b65-8bb3-29894bf05754-console-oauth-config\") pod \"console-88bcd8cf7-wrcr8\" (UID: \"41f9908d-ea61-4b65-8bb3-29894bf05754\") " pod="openshift-console/console-88bcd8cf7-wrcr8"
Jul 17 20:04:05.420536 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:04:05.420480    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/41f9908d-ea61-4b65-8bb3-29894bf05754-oauth-serving-cert\") pod \"console-88bcd8cf7-wrcr8\" (UID: \"41f9908d-ea61-4b65-8bb3-29894bf05754\") " pod="openshift-console/console-88bcd8cf7-wrcr8"
Jul 17 20:04:05.420536 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:04:05.420530    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/41f9908d-ea61-4b65-8bb3-29894bf05754-service-ca\") pod \"console-88bcd8cf7-wrcr8\" (UID: \"41f9908d-ea61-4b65-8bb3-29894bf05754\") " pod="openshift-console/console-88bcd8cf7-wrcr8"
Jul 17 20:04:05.420630 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:04:05.420554    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-chkvh\" (UniqueName: \"kubernetes.io/projected/41f9908d-ea61-4b65-8bb3-29894bf05754-kube-api-access-chkvh\") pod \"console-88bcd8cf7-wrcr8\" (UID: \"41f9908d-ea61-4b65-8bb3-29894bf05754\") " pod="openshift-console/console-88bcd8cf7-wrcr8"
Jul 17 20:04:05.420681 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:04:05.420641    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/41f9908d-ea61-4b65-8bb3-29894bf05754-console-config\") pod \"console-88bcd8cf7-wrcr8\" (UID: \"41f9908d-ea61-4b65-8bb3-29894bf05754\") " pod="openshift-console/console-88bcd8cf7-wrcr8"
Jul 17 20:04:05.496885 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:04:05.496857    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:04:05.521543 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:04:05.521515    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/41f9908d-ea61-4b65-8bb3-29894bf05754-console-oauth-config\") pod \"console-88bcd8cf7-wrcr8\" (UID: \"41f9908d-ea61-4b65-8bb3-29894bf05754\") " pod="openshift-console/console-88bcd8cf7-wrcr8"
Jul 17 20:04:05.521656 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:04:05.521550    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/41f9908d-ea61-4b65-8bb3-29894bf05754-oauth-serving-cert\") pod \"console-88bcd8cf7-wrcr8\" (UID: \"41f9908d-ea61-4b65-8bb3-29894bf05754\") " pod="openshift-console/console-88bcd8cf7-wrcr8"
Jul 17 20:04:05.521656 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:04:05.521591    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/41f9908d-ea61-4b65-8bb3-29894bf05754-service-ca\") pod \"console-88bcd8cf7-wrcr8\" (UID: \"41f9908d-ea61-4b65-8bb3-29894bf05754\") " pod="openshift-console/console-88bcd8cf7-wrcr8"
Jul 17 20:04:05.521656 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:04:05.521610    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-chkvh\" (UniqueName: \"kubernetes.io/projected/41f9908d-ea61-4b65-8bb3-29894bf05754-kube-api-access-chkvh\") pod \"console-88bcd8cf7-wrcr8\" (UID: \"41f9908d-ea61-4b65-8bb3-29894bf05754\") " pod="openshift-console/console-88bcd8cf7-wrcr8"
Jul 17 20:04:05.521656 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:04:05.521629    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/41f9908d-ea61-4b65-8bb3-29894bf05754-console-config\") pod \"console-88bcd8cf7-wrcr8\" (UID: \"41f9908d-ea61-4b65-8bb3-29894bf05754\") " pod="openshift-console/console-88bcd8cf7-wrcr8"
Jul 17 20:04:05.521656 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:04:05.521645    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/41f9908d-ea61-4b65-8bb3-29894bf05754-trusted-ca-bundle\") pod \"console-88bcd8cf7-wrcr8\" (UID: \"41f9908d-ea61-4b65-8bb3-29894bf05754\") " pod="openshift-console/console-88bcd8cf7-wrcr8"
Jul 17 20:04:05.521864 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:04:05.521700    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/41f9908d-ea61-4b65-8bb3-29894bf05754-console-serving-cert\") pod \"console-88bcd8cf7-wrcr8\" (UID: \"41f9908d-ea61-4b65-8bb3-29894bf05754\") " pod="openshift-console/console-88bcd8cf7-wrcr8"
Jul 17 20:04:05.522461 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:04:05.522439    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/41f9908d-ea61-4b65-8bb3-29894bf05754-oauth-serving-cert\") pod \"console-88bcd8cf7-wrcr8\" (UID: \"41f9908d-ea61-4b65-8bb3-29894bf05754\") " pod="openshift-console/console-88bcd8cf7-wrcr8"
Jul 17 20:04:05.522461 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:04:05.522451    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/41f9908d-ea61-4b65-8bb3-29894bf05754-service-ca\") pod \"console-88bcd8cf7-wrcr8\" (UID: \"41f9908d-ea61-4b65-8bb3-29894bf05754\") " pod="openshift-console/console-88bcd8cf7-wrcr8"
Jul 17 20:04:05.522640 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:04:05.522490    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/41f9908d-ea61-4b65-8bb3-29894bf05754-console-config\") pod \"console-88bcd8cf7-wrcr8\" (UID: \"41f9908d-ea61-4b65-8bb3-29894bf05754\") " pod="openshift-console/console-88bcd8cf7-wrcr8"
Jul 17 20:04:05.522701 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:04:05.522641    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/41f9908d-ea61-4b65-8bb3-29894bf05754-trusted-ca-bundle\") pod \"console-88bcd8cf7-wrcr8\" (UID: \"41f9908d-ea61-4b65-8bb3-29894bf05754\") " pod="openshift-console/console-88bcd8cf7-wrcr8"
Jul 17 20:04:05.523971 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:04:05.523952    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/41f9908d-ea61-4b65-8bb3-29894bf05754-console-oauth-config\") pod \"console-88bcd8cf7-wrcr8\" (UID: \"41f9908d-ea61-4b65-8bb3-29894bf05754\") " pod="openshift-console/console-88bcd8cf7-wrcr8"
Jul 17 20:04:05.524152 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:04:05.524137    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/41f9908d-ea61-4b65-8bb3-29894bf05754-console-serving-cert\") pod \"console-88bcd8cf7-wrcr8\" (UID: \"41f9908d-ea61-4b65-8bb3-29894bf05754\") " pod="openshift-console/console-88bcd8cf7-wrcr8"
Jul 17 20:04:05.543503 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:04:05.543484    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-chkvh\" (UniqueName: \"kubernetes.io/projected/41f9908d-ea61-4b65-8bb3-29894bf05754-kube-api-access-chkvh\") pod \"console-88bcd8cf7-wrcr8\" (UID: \"41f9908d-ea61-4b65-8bb3-29894bf05754\") " pod="openshift-console/console-88bcd8cf7-wrcr8"
Jul 17 20:04:05.614037 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:04:05.613947    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:04:05.639744 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:04:05.639718    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-88bcd8cf7-wrcr8"
Jul 17 20:04:05.773080 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:04:05.773038    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-88bcd8cf7-wrcr8"]
Jul 17 20:04:05.775354 ip-10-0-141-177 kubenswrapper[2572]: W0717 20:04:05.775331    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41f9908d_ea61_4b65_8bb3_29894bf05754.slice/crio-70f5749310e7972661713f5e50e57ddaa75d79b4831e03119b39b8697abe883c WatchSource:0}: Error finding container 70f5749310e7972661713f5e50e57ddaa75d79b4831e03119b39b8697abe883c: Status 404 returned error can't find the container with id 70f5749310e7972661713f5e50e57ddaa75d79b4831e03119b39b8697abe883c
Jul 17 20:04:05.818643 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:04:05.818609    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-xm6z5" event={"ID":"f4c42bc9-1ec6-4675-8741-966bde69c503","Type":"ContainerStarted","Data":"38592d41acf0707db9a8eaf4ca90d5b99be8227dd28f10cb37600cca09fe7a5c"}
Jul 17 20:04:05.818747 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:04:05.818677    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-xm6z5"
Jul 17 20:04:05.819912 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:04:05.819888    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-88bcd8cf7-wrcr8" event={"ID":"41f9908d-ea61-4b65-8bb3-29894bf05754","Type":"ContainerStarted","Data":"70f5749310e7972661713f5e50e57ddaa75d79b4831e03119b39b8697abe883c"}
Jul 17 20:04:05.840019 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:04:05.839968    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-xm6z5" podStartSLOduration=1.422502228 podStartE2EDuration="3.839950369s" totalImagesPullingTime="2.417448141s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 20:04:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 20:04:05.838506991 +0000 UTC m=+470.680002640" watchObservedRunningTime="2026-07-17 20:04:05.839950369 +0000 UTC m=+470.681446008"
Jul 17 20:04:06.275201 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:04:06.275168    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:04:06.826139 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:04:06.826102    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-88bcd8cf7-wrcr8" event={"ID":"41f9908d-ea61-4b65-8bb3-29894bf05754","Type":"ContainerStarted","Data":"0998d853b90bfde8550afd3f25b9bf264eb9ef8089efc176411f21a9a1b710c3"}
Jul 17 20:04:06.844525 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:04:06.844474    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-88bcd8cf7-wrcr8" podStartSLOduration=1.844459789 podStartE2EDuration="1.844459789s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 20:04:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 20:04:06.842902949 +0000 UTC m=+471.684398587" watchObservedRunningTime="2026-07-17 20:04:06.844459789 +0000 UTC m=+471.685955427"
Jul 17 20:04:08.521162 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:04:08.521126    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:04:09.786912 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:04:09.786879    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r7vbs"]
Jul 17 20:04:09.789291 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:04:09.789274    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r7vbs"
Jul 17 20:04:09.793105 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:04:09.793088    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-jbh4k\""
Jul 17 20:04:09.806408 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:04:09.806387    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r7vbs"]
Jul 17 20:04:09.960453 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:04:09.960425    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lfr2s\" (UniqueName: \"kubernetes.io/projected/64671031-8610-4f0c-abad-d7431243084e-kube-api-access-lfr2s\") pod \"kuadrant-operator-controller-manager-8684c9ff49-r7vbs\" (UID: \"64671031-8610-4f0c-abad-d7431243084e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r7vbs"
Jul 17 20:04:09.960594 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:04:09.960501    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/64671031-8610-4f0c-abad-d7431243084e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-r7vbs\" (UID: \"64671031-8610-4f0c-abad-d7431243084e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r7vbs"
Jul 17 20:04:10.061964 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:04:10.061880    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lfr2s\" (UniqueName: \"kubernetes.io/projected/64671031-8610-4f0c-abad-d7431243084e-kube-api-access-lfr2s\") pod \"kuadrant-operator-controller-manager-8684c9ff49-r7vbs\" (UID: \"64671031-8610-4f0c-abad-d7431243084e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r7vbs"
Jul 17 20:04:10.062126 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:04:10.061970    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/64671031-8610-4f0c-abad-d7431243084e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-r7vbs\" (UID: \"64671031-8610-4f0c-abad-d7431243084e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r7vbs"
Jul 17 20:04:10.062355 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:04:10.062339    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/64671031-8610-4f0c-abad-d7431243084e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-r7vbs\" (UID: \"64671031-8610-4f0c-abad-d7431243084e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r7vbs"
Jul 17 20:04:10.070134 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:04:10.070106    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lfr2s\" (UniqueName: \"kubernetes.io/projected/64671031-8610-4f0c-abad-d7431243084e-kube-api-access-lfr2s\") pod \"kuadrant-operator-controller-manager-8684c9ff49-r7vbs\" (UID: \"64671031-8610-4f0c-abad-d7431243084e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r7vbs"
Jul 17 20:04:10.099539 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:04:10.099511    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r7vbs"
Jul 17 20:04:10.236672 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:04:10.236599    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r7vbs"]
Jul 17 20:04:10.239060 ip-10-0-141-177 kubenswrapper[2572]: W0717 20:04:10.239033    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64671031_8610_4f0c_abad_d7431243084e.slice/crio-e928723587dd6c78e4bb2cc336143684ab33517f149c5740d5e7e85ab5977fad WatchSource:0}: Error finding container e928723587dd6c78e4bb2cc336143684ab33517f149c5740d5e7e85ab5977fad: Status 404 returned error can't find the container with id e928723587dd6c78e4bb2cc336143684ab33517f149c5740d5e7e85ab5977fad
Jul 17 20:04:10.845088 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:04:10.845034    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r7vbs" event={"ID":"64671031-8610-4f0c-abad-d7431243084e","Type":"ContainerStarted","Data":"e928723587dd6c78e4bb2cc336143684ab33517f149c5740d5e7e85ab5977fad"}
Jul 17 20:04:11.084624 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:04:11.084583    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:04:11.194282 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:04:11.194180    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:04:12.803459 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:04:12.803420    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-pq6pt"
Jul 17 20:04:14.841539 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:04:14.841507    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:04:15.640775 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:04:15.640733    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-88bcd8cf7-wrcr8"
Jul 17 20:04:15.640953 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:04:15.640830    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-88bcd8cf7-wrcr8"
Jul 17 20:04:15.646135 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:04:15.646112    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-88bcd8cf7-wrcr8"
Jul 17 20:04:15.874596 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:04:15.874510    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-88bcd8cf7-wrcr8"
Jul 17 20:04:16.053627 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:04:16.053595    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:04:16.151125 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:04:16.151024    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:04:16.221190 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:04:16.221156    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:04:16.475758 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:04:16.475727    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:04:16.577717 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:04:16.577671    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:04:16.680342 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:04:16.680305    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:04:16.746004 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:04:16.745976    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:04:16.829408 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:04:16.829364    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-xm6z5"
Jul 17 20:04:16.877282 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:04:16.877243    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r7vbs" event={"ID":"64671031-8610-4f0c-abad-d7431243084e","Type":"ContainerStarted","Data":"d30ce5e50365ba9e5a6593a3619ed748881340ec9b5ee2675f85c4840832482b"}
Jul 17 20:04:16.877689 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:04:16.877314    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r7vbs"
Jul 17 20:04:16.901451 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:04:16.901403    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r7vbs" podStartSLOduration=1.668980712 podStartE2EDuration="7.901388313s" totalImagesPullingTime="6.232407601s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 20:04:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 20:04:16.900513155 +0000 UTC m=+481.742008821" watchObservedRunningTime="2026-07-17 20:04:16.901388313 +0000 UTC m=+481.742883950"
Jul 17 20:04:18.756745 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:04:18.756691    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:04:18.850698 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:04:18.850668    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:04:19.197162 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:04:19.197044    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:04:19.404652 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:04:19.404617    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:04:22.231117 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:04:22.231085    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:04:22.330972 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:04:22.330937    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:04:25.940917 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:04:25.940889    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:04:25.998388 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:04:25.998364    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:04:27.883559 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:04:27.883526    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r7vbs"
Jul 17 20:04:28.993091 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:04:28.993037    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:04:29.093804 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:04:29.093773    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:04:29.596950 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:04:29.596909    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r7vbs"]
Jul 17 20:04:29.597200 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:04:29.597170    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r7vbs" podUID="64671031-8610-4f0c-abad-d7431243084e" containerName="manager" containerID="cri-o://d30ce5e50365ba9e5a6593a3619ed748881340ec9b5ee2675f85c4840832482b" gracePeriod=2
Jul 17 20:04:29.609851 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:04:29.609821    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r7vbs"]
Jul 17 20:04:29.621919 ip-10-0-141-177 kubenswrapper[2572]: E0717 20:04:29.621872    2572 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"64671031-8610-4f0c-abad-d7431243084e\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-r7vbs\": pods \"kuadrant-operator-controller-manager-8684c9ff49-r7vbs\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r7vbs"
Jul 17 20:04:29.627585 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:04:29.627561    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pntfz"]
Jul 17 20:04:29.628112 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:04:29.628090    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="64671031-8610-4f0c-abad-d7431243084e" containerName="manager"
Jul 17 20:04:29.628198 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:04:29.628115    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="64671031-8610-4f0c-abad-d7431243084e" containerName="manager"
Jul 17 20:04:29.628235 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:04:29.628217    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="64671031-8610-4f0c-abad-d7431243084e" containerName="manager"
Jul 17 20:04:29.630711 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:04:29.630690    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pntfz"
Jul 17 20:04:29.633228 ip-10-0-141-177 kubenswrapper[2572]: E0717 20:04:29.633200    2572 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-r7vbs\" is forbidden: User \"system:node:ip-10-0-141-177.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-177.ec2.internal' and this object" podUID="64671031-8610-4f0c-abad-d7431243084e" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r7vbs"
Jul 17 20:04:29.649658 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:04:29.649635    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pntfz"]
Jul 17 20:04:29.721420 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:04:29.721387    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1cbcf882-e963-46b7-9350-b68114089057-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-pntfz\" (UID: \"1cbcf882-e963-46b7-9350-b68114089057\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pntfz"
Jul 17 20:04:29.721553 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:04:29.721533    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bmvs8\" (UniqueName: \"kubernetes.io/projected/1cbcf882-e963-46b7-9350-b68114089057-kube-api-access-bmvs8\") pod \"kuadrant-operator-controller-manager-8684c9ff49-pntfz\" (UID: \"1cbcf882-e963-46b7-9350-b68114089057\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pntfz"
Jul 17 20:04:29.822788 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:04:29.822759    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bmvs8\" (UniqueName: \"kubernetes.io/projected/1cbcf882-e963-46b7-9350-b68114089057-kube-api-access-bmvs8\") pod \"kuadrant-operator-controller-manager-8684c9ff49-pntfz\" (UID: \"1cbcf882-e963-46b7-9350-b68114089057\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pntfz"
Jul 17 20:04:29.822916 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:04:29.822814    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1cbcf882-e963-46b7-9350-b68114089057-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-pntfz\" (UID: \"1cbcf882-e963-46b7-9350-b68114089057\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pntfz"
Jul 17 20:04:29.823169 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:04:29.823147    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1cbcf882-e963-46b7-9350-b68114089057-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-pntfz\" (UID: \"1cbcf882-e963-46b7-9350-b68114089057\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pntfz"
Jul 17 20:04:29.833062 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:04:29.833028    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bmvs8\" (UniqueName: \"kubernetes.io/projected/1cbcf882-e963-46b7-9350-b68114089057-kube-api-access-bmvs8\") pod \"kuadrant-operator-controller-manager-8684c9ff49-pntfz\" (UID: \"1cbcf882-e963-46b7-9350-b68114089057\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pntfz"
Jul 17 20:04:29.833251 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:04:29.833234    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r7vbs"
Jul 17 20:04:29.923343 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:04:29.923259    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lfr2s\" (UniqueName: \"kubernetes.io/projected/64671031-8610-4f0c-abad-d7431243084e-kube-api-access-lfr2s\") pod \"64671031-8610-4f0c-abad-d7431243084e\" (UID: \"64671031-8610-4f0c-abad-d7431243084e\") "
Jul 17 20:04:29.923343 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:04:29.923317    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/64671031-8610-4f0c-abad-d7431243084e-extensions-socket-volume\") pod \"64671031-8610-4f0c-abad-d7431243084e\" (UID: \"64671031-8610-4f0c-abad-d7431243084e\") "
Jul 17 20:04:29.923844 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:04:29.923809    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64671031-8610-4f0c-abad-d7431243084e-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "64671031-8610-4f0c-abad-d7431243084e" (UID: "64671031-8610-4f0c-abad-d7431243084e"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 20:04:29.925392 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:04:29.925370    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/64671031-8610-4f0c-abad-d7431243084e-kube-api-access-lfr2s" (OuterVolumeSpecName: "kube-api-access-lfr2s") pod "64671031-8610-4f0c-abad-d7431243084e" (UID: "64671031-8610-4f0c-abad-d7431243084e"). InnerVolumeSpecName "kube-api-access-lfr2s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 20:04:29.936523 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:04:29.936499    2572 generic.go:356] "Generic (PLEG): container finished" podID="64671031-8610-4f0c-abad-d7431243084e" containerID="d30ce5e50365ba9e5a6593a3619ed748881340ec9b5ee2675f85c4840832482b" exitCode=0
Jul 17 20:04:29.936602 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:04:29.936540    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r7vbs"
Jul 17 20:04:29.936602 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:04:29.936561    2572 scope.go:117] "RemoveContainer" containerID="d30ce5e50365ba9e5a6593a3619ed748881340ec9b5ee2675f85c4840832482b"
Jul 17 20:04:29.944820 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:04:29.944800    2572 scope.go:117] "RemoveContainer" containerID="d30ce5e50365ba9e5a6593a3619ed748881340ec9b5ee2675f85c4840832482b"
Jul 17 20:04:29.945080 ip-10-0-141-177 kubenswrapper[2572]: E0717 20:04:29.945044    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d30ce5e50365ba9e5a6593a3619ed748881340ec9b5ee2675f85c4840832482b\": container with ID starting with d30ce5e50365ba9e5a6593a3619ed748881340ec9b5ee2675f85c4840832482b not found: ID does not exist" containerID="d30ce5e50365ba9e5a6593a3619ed748881340ec9b5ee2675f85c4840832482b"
Jul 17 20:04:29.945133 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:04:29.945092    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d30ce5e50365ba9e5a6593a3619ed748881340ec9b5ee2675f85c4840832482b"} err="failed to get container status \"d30ce5e50365ba9e5a6593a3619ed748881340ec9b5ee2675f85c4840832482b\": rpc error: code = NotFound desc = could not find container \"d30ce5e50365ba9e5a6593a3619ed748881340ec9b5ee2675f85c4840832482b\": container with ID starting with d30ce5e50365ba9e5a6593a3619ed748881340ec9b5ee2675f85c4840832482b not found: ID does not exist"
Jul 17 20:04:29.984766 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:04:29.984746    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pntfz"
Jul 17 20:04:30.024955 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:04:30.024921    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lfr2s\" (UniqueName: \"kubernetes.io/projected/64671031-8610-4f0c-abad-d7431243084e-kube-api-access-lfr2s\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Jul 17 20:04:30.024955 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:04:30.024958    2572 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/64671031-8610-4f0c-abad-d7431243084e-extensions-socket-volume\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Jul 17 20:04:30.131120 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:04:30.131093    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pntfz"]
Jul 17 20:04:30.133655 ip-10-0-141-177 kubenswrapper[2572]: W0717 20:04:30.133629    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1cbcf882_e963_46b7_9350_b68114089057.slice/crio-aa18edf7395b0561edf8e777007a363ddd928ffcb5b84393db318a34ab172250 WatchSource:0}: Error finding container aa18edf7395b0561edf8e777007a363ddd928ffcb5b84393db318a34ab172250: Status 404 returned error can't find the container with id aa18edf7395b0561edf8e777007a363ddd928ffcb5b84393db318a34ab172250
Jul 17 20:04:30.943630 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:04:30.943592    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pntfz" event={"ID":"1cbcf882-e963-46b7-9350-b68114089057","Type":"ContainerStarted","Data":"e8c21c8fa35c29299251088f24f59acfd42fa69fba0c8b6cde5725b430a4b1fd"}
Jul 17 20:04:30.943816 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:04:30.943651    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pntfz" event={"ID":"1cbcf882-e963-46b7-9350-b68114089057","Type":"ContainerStarted","Data":"aa18edf7395b0561edf8e777007a363ddd928ffcb5b84393db318a34ab172250"}
Jul 17 20:04:30.943816 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:04:30.943715    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pntfz"
Jul 17 20:04:30.970321 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:04:30.970268    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pntfz" podStartSLOduration=1.970250896 podStartE2EDuration="1.970250896s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 20:04:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 20:04:30.968026889 +0000 UTC m=+495.809522538" watchObservedRunningTime="2026-07-17 20:04:30.970250896 +0000 UTC m=+495.811746533"
Jul 17 20:04:31.687201 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:04:31.687170    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="64671031-8610-4f0c-abad-d7431243084e" path="/var/lib/kubelet/pods/64671031-8610-4f0c-abad-d7431243084e/volumes"
Jul 17 20:04:34.262020 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:04:34.261985    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:04:34.317657 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:04:34.317621    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:04:34.871154 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:04:34.871118    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:04:35.160767 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:04:35.160677    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:04:38.672989 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:04:38.672952    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:04:38.778509 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:04:38.778474    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:04:41.953284 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:04:41.953249    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pntfz"
Jul 17 20:04:42.086253 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:04:42.086221    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:04:42.208056 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:04:42.207973    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:04:46.796473 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:04:46.796436    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pntfz"]
Jul 17 20:04:46.796963 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:04:46.796629    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pntfz" podUID="1cbcf882-e963-46b7-9350-b68114089057" containerName="manager" containerID="cri-o://e8c21c8fa35c29299251088f24f59acfd42fa69fba0c8b6cde5725b430a4b1fd" gracePeriod=10
Jul 17 20:04:47.030436 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:04:47.030404    2572 generic.go:356] "Generic (PLEG): container finished" podID="1cbcf882-e963-46b7-9350-b68114089057" containerID="e8c21c8fa35c29299251088f24f59acfd42fa69fba0c8b6cde5725b430a4b1fd" exitCode=0
Jul 17 20:04:47.030592 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:04:47.030475    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pntfz" event={"ID":"1cbcf882-e963-46b7-9350-b68114089057","Type":"ContainerDied","Data":"e8c21c8fa35c29299251088f24f59acfd42fa69fba0c8b6cde5725b430a4b1fd"}
Jul 17 20:04:47.053583 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:04:47.053518    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pntfz"
Jul 17 20:04:47.178568 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:04:47.178532    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1cbcf882-e963-46b7-9350-b68114089057-extensions-socket-volume\") pod \"1cbcf882-e963-46b7-9350-b68114089057\" (UID: \"1cbcf882-e963-46b7-9350-b68114089057\") "
Jul 17 20:04:47.178732 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:04:47.178578    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bmvs8\" (UniqueName: \"kubernetes.io/projected/1cbcf882-e963-46b7-9350-b68114089057-kube-api-access-bmvs8\") pod \"1cbcf882-e963-46b7-9350-b68114089057\" (UID: \"1cbcf882-e963-46b7-9350-b68114089057\") "
Jul 17 20:04:47.179020 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:04:47.178987    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1cbcf882-e963-46b7-9350-b68114089057-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "1cbcf882-e963-46b7-9350-b68114089057" (UID: "1cbcf882-e963-46b7-9350-b68114089057"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 20:04:47.180660 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:04:47.180640    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1cbcf882-e963-46b7-9350-b68114089057-kube-api-access-bmvs8" (OuterVolumeSpecName: "kube-api-access-bmvs8") pod "1cbcf882-e963-46b7-9350-b68114089057" (UID: "1cbcf882-e963-46b7-9350-b68114089057"). InnerVolumeSpecName "kube-api-access-bmvs8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 20:04:47.279598 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:04:47.279562    2572 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1cbcf882-e963-46b7-9350-b68114089057-extensions-socket-volume\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Jul 17 20:04:47.279598 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:04:47.279591    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bmvs8\" (UniqueName: \"kubernetes.io/projected/1cbcf882-e963-46b7-9350-b68114089057-kube-api-access-bmvs8\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Jul 17 20:04:48.036501 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:04:48.036469    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pntfz" event={"ID":"1cbcf882-e963-46b7-9350-b68114089057","Type":"ContainerDied","Data":"aa18edf7395b0561edf8e777007a363ddd928ffcb5b84393db318a34ab172250"}
Jul 17 20:04:48.036901 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:04:48.036505    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pntfz"
Jul 17 20:04:48.036901 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:04:48.036533    2572 scope.go:117] "RemoveContainer" containerID="e8c21c8fa35c29299251088f24f59acfd42fa69fba0c8b6cde5725b430a4b1fd"
Jul 17 20:04:48.057184 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:04:48.057157    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pntfz"]
Jul 17 20:04:48.060539 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:04:48.060517    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pntfz"]
Jul 17 20:04:49.687451 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:04:49.687414    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1cbcf882-e963-46b7-9350-b68114089057" path="/var/lib/kubelet/pods/1cbcf882-e963-46b7-9350-b68114089057/volumes"
Jul 17 20:05:03.103242 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:05:03.103205    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-22gnc"]
Jul 17 20:05:03.103718 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:05:03.103643    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1cbcf882-e963-46b7-9350-b68114089057" containerName="manager"
Jul 17 20:05:03.103718 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:05:03.103657    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="1cbcf882-e963-46b7-9350-b68114089057" containerName="manager"
Jul 17 20:05:03.103718 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:05:03.103713    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="1cbcf882-e963-46b7-9350-b68114089057" containerName="manager"
Jul 17 20:05:03.106708 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:05:03.106688    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-22gnc"
Jul 17 20:05:03.108923 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:05:03.108903    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-7dmbc\""
Jul 17 20:05:03.116962 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:05:03.116939    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-22gnc"]
Jul 17 20:05:03.128363 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:05:03.128333    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:05:03.226195 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:05:03.226156    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4066ca84-39d8-4dfa-8b00-a3a11228aae4-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-22gnc\" (UID: \"4066ca84-39d8-4dfa-8b00-a3a11228aae4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-22gnc"
Jul 17 20:05:03.226405 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:05:03.226218    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4066ca84-39d8-4dfa-8b00-a3a11228aae4-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-22gnc\" (UID: \"4066ca84-39d8-4dfa-8b00-a3a11228aae4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-22gnc"
Jul 17 20:05:03.226405 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:05:03.226273    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4066ca84-39d8-4dfa-8b00-a3a11228aae4-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-22gnc\" (UID: \"4066ca84-39d8-4dfa-8b00-a3a11228aae4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-22gnc"
Jul 17 20:05:03.226405 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:05:03.226352    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4066ca84-39d8-4dfa-8b00-a3a11228aae4-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-22gnc\" (UID: \"4066ca84-39d8-4dfa-8b00-a3a11228aae4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-22gnc"
Jul 17 20:05:03.226405 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:05:03.226387    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z6zq6\" (UniqueName: \"kubernetes.io/projected/4066ca84-39d8-4dfa-8b00-a3a11228aae4-kube-api-access-z6zq6\") pod \"maas-default-gateway-openshift-default-56654dcf7-22gnc\" (UID: \"4066ca84-39d8-4dfa-8b00-a3a11228aae4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-22gnc"
Jul 17 20:05:03.226583 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:05:03.226422    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4066ca84-39d8-4dfa-8b00-a3a11228aae4-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-22gnc\" (UID: \"4066ca84-39d8-4dfa-8b00-a3a11228aae4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-22gnc"
Jul 17 20:05:03.226583 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:05:03.226496    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4066ca84-39d8-4dfa-8b00-a3a11228aae4-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-22gnc\" (UID: \"4066ca84-39d8-4dfa-8b00-a3a11228aae4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-22gnc"
Jul 17 20:05:03.226583 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:05:03.226540    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4066ca84-39d8-4dfa-8b00-a3a11228aae4-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-22gnc\" (UID: \"4066ca84-39d8-4dfa-8b00-a3a11228aae4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-22gnc"
Jul 17 20:05:03.226583 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:05:03.226559    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4066ca84-39d8-4dfa-8b00-a3a11228aae4-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-22gnc\" (UID: \"4066ca84-39d8-4dfa-8b00-a3a11228aae4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-22gnc"
Jul 17 20:05:03.327166 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:05:03.327125    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4066ca84-39d8-4dfa-8b00-a3a11228aae4-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-22gnc\" (UID: \"4066ca84-39d8-4dfa-8b00-a3a11228aae4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-22gnc"
Jul 17 20:05:03.327166 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:05:03.327169    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4066ca84-39d8-4dfa-8b00-a3a11228aae4-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-22gnc\" (UID: \"4066ca84-39d8-4dfa-8b00-a3a11228aae4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-22gnc"
Jul 17 20:05:03.327403 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:05:03.327197    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4066ca84-39d8-4dfa-8b00-a3a11228aae4-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-22gnc\" (UID: \"4066ca84-39d8-4dfa-8b00-a3a11228aae4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-22gnc"
Jul 17 20:05:03.327403 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:05:03.327216    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4066ca84-39d8-4dfa-8b00-a3a11228aae4-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-22gnc\" (UID: \"4066ca84-39d8-4dfa-8b00-a3a11228aae4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-22gnc"
Jul 17 20:05:03.327403 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:05:03.327240    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4066ca84-39d8-4dfa-8b00-a3a11228aae4-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-22gnc\" (UID: \"4066ca84-39d8-4dfa-8b00-a3a11228aae4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-22gnc"
Jul 17 20:05:03.327403 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:05:03.327274    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z6zq6\" (UniqueName: \"kubernetes.io/projected/4066ca84-39d8-4dfa-8b00-a3a11228aae4-kube-api-access-z6zq6\") pod \"maas-default-gateway-openshift-default-56654dcf7-22gnc\" (UID: \"4066ca84-39d8-4dfa-8b00-a3a11228aae4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-22gnc"
Jul 17 20:05:03.327403 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:05:03.327314    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4066ca84-39d8-4dfa-8b00-a3a11228aae4-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-22gnc\" (UID: \"4066ca84-39d8-4dfa-8b00-a3a11228aae4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-22gnc"
Jul 17 20:05:03.327403 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:05:03.327374    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4066ca84-39d8-4dfa-8b00-a3a11228aae4-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-22gnc\" (UID: \"4066ca84-39d8-4dfa-8b00-a3a11228aae4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-22gnc"
Jul 17 20:05:03.327682 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:05:03.327426    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4066ca84-39d8-4dfa-8b00-a3a11228aae4-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-22gnc\" (UID: \"4066ca84-39d8-4dfa-8b00-a3a11228aae4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-22gnc"
Jul 17 20:05:03.327682 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:05:03.327642    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4066ca84-39d8-4dfa-8b00-a3a11228aae4-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-22gnc\" (UID: \"4066ca84-39d8-4dfa-8b00-a3a11228aae4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-22gnc"
Jul 17 20:05:03.327901 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:05:03.327876    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4066ca84-39d8-4dfa-8b00-a3a11228aae4-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-22gnc\" (UID: \"4066ca84-39d8-4dfa-8b00-a3a11228aae4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-22gnc"
Jul 17 20:05:03.328050 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:05:03.328029    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4066ca84-39d8-4dfa-8b00-a3a11228aae4-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-22gnc\" (UID: \"4066ca84-39d8-4dfa-8b00-a3a11228aae4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-22gnc"
Jul 17 20:05:03.328216 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:05:03.328197    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4066ca84-39d8-4dfa-8b00-a3a11228aae4-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-22gnc\" (UID: \"4066ca84-39d8-4dfa-8b00-a3a11228aae4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-22gnc"
Jul 17 20:05:03.328285 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:05:03.328221    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4066ca84-39d8-4dfa-8b00-a3a11228aae4-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-22gnc\" (UID: \"4066ca84-39d8-4dfa-8b00-a3a11228aae4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-22gnc"
Jul 17 20:05:03.329570 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:05:03.329548    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4066ca84-39d8-4dfa-8b00-a3a11228aae4-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-22gnc\" (UID: \"4066ca84-39d8-4dfa-8b00-a3a11228aae4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-22gnc"
Jul 17 20:05:03.329888 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:05:03.329870    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4066ca84-39d8-4dfa-8b00-a3a11228aae4-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-22gnc\" (UID: \"4066ca84-39d8-4dfa-8b00-a3a11228aae4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-22gnc"
Jul 17 20:05:03.335013 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:05:03.334987    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4066ca84-39d8-4dfa-8b00-a3a11228aae4-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-22gnc\" (UID: \"4066ca84-39d8-4dfa-8b00-a3a11228aae4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-22gnc"
Jul 17 20:05:03.335574 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:05:03.335554    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z6zq6\" (UniqueName: \"kubernetes.io/projected/4066ca84-39d8-4dfa-8b00-a3a11228aae4-kube-api-access-z6zq6\") pod \"maas-default-gateway-openshift-default-56654dcf7-22gnc\" (UID: \"4066ca84-39d8-4dfa-8b00-a3a11228aae4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-22gnc"
Jul 17 20:05:03.419490 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:05:03.419399    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-22gnc"
Jul 17 20:05:03.543400 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:05:03.543373    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:05:03.557331 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:05:03.557298    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-22gnc"]
Jul 17 20:05:03.561525 ip-10-0-141-177 kubenswrapper[2572]: W0717 20:05:03.561499    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4066ca84_39d8_4dfa_8b00_a3a11228aae4.slice/crio-6a33416bdf1bf5b82f3f95f9915e2d4acdc8e590144acaa9a0cdf202ba2df2e6 WatchSource:0}: Error finding container 6a33416bdf1bf5b82f3f95f9915e2d4acdc8e590144acaa9a0cdf202ba2df2e6: Status 404 returned error can't find the container with id 6a33416bdf1bf5b82f3f95f9915e2d4acdc8e590144acaa9a0cdf202ba2df2e6
Jul 17 20:05:03.563570 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:05:03.563531    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 17 20:05:03.563650 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:05:03.563602    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 17 20:05:03.563650 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:05:03.563637    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 17 20:05:04.111793 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:05:04.111758    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-22gnc" event={"ID":"4066ca84-39d8-4dfa-8b00-a3a11228aae4","Type":"ContainerStarted","Data":"8971fc92a02cf88054a64f80cea6d374c7ef76a86145c46151256201429996cb"}
Jul 17 20:05:04.112214 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:05:04.111818    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-22gnc" event={"ID":"4066ca84-39d8-4dfa-8b00-a3a11228aae4","Type":"ContainerStarted","Data":"6a33416bdf1bf5b82f3f95f9915e2d4acdc8e590144acaa9a0cdf202ba2df2e6"}
Jul 17 20:05:04.132908 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:05:04.132858    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-22gnc" podStartSLOduration=1.132842623 podStartE2EDuration="1.132842623s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 20:05:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 20:05:04.130475123 +0000 UTC m=+528.971970757" watchObservedRunningTime="2026-07-17 20:05:04.132842623 +0000 UTC m=+528.974338259"
Jul 17 20:05:04.419898 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:05:04.419806    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-22gnc"
Jul 17 20:05:04.424510 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:05:04.424483    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-22gnc"
Jul 17 20:05:05.075728 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:05:05.075690    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-hqdd4"]
Jul 17 20:05:05.078053 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:05:05.078035    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-hqdd4"
Jul 17 20:05:05.080316 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:05:05.080293    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-5hf6p\""
Jul 17 20:05:05.080420 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:05:05.080312    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 17 20:05:05.084173 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:05:05.084153    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:05:05.087929 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:05:05.087909    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-hqdd4"]
Jul 17 20:05:05.116103 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:05:05.116057    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-22gnc"
Jul 17 20:05:05.117087 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:05:05.117048    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-22gnc"
Jul 17 20:05:05.147532 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:05:05.147498    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h8x8b\" (UniqueName: \"kubernetes.io/projected/032ebbbc-eab8-4ee4-85b5-52fd36d5ed34-kube-api-access-h8x8b\") pod \"limitador-limitador-64c94fd64f-hqdd4\" (UID: \"032ebbbc-eab8-4ee4-85b5-52fd36d5ed34\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-hqdd4"
Jul 17 20:05:05.148214 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:05:05.148184    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/032ebbbc-eab8-4ee4-85b5-52fd36d5ed34-config-file\") pod \"limitador-limitador-64c94fd64f-hqdd4\" (UID: \"032ebbbc-eab8-4ee4-85b5-52fd36d5ed34\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-hqdd4"
Jul 17 20:05:05.180850 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:05:05.180814    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-hqdd4"]
Jul 17 20:05:05.182995 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:05:05.182970    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:05:05.230521 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:05:05.230493    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:05:05.248749 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:05:05.248710    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/032ebbbc-eab8-4ee4-85b5-52fd36d5ed34-config-file\") pod \"limitador-limitador-64c94fd64f-hqdd4\" (UID: \"032ebbbc-eab8-4ee4-85b5-52fd36d5ed34\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-hqdd4"
Jul 17 20:05:05.248929 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:05:05.248831    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h8x8b\" (UniqueName: \"kubernetes.io/projected/032ebbbc-eab8-4ee4-85b5-52fd36d5ed34-kube-api-access-h8x8b\") pod \"limitador-limitador-64c94fd64f-hqdd4\" (UID: \"032ebbbc-eab8-4ee4-85b5-52fd36d5ed34\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-hqdd4"
Jul 17 20:05:05.249459 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:05:05.249440    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/032ebbbc-eab8-4ee4-85b5-52fd36d5ed34-config-file\") pod \"limitador-limitador-64c94fd64f-hqdd4\" (UID: \"032ebbbc-eab8-4ee4-85b5-52fd36d5ed34\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-hqdd4"
Jul 17 20:05:05.256629 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:05:05.256603    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h8x8b\" (UniqueName: \"kubernetes.io/projected/032ebbbc-eab8-4ee4-85b5-52fd36d5ed34-kube-api-access-h8x8b\") pod \"limitador-limitador-64c94fd64f-hqdd4\" (UID: \"032ebbbc-eab8-4ee4-85b5-52fd36d5ed34\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-hqdd4"
Jul 17 20:05:05.388808 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:05:05.388707    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-hqdd4"
Jul 17 20:05:05.517202 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:05:05.517179    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-hqdd4"]
Jul 17 20:05:05.519211 ip-10-0-141-177 kubenswrapper[2572]: W0717 20:05:05.519182    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod032ebbbc_eab8_4ee4_85b5_52fd36d5ed34.slice/crio-de85e4dc0d3f0b01c0acb1d112c90f3a739c394803ddfaf451edb08349b5ff17 WatchSource:0}: Error finding container de85e4dc0d3f0b01c0acb1d112c90f3a739c394803ddfaf451edb08349b5ff17: Status 404 returned error can't find the container with id de85e4dc0d3f0b01c0acb1d112c90f3a739c394803ddfaf451edb08349b5ff17
Jul 17 20:05:05.902681 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:05:05.902649    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:05:05.981602 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:05:05.981566    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:05:06.121146 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:05:06.121114    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-hqdd4" event={"ID":"032ebbbc-eab8-4ee4-85b5-52fd36d5ed34","Type":"ContainerStarted","Data":"de85e4dc0d3f0b01c0acb1d112c90f3a739c394803ddfaf451edb08349b5ff17"}
Jul 17 20:05:07.083814 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:05:07.083781    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:05:09.137934 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:05:09.137896    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-hqdd4" event={"ID":"032ebbbc-eab8-4ee4-85b5-52fd36d5ed34","Type":"ContainerStarted","Data":"c07de50e48beb33776a39d966d92efc0ee308b02fad81381fb323506c9400737"}
Jul 17 20:05:09.138346 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:05:09.138023    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-hqdd4"
Jul 17 20:05:09.154046 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:05:09.154000    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-hqdd4" podStartSLOduration=1.413083718 podStartE2EDuration="4.153982234s" totalImagesPullingTime="2.740898516s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 20:05:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 20:05:09.15289552 +0000 UTC m=+533.994391162" watchObservedRunningTime="2026-07-17 20:05:09.153982234 +0000 UTC m=+533.995477870"
Jul 17 20:05:19.925240 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:05:19.925207    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-hqdd4"]
Jul 17 20:05:19.925745 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:05:19.925419    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-hqdd4" podUID="032ebbbc-eab8-4ee4-85b5-52fd36d5ed34" containerName="limitador" containerID="cri-o://c07de50e48beb33776a39d966d92efc0ee308b02fad81381fb323506c9400737" gracePeriod=30
Jul 17 20:05:19.926188 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:05:19.926170    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-hqdd4"
Jul 17 20:05:20.473023 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:05:20.472998    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-hqdd4"
Jul 17 20:05:20.591550 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:05:20.591521    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/032ebbbc-eab8-4ee4-85b5-52fd36d5ed34-config-file\") pod \"032ebbbc-eab8-4ee4-85b5-52fd36d5ed34\" (UID: \"032ebbbc-eab8-4ee4-85b5-52fd36d5ed34\") "
Jul 17 20:05:20.591719 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:05:20.591594    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h8x8b\" (UniqueName: \"kubernetes.io/projected/032ebbbc-eab8-4ee4-85b5-52fd36d5ed34-kube-api-access-h8x8b\") pod \"032ebbbc-eab8-4ee4-85b5-52fd36d5ed34\" (UID: \"032ebbbc-eab8-4ee4-85b5-52fd36d5ed34\") "
Jul 17 20:05:20.591950 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:05:20.591922    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/032ebbbc-eab8-4ee4-85b5-52fd36d5ed34-config-file" (OuterVolumeSpecName: "config-file") pod "032ebbbc-eab8-4ee4-85b5-52fd36d5ed34" (UID: "032ebbbc-eab8-4ee4-85b5-52fd36d5ed34"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 20:05:20.593825 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:05:20.593800    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/032ebbbc-eab8-4ee4-85b5-52fd36d5ed34-kube-api-access-h8x8b" (OuterVolumeSpecName: "kube-api-access-h8x8b") pod "032ebbbc-eab8-4ee4-85b5-52fd36d5ed34" (UID: "032ebbbc-eab8-4ee4-85b5-52fd36d5ed34"). InnerVolumeSpecName "kube-api-access-h8x8b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 20:05:20.693258 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:05:20.693225    2572 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/032ebbbc-eab8-4ee4-85b5-52fd36d5ed34-config-file\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Jul 17 20:05:20.693258 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:05:20.693253    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h8x8b\" (UniqueName: \"kubernetes.io/projected/032ebbbc-eab8-4ee4-85b5-52fd36d5ed34-kube-api-access-h8x8b\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Jul 17 20:05:21.175087 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:05:21.175035    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:05:21.193337 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:05:21.193302    2572 generic.go:356] "Generic (PLEG): container finished" podID="032ebbbc-eab8-4ee4-85b5-52fd36d5ed34" containerID="c07de50e48beb33776a39d966d92efc0ee308b02fad81381fb323506c9400737" exitCode=0
Jul 17 20:05:21.193476 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:05:21.193353    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-hqdd4"
Jul 17 20:05:21.193476 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:05:21.193398    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-hqdd4" event={"ID":"032ebbbc-eab8-4ee4-85b5-52fd36d5ed34","Type":"ContainerDied","Data":"c07de50e48beb33776a39d966d92efc0ee308b02fad81381fb323506c9400737"}
Jul 17 20:05:21.193476 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:05:21.193447    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-hqdd4" event={"ID":"032ebbbc-eab8-4ee4-85b5-52fd36d5ed34","Type":"ContainerDied","Data":"de85e4dc0d3f0b01c0acb1d112c90f3a739c394803ddfaf451edb08349b5ff17"}
Jul 17 20:05:21.193476 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:05:21.193473    2572 scope.go:117] "RemoveContainer" containerID="c07de50e48beb33776a39d966d92efc0ee308b02fad81381fb323506c9400737"
Jul 17 20:05:21.202317 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:05:21.202300    2572 scope.go:117] "RemoveContainer" containerID="c07de50e48beb33776a39d966d92efc0ee308b02fad81381fb323506c9400737"
Jul 17 20:05:21.202564 ip-10-0-141-177 kubenswrapper[2572]: E0717 20:05:21.202547    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c07de50e48beb33776a39d966d92efc0ee308b02fad81381fb323506c9400737\": container with ID starting with c07de50e48beb33776a39d966d92efc0ee308b02fad81381fb323506c9400737 not found: ID does not exist" containerID="c07de50e48beb33776a39d966d92efc0ee308b02fad81381fb323506c9400737"
Jul 17 20:05:21.202612 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:05:21.202572    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c07de50e48beb33776a39d966d92efc0ee308b02fad81381fb323506c9400737"} err="failed to get container status \"c07de50e48beb33776a39d966d92efc0ee308b02fad81381fb323506c9400737\": rpc error: code = NotFound desc = could not find container \"c07de50e48beb33776a39d966d92efc0ee308b02fad81381fb323506c9400737\": container with ID starting with c07de50e48beb33776a39d966d92efc0ee308b02fad81381fb323506c9400737 not found: ID does not exist"
Jul 17 20:05:21.220291 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:05:21.220263    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-hqdd4"]
Jul 17 20:05:21.224505 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:05:21.224475    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-hqdd4"]
Jul 17 20:05:21.237165 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:05:21.237137    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:05:21.599391 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:05:21.599348    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-tnnhq"]
Jul 17 20:05:21.599914 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:05:21.599895    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="032ebbbc-eab8-4ee4-85b5-52fd36d5ed34" containerName="limitador"
Jul 17 20:05:21.599914 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:05:21.599914    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="032ebbbc-eab8-4ee4-85b5-52fd36d5ed34" containerName="limitador"
Jul 17 20:05:21.600096 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:05:21.600004    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="032ebbbc-eab8-4ee4-85b5-52fd36d5ed34" containerName="limitador"
Jul 17 20:05:21.604857 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:05:21.604836    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-tnnhq"
Jul 17 20:05:21.607407 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:05:21.607374    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 17 20:05:21.607804 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:05:21.607779    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Jul 17 20:05:21.607961 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:05:21.607792    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 17 20:05:21.608099 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:05:21.607942    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-72qql\""
Jul 17 20:05:21.609960 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:05:21.609940    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-tnnhq"]
Jul 17 20:05:21.627500 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:05:21.627477    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:05:21.686800 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:05:21.686771    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="032ebbbc-eab8-4ee4-85b5-52fd36d5ed34" path="/var/lib/kubelet/pods/032ebbbc-eab8-4ee4-85b5-52fd36d5ed34/volumes"
Jul 17 20:05:21.703312 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:05:21.703287    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/37950c44-17f5-4ad8-a942-f0552088189d-data\") pod \"postgres-69fb4594cf-tnnhq\" (UID: \"37950c44-17f5-4ad8-a942-f0552088189d\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-tnnhq"
Jul 17 20:05:21.703463 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:05:21.703334    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jxz2x\" (UniqueName: \"kubernetes.io/projected/37950c44-17f5-4ad8-a942-f0552088189d-kube-api-access-jxz2x\") pod \"postgres-69fb4594cf-tnnhq\" (UID: \"37950c44-17f5-4ad8-a942-f0552088189d\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-tnnhq"
Jul 17 20:05:21.804544 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:05:21.804513    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jxz2x\" (UniqueName: \"kubernetes.io/projected/37950c44-17f5-4ad8-a942-f0552088189d-kube-api-access-jxz2x\") pod \"postgres-69fb4594cf-tnnhq\" (UID: \"37950c44-17f5-4ad8-a942-f0552088189d\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-tnnhq"
Jul 17 20:05:21.804845 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:05:21.804608    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/37950c44-17f5-4ad8-a942-f0552088189d-data\") pod \"postgres-69fb4594cf-tnnhq\" (UID: \"37950c44-17f5-4ad8-a942-f0552088189d\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-tnnhq"
Jul 17 20:05:21.804977 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:05:21.804958    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/37950c44-17f5-4ad8-a942-f0552088189d-data\") pod \"postgres-69fb4594cf-tnnhq\" (UID: \"37950c44-17f5-4ad8-a942-f0552088189d\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-tnnhq"
Jul 17 20:05:21.812362 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:05:21.812341    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jxz2x\" (UniqueName: \"kubernetes.io/projected/37950c44-17f5-4ad8-a942-f0552088189d-kube-api-access-jxz2x\") pod \"postgres-69fb4594cf-tnnhq\" (UID: \"37950c44-17f5-4ad8-a942-f0552088189d\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-tnnhq"
Jul 17 20:05:21.918051 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:05:21.917966    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-tnnhq"
Jul 17 20:05:22.046941 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:05:22.046914    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-tnnhq"]
Jul 17 20:05:22.048973 ip-10-0-141-177 kubenswrapper[2572]: W0717 20:05:22.048949    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37950c44_17f5_4ad8_a942_f0552088189d.slice/crio-596e3809ec98517f05b5ab7e84e692629a91755563cc0726864b0d7e0817a231 WatchSource:0}: Error finding container 596e3809ec98517f05b5ab7e84e692629a91755563cc0726864b0d7e0817a231: Status 404 returned error can't find the container with id 596e3809ec98517f05b5ab7e84e692629a91755563cc0726864b0d7e0817a231
Jul 17 20:05:22.202707 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:05:22.202620    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-tnnhq" event={"ID":"37950c44-17f5-4ad8-a942-f0552088189d","Type":"ContainerStarted","Data":"596e3809ec98517f05b5ab7e84e692629a91755563cc0726864b0d7e0817a231"}
Jul 17 20:05:27.233258 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:05:27.233164    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-tnnhq" event={"ID":"37950c44-17f5-4ad8-a942-f0552088189d","Type":"ContainerStarted","Data":"12df0c698826a3806948fc3f2ad900210aff254171c4c275b5d5a68068f44aae"}
Jul 17 20:05:27.233258 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:05:27.233255    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-tnnhq"
Jul 17 20:05:27.249703 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:05:27.249650    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-tnnhq" podStartSLOduration=1.370750401 podStartE2EDuration="6.249631397s" totalImagesPullingTime="4.878880996s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 20:05:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 20:05:27.247602072 +0000 UTC m=+552.089097728" watchObservedRunningTime="2026-07-17 20:05:27.249631397 +0000 UTC m=+552.091127034"
Jul 17 20:05:33.267462 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:05:33.267432    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-tnnhq"
Jul 17 20:05:33.568909 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:05:33.568830    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:05:33.666403 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:05:33.666377    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:05:39.693307 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:05:39.693275    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:05:39.709830 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:05:39.709802    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7754f9495d-pglt5"]
Jul 17 20:05:39.740242 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:05:39.740203    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7754f9495d-pglt5"]
Jul 17 20:05:39.740392 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:05:39.740335    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7754f9495d-pglt5"
Jul 17 20:05:39.743117 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:05:39.743095    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 17 20:05:39.743261 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:05:39.743131    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-4shb5\""
Jul 17 20:05:39.743261 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:05:39.743133    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 17 20:05:39.864719 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:05:39.864686    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-587c8b5647-xnl5t"]
Jul 17 20:05:39.879169 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:05:39.879137    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c4790cd7-29de-491c-b45f-6567d9598771-webhook-cert\") pod \"maas-controller-7754f9495d-pglt5\" (UID: \"c4790cd7-29de-491c-b45f-6567d9598771\") " pod="opendatahub/maas-controller-7754f9495d-pglt5"
Jul 17 20:05:39.879321 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:05:39.879184    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-62t4n\" (UniqueName: \"kubernetes.io/projected/c4790cd7-29de-491c-b45f-6567d9598771-kube-api-access-62t4n\") pod \"maas-controller-7754f9495d-pglt5\" (UID: \"c4790cd7-29de-491c-b45f-6567d9598771\") " pod="opendatahub/maas-controller-7754f9495d-pglt5"
Jul 17 20:05:39.886715 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:05:39.886693    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-587c8b5647-xnl5t"]
Jul 17 20:05:39.886826 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:05:39.886779    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-587c8b5647-xnl5t"
Jul 17 20:05:39.980043 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:05:39.979966    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bz8dr\" (UniqueName: \"kubernetes.io/projected/2d9638d8-1c6a-427e-a9b2-0398c0fda9b8-kube-api-access-bz8dr\") pod \"maas-controller-587c8b5647-xnl5t\" (UID: \"2d9638d8-1c6a-427e-a9b2-0398c0fda9b8\") " pod="opendatahub/maas-controller-587c8b5647-xnl5t"
Jul 17 20:05:39.980043 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:05:39.980005    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2d9638d8-1c6a-427e-a9b2-0398c0fda9b8-webhook-cert\") pod \"maas-controller-587c8b5647-xnl5t\" (UID: \"2d9638d8-1c6a-427e-a9b2-0398c0fda9b8\") " pod="opendatahub/maas-controller-587c8b5647-xnl5t"
Jul 17 20:05:39.980249 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:05:39.980046    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c4790cd7-29de-491c-b45f-6567d9598771-webhook-cert\") pod \"maas-controller-7754f9495d-pglt5\" (UID: \"c4790cd7-29de-491c-b45f-6567d9598771\") " pod="opendatahub/maas-controller-7754f9495d-pglt5"
Jul 17 20:05:39.980249 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:05:39.980095    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-62t4n\" (UniqueName: \"kubernetes.io/projected/c4790cd7-29de-491c-b45f-6567d9598771-kube-api-access-62t4n\") pod \"maas-controller-7754f9495d-pglt5\" (UID: \"c4790cd7-29de-491c-b45f-6567d9598771\") " pod="opendatahub/maas-controller-7754f9495d-pglt5"
Jul 17 20:05:39.980249 ip-10-0-141-177 kubenswrapper[2572]: E0717 20:05:39.980189    2572 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found
Jul 17 20:05:39.980391 ip-10-0-141-177 kubenswrapper[2572]: E0717 20:05:39.980258    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c4790cd7-29de-491c-b45f-6567d9598771-webhook-cert podName:c4790cd7-29de-491c-b45f-6567d9598771 nodeName:}" failed. No retries permitted until 2026-07-17 20:05:40.48024206 +0000 UTC m=+565.321737680 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/c4790cd7-29de-491c-b45f-6567d9598771-webhook-cert") pod "maas-controller-7754f9495d-pglt5" (UID: "c4790cd7-29de-491c-b45f-6567d9598771") : secret "maas-controller-webhook-cert" not found
Jul 17 20:05:39.990699 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:05:39.990674    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-62t4n\" (UniqueName: \"kubernetes.io/projected/c4790cd7-29de-491c-b45f-6567d9598771-kube-api-access-62t4n\") pod \"maas-controller-7754f9495d-pglt5\" (UID: \"c4790cd7-29de-491c-b45f-6567d9598771\") " pod="opendatahub/maas-controller-7754f9495d-pglt5"
Jul 17 20:05:40.055263 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:05:40.055233    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:05:40.081416 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:05:40.081394    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bz8dr\" (UniqueName: \"kubernetes.io/projected/2d9638d8-1c6a-427e-a9b2-0398c0fda9b8-kube-api-access-bz8dr\") pod \"maas-controller-587c8b5647-xnl5t\" (UID: \"2d9638d8-1c6a-427e-a9b2-0398c0fda9b8\") " pod="opendatahub/maas-controller-587c8b5647-xnl5t"
Jul 17 20:05:40.081521 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:05:40.081426    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2d9638d8-1c6a-427e-a9b2-0398c0fda9b8-webhook-cert\") pod \"maas-controller-587c8b5647-xnl5t\" (UID: \"2d9638d8-1c6a-427e-a9b2-0398c0fda9b8\") " pod="opendatahub/maas-controller-587c8b5647-xnl5t"
Jul 17 20:05:40.081622 ip-10-0-141-177 kubenswrapper[2572]: E0717 20:05:40.081605    2572 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found
Jul 17 20:05:40.081682 ip-10-0-141-177 kubenswrapper[2572]: E0717 20:05:40.081672    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d9638d8-1c6a-427e-a9b2-0398c0fda9b8-webhook-cert podName:2d9638d8-1c6a-427e-a9b2-0398c0fda9b8 nodeName:}" failed. No retries permitted until 2026-07-17 20:05:40.581657638 +0000 UTC m=+565.423153253 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/2d9638d8-1c6a-427e-a9b2-0398c0fda9b8-webhook-cert") pod "maas-controller-587c8b5647-xnl5t" (UID: "2d9638d8-1c6a-427e-a9b2-0398c0fda9b8") : secret "maas-controller-webhook-cert" not found
Jul 17 20:05:40.089962 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:05:40.089938    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bz8dr\" (UniqueName: \"kubernetes.io/projected/2d9638d8-1c6a-427e-a9b2-0398c0fda9b8-kube-api-access-bz8dr\") pod \"maas-controller-587c8b5647-xnl5t\" (UID: \"2d9638d8-1c6a-427e-a9b2-0398c0fda9b8\") " pod="opendatahub/maas-controller-587c8b5647-xnl5t"
Jul 17 20:05:40.156539 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:05:40.156510    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:05:40.336905 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:05:40.336847    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:05:40.486149 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:05:40.486108    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c4790cd7-29de-491c-b45f-6567d9598771-webhook-cert\") pod \"maas-controller-7754f9495d-pglt5\" (UID: \"c4790cd7-29de-491c-b45f-6567d9598771\") " pod="opendatahub/maas-controller-7754f9495d-pglt5"
Jul 17 20:05:40.488460 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:05:40.488440    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c4790cd7-29de-491c-b45f-6567d9598771-webhook-cert\") pod \"maas-controller-7754f9495d-pglt5\" (UID: \"c4790cd7-29de-491c-b45f-6567d9598771\") " pod="opendatahub/maas-controller-7754f9495d-pglt5"
Jul 17 20:05:40.587458 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:05:40.587384    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2d9638d8-1c6a-427e-a9b2-0398c0fda9b8-webhook-cert\") pod \"maas-controller-587c8b5647-xnl5t\" (UID: \"2d9638d8-1c6a-427e-a9b2-0398c0fda9b8\") " pod="opendatahub/maas-controller-587c8b5647-xnl5t"
Jul 17 20:05:40.589664 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:05:40.589645    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2d9638d8-1c6a-427e-a9b2-0398c0fda9b8-webhook-cert\") pod \"maas-controller-587c8b5647-xnl5t\" (UID: \"2d9638d8-1c6a-427e-a9b2-0398c0fda9b8\") " pod="opendatahub/maas-controller-587c8b5647-xnl5t"
Jul 17 20:05:40.651537 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:05:40.651496    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7754f9495d-pglt5"
Jul 17 20:05:40.784006 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:05:40.783968    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7754f9495d-pglt5"]
Jul 17 20:05:40.784957 ip-10-0-141-177 kubenswrapper[2572]: W0717 20:05:40.784934    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4790cd7_29de_491c_b45f_6567d9598771.slice/crio-95ccb6899ee78469065e11cae3bd63069d25d1f9a1f18175ee613deb7f3e658c WatchSource:0}: Error finding container 95ccb6899ee78469065e11cae3bd63069d25d1f9a1f18175ee613deb7f3e658c: Status 404 returned error can't find the container with id 95ccb6899ee78469065e11cae3bd63069d25d1f9a1f18175ee613deb7f3e658c
Jul 17 20:05:40.797272 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:05:40.797247    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-587c8b5647-xnl5t"
Jul 17 20:05:40.925543 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:05:40.925517    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-587c8b5647-xnl5t"]
Jul 17 20:05:40.927288 ip-10-0-141-177 kubenswrapper[2572]: W0717 20:05:40.927262    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d9638d8_1c6a_427e_a9b2_0398c0fda9b8.slice/crio-79dcaa4375e0a3b47903f9ee44806cd73d525d87dac1b52faae9cbdc8695d849 WatchSource:0}: Error finding container 79dcaa4375e0a3b47903f9ee44806cd73d525d87dac1b52faae9cbdc8695d849: Status 404 returned error can't find the container with id 79dcaa4375e0a3b47903f9ee44806cd73d525d87dac1b52faae9cbdc8695d849
Jul 17 20:05:41.307752 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:05:41.307717    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7754f9495d-pglt5" event={"ID":"c4790cd7-29de-491c-b45f-6567d9598771","Type":"ContainerStarted","Data":"95ccb6899ee78469065e11cae3bd63069d25d1f9a1f18175ee613deb7f3e658c"}
Jul 17 20:05:41.308875 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:05:41.308842    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-587c8b5647-xnl5t" event={"ID":"2d9638d8-1c6a-427e-a9b2-0398c0fda9b8","Type":"ContainerStarted","Data":"79dcaa4375e0a3b47903f9ee44806cd73d525d87dac1b52faae9cbdc8695d849"}
Jul 17 20:05:43.886736 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:05:43.886654    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:05:43.989682 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:05:43.989640    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:05:44.327460 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:05:44.327419    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7754f9495d-pglt5" event={"ID":"c4790cd7-29de-491c-b45f-6567d9598771","Type":"ContainerStarted","Data":"ea939316a33f396b60ba6c5812744826f76dfc7824f2d4a2ce07656a2f790091"}
Jul 17 20:05:44.327653 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:05:44.327489    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7754f9495d-pglt5"
Jul 17 20:05:44.329001 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:05:44.328972    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-587c8b5647-xnl5t" event={"ID":"2d9638d8-1c6a-427e-a9b2-0398c0fda9b8","Type":"ContainerStarted","Data":"c80eccb784e97b459a6c4ee29c8b65698d8a398c44d6906252dc8a94d38d0ed2"}
Jul 17 20:05:44.329127 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:05:44.329055    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-587c8b5647-xnl5t"
Jul 17 20:05:44.344665 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:05:44.344617    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7754f9495d-pglt5" podStartSLOduration=2.500110919 podStartE2EDuration="5.344599493s" totalImagesPullingTime="2.844488574s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 20:05:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 20:05:44.342953166 +0000 UTC m=+569.184448814" watchObservedRunningTime="2026-07-17 20:05:44.344599493 +0000 UTC m=+569.186095129"
Jul 17 20:05:44.360486 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:05:44.360442    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-587c8b5647-xnl5t" podStartSLOduration=2.651193677 podStartE2EDuration="5.360425433s" totalImagesPullingTime="2.709231756s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 20:05:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 20:05:44.359727934 +0000 UTC m=+569.201223572" watchObservedRunningTime="2026-07-17 20:05:44.360425433 +0000 UTC m=+569.201921070"
Jul 17 20:05:55.336400 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:05:55.336368    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-587c8b5647-xnl5t"
Jul 17 20:05:55.336821 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:05:55.336435    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7754f9495d-pglt5"
Jul 17 20:05:55.394018 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:05:55.393985    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7754f9495d-pglt5"]
Jul 17 20:05:55.394209 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:05:55.394176    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-7754f9495d-pglt5" podUID="c4790cd7-29de-491c-b45f-6567d9598771" containerName="manager" containerID="cri-o://ea939316a33f396b60ba6c5812744826f76dfc7824f2d4a2ce07656a2f790091" gracePeriod=30
Jul 17 20:05:55.638450 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:05:55.638422    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7754f9495d-pglt5"
Jul 17 20:05:55.728656 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:05:55.728626    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c4790cd7-29de-491c-b45f-6567d9598771-webhook-cert\") pod \"c4790cd7-29de-491c-b45f-6567d9598771\" (UID: \"c4790cd7-29de-491c-b45f-6567d9598771\") "
Jul 17 20:05:55.728845 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:05:55.728668    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-62t4n\" (UniqueName: \"kubernetes.io/projected/c4790cd7-29de-491c-b45f-6567d9598771-kube-api-access-62t4n\") pod \"c4790cd7-29de-491c-b45f-6567d9598771\" (UID: \"c4790cd7-29de-491c-b45f-6567d9598771\") "
Jul 17 20:05:55.730848 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:05:55.730816    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c4790cd7-29de-491c-b45f-6567d9598771-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "c4790cd7-29de-491c-b45f-6567d9598771" (UID: "c4790cd7-29de-491c-b45f-6567d9598771"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 20:05:55.730961 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:05:55.730910    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c4790cd7-29de-491c-b45f-6567d9598771-kube-api-access-62t4n" (OuterVolumeSpecName: "kube-api-access-62t4n") pod "c4790cd7-29de-491c-b45f-6567d9598771" (UID: "c4790cd7-29de-491c-b45f-6567d9598771"). InnerVolumeSpecName "kube-api-access-62t4n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 20:05:55.830293 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:05:55.830264    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-62t4n\" (UniqueName: \"kubernetes.io/projected/c4790cd7-29de-491c-b45f-6567d9598771-kube-api-access-62t4n\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Jul 17 20:05:55.830293 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:05:55.830290    2572 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c4790cd7-29de-491c-b45f-6567d9598771-webhook-cert\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Jul 17 20:05:56.385923 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:05:56.385889    2572 generic.go:356] "Generic (PLEG): container finished" podID="c4790cd7-29de-491c-b45f-6567d9598771" containerID="ea939316a33f396b60ba6c5812744826f76dfc7824f2d4a2ce07656a2f790091" exitCode=0
Jul 17 20:05:56.386413 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:05:56.385933    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7754f9495d-pglt5"
Jul 17 20:05:56.386413 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:05:56.385925    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7754f9495d-pglt5" event={"ID":"c4790cd7-29de-491c-b45f-6567d9598771","Type":"ContainerDied","Data":"ea939316a33f396b60ba6c5812744826f76dfc7824f2d4a2ce07656a2f790091"}
Jul 17 20:05:56.386413 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:05:56.385997    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7754f9495d-pglt5" event={"ID":"c4790cd7-29de-491c-b45f-6567d9598771","Type":"ContainerDied","Data":"95ccb6899ee78469065e11cae3bd63069d25d1f9a1f18175ee613deb7f3e658c"}
Jul 17 20:05:56.386413 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:05:56.386032    2572 scope.go:117] "RemoveContainer" containerID="ea939316a33f396b60ba6c5812744826f76dfc7824f2d4a2ce07656a2f790091"
Jul 17 20:05:56.401643 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:05:56.401620    2572 scope.go:117] "RemoveContainer" containerID="ea939316a33f396b60ba6c5812744826f76dfc7824f2d4a2ce07656a2f790091"
Jul 17 20:05:56.401936 ip-10-0-141-177 kubenswrapper[2572]: E0717 20:05:56.401912    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ea939316a33f396b60ba6c5812744826f76dfc7824f2d4a2ce07656a2f790091\": container with ID starting with ea939316a33f396b60ba6c5812744826f76dfc7824f2d4a2ce07656a2f790091 not found: ID does not exist" containerID="ea939316a33f396b60ba6c5812744826f76dfc7824f2d4a2ce07656a2f790091"
Jul 17 20:05:56.402004 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:05:56.401945    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea939316a33f396b60ba6c5812744826f76dfc7824f2d4a2ce07656a2f790091"} err="failed to get container status \"ea939316a33f396b60ba6c5812744826f76dfc7824f2d4a2ce07656a2f790091\": rpc error: code = NotFound desc = could not find container \"ea939316a33f396b60ba6c5812744826f76dfc7824f2d4a2ce07656a2f790091\": container with ID starting with ea939316a33f396b60ba6c5812744826f76dfc7824f2d4a2ce07656a2f790091 not found: ID does not exist"
Jul 17 20:05:56.409496 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:05:56.409470    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7754f9495d-pglt5"]
Jul 17 20:05:56.412547 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:05:56.412522    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7754f9495d-pglt5"]
Jul 17 20:05:57.687171 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:05:57.687139    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c4790cd7-29de-491c-b45f-6567d9598771" path="/var/lib/kubelet/pods/c4790cd7-29de-491c-b45f-6567d9598771/volumes"
Jul 17 20:06:12.950124 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:06:12.950062    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:06:16.925298 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:06:16.925258    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:06:17.026892 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:06:17.026853    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:06:17.450630 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:06:17.450596    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:06:17.577394 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:06:17.577361    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-c89698cdd-xpc48"]
Jul 17 20:06:17.577898 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:06:17.577882    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4790cd7-29de-491c-b45f-6567d9598771" containerName="manager"
Jul 17 20:06:17.577956 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:06:17.577901    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4790cd7-29de-491c-b45f-6567d9598771" containerName="manager"
Jul 17 20:06:17.578018 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:06:17.578007    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="c4790cd7-29de-491c-b45f-6567d9598771" containerName="manager"
Jul 17 20:06:17.582838 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:06:17.582816    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-c89698cdd-xpc48"
Jul 17 20:06:17.585632 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:06:17.585596    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-mxjrb\""
Jul 17 20:06:17.585759 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:06:17.585644    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Jul 17 20:06:17.591194 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:06:17.591017    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-c89698cdd-xpc48"]
Jul 17 20:06:17.728325 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:06:17.728237    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f1674f3c-ee0c-4d64-90a5-c6032638e4de-maas-api-tls\") pod \"maas-api-c89698cdd-xpc48\" (UID: \"f1674f3c-ee0c-4d64-90a5-c6032638e4de\") " pod="odh-ai-gateway-infra/maas-api-c89698cdd-xpc48"
Jul 17 20:06:17.728325 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:06:17.728284    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f1674f3c-ee0c-4d64-90a5-c6032638e4de-openshift-service-ca\") pod \"maas-api-c89698cdd-xpc48\" (UID: \"f1674f3c-ee0c-4d64-90a5-c6032638e4de\") " pod="odh-ai-gateway-infra/maas-api-c89698cdd-xpc48"
Jul 17 20:06:17.728523 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:06:17.728397    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ngh6s\" (UniqueName: \"kubernetes.io/projected/f1674f3c-ee0c-4d64-90a5-c6032638e4de-kube-api-access-ngh6s\") pod \"maas-api-c89698cdd-xpc48\" (UID: \"f1674f3c-ee0c-4d64-90a5-c6032638e4de\") " pod="odh-ai-gateway-infra/maas-api-c89698cdd-xpc48"
Jul 17 20:06:17.770108 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:06:17.770050    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:06:17.829455 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:06:17.829420    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f1674f3c-ee0c-4d64-90a5-c6032638e4de-openshift-service-ca\") pod \"maas-api-c89698cdd-xpc48\" (UID: \"f1674f3c-ee0c-4d64-90a5-c6032638e4de\") " pod="odh-ai-gateway-infra/maas-api-c89698cdd-xpc48"
Jul 17 20:06:17.829614 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:06:17.829478    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ngh6s\" (UniqueName: \"kubernetes.io/projected/f1674f3c-ee0c-4d64-90a5-c6032638e4de-kube-api-access-ngh6s\") pod \"maas-api-c89698cdd-xpc48\" (UID: \"f1674f3c-ee0c-4d64-90a5-c6032638e4de\") " pod="odh-ai-gateway-infra/maas-api-c89698cdd-xpc48"
Jul 17 20:06:17.829614 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:06:17.829546    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f1674f3c-ee0c-4d64-90a5-c6032638e4de-maas-api-tls\") pod \"maas-api-c89698cdd-xpc48\" (UID: \"f1674f3c-ee0c-4d64-90a5-c6032638e4de\") " pod="odh-ai-gateway-infra/maas-api-c89698cdd-xpc48"
Jul 17 20:06:17.830221 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:06:17.830198    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f1674f3c-ee0c-4d64-90a5-c6032638e4de-openshift-service-ca\") pod \"maas-api-c89698cdd-xpc48\" (UID: \"f1674f3c-ee0c-4d64-90a5-c6032638e4de\") " pod="odh-ai-gateway-infra/maas-api-c89698cdd-xpc48"
Jul 17 20:06:17.831944 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:06:17.831921    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f1674f3c-ee0c-4d64-90a5-c6032638e4de-maas-api-tls\") pod \"maas-api-c89698cdd-xpc48\" (UID: \"f1674f3c-ee0c-4d64-90a5-c6032638e4de\") " pod="odh-ai-gateway-infra/maas-api-c89698cdd-xpc48"
Jul 17 20:06:17.839121 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:06:17.839093    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ngh6s\" (UniqueName: \"kubernetes.io/projected/f1674f3c-ee0c-4d64-90a5-c6032638e4de-kube-api-access-ngh6s\") pod \"maas-api-c89698cdd-xpc48\" (UID: \"f1674f3c-ee0c-4d64-90a5-c6032638e4de\") " pod="odh-ai-gateway-infra/maas-api-c89698cdd-xpc48"
Jul 17 20:06:17.895632 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:06:17.895601    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-c89698cdd-xpc48"
Jul 17 20:06:18.033394 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:06:18.033360    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-c89698cdd-xpc48"]
Jul 17 20:06:18.035271 ip-10-0-141-177 kubenswrapper[2572]: W0717 20:06:18.035242    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1674f3c_ee0c_4d64_90a5_c6032638e4de.slice/crio-37d4060f5d04aabf0fd7498b8d71cac65f6d12eff0a7d1bea3a03a46d1911020 WatchSource:0}: Error finding container 37d4060f5d04aabf0fd7498b8d71cac65f6d12eff0a7d1bea3a03a46d1911020: Status 404 returned error can't find the container with id 37d4060f5d04aabf0fd7498b8d71cac65f6d12eff0a7d1bea3a03a46d1911020
Jul 17 20:06:18.047565 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:06:18.047529    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:06:18.125601 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:06:18.125557    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:06:18.129787 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:06:18.129760    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-7vbff"]
Jul 17 20:06:18.133466 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:06:18.133449    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7677b774bb-7vbff"
Jul 17 20:06:18.136017 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:06:18.135996    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-2xtl7\""
Jul 17 20:06:18.136162 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:06:18.136029    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 17 20:06:18.141882 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:06:18.141843    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-7vbff"]
Jul 17 20:06:18.232854 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:06:18.232766    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-42xnr\" (UniqueName: \"kubernetes.io/projected/de96ce09-93d3-44d5-b157-1c8a47432407-kube-api-access-42xnr\") pod \"payload-pre-processing-7677b774bb-7vbff\" (UID: \"de96ce09-93d3-44d5-b157-1c8a47432407\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-7vbff"
Jul 17 20:06:18.232854 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:06:18.232812    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/de96ce09-93d3-44d5-b157-1c8a47432407-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-7vbff\" (UID: \"de96ce09-93d3-44d5-b157-1c8a47432407\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-7vbff"
Jul 17 20:06:18.333673 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:06:18.333641    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-42xnr\" (UniqueName: \"kubernetes.io/projected/de96ce09-93d3-44d5-b157-1c8a47432407-kube-api-access-42xnr\") pod \"payload-pre-processing-7677b774bb-7vbff\" (UID: \"de96ce09-93d3-44d5-b157-1c8a47432407\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-7vbff"
Jul 17 20:06:18.333861 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:06:18.333700    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/de96ce09-93d3-44d5-b157-1c8a47432407-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-7vbff\" (UID: \"de96ce09-93d3-44d5-b157-1c8a47432407\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-7vbff"
Jul 17 20:06:18.334459 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:06:18.334433    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/de96ce09-93d3-44d5-b157-1c8a47432407-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-7vbff\" (UID: \"de96ce09-93d3-44d5-b157-1c8a47432407\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-7vbff"
Jul 17 20:06:18.347193 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:06:18.347171    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-42xnr\" (UniqueName: \"kubernetes.io/projected/de96ce09-93d3-44d5-b157-1c8a47432407-kube-api-access-42xnr\") pod \"payload-pre-processing-7677b774bb-7vbff\" (UID: \"de96ce09-93d3-44d5-b157-1c8a47432407\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-7vbff"
Jul 17 20:06:18.446275 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:06:18.446237    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7677b774bb-7vbff"
Jul 17 20:06:18.496894 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:06:18.496769    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-c89698cdd-xpc48" event={"ID":"f1674f3c-ee0c-4d64-90a5-c6032638e4de","Type":"ContainerStarted","Data":"37d4060f5d04aabf0fd7498b8d71cac65f6d12eff0a7d1bea3a03a46d1911020"}
Jul 17 20:06:18.578246 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:06:18.578213    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-7vbff"]
Jul 17 20:06:18.580083 ip-10-0-141-177 kubenswrapper[2572]: W0717 20:06:18.580048    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde96ce09_93d3_44d5_b157_1c8a47432407.slice/crio-691fb7661ce6a49cd330e56b095aa31d5442b9c4b2c5385dcda96227c1d9e7fb WatchSource:0}: Error finding container 691fb7661ce6a49cd330e56b095aa31d5442b9c4b2c5385dcda96227c1d9e7fb: Status 404 returned error can't find the container with id 691fb7661ce6a49cd330e56b095aa31d5442b9c4b2c5385dcda96227c1d9e7fb
Jul 17 20:06:19.506088 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:06:19.506031    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7677b774bb-7vbff" event={"ID":"de96ce09-93d3-44d5-b157-1c8a47432407","Type":"ContainerStarted","Data":"691fb7661ce6a49cd330e56b095aa31d5442b9c4b2c5385dcda96227c1d9e7fb"}
Jul 17 20:06:20.512957 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:06:20.512916    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-c89698cdd-xpc48" event={"ID":"f1674f3c-ee0c-4d64-90a5-c6032638e4de","Type":"ContainerStarted","Data":"64e90496c542ae4d6e683b17f0f9202998ecec516b7bad90da86507db39a10fe"}
Jul 17 20:06:20.513392 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:06:20.513056    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-c89698cdd-xpc48"
Jul 17 20:06:21.075215 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:06:21.075182    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:06:22.526142 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:06:22.526095    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7677b774bb-7vbff" event={"ID":"de96ce09-93d3-44d5-b157-1c8a47432407","Type":"ContainerStarted","Data":"13cd1b1249cb47c8818f3fa38663200db3aa4900ad7e0d853fb6121b6bfe20a0"}
Jul 17 20:06:22.526689 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:06:22.526434    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7677b774bb-7vbff"
Jul 17 20:06:22.542081 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:06:22.541995    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7677b774bb-7vbff" podStartSLOduration=1.501254389 podStartE2EDuration="4.541974019s" totalImagesPullingTime="3.04071963s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 20:06:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 20:06:22.541129621 +0000 UTC m=+607.382625284" watchObservedRunningTime="2026-07-17 20:06:22.541974019 +0000 UTC m=+607.383469658"
Jul 17 20:06:22.544575 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:06:22.544517    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-c89698cdd-xpc48" podStartSLOduration=3.611540366 podStartE2EDuration="5.544502795s" totalImagesPullingTime="1.932962429s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 20:06:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 20:06:20.53777025 +0000 UTC m=+605.379265889" watchObservedRunningTime="2026-07-17 20:06:22.544502795 +0000 UTC m=+607.385998436"
Jul 17 20:06:26.525245 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:06:26.525215    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-c89698cdd-xpc48"
Jul 17 20:06:26.547224 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:06:26.547193    2572 generic.go:356] "Generic (PLEG): container finished" podID="4066ca84-39d8-4dfa-8b00-a3a11228aae4" containerID="8971fc92a02cf88054a64f80cea6d374c7ef76a86145c46151256201429996cb" exitCode=0
Jul 17 20:06:26.547380 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:06:26.547265    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-22gnc" event={"ID":"4066ca84-39d8-4dfa-8b00-a3a11228aae4","Type":"ContainerDied","Data":"8971fc92a02cf88054a64f80cea6d374c7ef76a86145c46151256201429996cb"}
Jul 17 20:06:26.547650 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:06:26.547637    2572 scope.go:117] "RemoveContainer" containerID="8971fc92a02cf88054a64f80cea6d374c7ef76a86145c46151256201429996cb"
Jul 17 20:06:26.548777 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:06:26.548744    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 17 20:06:26.548894 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:06:26.548817    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 17 20:06:26.548894 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:06:26.548866    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 17 20:06:27.497415 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:06:27.497379    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:06:27.557017 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:06:27.556978    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-22gnc" event={"ID":"4066ca84-39d8-4dfa-8b00-a3a11228aae4","Type":"ContainerStarted","Data":"eceafef3620025f4b11029dfe39878af349157eab79be723905333ac41c35d9a"}
Jul 17 20:06:28.419680 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:06:28.419648    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-22gnc"
Jul 17 20:06:28.419972 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:06:28.419946    2572 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-22gnc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" start-of-body=
Jul 17 20:06:28.420109 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:06:28.420017    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-22gnc" podUID="4066ca84-39d8-4dfa-8b00-a3a11228aae4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused"
Jul 17 20:06:28.905408 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:06:28.905379    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:06:29.420438 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:06:29.420405    2572 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-22gnc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" start-of-body=
Jul 17 20:06:29.420609 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:06:29.420468    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-22gnc" podUID="4066ca84-39d8-4dfa-8b00-a3a11228aae4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused"
Jul 17 20:06:30.420652 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:06:30.420618    2572 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-22gnc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" start-of-body=
Jul 17 20:06:30.421063 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:06:30.420677    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-22gnc" podUID="4066ca84-39d8-4dfa-8b00-a3a11228aae4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused"
Jul 17 20:06:31.420298 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:06:31.420261    2572 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-22gnc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" start-of-body=
Jul 17 20:06:31.420721 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:06:31.420331    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-22gnc" podUID="4066ca84-39d8-4dfa-8b00-a3a11228aae4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused"
Jul 17 20:06:32.424484 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:06:32.424444    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-22gnc"
Jul 17 20:06:32.424860 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:06:32.424700    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-22gnc"
Jul 17 20:06:32.425450 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:06:32.425430    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-22gnc"
Jul 17 20:06:33.533637 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:06:33.533603    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7677b774bb-7vbff"
Jul 17 20:06:41.669184 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:06:41.669105    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2h8vp"]
Jul 17 20:06:41.672306 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:06:41.672284    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2h8vp"
Jul 17 20:06:41.674731 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:06:41.674714    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 17 20:06:41.675700 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:06:41.675681    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 17 20:06:41.675823 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:06:41.675801    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-pjnw2\""
Jul 17 20:06:41.675881 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:06:41.675850    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 17 20:06:41.694696 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:06:41.694661    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2h8vp"]
Jul 17 20:06:41.697539 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:06:41.697505    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:06:41.754627 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:06:41.754599    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d85900f6-eedb-4e03-ae70-974f2c09a516-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2h8vp\" (UID: \"d85900f6-eedb-4e03-ae70-974f2c09a516\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2h8vp"
Jul 17 20:06:41.754741 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:06:41.754635    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d85900f6-eedb-4e03-ae70-974f2c09a516-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2h8vp\" (UID: \"d85900f6-eedb-4e03-ae70-974f2c09a516\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2h8vp"
Jul 17 20:06:41.754741 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:06:41.754673    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d85900f6-eedb-4e03-ae70-974f2c09a516-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2h8vp\" (UID: \"d85900f6-eedb-4e03-ae70-974f2c09a516\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2h8vp"
Jul 17 20:06:41.754741 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:06:41.754714    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d85900f6-eedb-4e03-ae70-974f2c09a516-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2h8vp\" (UID: \"d85900f6-eedb-4e03-ae70-974f2c09a516\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2h8vp"
Jul 17 20:06:41.754741 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:06:41.754736    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g4xhp\" (UniqueName: \"kubernetes.io/projected/d85900f6-eedb-4e03-ae70-974f2c09a516-kube-api-access-g4xhp\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2h8vp\" (UID: \"d85900f6-eedb-4e03-ae70-974f2c09a516\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2h8vp"
Jul 17 20:06:41.754876 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:06:41.754802    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d85900f6-eedb-4e03-ae70-974f2c09a516-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2h8vp\" (UID: \"d85900f6-eedb-4e03-ae70-974f2c09a516\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2h8vp"
Jul 17 20:06:41.855605 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:06:41.855569    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g4xhp\" (UniqueName: \"kubernetes.io/projected/d85900f6-eedb-4e03-ae70-974f2c09a516-kube-api-access-g4xhp\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2h8vp\" (UID: \"d85900f6-eedb-4e03-ae70-974f2c09a516\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2h8vp"
Jul 17 20:06:41.855760 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:06:41.855614    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d85900f6-eedb-4e03-ae70-974f2c09a516-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2h8vp\" (UID: \"d85900f6-eedb-4e03-ae70-974f2c09a516\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2h8vp"
Jul 17 20:06:41.855760 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:06:41.855733    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d85900f6-eedb-4e03-ae70-974f2c09a516-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2h8vp\" (UID: \"d85900f6-eedb-4e03-ae70-974f2c09a516\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2h8vp"
Jul 17 20:06:41.855837 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:06:41.855780    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d85900f6-eedb-4e03-ae70-974f2c09a516-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2h8vp\" (UID: \"d85900f6-eedb-4e03-ae70-974f2c09a516\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2h8vp"
Jul 17 20:06:41.855870 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:06:41.855835    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d85900f6-eedb-4e03-ae70-974f2c09a516-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2h8vp\" (UID: \"d85900f6-eedb-4e03-ae70-974f2c09a516\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2h8vp"
Jul 17 20:06:41.855912 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:06:41.855884    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d85900f6-eedb-4e03-ae70-974f2c09a516-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2h8vp\" (UID: \"d85900f6-eedb-4e03-ae70-974f2c09a516\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2h8vp"
Jul 17 20:06:41.855987 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:06:41.855968    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d85900f6-eedb-4e03-ae70-974f2c09a516-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2h8vp\" (UID: \"d85900f6-eedb-4e03-ae70-974f2c09a516\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2h8vp"
Jul 17 20:06:41.856164 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:06:41.856141    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d85900f6-eedb-4e03-ae70-974f2c09a516-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2h8vp\" (UID: \"d85900f6-eedb-4e03-ae70-974f2c09a516\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2h8vp"
Jul 17 20:06:41.856275 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:06:41.856235    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d85900f6-eedb-4e03-ae70-974f2c09a516-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2h8vp\" (UID: \"d85900f6-eedb-4e03-ae70-974f2c09a516\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2h8vp"
Jul 17 20:06:41.857863 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:06:41.857839    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d85900f6-eedb-4e03-ae70-974f2c09a516-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2h8vp\" (UID: \"d85900f6-eedb-4e03-ae70-974f2c09a516\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2h8vp"
Jul 17 20:06:41.858186 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:06:41.858166    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d85900f6-eedb-4e03-ae70-974f2c09a516-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2h8vp\" (UID: \"d85900f6-eedb-4e03-ae70-974f2c09a516\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2h8vp"
Jul 17 20:06:41.862958 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:06:41.862937    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g4xhp\" (UniqueName: \"kubernetes.io/projected/d85900f6-eedb-4e03-ae70-974f2c09a516-kube-api-access-g4xhp\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2h8vp\" (UID: \"d85900f6-eedb-4e03-ae70-974f2c09a516\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2h8vp"
Jul 17 20:06:41.985320 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:06:41.985290    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2h8vp"
Jul 17 20:06:42.113654 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:06:42.113631    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2h8vp"]
Jul 17 20:06:42.115217 ip-10-0-141-177 kubenswrapper[2572]: W0717 20:06:42.115190    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd85900f6_eedb_4e03_ae70_974f2c09a516.slice/crio-0882c40f7a8290194bde306d885e6f815bdcaf28d6bdaeb41351ca8a59d4e937 WatchSource:0}: Error finding container 0882c40f7a8290194bde306d885e6f815bdcaf28d6bdaeb41351ca8a59d4e937: Status 404 returned error can't find the container with id 0882c40f7a8290194bde306d885e6f815bdcaf28d6bdaeb41351ca8a59d4e937
Jul 17 20:06:42.116639 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:06:42.116611    2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 17 20:06:42.637217 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:06:42.637163    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2h8vp" event={"ID":"d85900f6-eedb-4e03-ae70-974f2c09a516","Type":"ContainerStarted","Data":"0882c40f7a8290194bde306d885e6f815bdcaf28d6bdaeb41351ca8a59d4e937"}
Jul 17 20:06:43.643528 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:06:43.643496    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2h8vp" event={"ID":"d85900f6-eedb-4e03-ae70-974f2c09a516","Type":"ContainerStarted","Data":"978ce5868b836a02735228d06c495e8725d9a6e1e0f9350da5aad2e46dc0c8fd"}
Jul 17 20:06:43.661148 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:06:43.661104    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2h8vp" podStartSLOduration=1.571017682 podStartE2EDuration="2.661088593s" totalImagesPullingTime="1.090070911s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 20:06:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 20:06:43.659316871 +0000 UTC m=+628.500812517" watchObservedRunningTime="2026-07-17 20:06:43.661088593 +0000 UTC m=+628.502584227"
Jul 17 20:06:47.575258 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:06:47.575225    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-dl5x8"]
Jul 17 20:06:47.578171 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:06:47.578153    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dl5x8"
Jul 17 20:06:47.580635 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:06:47.580619    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Jul 17 20:06:47.588506 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:06:47.588486    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-dl5x8"]
Jul 17 20:06:47.674517 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:06:47.674486    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:06:47.711314 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:06:47.711280    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cb4aef12-4a25-467b-8166-93351e924785-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dl5x8\" (UID: \"cb4aef12-4a25-467b-8166-93351e924785\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dl5x8"
Jul 17 20:06:47.711489 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:06:47.711340    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c627v\" (UniqueName: \"kubernetes.io/projected/cb4aef12-4a25-467b-8166-93351e924785-kube-api-access-c627v\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dl5x8\" (UID: \"cb4aef12-4a25-467b-8166-93351e924785\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dl5x8"
Jul 17 20:06:47.711489 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:06:47.711402    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cb4aef12-4a25-467b-8166-93351e924785-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dl5x8\" (UID: \"cb4aef12-4a25-467b-8166-93351e924785\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dl5x8"
Jul 17 20:06:47.711489 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:06:47.711427    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cb4aef12-4a25-467b-8166-93351e924785-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dl5x8\" (UID: \"cb4aef12-4a25-467b-8166-93351e924785\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dl5x8"
Jul 17 20:06:47.711489 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:06:47.711459    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cb4aef12-4a25-467b-8166-93351e924785-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dl5x8\" (UID: \"cb4aef12-4a25-467b-8166-93351e924785\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dl5x8"
Jul 17 20:06:47.711489 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:06:47.711490    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cb4aef12-4a25-467b-8166-93351e924785-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dl5x8\" (UID: \"cb4aef12-4a25-467b-8166-93351e924785\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dl5x8"
Jul 17 20:06:47.812580 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:06:47.812544    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cb4aef12-4a25-467b-8166-93351e924785-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dl5x8\" (UID: \"cb4aef12-4a25-467b-8166-93351e924785\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dl5x8"
Jul 17 20:06:47.813054 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:06:47.813027    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cb4aef12-4a25-467b-8166-93351e924785-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dl5x8\" (UID: \"cb4aef12-4a25-467b-8166-93351e924785\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dl5x8"
Jul 17 20:06:47.813350 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:06:47.813191    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cb4aef12-4a25-467b-8166-93351e924785-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dl5x8\" (UID: \"cb4aef12-4a25-467b-8166-93351e924785\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dl5x8"
Jul 17 20:06:47.813505 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:06:47.813484    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c627v\" (UniqueName: \"kubernetes.io/projected/cb4aef12-4a25-467b-8166-93351e924785-kube-api-access-c627v\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dl5x8\" (UID: \"cb4aef12-4a25-467b-8166-93351e924785\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dl5x8"
Jul 17 20:06:47.813711 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:06:47.813511    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cb4aef12-4a25-467b-8166-93351e924785-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dl5x8\" (UID: \"cb4aef12-4a25-467b-8166-93351e924785\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dl5x8"
Jul 17 20:06:47.813821 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:06:47.813711    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cb4aef12-4a25-467b-8166-93351e924785-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dl5x8\" (UID: \"cb4aef12-4a25-467b-8166-93351e924785\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dl5x8"
Jul 17 20:06:47.813923 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:06:47.813908    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cb4aef12-4a25-467b-8166-93351e924785-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dl5x8\" (UID: \"cb4aef12-4a25-467b-8166-93351e924785\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dl5x8"
Jul 17 20:06:47.814058 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:06:47.814042    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cb4aef12-4a25-467b-8166-93351e924785-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dl5x8\" (UID: \"cb4aef12-4a25-467b-8166-93351e924785\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dl5x8"
Jul 17 20:06:47.814429 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:06:47.814399    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cb4aef12-4a25-467b-8166-93351e924785-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dl5x8\" (UID: \"cb4aef12-4a25-467b-8166-93351e924785\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dl5x8"
Jul 17 20:06:47.815885 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:06:47.815863    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cb4aef12-4a25-467b-8166-93351e924785-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dl5x8\" (UID: \"cb4aef12-4a25-467b-8166-93351e924785\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dl5x8"
Jul 17 20:06:47.816225 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:06:47.816208    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cb4aef12-4a25-467b-8166-93351e924785-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dl5x8\" (UID: \"cb4aef12-4a25-467b-8166-93351e924785\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dl5x8"
Jul 17 20:06:47.821339 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:06:47.821311    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c627v\" (UniqueName: \"kubernetes.io/projected/cb4aef12-4a25-467b-8166-93351e924785-kube-api-access-c627v\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dl5x8\" (UID: \"cb4aef12-4a25-467b-8166-93351e924785\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dl5x8"
Jul 17 20:06:47.889238 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:06:47.889171    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dl5x8"
Jul 17 20:06:48.023402 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:06:48.023374    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-dl5x8"]
Jul 17 20:06:48.025493 ip-10-0-141-177 kubenswrapper[2572]: W0717 20:06:48.025466    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb4aef12_4a25_467b_8166_93351e924785.slice/crio-f1f4be15b4a6b152a2595eac11a9a7622811c1541155cbf221e9f8d813a30a02 WatchSource:0}: Error finding container f1f4be15b4a6b152a2595eac11a9a7622811c1541155cbf221e9f8d813a30a02: Status 404 returned error can't find the container with id f1f4be15b4a6b152a2595eac11a9a7622811c1541155cbf221e9f8d813a30a02
Jul 17 20:06:48.666551 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:06:48.666511    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dl5x8" event={"ID":"cb4aef12-4a25-467b-8166-93351e924785","Type":"ContainerStarted","Data":"9c56039637e98b63ced78fcaf65de5816b0ae881ec97ab720443144ffc3f3773"}
Jul 17 20:06:48.666951 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:06:48.666567    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dl5x8" event={"ID":"cb4aef12-4a25-467b-8166-93351e924785","Type":"ContainerStarted","Data":"f1f4be15b4a6b152a2595eac11a9a7622811c1541155cbf221e9f8d813a30a02"}
Jul 17 20:06:48.683796 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:06:48.683743    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dl5x8" podStartSLOduration=1.510377686 podStartE2EDuration="1.683727262s" totalImagesPullingTime="173.349576ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 20:06:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 20:06:48.682416173 +0000 UTC m=+633.523911834" watchObservedRunningTime="2026-07-17 20:06:48.683727262 +0000 UTC m=+633.525222950"
Jul 17 20:06:51.985625 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:06:51.985586    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2h8vp"
Jul 17 20:06:51.986110 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:06:51.985654    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2h8vp"
Jul 17 20:06:51.998473 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:06:51.998451    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2h8vp"
Jul 17 20:06:52.696992 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:06:52.696965    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2h8vp"
Jul 17 20:06:54.112111 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:06:54.112085    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:06:57.889884 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:06:57.889825    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dl5x8"
Jul 17 20:06:57.890362 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:06:57.889940    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dl5x8"
Jul 17 20:06:57.902674 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:06:57.902649    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dl5x8"
Jul 17 20:06:58.726462 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:06:58.726433    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dl5x8"
Jul 17 20:07:18.963600 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:07:18.963563    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:07:19.389346 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:07:19.389312    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbxlx28"]
Jul 17 20:07:19.395887 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:07:19.395855    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbxlx28"
Jul 17 20:07:19.398530 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:07:19.398503    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jul 17 20:07:19.404524 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:07:19.404498    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbxlx28"]
Jul 17 20:07:19.488275 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:07:19.488246    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:07:19.507964 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:07:19.507938    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/93792ed5-d76a-434a-bd42-546afe5467e3-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbxlx28\" (UID: \"93792ed5-d76a-434a-bd42-546afe5467e3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbxlx28"
Jul 17 20:07:19.508149 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:07:19.507988    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/93792ed5-d76a-434a-bd42-546afe5467e3-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbxlx28\" (UID: \"93792ed5-d76a-434a-bd42-546afe5467e3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbxlx28"
Jul 17 20:07:19.508149 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:07:19.508019    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/93792ed5-d76a-434a-bd42-546afe5467e3-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbxlx28\" (UID: \"93792ed5-d76a-434a-bd42-546afe5467e3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbxlx28"
Jul 17 20:07:19.508149 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:07:19.508038    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dgf2r\" (UniqueName: \"kubernetes.io/projected/93792ed5-d76a-434a-bd42-546afe5467e3-kube-api-access-dgf2r\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbxlx28\" (UID: \"93792ed5-d76a-434a-bd42-546afe5467e3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbxlx28"
Jul 17 20:07:19.508149 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:07:19.508062    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/93792ed5-d76a-434a-bd42-546afe5467e3-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbxlx28\" (UID: \"93792ed5-d76a-434a-bd42-546afe5467e3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbxlx28"
Jul 17 20:07:19.508308 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:07:19.508184    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/93792ed5-d76a-434a-bd42-546afe5467e3-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbxlx28\" (UID: \"93792ed5-d76a-434a-bd42-546afe5467e3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbxlx28"
Jul 17 20:07:19.608888 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:07:19.608852    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/93792ed5-d76a-434a-bd42-546afe5467e3-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbxlx28\" (UID: \"93792ed5-d76a-434a-bd42-546afe5467e3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbxlx28"
Jul 17 20:07:19.609091 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:07:19.608910    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/93792ed5-d76a-434a-bd42-546afe5467e3-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbxlx28\" (UID: \"93792ed5-d76a-434a-bd42-546afe5467e3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbxlx28"
Jul 17 20:07:19.609091 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:07:19.608945    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/93792ed5-d76a-434a-bd42-546afe5467e3-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbxlx28\" (UID: \"93792ed5-d76a-434a-bd42-546afe5467e3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbxlx28"
Jul 17 20:07:19.609091 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:07:19.608990    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/93792ed5-d76a-434a-bd42-546afe5467e3-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbxlx28\" (UID: \"93792ed5-d76a-434a-bd42-546afe5467e3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbxlx28"
Jul 17 20:07:19.609091 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:07:19.609053    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/93792ed5-d76a-434a-bd42-546afe5467e3-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbxlx28\" (UID: \"93792ed5-d76a-434a-bd42-546afe5467e3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbxlx28"
Jul 17 20:07:19.609321 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:07:19.609123    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dgf2r\" (UniqueName: \"kubernetes.io/projected/93792ed5-d76a-434a-bd42-546afe5467e3-kube-api-access-dgf2r\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbxlx28\" (UID: \"93792ed5-d76a-434a-bd42-546afe5467e3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbxlx28"
Jul 17 20:07:19.609427 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:07:19.609399    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/93792ed5-d76a-434a-bd42-546afe5467e3-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbxlx28\" (UID: \"93792ed5-d76a-434a-bd42-546afe5467e3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbxlx28"
Jul 17 20:07:19.609552 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:07:19.609447    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/93792ed5-d76a-434a-bd42-546afe5467e3-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbxlx28\" (UID: \"93792ed5-d76a-434a-bd42-546afe5467e3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbxlx28"
Jul 17 20:07:19.609552 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:07:19.609504    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/93792ed5-d76a-434a-bd42-546afe5467e3-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbxlx28\" (UID: \"93792ed5-d76a-434a-bd42-546afe5467e3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbxlx28"
Jul 17 20:07:19.611361 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:07:19.611342    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/93792ed5-d76a-434a-bd42-546afe5467e3-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbxlx28\" (UID: \"93792ed5-d76a-434a-bd42-546afe5467e3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbxlx28"
Jul 17 20:07:19.611546 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:07:19.611530    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/93792ed5-d76a-434a-bd42-546afe5467e3-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbxlx28\" (UID: \"93792ed5-d76a-434a-bd42-546afe5467e3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbxlx28"
Jul 17 20:07:19.616710 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:07:19.616687    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dgf2r\" (UniqueName: \"kubernetes.io/projected/93792ed5-d76a-434a-bd42-546afe5467e3-kube-api-access-dgf2r\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbxlx28\" (UID: \"93792ed5-d76a-434a-bd42-546afe5467e3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbxlx28"
Jul 17 20:07:19.706850 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:07:19.706770    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbxlx28"
Jul 17 20:07:19.838242 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:07:19.838217    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbxlx28"]
Jul 17 20:07:19.839738 ip-10-0-141-177 kubenswrapper[2572]: W0717 20:07:19.839715    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93792ed5_d76a_434a_bd42_546afe5467e3.slice/crio-0d5ebcb0b1abfc8787a47edc34770c7f0acc8283a05a073dc43621d5051e593b WatchSource:0}: Error finding container 0d5ebcb0b1abfc8787a47edc34770c7f0acc8283a05a073dc43621d5051e593b: Status 404 returned error can't find the container with id 0d5ebcb0b1abfc8787a47edc34770c7f0acc8283a05a073dc43621d5051e593b
Jul 17 20:07:20.828200 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:07:20.828164    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbxlx28" event={"ID":"93792ed5-d76a-434a-bd42-546afe5467e3","Type":"ContainerStarted","Data":"eec05023b76ab70db72eefe760075804ce5abb260c299a8a685e4578ceb99c1f"}
Jul 17 20:07:20.828708 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:07:20.828225    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbxlx28" event={"ID":"93792ed5-d76a-434a-bd42-546afe5467e3","Type":"ContainerStarted","Data":"0d5ebcb0b1abfc8787a47edc34770c7f0acc8283a05a073dc43621d5051e593b"}
Jul 17 20:07:20.844746 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:07:20.844699    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbxlx28" podStartSLOduration=1.66467147 podStartE2EDuration="1.844684967s" totalImagesPullingTime="180.013497ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 20:07:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 20:07:20.843766827 +0000 UTC m=+665.685262483" watchObservedRunningTime="2026-07-17 20:07:20.844684967 +0000 UTC m=+665.686180603"
Jul 17 20:07:29.707147 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:07:29.707113    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbxlx28"
Jul 17 20:07:29.707578 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:07:29.707166    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbxlx28"
Jul 17 20:07:29.719682 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:07:29.719651    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbxlx28"
Jul 17 20:07:29.886358 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:07:29.886331    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbxlx28"
Jul 17 20:07:30.476357 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:07:30.476330    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:07:44.622139 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:07:44.622094    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:08:18.275611 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:08:18.275511    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:08:29.742948 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:08:29.742911    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:09:02.187090 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:09:02.187030    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:09:02.293513 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:09:02.293480    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:09:03.303047 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:09:03.303015    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:09:03.387612 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:09:03.387580    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:09:48.055088 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:09:48.054999    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-587c8b5647-xnl5t"]
Jul 17 20:09:48.055587 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:09:48.055221    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-587c8b5647-xnl5t" podUID="2d9638d8-1c6a-427e-a9b2-0398c0fda9b8" containerName="manager" containerID="cri-o://c80eccb784e97b459a6c4ee29c8b65698d8a398c44d6906252dc8a94d38d0ed2" gracePeriod=30
Jul 17 20:09:48.308710 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:09:48.308654    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-587c8b5647-xnl5t"
Jul 17 20:09:48.414578 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:09:48.414540    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2d9638d8-1c6a-427e-a9b2-0398c0fda9b8-webhook-cert\") pod \"2d9638d8-1c6a-427e-a9b2-0398c0fda9b8\" (UID: \"2d9638d8-1c6a-427e-a9b2-0398c0fda9b8\") "
Jul 17 20:09:48.414762 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:09:48.414624    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bz8dr\" (UniqueName: \"kubernetes.io/projected/2d9638d8-1c6a-427e-a9b2-0398c0fda9b8-kube-api-access-bz8dr\") pod \"2d9638d8-1c6a-427e-a9b2-0398c0fda9b8\" (UID: \"2d9638d8-1c6a-427e-a9b2-0398c0fda9b8\") "
Jul 17 20:09:48.416630 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:09:48.416597    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2d9638d8-1c6a-427e-a9b2-0398c0fda9b8-kube-api-access-bz8dr" (OuterVolumeSpecName: "kube-api-access-bz8dr") pod "2d9638d8-1c6a-427e-a9b2-0398c0fda9b8" (UID: "2d9638d8-1c6a-427e-a9b2-0398c0fda9b8"). InnerVolumeSpecName "kube-api-access-bz8dr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 20:09:48.416630 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:09:48.416610    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2d9638d8-1c6a-427e-a9b2-0398c0fda9b8-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "2d9638d8-1c6a-427e-a9b2-0398c0fda9b8" (UID: "2d9638d8-1c6a-427e-a9b2-0398c0fda9b8"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 20:09:48.516453 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:09:48.516416    2572 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2d9638d8-1c6a-427e-a9b2-0398c0fda9b8-webhook-cert\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Jul 17 20:09:48.516453 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:09:48.516448    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bz8dr\" (UniqueName: \"kubernetes.io/projected/2d9638d8-1c6a-427e-a9b2-0398c0fda9b8-kube-api-access-bz8dr\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Jul 17 20:09:48.559637 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:09:48.559554    2572 generic.go:356] "Generic (PLEG): container finished" podID="2d9638d8-1c6a-427e-a9b2-0398c0fda9b8" containerID="c80eccb784e97b459a6c4ee29c8b65698d8a398c44d6906252dc8a94d38d0ed2" exitCode=0
Jul 17 20:09:48.559637 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:09:48.559604    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-587c8b5647-xnl5t"
Jul 17 20:09:48.559840 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:09:48.559634    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-587c8b5647-xnl5t" event={"ID":"2d9638d8-1c6a-427e-a9b2-0398c0fda9b8","Type":"ContainerDied","Data":"c80eccb784e97b459a6c4ee29c8b65698d8a398c44d6906252dc8a94d38d0ed2"}
Jul 17 20:09:48.559840 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:09:48.559686    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-587c8b5647-xnl5t" event={"ID":"2d9638d8-1c6a-427e-a9b2-0398c0fda9b8","Type":"ContainerDied","Data":"79dcaa4375e0a3b47903f9ee44806cd73d525d87dac1b52faae9cbdc8695d849"}
Jul 17 20:09:48.559840 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:09:48.559708    2572 scope.go:117] "RemoveContainer" containerID="c80eccb784e97b459a6c4ee29c8b65698d8a398c44d6906252dc8a94d38d0ed2"
Jul 17 20:09:48.569213 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:09:48.569196    2572 scope.go:117] "RemoveContainer" containerID="c80eccb784e97b459a6c4ee29c8b65698d8a398c44d6906252dc8a94d38d0ed2"
Jul 17 20:09:48.569446 ip-10-0-141-177 kubenswrapper[2572]: E0717 20:09:48.569426    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c80eccb784e97b459a6c4ee29c8b65698d8a398c44d6906252dc8a94d38d0ed2\": container with ID starting with c80eccb784e97b459a6c4ee29c8b65698d8a398c44d6906252dc8a94d38d0ed2 not found: ID does not exist" containerID="c80eccb784e97b459a6c4ee29c8b65698d8a398c44d6906252dc8a94d38d0ed2"
Jul 17 20:09:48.569489 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:09:48.569454    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c80eccb784e97b459a6c4ee29c8b65698d8a398c44d6906252dc8a94d38d0ed2"} err="failed to get container status \"c80eccb784e97b459a6c4ee29c8b65698d8a398c44d6906252dc8a94d38d0ed2\": rpc error: code = NotFound desc = could not find container \"c80eccb784e97b459a6c4ee29c8b65698d8a398c44d6906252dc8a94d38d0ed2\": container with ID starting with c80eccb784e97b459a6c4ee29c8b65698d8a398c44d6906252dc8a94d38d0ed2 not found: ID does not exist"
Jul 17 20:09:48.581403 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:09:48.581384    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-587c8b5647-xnl5t"]
Jul 17 20:09:48.585406 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:09:48.585385    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-587c8b5647-xnl5t"]
Jul 17 20:09:49.688171 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:09:49.688134    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2d9638d8-1c6a-427e-a9b2-0398c0fda9b8" path="/var/lib/kubelet/pods/2d9638d8-1c6a-427e-a9b2-0398c0fda9b8/volumes"
Jul 17 20:10:32.391202 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:10:32.391164    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:10:49.353839 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:10:49.353800    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-587c8b5647-wxttl"]
Jul 17 20:10:49.354258 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:10:49.354245    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d9638d8-1c6a-427e-a9b2-0398c0fda9b8" containerName="manager"
Jul 17 20:10:49.354311 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:10:49.354260    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d9638d8-1c6a-427e-a9b2-0398c0fda9b8" containerName="manager"
Jul 17 20:10:49.354351 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:10:49.354321    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="2d9638d8-1c6a-427e-a9b2-0398c0fda9b8" containerName="manager"
Jul 17 20:10:49.357204 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:10:49.357187    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-587c8b5647-wxttl"
Jul 17 20:10:49.360472 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:10:49.360454    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-4shb5\""
Jul 17 20:10:49.360600 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:10:49.360482    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 17 20:10:49.360600 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:10:49.360459    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 17 20:10:49.364585 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:10:49.364560    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-587c8b5647-wxttl"]
Jul 17 20:10:49.489706 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:10:49.489669    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4fce90d3-4095-4627-a5bb-eb680e4a734b-webhook-cert\") pod \"maas-controller-587c8b5647-wxttl\" (UID: \"4fce90d3-4095-4627-a5bb-eb680e4a734b\") " pod="opendatahub/maas-controller-587c8b5647-wxttl"
Jul 17 20:10:49.489881 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:10:49.489817    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rwllw\" (UniqueName: \"kubernetes.io/projected/4fce90d3-4095-4627-a5bb-eb680e4a734b-kube-api-access-rwllw\") pod \"maas-controller-587c8b5647-wxttl\" (UID: \"4fce90d3-4095-4627-a5bb-eb680e4a734b\") " pod="opendatahub/maas-controller-587c8b5647-wxttl"
Jul 17 20:10:49.590714 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:10:49.590679    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rwllw\" (UniqueName: \"kubernetes.io/projected/4fce90d3-4095-4627-a5bb-eb680e4a734b-kube-api-access-rwllw\") pod \"maas-controller-587c8b5647-wxttl\" (UID: \"4fce90d3-4095-4627-a5bb-eb680e4a734b\") " pod="opendatahub/maas-controller-587c8b5647-wxttl"
Jul 17 20:10:49.590859 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:10:49.590738    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4fce90d3-4095-4627-a5bb-eb680e4a734b-webhook-cert\") pod \"maas-controller-587c8b5647-wxttl\" (UID: \"4fce90d3-4095-4627-a5bb-eb680e4a734b\") " pod="opendatahub/maas-controller-587c8b5647-wxttl"
Jul 17 20:10:49.593299 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:10:49.593274    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4fce90d3-4095-4627-a5bb-eb680e4a734b-webhook-cert\") pod \"maas-controller-587c8b5647-wxttl\" (UID: \"4fce90d3-4095-4627-a5bb-eb680e4a734b\") " pod="opendatahub/maas-controller-587c8b5647-wxttl"
Jul 17 20:10:49.600370 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:10:49.600351    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rwllw\" (UniqueName: \"kubernetes.io/projected/4fce90d3-4095-4627-a5bb-eb680e4a734b-kube-api-access-rwllw\") pod \"maas-controller-587c8b5647-wxttl\" (UID: \"4fce90d3-4095-4627-a5bb-eb680e4a734b\") " pod="opendatahub/maas-controller-587c8b5647-wxttl"
Jul 17 20:10:49.668409 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:10:49.668346    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-587c8b5647-wxttl"
Jul 17 20:10:50.019917 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:10:50.019883    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-587c8b5647-wxttl"]
Jul 17 20:10:50.025213 ip-10-0-141-177 kubenswrapper[2572]: W0717 20:10:50.025183    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4fce90d3_4095_4627_a5bb_eb680e4a734b.slice/crio-5b3917bb5f4ec6782c30c5b2473622fbcb0c0aee20f4b30c67a481e2226629f8 WatchSource:0}: Error finding container 5b3917bb5f4ec6782c30c5b2473622fbcb0c0aee20f4b30c67a481e2226629f8: Status 404 returned error can't find the container with id 5b3917bb5f4ec6782c30c5b2473622fbcb0c0aee20f4b30c67a481e2226629f8
Jul 17 20:10:50.870636 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:10:50.870550    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-587c8b5647-wxttl" event={"ID":"4fce90d3-4095-4627-a5bb-eb680e4a734b","Type":"ContainerStarted","Data":"128d19aa87982a68c07a8a50a33426c76f7f81412b779f28a2e84009c94ff041"}
Jul 17 20:10:50.870636 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:10:50.870625    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-587c8b5647-wxttl" event={"ID":"4fce90d3-4095-4627-a5bb-eb680e4a734b","Type":"ContainerStarted","Data":"5b3917bb5f4ec6782c30c5b2473622fbcb0c0aee20f4b30c67a481e2226629f8"}
Jul 17 20:10:50.871029 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:10:50.870705    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-587c8b5647-wxttl"
Jul 17 20:10:50.888052 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:10:50.887998    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-587c8b5647-wxttl" podStartSLOduration=1.416987881 podStartE2EDuration="1.887979588s" totalImagesPullingTime="470.991707ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 20:10:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 20:10:50.886030927 +0000 UTC m=+875.727526575" watchObservedRunningTime="2026-07-17 20:10:50.887979588 +0000 UTC m=+875.729475247"
Jul 17 20:11:01.878209 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:11:01.878179    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-587c8b5647-wxttl"
Jul 17 20:11:06.377293 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:11:06.377261    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:11:06.479760 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:11:06.479723    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-587c8b5647-wxttl"]
Jul 17 20:11:06.479933 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:11:06.479904    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-587c8b5647-wxttl" podUID="4fce90d3-4095-4627-a5bb-eb680e4a734b" containerName="manager" containerID="cri-o://128d19aa87982a68c07a8a50a33426c76f7f81412b779f28a2e84009c94ff041" gracePeriod=30
Jul 17 20:11:06.734716 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:11:06.734693    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-587c8b5647-wxttl"
Jul 17 20:11:06.847927 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:11:06.847896    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4fce90d3-4095-4627-a5bb-eb680e4a734b-webhook-cert\") pod \"4fce90d3-4095-4627-a5bb-eb680e4a734b\" (UID: \"4fce90d3-4095-4627-a5bb-eb680e4a734b\") "
Jul 17 20:11:06.848143 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:11:06.847946    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rwllw\" (UniqueName: \"kubernetes.io/projected/4fce90d3-4095-4627-a5bb-eb680e4a734b-kube-api-access-rwllw\") pod \"4fce90d3-4095-4627-a5bb-eb680e4a734b\" (UID: \"4fce90d3-4095-4627-a5bb-eb680e4a734b\") "
Jul 17 20:11:06.849877 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:11:06.849853    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4fce90d3-4095-4627-a5bb-eb680e4a734b-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "4fce90d3-4095-4627-a5bb-eb680e4a734b" (UID: "4fce90d3-4095-4627-a5bb-eb680e4a734b"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 20:11:06.849961 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:11:06.849887    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4fce90d3-4095-4627-a5bb-eb680e4a734b-kube-api-access-rwllw" (OuterVolumeSpecName: "kube-api-access-rwllw") pod "4fce90d3-4095-4627-a5bb-eb680e4a734b" (UID: "4fce90d3-4095-4627-a5bb-eb680e4a734b"). InnerVolumeSpecName "kube-api-access-rwllw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 20:11:06.949728 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:11:06.949658    2572 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4fce90d3-4095-4627-a5bb-eb680e4a734b-webhook-cert\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Jul 17 20:11:06.949728 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:11:06.949683    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rwllw\" (UniqueName: \"kubernetes.io/projected/4fce90d3-4095-4627-a5bb-eb680e4a734b-kube-api-access-rwllw\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Jul 17 20:11:06.959776 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:11:06.959747    2572 generic.go:356] "Generic (PLEG): container finished" podID="4fce90d3-4095-4627-a5bb-eb680e4a734b" containerID="128d19aa87982a68c07a8a50a33426c76f7f81412b779f28a2e84009c94ff041" exitCode=0
Jul 17 20:11:06.959889 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:11:06.959789    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-587c8b5647-wxttl"
Jul 17 20:11:06.959889 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:11:06.959838    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-587c8b5647-wxttl" event={"ID":"4fce90d3-4095-4627-a5bb-eb680e4a734b","Type":"ContainerDied","Data":"128d19aa87982a68c07a8a50a33426c76f7f81412b779f28a2e84009c94ff041"}
Jul 17 20:11:06.959889 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:11:06.959886    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-587c8b5647-wxttl" event={"ID":"4fce90d3-4095-4627-a5bb-eb680e4a734b","Type":"ContainerDied","Data":"5b3917bb5f4ec6782c30c5b2473622fbcb0c0aee20f4b30c67a481e2226629f8"}
Jul 17 20:11:06.960019 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:11:06.959907    2572 scope.go:117] "RemoveContainer" containerID="128d19aa87982a68c07a8a50a33426c76f7f81412b779f28a2e84009c94ff041"
Jul 17 20:11:06.968834 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:11:06.968814    2572 scope.go:117] "RemoveContainer" containerID="128d19aa87982a68c07a8a50a33426c76f7f81412b779f28a2e84009c94ff041"
Jul 17 20:11:06.969052 ip-10-0-141-177 kubenswrapper[2572]: E0717 20:11:06.969034    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"128d19aa87982a68c07a8a50a33426c76f7f81412b779f28a2e84009c94ff041\": container with ID starting with 128d19aa87982a68c07a8a50a33426c76f7f81412b779f28a2e84009c94ff041 not found: ID does not exist" containerID="128d19aa87982a68c07a8a50a33426c76f7f81412b779f28a2e84009c94ff041"
Jul 17 20:11:06.969140 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:11:06.969059    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"128d19aa87982a68c07a8a50a33426c76f7f81412b779f28a2e84009c94ff041"} err="failed to get container status \"128d19aa87982a68c07a8a50a33426c76f7f81412b779f28a2e84009c94ff041\": rpc error: code = NotFound desc = could not find container \"128d19aa87982a68c07a8a50a33426c76f7f81412b779f28a2e84009c94ff041\": container with ID starting with 128d19aa87982a68c07a8a50a33426c76f7f81412b779f28a2e84009c94ff041 not found: ID does not exist"
Jul 17 20:11:06.980229 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:11:06.980209    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-587c8b5647-wxttl"]
Jul 17 20:11:06.983540 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:11:06.983521    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-587c8b5647-wxttl"]
Jul 17 20:11:07.631525 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:11:07.631490    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:11:07.687414 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:11:07.687385    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4fce90d3-4095-4627-a5bb-eb680e4a734b" path="/var/lib/kubelet/pods/4fce90d3-4095-4627-a5bb-eb680e4a734b/volumes"
Jul 17 20:11:07.736627 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:11:07.736597    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-587c8b5647-6q4z2"]
Jul 17 20:11:07.736977 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:11:07.736965    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4fce90d3-4095-4627-a5bb-eb680e4a734b" containerName="manager"
Jul 17 20:11:07.737026 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:11:07.736979    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="4fce90d3-4095-4627-a5bb-eb680e4a734b" containerName="manager"
Jul 17 20:11:07.737099 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:11:07.737089    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="4fce90d3-4095-4627-a5bb-eb680e4a734b" containerName="manager"
Jul 17 20:11:07.741388 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:11:07.741373    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-587c8b5647-6q4z2"
Jul 17 20:11:07.744572 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:11:07.744548    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-4shb5\""
Jul 17 20:11:07.744708 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:11:07.744601    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 17 20:11:07.744860 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:11:07.744840    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 17 20:11:07.758747 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:11:07.758725    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-587c8b5647-6q4z2"]
Jul 17 20:11:07.859175 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:11:07.859103    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l4794\" (UniqueName: \"kubernetes.io/projected/0f2a06e4-1a7f-4ac5-8e81-f5f531c8a405-kube-api-access-l4794\") pod \"maas-controller-587c8b5647-6q4z2\" (UID: \"0f2a06e4-1a7f-4ac5-8e81-f5f531c8a405\") " pod="opendatahub/maas-controller-587c8b5647-6q4z2"
Jul 17 20:11:07.859175 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:11:07.859140    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0f2a06e4-1a7f-4ac5-8e81-f5f531c8a405-webhook-cert\") pod \"maas-controller-587c8b5647-6q4z2\" (UID: \"0f2a06e4-1a7f-4ac5-8e81-f5f531c8a405\") " pod="opendatahub/maas-controller-587c8b5647-6q4z2"
Jul 17 20:11:07.960718 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:11:07.960687    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l4794\" (UniqueName: \"kubernetes.io/projected/0f2a06e4-1a7f-4ac5-8e81-f5f531c8a405-kube-api-access-l4794\") pod \"maas-controller-587c8b5647-6q4z2\" (UID: \"0f2a06e4-1a7f-4ac5-8e81-f5f531c8a405\") " pod="opendatahub/maas-controller-587c8b5647-6q4z2"
Jul 17 20:11:07.960718 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:11:07.960722    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0f2a06e4-1a7f-4ac5-8e81-f5f531c8a405-webhook-cert\") pod \"maas-controller-587c8b5647-6q4z2\" (UID: \"0f2a06e4-1a7f-4ac5-8e81-f5f531c8a405\") " pod="opendatahub/maas-controller-587c8b5647-6q4z2"
Jul 17 20:11:07.963007 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:11:07.962981    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0f2a06e4-1a7f-4ac5-8e81-f5f531c8a405-webhook-cert\") pod \"maas-controller-587c8b5647-6q4z2\" (UID: \"0f2a06e4-1a7f-4ac5-8e81-f5f531c8a405\") " pod="opendatahub/maas-controller-587c8b5647-6q4z2"
Jul 17 20:11:07.969304 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:11:07.969283    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l4794\" (UniqueName: \"kubernetes.io/projected/0f2a06e4-1a7f-4ac5-8e81-f5f531c8a405-kube-api-access-l4794\") pod \"maas-controller-587c8b5647-6q4z2\" (UID: \"0f2a06e4-1a7f-4ac5-8e81-f5f531c8a405\") " pod="opendatahub/maas-controller-587c8b5647-6q4z2"
Jul 17 20:11:08.058327 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:11:08.058304    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-587c8b5647-6q4z2"
Jul 17 20:11:08.194744 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:11:08.194722    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-587c8b5647-6q4z2"]
Jul 17 20:11:08.196248 ip-10-0-141-177 kubenswrapper[2572]: W0717 20:11:08.196219    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f2a06e4_1a7f_4ac5_8e81_f5f531c8a405.slice/crio-bf7e390635896211362b5c1b13dd3b02319776ffaeade3d278501fb09a3af926 WatchSource:0}: Error finding container bf7e390635896211362b5c1b13dd3b02319776ffaeade3d278501fb09a3af926: Status 404 returned error can't find the container with id bf7e390635896211362b5c1b13dd3b02319776ffaeade3d278501fb09a3af926
Jul 17 20:11:08.971465 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:11:08.971369    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-587c8b5647-6q4z2" event={"ID":"0f2a06e4-1a7f-4ac5-8e81-f5f531c8a405","Type":"ContainerStarted","Data":"b0f7240f676bfaa6faa03644ce816396cfe76ee37b513d77ff809c3dfe8db088"}
Jul 17 20:11:08.971465 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:11:08.971429    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-587c8b5647-6q4z2" event={"ID":"0f2a06e4-1a7f-4ac5-8e81-f5f531c8a405","Type":"ContainerStarted","Data":"bf7e390635896211362b5c1b13dd3b02319776ffaeade3d278501fb09a3af926"}
Jul 17 20:11:08.971465 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:11:08.971460    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-587c8b5647-6q4z2"
Jul 17 20:11:08.991697 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:11:08.991646    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-587c8b5647-6q4z2" podStartSLOduration=1.556441812 podStartE2EDuration="1.991629893s" totalImagesPullingTime="435.188081ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 20:11:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 20:11:08.989381373 +0000 UTC m=+893.830877010" watchObservedRunningTime="2026-07-17 20:11:08.991629893 +0000 UTC m=+893.833125530"
Jul 17 20:11:19.978598 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:11:19.978561    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-587c8b5647-6q4z2"
Jul 17 20:11:33.277921 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:11:33.277887    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:11:43.018646 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:11:43.018612    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:11:43.122510 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:11:43.122467    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:11:43.316526 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:11:43.316438    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:11:49.517336 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:11:49.517305    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:11:49.622557 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:11:49.622515    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:11:49.719184 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:11:49.719154    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:11:49.940131 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:11:49.940023    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:11:56.213160 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:11:56.213122    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:11:56.310978 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:11:56.310944    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:12:22.149245 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:12:22.149166    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:12:42.235441 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:12:42.235362    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:12:42.336178 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:12:42.336147    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:14:16.953317 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:14:16.953241    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:14:17.041961 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:14:17.041927    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:15:42.134480 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:15:42.134395    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:16:51.663300 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:16:51.663270    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:19:35.766538 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:19:35.766506    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:19:35.817809 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:19:35.817780    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:21:40.095298 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:21:40.095221    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:22:15.384710 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:22:15.384660    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:22:31.097907 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:22:31.097861    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:22:32.226419 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:22:32.226385    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:22:41.715521 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:22:41.715488    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:22:49.984705 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:22:49.984668    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:22:55.055324 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:22:55.055288    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:22:57.899029 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:22:57.898994    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:22:57.995953 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:22:57.995921    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:22:58.326315 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:22:58.326284    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:23:03.964389 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:23:03.964353    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:23:04.065122 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:23:04.065092    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:23:04.140409 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:23:04.140375    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-5420d171-openshift-default-f49dfb5c5-rw6hq"]
Jul 17 20:23:04.144525 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:23:04.144507    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-5420d171-openshift-default-f49dfb5c5-rw6hq"
Jul 17 20:23:04.147432 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:23:04.147406    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-5420d171-openshift-default-dockercfg-mtkg2\""
Jul 17 20:23:04.166723 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:23:04.166703    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-5420d171-openshift-default-f49dfb5c5-rw6hq"]
Jul 17 20:23:04.168228 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:23:04.168200    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:23:04.268196 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:23:04.268163    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:23:04.308367 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:23:04.308339    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3900dba8-8e73-4e48-82f6-63da768e8014-istio-podinfo\") pod \"e2e-ait-5420d171-openshift-default-f49dfb5c5-rw6hq\" (UID: \"3900dba8-8e73-4e48-82f6-63da768e8014\") " pod="openshift-ingress/e2e-ait-5420d171-openshift-default-f49dfb5c5-rw6hq"
Jul 17 20:23:04.308503 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:23:04.308395    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c22xf\" (UniqueName: \"kubernetes.io/projected/3900dba8-8e73-4e48-82f6-63da768e8014-kube-api-access-c22xf\") pod \"e2e-ait-5420d171-openshift-default-f49dfb5c5-rw6hq\" (UID: \"3900dba8-8e73-4e48-82f6-63da768e8014\") " pod="openshift-ingress/e2e-ait-5420d171-openshift-default-f49dfb5c5-rw6hq"
Jul 17 20:23:04.308503 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:23:04.308459    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3900dba8-8e73-4e48-82f6-63da768e8014-istio-data\") pod \"e2e-ait-5420d171-openshift-default-f49dfb5c5-rw6hq\" (UID: \"3900dba8-8e73-4e48-82f6-63da768e8014\") " pod="openshift-ingress/e2e-ait-5420d171-openshift-default-f49dfb5c5-rw6hq"
Jul 17 20:23:04.308573 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:23:04.308504    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3900dba8-8e73-4e48-82f6-63da768e8014-istiod-ca-cert\") pod \"e2e-ait-5420d171-openshift-default-f49dfb5c5-rw6hq\" (UID: \"3900dba8-8e73-4e48-82f6-63da768e8014\") " pod="openshift-ingress/e2e-ait-5420d171-openshift-default-f49dfb5c5-rw6hq"
Jul 17 20:23:04.308573 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:23:04.308526    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3900dba8-8e73-4e48-82f6-63da768e8014-credential-socket\") pod \"e2e-ait-5420d171-openshift-default-f49dfb5c5-rw6hq\" (UID: \"3900dba8-8e73-4e48-82f6-63da768e8014\") " pod="openshift-ingress/e2e-ait-5420d171-openshift-default-f49dfb5c5-rw6hq"
Jul 17 20:23:04.308573 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:23:04.308544    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3900dba8-8e73-4e48-82f6-63da768e8014-workload-socket\") pod \"e2e-ait-5420d171-openshift-default-f49dfb5c5-rw6hq\" (UID: \"3900dba8-8e73-4e48-82f6-63da768e8014\") " pod="openshift-ingress/e2e-ait-5420d171-openshift-default-f49dfb5c5-rw6hq"
Jul 17 20:23:04.308668 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:23:04.308634    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3900dba8-8e73-4e48-82f6-63da768e8014-istio-envoy\") pod \"e2e-ait-5420d171-openshift-default-f49dfb5c5-rw6hq\" (UID: \"3900dba8-8e73-4e48-82f6-63da768e8014\") " pod="openshift-ingress/e2e-ait-5420d171-openshift-default-f49dfb5c5-rw6hq"
Jul 17 20:23:04.308668 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:23:04.308655    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3900dba8-8e73-4e48-82f6-63da768e8014-workload-certs\") pod \"e2e-ait-5420d171-openshift-default-f49dfb5c5-rw6hq\" (UID: \"3900dba8-8e73-4e48-82f6-63da768e8014\") " pod="openshift-ingress/e2e-ait-5420d171-openshift-default-f49dfb5c5-rw6hq"
Jul 17 20:23:04.308734 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:23:04.308723    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3900dba8-8e73-4e48-82f6-63da768e8014-istio-token\") pod \"e2e-ait-5420d171-openshift-default-f49dfb5c5-rw6hq\" (UID: \"3900dba8-8e73-4e48-82f6-63da768e8014\") " pod="openshift-ingress/e2e-ait-5420d171-openshift-default-f49dfb5c5-rw6hq"
Jul 17 20:23:04.409222 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:23:04.409192    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3900dba8-8e73-4e48-82f6-63da768e8014-istio-token\") pod \"e2e-ait-5420d171-openshift-default-f49dfb5c5-rw6hq\" (UID: \"3900dba8-8e73-4e48-82f6-63da768e8014\") " pod="openshift-ingress/e2e-ait-5420d171-openshift-default-f49dfb5c5-rw6hq"
Jul 17 20:23:04.409376 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:23:04.409228    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3900dba8-8e73-4e48-82f6-63da768e8014-istio-podinfo\") pod \"e2e-ait-5420d171-openshift-default-f49dfb5c5-rw6hq\" (UID: \"3900dba8-8e73-4e48-82f6-63da768e8014\") " pod="openshift-ingress/e2e-ait-5420d171-openshift-default-f49dfb5c5-rw6hq"
Jul 17 20:23:04.409376 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:23:04.409284    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c22xf\" (UniqueName: \"kubernetes.io/projected/3900dba8-8e73-4e48-82f6-63da768e8014-kube-api-access-c22xf\") pod \"e2e-ait-5420d171-openshift-default-f49dfb5c5-rw6hq\" (UID: \"3900dba8-8e73-4e48-82f6-63da768e8014\") " pod="openshift-ingress/e2e-ait-5420d171-openshift-default-f49dfb5c5-rw6hq"
Jul 17 20:23:04.409376 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:23:04.409316    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3900dba8-8e73-4e48-82f6-63da768e8014-istio-data\") pod \"e2e-ait-5420d171-openshift-default-f49dfb5c5-rw6hq\" (UID: \"3900dba8-8e73-4e48-82f6-63da768e8014\") " pod="openshift-ingress/e2e-ait-5420d171-openshift-default-f49dfb5c5-rw6hq"
Jul 17 20:23:04.409376 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:23:04.409344    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3900dba8-8e73-4e48-82f6-63da768e8014-istiod-ca-cert\") pod \"e2e-ait-5420d171-openshift-default-f49dfb5c5-rw6hq\" (UID: \"3900dba8-8e73-4e48-82f6-63da768e8014\") " pod="openshift-ingress/e2e-ait-5420d171-openshift-default-f49dfb5c5-rw6hq"
Jul 17 20:23:04.409376 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:23:04.409370    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3900dba8-8e73-4e48-82f6-63da768e8014-credential-socket\") pod \"e2e-ait-5420d171-openshift-default-f49dfb5c5-rw6hq\" (UID: \"3900dba8-8e73-4e48-82f6-63da768e8014\") " pod="openshift-ingress/e2e-ait-5420d171-openshift-default-f49dfb5c5-rw6hq"
Jul 17 20:23:04.409629 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:23:04.409394    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3900dba8-8e73-4e48-82f6-63da768e8014-workload-socket\") pod \"e2e-ait-5420d171-openshift-default-f49dfb5c5-rw6hq\" (UID: \"3900dba8-8e73-4e48-82f6-63da768e8014\") " pod="openshift-ingress/e2e-ait-5420d171-openshift-default-f49dfb5c5-rw6hq"
Jul 17 20:23:04.409629 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:23:04.409513    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3900dba8-8e73-4e48-82f6-63da768e8014-istio-envoy\") pod \"e2e-ait-5420d171-openshift-default-f49dfb5c5-rw6hq\" (UID: \"3900dba8-8e73-4e48-82f6-63da768e8014\") " pod="openshift-ingress/e2e-ait-5420d171-openshift-default-f49dfb5c5-rw6hq"
Jul 17 20:23:04.409629 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:23:04.409581    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3900dba8-8e73-4e48-82f6-63da768e8014-workload-certs\") pod \"e2e-ait-5420d171-openshift-default-f49dfb5c5-rw6hq\" (UID: \"3900dba8-8e73-4e48-82f6-63da768e8014\") " pod="openshift-ingress/e2e-ait-5420d171-openshift-default-f49dfb5c5-rw6hq"
Jul 17 20:23:04.409785 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:23:04.409722    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3900dba8-8e73-4e48-82f6-63da768e8014-istio-data\") pod \"e2e-ait-5420d171-openshift-default-f49dfb5c5-rw6hq\" (UID: \"3900dba8-8e73-4e48-82f6-63da768e8014\") " pod="openshift-ingress/e2e-ait-5420d171-openshift-default-f49dfb5c5-rw6hq"
Jul 17 20:23:04.409785 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:23:04.409771    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3900dba8-8e73-4e48-82f6-63da768e8014-workload-socket\") pod \"e2e-ait-5420d171-openshift-default-f49dfb5c5-rw6hq\" (UID: \"3900dba8-8e73-4e48-82f6-63da768e8014\") " pod="openshift-ingress/e2e-ait-5420d171-openshift-default-f49dfb5c5-rw6hq"
Jul 17 20:23:04.409867 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:23:04.409844    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3900dba8-8e73-4e48-82f6-63da768e8014-credential-socket\") pod \"e2e-ait-5420d171-openshift-default-f49dfb5c5-rw6hq\" (UID: \"3900dba8-8e73-4e48-82f6-63da768e8014\") " pod="openshift-ingress/e2e-ait-5420d171-openshift-default-f49dfb5c5-rw6hq"
Jul 17 20:23:04.409942 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:23:04.409918    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3900dba8-8e73-4e48-82f6-63da768e8014-workload-certs\") pod \"e2e-ait-5420d171-openshift-default-f49dfb5c5-rw6hq\" (UID: \"3900dba8-8e73-4e48-82f6-63da768e8014\") " pod="openshift-ingress/e2e-ait-5420d171-openshift-default-f49dfb5c5-rw6hq"
Jul 17 20:23:04.410213 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:23:04.410191    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3900dba8-8e73-4e48-82f6-63da768e8014-istiod-ca-cert\") pod \"e2e-ait-5420d171-openshift-default-f49dfb5c5-rw6hq\" (UID: \"3900dba8-8e73-4e48-82f6-63da768e8014\") " pod="openshift-ingress/e2e-ait-5420d171-openshift-default-f49dfb5c5-rw6hq"
Jul 17 20:23:04.411848 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:23:04.411825    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3900dba8-8e73-4e48-82f6-63da768e8014-istio-envoy\") pod \"e2e-ait-5420d171-openshift-default-f49dfb5c5-rw6hq\" (UID: \"3900dba8-8e73-4e48-82f6-63da768e8014\") " pod="openshift-ingress/e2e-ait-5420d171-openshift-default-f49dfb5c5-rw6hq"
Jul 17 20:23:04.411935 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:23:04.411919    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3900dba8-8e73-4e48-82f6-63da768e8014-istio-podinfo\") pod \"e2e-ait-5420d171-openshift-default-f49dfb5c5-rw6hq\" (UID: \"3900dba8-8e73-4e48-82f6-63da768e8014\") " pod="openshift-ingress/e2e-ait-5420d171-openshift-default-f49dfb5c5-rw6hq"
Jul 17 20:23:04.416682 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:23:04.416657    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c22xf\" (UniqueName: \"kubernetes.io/projected/3900dba8-8e73-4e48-82f6-63da768e8014-kube-api-access-c22xf\") pod \"e2e-ait-5420d171-openshift-default-f49dfb5c5-rw6hq\" (UID: \"3900dba8-8e73-4e48-82f6-63da768e8014\") " pod="openshift-ingress/e2e-ait-5420d171-openshift-default-f49dfb5c5-rw6hq"
Jul 17 20:23:04.416781 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:23:04.416761    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3900dba8-8e73-4e48-82f6-63da768e8014-istio-token\") pod \"e2e-ait-5420d171-openshift-default-f49dfb5c5-rw6hq\" (UID: \"3900dba8-8e73-4e48-82f6-63da768e8014\") " pod="openshift-ingress/e2e-ait-5420d171-openshift-default-f49dfb5c5-rw6hq"
Jul 17 20:23:04.454600 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:23:04.454577    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-5420d171-openshift-default-f49dfb5c5-rw6hq"
Jul 17 20:23:04.591714 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:23:04.591690    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-5420d171-openshift-default-f49dfb5c5-rw6hq"]
Jul 17 20:23:04.593445 ip-10-0-141-177 kubenswrapper[2572]: W0717 20:23:04.593418    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3900dba8_8e73_4e48_82f6_63da768e8014.slice/crio-f859e01177e73c5de132b8db06e6e73fb19d33539baa603e08eb6952472ebed7 WatchSource:0}: Error finding container f859e01177e73c5de132b8db06e6e73fb19d33539baa603e08eb6952472ebed7: Status 404 returned error can't find the container with id f859e01177e73c5de132b8db06e6e73fb19d33539baa603e08eb6952472ebed7
Jul 17 20:23:04.595543 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:23:04.595509    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 17 20:23:04.595642 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:23:04.595574    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 17 20:23:04.595642 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:23:04.595605    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 17 20:23:05.360905 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:23:05.360874    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:23:05.436966 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:23:05.436929    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-5420d171-7f6d594b7-lhs6f"]
Jul 17 20:23:05.440546 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:23:05.440522    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5420d171-7f6d594b7-lhs6f"
Jul 17 20:23:05.443028 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:23:05.443000    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-5420d171-serving-cert\""
Jul 17 20:23:05.443255 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:23:05.443220    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:23:05.452318 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:23:05.452293    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-5420d171-7f6d594b7-lhs6f"]
Jul 17 20:23:05.498900 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:23:05.498863    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-5420d171-openshift-default-f49dfb5c5-rw6hq" event={"ID":"3900dba8-8e73-4e48-82f6-63da768e8014","Type":"ContainerStarted","Data":"c685fdc2d7ea9719a089c12c68770e4b5bbb356f3771bce009d637ebf018fab7"}
Jul 17 20:23:05.499039 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:23:05.498940    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-5420d171-openshift-default-f49dfb5c5-rw6hq" event={"ID":"3900dba8-8e73-4e48-82f6-63da768e8014","Type":"ContainerStarted","Data":"f859e01177e73c5de132b8db06e6e73fb19d33539baa603e08eb6952472ebed7"}
Jul 17 20:23:05.511508 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:23:05.511478    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:23:05.518101 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:23:05.518046    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-5420d171-openshift-default-f49dfb5c5-rw6hq" podStartSLOduration=1.5180317730000001 podStartE2EDuration="1.518031773s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 20:23:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 20:23:05.516378661 +0000 UTC m=+1610.357874299" watchObservedRunningTime="2026-07-17 20:23:05.518031773 +0000 UTC m=+1610.359527410"
Jul 17 20:23:05.520932 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:23:05.520903    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cafc8ddb-438c-42b2-bfaa-48968198e4af-maas-api-tls\") pod \"maas-api-e2e-ait-5420d171-7f6d594b7-lhs6f\" (UID: \"cafc8ddb-438c-42b2-bfaa-48968198e4af\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-5420d171-7f6d594b7-lhs6f"
Jul 17 20:23:05.521045 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:23:05.520967    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dzzwh\" (UniqueName: \"kubernetes.io/projected/cafc8ddb-438c-42b2-bfaa-48968198e4af-kube-api-access-dzzwh\") pod \"maas-api-e2e-ait-5420d171-7f6d594b7-lhs6f\" (UID: \"cafc8ddb-438c-42b2-bfaa-48968198e4af\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-5420d171-7f6d594b7-lhs6f"
Jul 17 20:23:05.521127 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:23:05.521062    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cafc8ddb-438c-42b2-bfaa-48968198e4af-openshift-service-ca\") pod \"maas-api-e2e-ait-5420d171-7f6d594b7-lhs6f\" (UID: \"cafc8ddb-438c-42b2-bfaa-48968198e4af\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-5420d171-7f6d594b7-lhs6f"
Jul 17 20:23:05.622693 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:23:05.622594    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cafc8ddb-438c-42b2-bfaa-48968198e4af-maas-api-tls\") pod \"maas-api-e2e-ait-5420d171-7f6d594b7-lhs6f\" (UID: \"cafc8ddb-438c-42b2-bfaa-48968198e4af\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-5420d171-7f6d594b7-lhs6f"
Jul 17 20:23:05.622693 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:23:05.622656    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dzzwh\" (UniqueName: \"kubernetes.io/projected/cafc8ddb-438c-42b2-bfaa-48968198e4af-kube-api-access-dzzwh\") pod \"maas-api-e2e-ait-5420d171-7f6d594b7-lhs6f\" (UID: \"cafc8ddb-438c-42b2-bfaa-48968198e4af\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-5420d171-7f6d594b7-lhs6f"
Jul 17 20:23:05.622898 ip-10-0-141-177 kubenswrapper[2572]: E0717 20:23:05.622696    2572 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-5420d171-serving-cert: secret "maas-api-e2e-ait-5420d171-serving-cert" not found
Jul 17 20:23:05.622898 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:23:05.622724    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cafc8ddb-438c-42b2-bfaa-48968198e4af-openshift-service-ca\") pod \"maas-api-e2e-ait-5420d171-7f6d594b7-lhs6f\" (UID: \"cafc8ddb-438c-42b2-bfaa-48968198e4af\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-5420d171-7f6d594b7-lhs6f"
Jul 17 20:23:05.622898 ip-10-0-141-177 kubenswrapper[2572]: E0717 20:23:05.622770    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cafc8ddb-438c-42b2-bfaa-48968198e4af-maas-api-tls podName:cafc8ddb-438c-42b2-bfaa-48968198e4af nodeName:}" failed. No retries permitted until 2026-07-17 20:23:06.122748219 +0000 UTC m=+1610.964243834 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/cafc8ddb-438c-42b2-bfaa-48968198e4af-maas-api-tls") pod "maas-api-e2e-ait-5420d171-7f6d594b7-lhs6f" (UID: "cafc8ddb-438c-42b2-bfaa-48968198e4af") : secret "maas-api-e2e-ait-5420d171-serving-cert" not found
Jul 17 20:23:05.623439 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:23:05.623420    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cafc8ddb-438c-42b2-bfaa-48968198e4af-openshift-service-ca\") pod \"maas-api-e2e-ait-5420d171-7f6d594b7-lhs6f\" (UID: \"cafc8ddb-438c-42b2-bfaa-48968198e4af\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-5420d171-7f6d594b7-lhs6f"
Jul 17 20:23:05.634900 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:23:05.634866    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dzzwh\" (UniqueName: \"kubernetes.io/projected/cafc8ddb-438c-42b2-bfaa-48968198e4af-kube-api-access-dzzwh\") pod \"maas-api-e2e-ait-5420d171-7f6d594b7-lhs6f\" (UID: \"cafc8ddb-438c-42b2-bfaa-48968198e4af\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-5420d171-7f6d594b7-lhs6f"
Jul 17 20:23:05.861107 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:23:05.861058    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:23:06.127803 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:23:06.127767    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cafc8ddb-438c-42b2-bfaa-48968198e4af-maas-api-tls\") pod \"maas-api-e2e-ait-5420d171-7f6d594b7-lhs6f\" (UID: \"cafc8ddb-438c-42b2-bfaa-48968198e4af\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-5420d171-7f6d594b7-lhs6f"
Jul 17 20:23:06.130246 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:23:06.130219    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cafc8ddb-438c-42b2-bfaa-48968198e4af-maas-api-tls\") pod \"maas-api-e2e-ait-5420d171-7f6d594b7-lhs6f\" (UID: \"cafc8ddb-438c-42b2-bfaa-48968198e4af\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-5420d171-7f6d594b7-lhs6f"
Jul 17 20:23:06.143129 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:23:06.143106    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:23:06.244935 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:23:06.244906    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:23:06.353011 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:23:06.352964    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5420d171-7f6d594b7-lhs6f"
Jul 17 20:23:06.454941 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:23:06.454871    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-5420d171-openshift-default-f49dfb5c5-rw6hq"
Jul 17 20:23:06.460260 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:23:06.460237    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-5420d171-openshift-default-f49dfb5c5-rw6hq"
Jul 17 20:23:06.488461 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:23:06.488332    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-5420d171-7f6d594b7-lhs6f"]
Jul 17 20:23:06.491917 ip-10-0-141-177 kubenswrapper[2572]: W0717 20:23:06.491887    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcafc8ddb_438c_42b2_bfaa_48968198e4af.slice/crio-9467cb8c94ce61aeb5a00b7a71ffeb66da4a4b86d2c7e52a2c1175df829c8f7a WatchSource:0}: Error finding container 9467cb8c94ce61aeb5a00b7a71ffeb66da4a4b86d2c7e52a2c1175df829c8f7a: Status 404 returned error can't find the container with id 9467cb8c94ce61aeb5a00b7a71ffeb66da4a4b86d2c7e52a2c1175df829c8f7a
Jul 17 20:23:06.493500 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:23:06.493481    2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 17 20:23:06.505393 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:23:06.505364    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5420d171-7f6d594b7-lhs6f" event={"ID":"cafc8ddb-438c-42b2-bfaa-48968198e4af","Type":"ContainerStarted","Data":"9467cb8c94ce61aeb5a00b7a71ffeb66da4a4b86d2c7e52a2c1175df829c8f7a"}
Jul 17 20:23:06.505576 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:23:06.505563    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-5420d171-openshift-default-f49dfb5c5-rw6hq"
Jul 17 20:23:06.506484 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:23:06.506468    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-5420d171-openshift-default-f49dfb5c5-rw6hq"
Jul 17 20:23:07.511438 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:23:07.511365    2572 generic.go:356] "Generic (PLEG): container finished" podID="cafc8ddb-438c-42b2-bfaa-48968198e4af" containerID="a175108fffbdd293911eeab530fb97a4c709bcfe2919e798d0cdb3058b20d692" exitCode=1
Jul 17 20:23:07.511848 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:23:07.511451    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5420d171-7f6d594b7-lhs6f" event={"ID":"cafc8ddb-438c-42b2-bfaa-48968198e4af","Type":"ContainerDied","Data":"a175108fffbdd293911eeab530fb97a4c709bcfe2919e798d0cdb3058b20d692"}
Jul 17 20:23:07.511848 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:23:07.511651    2572 scope.go:117] "RemoveContainer" containerID="a175108fffbdd293911eeab530fb97a4c709bcfe2919e798d0cdb3058b20d692"
Jul 17 20:23:07.879291 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:23:07.879260    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:23:08.518230 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:23:08.518145    2572 generic.go:356] "Generic (PLEG): container finished" podID="cafc8ddb-438c-42b2-bfaa-48968198e4af" containerID="5ea6148c0747d53a0912fb1599ac61b17d02e7b927f1ad69ba2794409e8ceaad" exitCode=1
Jul 17 20:23:08.518664 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:23:08.518229    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5420d171-7f6d594b7-lhs6f" event={"ID":"cafc8ddb-438c-42b2-bfaa-48968198e4af","Type":"ContainerDied","Data":"5ea6148c0747d53a0912fb1599ac61b17d02e7b927f1ad69ba2794409e8ceaad"}
Jul 17 20:23:08.518664 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:23:08.518282    2572 scope.go:117] "RemoveContainer" containerID="a175108fffbdd293911eeab530fb97a4c709bcfe2919e798d0cdb3058b20d692"
Jul 17 20:23:08.518664 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:23:08.518444    2572 scope.go:117] "RemoveContainer" containerID="5ea6148c0747d53a0912fb1599ac61b17d02e7b927f1ad69ba2794409e8ceaad"
Jul 17 20:23:08.518839 ip-10-0-141-177 kubenswrapper[2572]: E0717 20:23:08.518663    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-ait-5420d171-7f6d594b7-lhs6f_odh-ai-gateway-infra(cafc8ddb-438c-42b2-bfaa-48968198e4af)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5420d171-7f6d594b7-lhs6f" podUID="cafc8ddb-438c-42b2-bfaa-48968198e4af"
Jul 17 20:23:09.526269 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:23:09.526242    2572 scope.go:117] "RemoveContainer" containerID="5ea6148c0747d53a0912fb1599ac61b17d02e7b927f1ad69ba2794409e8ceaad"
Jul 17 20:23:09.526649 ip-10-0-141-177 kubenswrapper[2572]: E0717 20:23:09.526447    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-ait-5420d171-7f6d594b7-lhs6f_odh-ai-gateway-infra(cafc8ddb-438c-42b2-bfaa-48968198e4af)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5420d171-7f6d594b7-lhs6f" podUID="cafc8ddb-438c-42b2-bfaa-48968198e4af"
Jul 17 20:23:11.353700 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:23:11.353663    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5420d171-7f6d594b7-lhs6f"
Jul 17 20:23:11.354104 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:23:11.354082    2572 scope.go:117] "RemoveContainer" containerID="5ea6148c0747d53a0912fb1599ac61b17d02e7b927f1ad69ba2794409e8ceaad"
Jul 17 20:23:11.354311 ip-10-0-141-177 kubenswrapper[2572]: E0717 20:23:11.354288    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-ait-5420d171-7f6d594b7-lhs6f_odh-ai-gateway-infra(cafc8ddb-438c-42b2-bfaa-48968198e4af)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5420d171-7f6d594b7-lhs6f" podUID="cafc8ddb-438c-42b2-bfaa-48968198e4af"
Jul 17 20:23:16.354048 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:23:16.354011    2572 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5420d171-7f6d594b7-lhs6f"
Jul 17 20:23:16.354448 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:23:16.354433    2572 scope.go:117] "RemoveContainer" containerID="5ea6148c0747d53a0912fb1599ac61b17d02e7b927f1ad69ba2794409e8ceaad"
Jul 17 20:23:16.354653 ip-10-0-141-177 kubenswrapper[2572]: E0717 20:23:16.354632    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-ait-5420d171-7f6d594b7-lhs6f_odh-ai-gateway-infra(cafc8ddb-438c-42b2-bfaa-48968198e4af)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5420d171-7f6d594b7-lhs6f" podUID="cafc8ddb-438c-42b2-bfaa-48968198e4af"
Jul 17 20:23:16.582555 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:23:16.582525    2572 generic.go:356] "Generic (PLEG): container finished" podID="3900dba8-8e73-4e48-82f6-63da768e8014" containerID="c685fdc2d7ea9719a089c12c68770e4b5bbb356f3771bce009d637ebf018fab7" exitCode=0
Jul 17 20:23:16.582719 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:23:16.582598    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-5420d171-openshift-default-f49dfb5c5-rw6hq" event={"ID":"3900dba8-8e73-4e48-82f6-63da768e8014","Type":"ContainerDied","Data":"c685fdc2d7ea9719a089c12c68770e4b5bbb356f3771bce009d637ebf018fab7"}
Jul 17 20:23:16.582963 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:23:16.582949    2572 scope.go:117] "RemoveContainer" containerID="c685fdc2d7ea9719a089c12c68770e4b5bbb356f3771bce009d637ebf018fab7"
Jul 17 20:23:16.583953 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:23:16.583925    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 17 20:23:16.584055 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:23:16.584035    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 17 20:23:16.584146 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:23:16.584106    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 17 20:23:17.589996 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:23:17.589963    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-5420d171-openshift-default-f49dfb5c5-rw6hq" event={"ID":"3900dba8-8e73-4e48-82f6-63da768e8014","Type":"ContainerStarted","Data":"075816cdb638f6527a822bdc3d72f2fa92ccd6783446d0b97e7ffd0dc3d3eae4"}
Jul 17 20:23:18.455716 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:23:18.455682    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-5420d171-openshift-default-f49dfb5c5-rw6hq"
Jul 17 20:23:18.456837 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:23:18.456810    2572 patch_prober.go:28] interesting pod/e2e-ait-5420d171-openshift-default-f49dfb5c5-rw6hq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Jul 17 20:23:18.456980 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:23:18.456864    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-5420d171-openshift-default-f49dfb5c5-rw6hq" podUID="3900dba8-8e73-4e48-82f6-63da768e8014" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Jul 17 20:23:19.455187 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:23:19.455152    2572 patch_prober.go:28] interesting pod/e2e-ait-5420d171-openshift-default-f49dfb5c5-rw6hq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Jul 17 20:23:19.455570 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:23:19.455219    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-5420d171-openshift-default-f49dfb5c5-rw6hq" podUID="3900dba8-8e73-4e48-82f6-63da768e8014" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Jul 17 20:23:20.455641 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:23:20.455605    2572 patch_prober.go:28] interesting pod/e2e-ait-5420d171-openshift-default-f49dfb5c5-rw6hq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Jul 17 20:23:20.456041 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:23:20.455690    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-5420d171-openshift-default-f49dfb5c5-rw6hq" podUID="3900dba8-8e73-4e48-82f6-63da768e8014" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Jul 17 20:23:21.458813 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:23:21.458784    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-5420d171-openshift-default-f49dfb5c5-rw6hq"
Jul 17 20:23:21.459232 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:23:21.459047    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-5420d171-openshift-default-f49dfb5c5-rw6hq"
Jul 17 20:23:21.459643 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:23:21.459628    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-5420d171-openshift-default-f49dfb5c5-rw6hq"
Jul 17 20:23:28.681996 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:23:28.681959    2572 scope.go:117] "RemoveContainer" containerID="5ea6148c0747d53a0912fb1599ac61b17d02e7b927f1ad69ba2794409e8ceaad"
Jul 17 20:23:29.648719 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:23:29.648683    2572 generic.go:356] "Generic (PLEG): container finished" podID="cafc8ddb-438c-42b2-bfaa-48968198e4af" containerID="9833583ce24f517443106c4cc36a21348df55e58cd82924578f5478bb91d5aeb" exitCode=1
Jul 17 20:23:29.648874 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:23:29.648743    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5420d171-7f6d594b7-lhs6f" event={"ID":"cafc8ddb-438c-42b2-bfaa-48968198e4af","Type":"ContainerDied","Data":"9833583ce24f517443106c4cc36a21348df55e58cd82924578f5478bb91d5aeb"}
Jul 17 20:23:29.648874 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:23:29.648790    2572 scope.go:117] "RemoveContainer" containerID="5ea6148c0747d53a0912fb1599ac61b17d02e7b927f1ad69ba2794409e8ceaad"
Jul 17 20:23:29.649176 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:23:29.649149    2572 scope.go:117] "RemoveContainer" containerID="9833583ce24f517443106c4cc36a21348df55e58cd82924578f5478bb91d5aeb"
Jul 17 20:23:29.649413 ip-10-0-141-177 kubenswrapper[2572]: E0717 20:23:29.649386    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 20s restarting failed container=maas-api pod=maas-api-e2e-ait-5420d171-7f6d594b7-lhs6f_odh-ai-gateway-infra(cafc8ddb-438c-42b2-bfaa-48968198e4af)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5420d171-7f6d594b7-lhs6f" podUID="cafc8ddb-438c-42b2-bfaa-48968198e4af"
Jul 17 20:23:31.353956 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:23:31.353923    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5420d171-7f6d594b7-lhs6f"
Jul 17 20:23:31.354401 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:23:31.354356    2572 scope.go:117] "RemoveContainer" containerID="9833583ce24f517443106c4cc36a21348df55e58cd82924578f5478bb91d5aeb"
Jul 17 20:23:31.354586 ip-10-0-141-177 kubenswrapper[2572]: E0717 20:23:31.354563    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 20s restarting failed container=maas-api pod=maas-api-e2e-ait-5420d171-7f6d594b7-lhs6f_odh-ai-gateway-infra(cafc8ddb-438c-42b2-bfaa-48968198e4af)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5420d171-7f6d594b7-lhs6f" podUID="cafc8ddb-438c-42b2-bfaa-48968198e4af"
Jul 17 20:23:36.353243 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:23:36.353214    2572 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5420d171-7f6d594b7-lhs6f"
Jul 17 20:23:36.353712 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:23:36.353592    2572 scope.go:117] "RemoveContainer" containerID="9833583ce24f517443106c4cc36a21348df55e58cd82924578f5478bb91d5aeb"
Jul 17 20:23:36.353787 ip-10-0-141-177 kubenswrapper[2572]: E0717 20:23:36.353764    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 20s restarting failed container=maas-api pod=maas-api-e2e-ait-5420d171-7f6d594b7-lhs6f_odh-ai-gateway-infra(cafc8ddb-438c-42b2-bfaa-48968198e4af)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5420d171-7f6d594b7-lhs6f" podUID="cafc8ddb-438c-42b2-bfaa-48968198e4af"
Jul 17 20:23:46.124092 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:23:46.124049    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:23:46.681491 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:23:46.681465    2572 scope.go:117] "RemoveContainer" containerID="9833583ce24f517443106c4cc36a21348df55e58cd82924578f5478bb91d5aeb"
Jul 17 20:23:46.681658 ip-10-0-141-177 kubenswrapper[2572]: E0717 20:23:46.681637    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 20s restarting failed container=maas-api pod=maas-api-e2e-ait-5420d171-7f6d594b7-lhs6f_odh-ai-gateway-infra(cafc8ddb-438c-42b2-bfaa-48968198e4af)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5420d171-7f6d594b7-lhs6f" podUID="cafc8ddb-438c-42b2-bfaa-48968198e4af"
Jul 17 20:24:01.681542 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:24:01.681513    2572 scope.go:117] "RemoveContainer" containerID="9833583ce24f517443106c4cc36a21348df55e58cd82924578f5478bb91d5aeb"
Jul 17 20:24:02.813114 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:24:02.813015    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5420d171-7f6d594b7-lhs6f" event={"ID":"cafc8ddb-438c-42b2-bfaa-48968198e4af","Type":"ContainerStarted","Data":"81cbae579dce025e0a6265a790165010e376057b07974deb92c0804972ceadaf"}
Jul 17 20:24:02.813493 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:24:02.813237    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5420d171-7f6d594b7-lhs6f"
Jul 17 20:24:02.830933 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:24:02.830881    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5420d171-7f6d594b7-lhs6f" podStartSLOduration=55.751972238 podStartE2EDuration="57.830867312s" totalImagesPullingTime="2.078895074s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 20:23:05 +0000 UTC" imagePullSessionsCount=4 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 20:24:02.827987166 +0000 UTC m=+1667.669482804" watchObservedRunningTime="2026-07-17 20:24:02.830867312 +0000 UTC m=+1667.672362949"
Jul 17 20:24:03.819638 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:24:03.819608    2572 generic.go:356] "Generic (PLEG): container finished" podID="cafc8ddb-438c-42b2-bfaa-48968198e4af" containerID="81cbae579dce025e0a6265a790165010e376057b07974deb92c0804972ceadaf" exitCode=1
Jul 17 20:24:03.820105 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:24:03.819656    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5420d171-7f6d594b7-lhs6f" event={"ID":"cafc8ddb-438c-42b2-bfaa-48968198e4af","Type":"ContainerDied","Data":"81cbae579dce025e0a6265a790165010e376057b07974deb92c0804972ceadaf"}
Jul 17 20:24:03.820105 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:24:03.819707    2572 scope.go:117] "RemoveContainer" containerID="9833583ce24f517443106c4cc36a21348df55e58cd82924578f5478bb91d5aeb"
Jul 17 20:24:03.820105 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:24:03.819937    2572 scope.go:117] "RemoveContainer" containerID="81cbae579dce025e0a6265a790165010e376057b07974deb92c0804972ceadaf"
Jul 17 20:24:03.820242 ip-10-0-141-177 kubenswrapper[2572]: E0717 20:24:03.820192    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-ait-5420d171-7f6d594b7-lhs6f_odh-ai-gateway-infra(cafc8ddb-438c-42b2-bfaa-48968198e4af)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5420d171-7f6d594b7-lhs6f" podUID="cafc8ddb-438c-42b2-bfaa-48968198e4af"
Jul 17 20:24:04.826313 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:24:04.826289    2572 scope.go:117] "RemoveContainer" containerID="81cbae579dce025e0a6265a790165010e376057b07974deb92c0804972ceadaf"
Jul 17 20:24:04.826679 ip-10-0-141-177 kubenswrapper[2572]: E0717 20:24:04.826455    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-ait-5420d171-7f6d594b7-lhs6f_odh-ai-gateway-infra(cafc8ddb-438c-42b2-bfaa-48968198e4af)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5420d171-7f6d594b7-lhs6f" podUID="cafc8ddb-438c-42b2-bfaa-48968198e4af"
Jul 17 20:24:06.354053 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:24:06.354022    2572 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5420d171-7f6d594b7-lhs6f"
Jul 17 20:24:06.354454 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:24:06.354429    2572 scope.go:117] "RemoveContainer" containerID="81cbae579dce025e0a6265a790165010e376057b07974deb92c0804972ceadaf"
Jul 17 20:24:06.354624 ip-10-0-141-177 kubenswrapper[2572]: E0717 20:24:06.354605    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-ait-5420d171-7f6d594b7-lhs6f_odh-ai-gateway-infra(cafc8ddb-438c-42b2-bfaa-48968198e4af)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5420d171-7f6d594b7-lhs6f" podUID="cafc8ddb-438c-42b2-bfaa-48968198e4af"
Jul 17 20:24:17.681734 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:24:17.681701    2572 scope.go:117] "RemoveContainer" containerID="81cbae579dce025e0a6265a790165010e376057b07974deb92c0804972ceadaf"
Jul 17 20:24:17.682167 ip-10-0-141-177 kubenswrapper[2572]: E0717 20:24:17.681890    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-ait-5420d171-7f6d594b7-lhs6f_odh-ai-gateway-infra(cafc8ddb-438c-42b2-bfaa-48968198e4af)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5420d171-7f6d594b7-lhs6f" podUID="cafc8ddb-438c-42b2-bfaa-48968198e4af"
Jul 17 20:24:31.681783 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:24:31.681747    2572 scope.go:117] "RemoveContainer" containerID="81cbae579dce025e0a6265a790165010e376057b07974deb92c0804972ceadaf"
Jul 17 20:24:31.682300 ip-10-0-141-177 kubenswrapper[2572]: E0717 20:24:31.681989    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-ait-5420d171-7f6d594b7-lhs6f_odh-ai-gateway-infra(cafc8ddb-438c-42b2-bfaa-48968198e4af)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5420d171-7f6d594b7-lhs6f" podUID="cafc8ddb-438c-42b2-bfaa-48968198e4af"
Jul 17 20:24:46.682317 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:24:46.682245    2572 scope.go:117] "RemoveContainer" containerID="81cbae579dce025e0a6265a790165010e376057b07974deb92c0804972ceadaf"
Jul 17 20:24:48.047316 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:24:48.047285    2572 generic.go:356] "Generic (PLEG): container finished" podID="cafc8ddb-438c-42b2-bfaa-48968198e4af" containerID="32f3956b2ea69745f4c3be7223aeb17126ef2429e9a28e3dde02124cd7eb3452" exitCode=1
Jul 17 20:24:48.047719 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:24:48.047328    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5420d171-7f6d594b7-lhs6f" event={"ID":"cafc8ddb-438c-42b2-bfaa-48968198e4af","Type":"ContainerDied","Data":"32f3956b2ea69745f4c3be7223aeb17126ef2429e9a28e3dde02124cd7eb3452"}
Jul 17 20:24:48.047719 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:24:48.047383    2572 scope.go:117] "RemoveContainer" containerID="81cbae579dce025e0a6265a790165010e376057b07974deb92c0804972ceadaf"
Jul 17 20:24:48.047853 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:24:48.047733    2572 scope.go:117] "RemoveContainer" containerID="32f3956b2ea69745f4c3be7223aeb17126ef2429e9a28e3dde02124cd7eb3452"
Jul 17 20:24:48.047971 ip-10-0-141-177 kubenswrapper[2572]: E0717 20:24:48.047948    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-e2e-ait-5420d171-7f6d594b7-lhs6f_odh-ai-gateway-infra(cafc8ddb-438c-42b2-bfaa-48968198e4af)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5420d171-7f6d594b7-lhs6f" podUID="cafc8ddb-438c-42b2-bfaa-48968198e4af"
Jul 17 20:24:52.813611 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:24:52.813569    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5420d171-7f6d594b7-lhs6f"
Jul 17 20:24:52.814128 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:24:52.814015    2572 scope.go:117] "RemoveContainer" containerID="32f3956b2ea69745f4c3be7223aeb17126ef2429e9a28e3dde02124cd7eb3452"
Jul 17 20:24:52.814293 ip-10-0-141-177 kubenswrapper[2572]: E0717 20:24:52.814270    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-e2e-ait-5420d171-7f6d594b7-lhs6f_odh-ai-gateway-infra(cafc8ddb-438c-42b2-bfaa-48968198e4af)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5420d171-7f6d594b7-lhs6f" podUID="cafc8ddb-438c-42b2-bfaa-48968198e4af"
Jul 17 20:24:56.353483 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:24:56.353450    2572 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5420d171-7f6d594b7-lhs6f"
Jul 17 20:24:56.353884 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:24:56.353864    2572 scope.go:117] "RemoveContainer" containerID="32f3956b2ea69745f4c3be7223aeb17126ef2429e9a28e3dde02124cd7eb3452"
Jul 17 20:24:56.354102 ip-10-0-141-177 kubenswrapper[2572]: E0717 20:24:56.354055    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-e2e-ait-5420d171-7f6d594b7-lhs6f_odh-ai-gateway-infra(cafc8ddb-438c-42b2-bfaa-48968198e4af)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5420d171-7f6d594b7-lhs6f" podUID="cafc8ddb-438c-42b2-bfaa-48968198e4af"
Jul 17 20:25:08.682026 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:25:08.681998    2572 scope.go:117] "RemoveContainer" containerID="32f3956b2ea69745f4c3be7223aeb17126ef2429e9a28e3dde02124cd7eb3452"
Jul 17 20:25:08.682429 ip-10-0-141-177 kubenswrapper[2572]: E0717 20:25:08.682214    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-e2e-ait-5420d171-7f6d594b7-lhs6f_odh-ai-gateway-infra(cafc8ddb-438c-42b2-bfaa-48968198e4af)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5420d171-7f6d594b7-lhs6f" podUID="cafc8ddb-438c-42b2-bfaa-48968198e4af"
Jul 17 20:25:19.682167 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:25:19.682129    2572 scope.go:117] "RemoveContainer" containerID="32f3956b2ea69745f4c3be7223aeb17126ef2429e9a28e3dde02124cd7eb3452"
Jul 17 20:25:19.682740 ip-10-0-141-177 kubenswrapper[2572]: E0717 20:25:19.682308    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-e2e-ait-5420d171-7f6d594b7-lhs6f_odh-ai-gateway-infra(cafc8ddb-438c-42b2-bfaa-48968198e4af)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5420d171-7f6d594b7-lhs6f" podUID="cafc8ddb-438c-42b2-bfaa-48968198e4af"
Jul 17 20:25:33.681842 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:25:33.681805    2572 scope.go:117] "RemoveContainer" containerID="32f3956b2ea69745f4c3be7223aeb17126ef2429e9a28e3dde02124cd7eb3452"
Jul 17 20:25:33.682381 ip-10-0-141-177 kubenswrapper[2572]: E0717 20:25:33.682053    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-e2e-ait-5420d171-7f6d594b7-lhs6f_odh-ai-gateway-infra(cafc8ddb-438c-42b2-bfaa-48968198e4af)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5420d171-7f6d594b7-lhs6f" podUID="cafc8ddb-438c-42b2-bfaa-48968198e4af"
Jul 17 20:25:44.681976 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:25:44.681935    2572 scope.go:117] "RemoveContainer" containerID="32f3956b2ea69745f4c3be7223aeb17126ef2429e9a28e3dde02124cd7eb3452"
Jul 17 20:25:44.682542 ip-10-0-141-177 kubenswrapper[2572]: E0717 20:25:44.682212    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-e2e-ait-5420d171-7f6d594b7-lhs6f_odh-ai-gateway-infra(cafc8ddb-438c-42b2-bfaa-48968198e4af)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5420d171-7f6d594b7-lhs6f" podUID="cafc8ddb-438c-42b2-bfaa-48968198e4af"
Jul 17 20:25:55.683899 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:25:55.683869    2572 scope.go:117] "RemoveContainer" containerID="32f3956b2ea69745f4c3be7223aeb17126ef2429e9a28e3dde02124cd7eb3452"
Jul 17 20:25:55.684470 ip-10-0-141-177 kubenswrapper[2572]: E0717 20:25:55.684046    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-e2e-ait-5420d171-7f6d594b7-lhs6f_odh-ai-gateway-infra(cafc8ddb-438c-42b2-bfaa-48968198e4af)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5420d171-7f6d594b7-lhs6f" podUID="cafc8ddb-438c-42b2-bfaa-48968198e4af"
Jul 17 20:26:08.681660 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:08.681582    2572 scope.go:117] "RemoveContainer" containerID="32f3956b2ea69745f4c3be7223aeb17126ef2429e9a28e3dde02124cd7eb3452"
Jul 17 20:26:09.453751 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:09.453718    2572 generic.go:356] "Generic (PLEG): container finished" podID="cafc8ddb-438c-42b2-bfaa-48968198e4af" containerID="67df2921bd931e58a6072ebd2cf2ad1109efc05b87e4c7a34a702d9e4d6b4852" exitCode=1
Jul 17 20:26:09.453939 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:09.453789    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5420d171-7f6d594b7-lhs6f" event={"ID":"cafc8ddb-438c-42b2-bfaa-48968198e4af","Type":"ContainerDied","Data":"67df2921bd931e58a6072ebd2cf2ad1109efc05b87e4c7a34a702d9e4d6b4852"}
Jul 17 20:26:09.453939 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:09.453849    2572 scope.go:117] "RemoveContainer" containerID="32f3956b2ea69745f4c3be7223aeb17126ef2429e9a28e3dde02124cd7eb3452"
Jul 17 20:26:09.454269 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:09.454249    2572 scope.go:117] "RemoveContainer" containerID="67df2921bd931e58a6072ebd2cf2ad1109efc05b87e4c7a34a702d9e4d6b4852"
Jul 17 20:26:09.454461 ip-10-0-141-177 kubenswrapper[2572]: E0717 20:26:09.454443    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-e2e-ait-5420d171-7f6d594b7-lhs6f_odh-ai-gateway-infra(cafc8ddb-438c-42b2-bfaa-48968198e4af)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5420d171-7f6d594b7-lhs6f" podUID="cafc8ddb-438c-42b2-bfaa-48968198e4af"
Jul 17 20:26:10.446972 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:10.446932    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-5420d171-openshift-default-f49dfb5c5-rw6hq"]
Jul 17 20:26:10.447389 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:10.447173    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-5420d171-openshift-default-f49dfb5c5-rw6hq" podUID="3900dba8-8e73-4e48-82f6-63da768e8014" containerName="istio-proxy" containerID="cri-o://075816cdb638f6527a822bdc3d72f2fa92ccd6783446d0b97e7ffd0dc3d3eae4" gracePeriod=30
Jul 17 20:26:10.495490 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:10.495457    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:26:10.590519 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:10.590490    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:26:12.813372 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:12.813342    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5420d171-7f6d594b7-lhs6f"
Jul 17 20:26:12.813755 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:12.813663    2572 scope.go:117] "RemoveContainer" containerID="67df2921bd931e58a6072ebd2cf2ad1109efc05b87e4c7a34a702d9e4d6b4852"
Jul 17 20:26:12.813858 ip-10-0-141-177 kubenswrapper[2572]: E0717 20:26:12.813838    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-e2e-ait-5420d171-7f6d594b7-lhs6f_odh-ai-gateway-infra(cafc8ddb-438c-42b2-bfaa-48968198e4af)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5420d171-7f6d594b7-lhs6f" podUID="cafc8ddb-438c-42b2-bfaa-48968198e4af"
Jul 17 20:26:15.712515 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:15.712454    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-5420d171-openshift-default-f49dfb5c5-rw6hq"
Jul 17 20:26:15.839541 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:15.839510    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3900dba8-8e73-4e48-82f6-63da768e8014-istio-token\") pod \"3900dba8-8e73-4e48-82f6-63da768e8014\" (UID: \"3900dba8-8e73-4e48-82f6-63da768e8014\") "
Jul 17 20:26:15.839693 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:15.839615    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c22xf\" (UniqueName: \"kubernetes.io/projected/3900dba8-8e73-4e48-82f6-63da768e8014-kube-api-access-c22xf\") pod \"3900dba8-8e73-4e48-82f6-63da768e8014\" (UID: \"3900dba8-8e73-4e48-82f6-63da768e8014\") "
Jul 17 20:26:15.839693 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:15.839672    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3900dba8-8e73-4e48-82f6-63da768e8014-istiod-ca-cert\") pod \"3900dba8-8e73-4e48-82f6-63da768e8014\" (UID: \"3900dba8-8e73-4e48-82f6-63da768e8014\") "
Jul 17 20:26:15.839809 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:15.839698    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3900dba8-8e73-4e48-82f6-63da768e8014-workload-certs\") pod \"3900dba8-8e73-4e48-82f6-63da768e8014\" (UID: \"3900dba8-8e73-4e48-82f6-63da768e8014\") "
Jul 17 20:26:15.839809 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:15.839719    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3900dba8-8e73-4e48-82f6-63da768e8014-istio-podinfo\") pod \"3900dba8-8e73-4e48-82f6-63da768e8014\" (UID: \"3900dba8-8e73-4e48-82f6-63da768e8014\") "
Jul 17 20:26:15.839809 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:15.839741    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3900dba8-8e73-4e48-82f6-63da768e8014-credential-socket\") pod \"3900dba8-8e73-4e48-82f6-63da768e8014\" (UID: \"3900dba8-8e73-4e48-82f6-63da768e8014\") "
Jul 17 20:26:15.839809 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:15.839792    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3900dba8-8e73-4e48-82f6-63da768e8014-istio-data\") pod \"3900dba8-8e73-4e48-82f6-63da768e8014\" (UID: \"3900dba8-8e73-4e48-82f6-63da768e8014\") "
Jul 17 20:26:15.840030 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:15.839819    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3900dba8-8e73-4e48-82f6-63da768e8014-istio-envoy\") pod \"3900dba8-8e73-4e48-82f6-63da768e8014\" (UID: \"3900dba8-8e73-4e48-82f6-63da768e8014\") "
Jul 17 20:26:15.840030 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:15.839856    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3900dba8-8e73-4e48-82f6-63da768e8014-workload-socket\") pod \"3900dba8-8e73-4e48-82f6-63da768e8014\" (UID: \"3900dba8-8e73-4e48-82f6-63da768e8014\") "
Jul 17 20:26:15.840177 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:15.840100    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3900dba8-8e73-4e48-82f6-63da768e8014-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "3900dba8-8e73-4e48-82f6-63da768e8014" (UID: "3900dba8-8e73-4e48-82f6-63da768e8014"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 20:26:15.840177 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:15.840119    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3900dba8-8e73-4e48-82f6-63da768e8014-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "3900dba8-8e73-4e48-82f6-63da768e8014" (UID: "3900dba8-8e73-4e48-82f6-63da768e8014"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 20:26:15.840621 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:15.840595    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3900dba8-8e73-4e48-82f6-63da768e8014-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "3900dba8-8e73-4e48-82f6-63da768e8014" (UID: "3900dba8-8e73-4e48-82f6-63da768e8014"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 20:26:15.840829 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:15.840805    2572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3900dba8-8e73-4e48-82f6-63da768e8014-workload-certs\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Jul 17 20:26:15.841018 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:15.840999    2572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3900dba8-8e73-4e48-82f6-63da768e8014-credential-socket\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Jul 17 20:26:15.841931 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:15.841893    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3900dba8-8e73-4e48-82f6-63da768e8014-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "3900dba8-8e73-4e48-82f6-63da768e8014" (UID: "3900dba8-8e73-4e48-82f6-63da768e8014"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 20:26:15.842313 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:15.842276    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3900dba8-8e73-4e48-82f6-63da768e8014-kube-api-access-c22xf" (OuterVolumeSpecName: "kube-api-access-c22xf") pod "3900dba8-8e73-4e48-82f6-63da768e8014" (UID: "3900dba8-8e73-4e48-82f6-63da768e8014"). InnerVolumeSpecName "kube-api-access-c22xf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 20:26:15.842430 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:15.842298    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3900dba8-8e73-4e48-82f6-63da768e8014-istio-token" (OuterVolumeSpecName: "istio-token") pod "3900dba8-8e73-4e48-82f6-63da768e8014" (UID: "3900dba8-8e73-4e48-82f6-63da768e8014"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 20:26:15.842430 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:15.842404    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3900dba8-8e73-4e48-82f6-63da768e8014-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "3900dba8-8e73-4e48-82f6-63da768e8014" (UID: "3900dba8-8e73-4e48-82f6-63da768e8014"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 17 20:26:15.842543 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:15.842422    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3900dba8-8e73-4e48-82f6-63da768e8014-istio-data" (OuterVolumeSpecName: "istio-data") pod "3900dba8-8e73-4e48-82f6-63da768e8014" (UID: "3900dba8-8e73-4e48-82f6-63da768e8014"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 20:26:15.842773 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:15.842756    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3900dba8-8e73-4e48-82f6-63da768e8014-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "3900dba8-8e73-4e48-82f6-63da768e8014" (UID: "3900dba8-8e73-4e48-82f6-63da768e8014"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 20:26:15.942482 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:15.942442    2572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3900dba8-8e73-4e48-82f6-63da768e8014-istiod-ca-cert\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Jul 17 20:26:15.942482 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:15.942480    2572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3900dba8-8e73-4e48-82f6-63da768e8014-istio-podinfo\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Jul 17 20:26:15.942482 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:15.942489    2572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3900dba8-8e73-4e48-82f6-63da768e8014-istio-data\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Jul 17 20:26:15.942482 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:15.942497    2572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3900dba8-8e73-4e48-82f6-63da768e8014-istio-envoy\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Jul 17 20:26:15.942749 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:15.942506    2572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3900dba8-8e73-4e48-82f6-63da768e8014-workload-socket\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Jul 17 20:26:15.942749 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:15.942514    2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3900dba8-8e73-4e48-82f6-63da768e8014-istio-token\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Jul 17 20:26:15.942749 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:15.942525    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c22xf\" (UniqueName: \"kubernetes.io/projected/3900dba8-8e73-4e48-82f6-63da768e8014-kube-api-access-c22xf\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Jul 17 20:26:15.981846 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:15.981760    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-5420d171-7f6d594b7-lhs6f"]
Jul 17 20:26:16.004350 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:16.004316    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:26:16.108348 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:16.108318    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5420d171-7f6d594b7-lhs6f"
Jul 17 20:26:16.245017 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:16.244986    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cafc8ddb-438c-42b2-bfaa-48968198e4af-maas-api-tls\") pod \"cafc8ddb-438c-42b2-bfaa-48968198e4af\" (UID: \"cafc8ddb-438c-42b2-bfaa-48968198e4af\") "
Jul 17 20:26:16.245241 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:16.245107    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dzzwh\" (UniqueName: \"kubernetes.io/projected/cafc8ddb-438c-42b2-bfaa-48968198e4af-kube-api-access-dzzwh\") pod \"cafc8ddb-438c-42b2-bfaa-48968198e4af\" (UID: \"cafc8ddb-438c-42b2-bfaa-48968198e4af\") "
Jul 17 20:26:16.245241 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:16.245166    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cafc8ddb-438c-42b2-bfaa-48968198e4af-openshift-service-ca\") pod \"cafc8ddb-438c-42b2-bfaa-48968198e4af\" (UID: \"cafc8ddb-438c-42b2-bfaa-48968198e4af\") "
Jul 17 20:26:16.245571 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:16.245526    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cafc8ddb-438c-42b2-bfaa-48968198e4af-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "cafc8ddb-438c-42b2-bfaa-48968198e4af" (UID: "cafc8ddb-438c-42b2-bfaa-48968198e4af"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 20:26:16.247321 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:16.247299    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cafc8ddb-438c-42b2-bfaa-48968198e4af-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "cafc8ddb-438c-42b2-bfaa-48968198e4af" (UID: "cafc8ddb-438c-42b2-bfaa-48968198e4af"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 20:26:16.247408 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:16.247367    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cafc8ddb-438c-42b2-bfaa-48968198e4af-kube-api-access-dzzwh" (OuterVolumeSpecName: "kube-api-access-dzzwh") pod "cafc8ddb-438c-42b2-bfaa-48968198e4af" (UID: "cafc8ddb-438c-42b2-bfaa-48968198e4af"). InnerVolumeSpecName "kube-api-access-dzzwh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 20:26:16.346442 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:16.346409    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cafc8ddb-438c-42b2-bfaa-48968198e4af-maas-api-tls\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Jul 17 20:26:16.346442 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:16.346440    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dzzwh\" (UniqueName: \"kubernetes.io/projected/cafc8ddb-438c-42b2-bfaa-48968198e4af-kube-api-access-dzzwh\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Jul 17 20:26:16.346442 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:16.346450    2572 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cafc8ddb-438c-42b2-bfaa-48968198e4af-openshift-service-ca\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Jul 17 20:26:16.499667 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:16.499576    2572 generic.go:356] "Generic (PLEG): container finished" podID="3900dba8-8e73-4e48-82f6-63da768e8014" containerID="075816cdb638f6527a822bdc3d72f2fa92ccd6783446d0b97e7ffd0dc3d3eae4" exitCode=0
Jul 17 20:26:16.499667 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:16.499633    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-5420d171-openshift-default-f49dfb5c5-rw6hq"
Jul 17 20:26:16.499667 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:16.499659    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-5420d171-openshift-default-f49dfb5c5-rw6hq" event={"ID":"3900dba8-8e73-4e48-82f6-63da768e8014","Type":"ContainerDied","Data":"075816cdb638f6527a822bdc3d72f2fa92ccd6783446d0b97e7ffd0dc3d3eae4"}
Jul 17 20:26:16.499890 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:16.499740    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-5420d171-openshift-default-f49dfb5c5-rw6hq" event={"ID":"3900dba8-8e73-4e48-82f6-63da768e8014","Type":"ContainerDied","Data":"f859e01177e73c5de132b8db06e6e73fb19d33539baa603e08eb6952472ebed7"}
Jul 17 20:26:16.499890 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:16.499773    2572 scope.go:117] "RemoveContainer" containerID="075816cdb638f6527a822bdc3d72f2fa92ccd6783446d0b97e7ffd0dc3d3eae4"
Jul 17 20:26:16.501226 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:16.501179    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5420d171-7f6d594b7-lhs6f"
Jul 17 20:26:16.501226 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:16.501181    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5420d171-7f6d594b7-lhs6f" event={"ID":"cafc8ddb-438c-42b2-bfaa-48968198e4af","Type":"ContainerDied","Data":"9467cb8c94ce61aeb5a00b7a71ffeb66da4a4b86d2c7e52a2c1175df829c8f7a"}
Jul 17 20:26:16.509999 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:16.509982    2572 scope.go:117] "RemoveContainer" containerID="c685fdc2d7ea9719a089c12c68770e4b5bbb356f3771bce009d637ebf018fab7"
Jul 17 20:26:16.518097 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:16.518055    2572 scope.go:117] "RemoveContainer" containerID="075816cdb638f6527a822bdc3d72f2fa92ccd6783446d0b97e7ffd0dc3d3eae4"
Jul 17 20:26:16.518323 ip-10-0-141-177 kubenswrapper[2572]: E0717 20:26:16.518305    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"075816cdb638f6527a822bdc3d72f2fa92ccd6783446d0b97e7ffd0dc3d3eae4\": container with ID starting with 075816cdb638f6527a822bdc3d72f2fa92ccd6783446d0b97e7ffd0dc3d3eae4 not found: ID does not exist" containerID="075816cdb638f6527a822bdc3d72f2fa92ccd6783446d0b97e7ffd0dc3d3eae4"
Jul 17 20:26:16.518378 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:16.518330    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"075816cdb638f6527a822bdc3d72f2fa92ccd6783446d0b97e7ffd0dc3d3eae4"} err="failed to get container status \"075816cdb638f6527a822bdc3d72f2fa92ccd6783446d0b97e7ffd0dc3d3eae4\": rpc error: code = NotFound desc = could not find container \"075816cdb638f6527a822bdc3d72f2fa92ccd6783446d0b97e7ffd0dc3d3eae4\": container with ID starting with 075816cdb638f6527a822bdc3d72f2fa92ccd6783446d0b97e7ffd0dc3d3eae4 not found: ID does not exist"
Jul 17 20:26:16.518378 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:16.518346    2572 scope.go:117] "RemoveContainer" containerID="c685fdc2d7ea9719a089c12c68770e4b5bbb356f3771bce009d637ebf018fab7"
Jul 17 20:26:16.518573 ip-10-0-141-177 kubenswrapper[2572]: E0717 20:26:16.518551    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c685fdc2d7ea9719a089c12c68770e4b5bbb356f3771bce009d637ebf018fab7\": container with ID starting with c685fdc2d7ea9719a089c12c68770e4b5bbb356f3771bce009d637ebf018fab7 not found: ID does not exist" containerID="c685fdc2d7ea9719a089c12c68770e4b5bbb356f3771bce009d637ebf018fab7"
Jul 17 20:26:16.518639 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:16.518582    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c685fdc2d7ea9719a089c12c68770e4b5bbb356f3771bce009d637ebf018fab7"} err="failed to get container status \"c685fdc2d7ea9719a089c12c68770e4b5bbb356f3771bce009d637ebf018fab7\": rpc error: code = NotFound desc = could not find container \"c685fdc2d7ea9719a089c12c68770e4b5bbb356f3771bce009d637ebf018fab7\": container with ID starting with c685fdc2d7ea9719a089c12c68770e4b5bbb356f3771bce009d637ebf018fab7 not found: ID does not exist"
Jul 17 20:26:16.518639 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:16.518604    2572 scope.go:117] "RemoveContainer" containerID="67df2921bd931e58a6072ebd2cf2ad1109efc05b87e4c7a34a702d9e4d6b4852"
Jul 17 20:26:16.525751 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:16.525729    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-5420d171-openshift-default-f49dfb5c5-rw6hq"]
Jul 17 20:26:16.529908 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:16.529884    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-5420d171-openshift-default-f49dfb5c5-rw6hq"]
Jul 17 20:26:16.539774 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:16.539746    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-5420d171-7f6d594b7-lhs6f"]
Jul 17 20:26:16.543843 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:16.543821    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-5420d171-7f6d594b7-lhs6f"]
Jul 17 20:26:16.662763 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:16.662729    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:26:17.688759 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:17.688721    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3900dba8-8e73-4e48-82f6-63da768e8014" path="/var/lib/kubelet/pods/3900dba8-8e73-4e48-82f6-63da768e8014/volumes"
Jul 17 20:26:17.689322 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:17.689303    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cafc8ddb-438c-42b2-bfaa-48968198e4af" path="/var/lib/kubelet/pods/cafc8ddb-438c-42b2-bfaa-48968198e4af/volumes"
Jul 17 20:26:22.241715 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:22.241680    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:26:22.312039 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:22.312011    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:26:22.512260 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:22.512165    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:26:22.630011 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:22.629976    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:26:22.776969 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:22.776884    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-2e9331f5-gw-openshift-default-76bb964575-szww7"]
Jul 17 20:26:22.777453 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:22.777432    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3900dba8-8e73-4e48-82f6-63da768e8014" containerName="istio-proxy"
Jul 17 20:26:22.777453 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:22.777451    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="3900dba8-8e73-4e48-82f6-63da768e8014" containerName="istio-proxy"
Jul 17 20:26:22.777632 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:22.777467    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cafc8ddb-438c-42b2-bfaa-48968198e4af" containerName="maas-api"
Jul 17 20:26:22.777632 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:22.777473    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="cafc8ddb-438c-42b2-bfaa-48968198e4af" containerName="maas-api"
Jul 17 20:26:22.777632 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:22.777484    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cafc8ddb-438c-42b2-bfaa-48968198e4af" containerName="maas-api"
Jul 17 20:26:22.777632 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:22.777489    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="cafc8ddb-438c-42b2-bfaa-48968198e4af" containerName="maas-api"
Jul 17 20:26:22.777632 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:22.777497    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cafc8ddb-438c-42b2-bfaa-48968198e4af" containerName="maas-api"
Jul 17 20:26:22.777632 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:22.777503    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="cafc8ddb-438c-42b2-bfaa-48968198e4af" containerName="maas-api"
Jul 17 20:26:22.777632 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:22.777508    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cafc8ddb-438c-42b2-bfaa-48968198e4af" containerName="maas-api"
Jul 17 20:26:22.777632 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:22.777513    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="cafc8ddb-438c-42b2-bfaa-48968198e4af" containerName="maas-api"
Jul 17 20:26:22.777632 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:22.777519    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cafc8ddb-438c-42b2-bfaa-48968198e4af" containerName="maas-api"
Jul 17 20:26:22.777632 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:22.777524    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="cafc8ddb-438c-42b2-bfaa-48968198e4af" containerName="maas-api"
Jul 17 20:26:22.777632 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:22.777594    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="3900dba8-8e73-4e48-82f6-63da768e8014" containerName="istio-proxy"
Jul 17 20:26:22.777632 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:22.777603    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="cafc8ddb-438c-42b2-bfaa-48968198e4af" containerName="maas-api"
Jul 17 20:26:22.777632 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:22.777608    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="cafc8ddb-438c-42b2-bfaa-48968198e4af" containerName="maas-api"
Jul 17 20:26:22.777632 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:22.777613    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="cafc8ddb-438c-42b2-bfaa-48968198e4af" containerName="maas-api"
Jul 17 20:26:22.777632 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:22.777618    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="cafc8ddb-438c-42b2-bfaa-48968198e4af" containerName="maas-api"
Jul 17 20:26:22.777632 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:22.777625    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="cafc8ddb-438c-42b2-bfaa-48968198e4af" containerName="maas-api"
Jul 17 20:26:22.777632 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:22.777630    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="cafc8ddb-438c-42b2-bfaa-48968198e4af" containerName="maas-api"
Jul 17 20:26:22.781976 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:22.781955    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-2e9331f5-gw-openshift-default-76bb964575-szww7"
Jul 17 20:26:22.784722 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:22.784704    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-2e9331f5-gw-openshift-default-dockercfg-mrpgh\""
Jul 17 20:26:22.796440 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:22.796415    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-2e9331f5-gw-openshift-default-76bb964575-szww7"]
Jul 17 20:26:22.816265 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:22.816216    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:26:22.914617 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:22.914580    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9a8f400e-4946-4dd4-b6d0-890cbca44ead-istio-data\") pod \"e2e-migrate-2e9331f5-gw-openshift-default-76bb964575-szww7\" (UID: \"9a8f400e-4946-4dd4-b6d0-890cbca44ead\") " pod="openshift-ingress/e2e-migrate-2e9331f5-gw-openshift-default-76bb964575-szww7"
Jul 17 20:26:22.914617 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:22.914617    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zx6gd\" (UniqueName: \"kubernetes.io/projected/9a8f400e-4946-4dd4-b6d0-890cbca44ead-kube-api-access-zx6gd\") pod \"e2e-migrate-2e9331f5-gw-openshift-default-76bb964575-szww7\" (UID: \"9a8f400e-4946-4dd4-b6d0-890cbca44ead\") " pod="openshift-ingress/e2e-migrate-2e9331f5-gw-openshift-default-76bb964575-szww7"
Jul 17 20:26:22.914856 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:22.914639    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9a8f400e-4946-4dd4-b6d0-890cbca44ead-workload-certs\") pod \"e2e-migrate-2e9331f5-gw-openshift-default-76bb964575-szww7\" (UID: \"9a8f400e-4946-4dd4-b6d0-890cbca44ead\") " pod="openshift-ingress/e2e-migrate-2e9331f5-gw-openshift-default-76bb964575-szww7"
Jul 17 20:26:22.914856 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:22.914656    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9a8f400e-4946-4dd4-b6d0-890cbca44ead-istiod-ca-cert\") pod \"e2e-migrate-2e9331f5-gw-openshift-default-76bb964575-szww7\" (UID: \"9a8f400e-4946-4dd4-b6d0-890cbca44ead\") " pod="openshift-ingress/e2e-migrate-2e9331f5-gw-openshift-default-76bb964575-szww7"
Jul 17 20:26:22.914856 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:22.914783    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9a8f400e-4946-4dd4-b6d0-890cbca44ead-istio-podinfo\") pod \"e2e-migrate-2e9331f5-gw-openshift-default-76bb964575-szww7\" (UID: \"9a8f400e-4946-4dd4-b6d0-890cbca44ead\") " pod="openshift-ingress/e2e-migrate-2e9331f5-gw-openshift-default-76bb964575-szww7"
Jul 17 20:26:22.914856 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:22.914817    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9a8f400e-4946-4dd4-b6d0-890cbca44ead-istio-token\") pod \"e2e-migrate-2e9331f5-gw-openshift-default-76bb964575-szww7\" (UID: \"9a8f400e-4946-4dd4-b6d0-890cbca44ead\") " pod="openshift-ingress/e2e-migrate-2e9331f5-gw-openshift-default-76bb964575-szww7"
Jul 17 20:26:22.915003 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:22.914863    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9a8f400e-4946-4dd4-b6d0-890cbca44ead-credential-socket\") pod \"e2e-migrate-2e9331f5-gw-openshift-default-76bb964575-szww7\" (UID: \"9a8f400e-4946-4dd4-b6d0-890cbca44ead\") " pod="openshift-ingress/e2e-migrate-2e9331f5-gw-openshift-default-76bb964575-szww7"
Jul 17 20:26:22.915003 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:22.914889    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9a8f400e-4946-4dd4-b6d0-890cbca44ead-istio-envoy\") pod \"e2e-migrate-2e9331f5-gw-openshift-default-76bb964575-szww7\" (UID: \"9a8f400e-4946-4dd4-b6d0-890cbca44ead\") " pod="openshift-ingress/e2e-migrate-2e9331f5-gw-openshift-default-76bb964575-szww7"
Jul 17 20:26:22.915003 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:22.914906    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9a8f400e-4946-4dd4-b6d0-890cbca44ead-workload-socket\") pod \"e2e-migrate-2e9331f5-gw-openshift-default-76bb964575-szww7\" (UID: \"9a8f400e-4946-4dd4-b6d0-890cbca44ead\") " pod="openshift-ingress/e2e-migrate-2e9331f5-gw-openshift-default-76bb964575-szww7"
Jul 17 20:26:23.016039 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:23.016000    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9a8f400e-4946-4dd4-b6d0-890cbca44ead-istio-podinfo\") pod \"e2e-migrate-2e9331f5-gw-openshift-default-76bb964575-szww7\" (UID: \"9a8f400e-4946-4dd4-b6d0-890cbca44ead\") " pod="openshift-ingress/e2e-migrate-2e9331f5-gw-openshift-default-76bb964575-szww7"
Jul 17 20:26:23.016039 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:23.016041    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9a8f400e-4946-4dd4-b6d0-890cbca44ead-istio-token\") pod \"e2e-migrate-2e9331f5-gw-openshift-default-76bb964575-szww7\" (UID: \"9a8f400e-4946-4dd4-b6d0-890cbca44ead\") " pod="openshift-ingress/e2e-migrate-2e9331f5-gw-openshift-default-76bb964575-szww7"
Jul 17 20:26:23.016313 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:23.016115    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9a8f400e-4946-4dd4-b6d0-890cbca44ead-credential-socket\") pod \"e2e-migrate-2e9331f5-gw-openshift-default-76bb964575-szww7\" (UID: \"9a8f400e-4946-4dd4-b6d0-890cbca44ead\") " pod="openshift-ingress/e2e-migrate-2e9331f5-gw-openshift-default-76bb964575-szww7"
Jul 17 20:26:23.016313 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:23.016141    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9a8f400e-4946-4dd4-b6d0-890cbca44ead-istio-envoy\") pod \"e2e-migrate-2e9331f5-gw-openshift-default-76bb964575-szww7\" (UID: \"9a8f400e-4946-4dd4-b6d0-890cbca44ead\") " pod="openshift-ingress/e2e-migrate-2e9331f5-gw-openshift-default-76bb964575-szww7"
Jul 17 20:26:23.016313 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:23.016163    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9a8f400e-4946-4dd4-b6d0-890cbca44ead-workload-socket\") pod \"e2e-migrate-2e9331f5-gw-openshift-default-76bb964575-szww7\" (UID: \"9a8f400e-4946-4dd4-b6d0-890cbca44ead\") " pod="openshift-ingress/e2e-migrate-2e9331f5-gw-openshift-default-76bb964575-szww7"
Jul 17 20:26:23.016313 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:23.016188    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9a8f400e-4946-4dd4-b6d0-890cbca44ead-istio-data\") pod \"e2e-migrate-2e9331f5-gw-openshift-default-76bb964575-szww7\" (UID: \"9a8f400e-4946-4dd4-b6d0-890cbca44ead\") " pod="openshift-ingress/e2e-migrate-2e9331f5-gw-openshift-default-76bb964575-szww7"
Jul 17 20:26:23.016313 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:23.016205    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zx6gd\" (UniqueName: \"kubernetes.io/projected/9a8f400e-4946-4dd4-b6d0-890cbca44ead-kube-api-access-zx6gd\") pod \"e2e-migrate-2e9331f5-gw-openshift-default-76bb964575-szww7\" (UID: \"9a8f400e-4946-4dd4-b6d0-890cbca44ead\") " pod="openshift-ingress/e2e-migrate-2e9331f5-gw-openshift-default-76bb964575-szww7"
Jul 17 20:26:23.016313 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:23.016231    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9a8f400e-4946-4dd4-b6d0-890cbca44ead-workload-certs\") pod \"e2e-migrate-2e9331f5-gw-openshift-default-76bb964575-szww7\" (UID: \"9a8f400e-4946-4dd4-b6d0-890cbca44ead\") " pod="openshift-ingress/e2e-migrate-2e9331f5-gw-openshift-default-76bb964575-szww7"
Jul 17 20:26:23.016313 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:23.016256    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9a8f400e-4946-4dd4-b6d0-890cbca44ead-istiod-ca-cert\") pod \"e2e-migrate-2e9331f5-gw-openshift-default-76bb964575-szww7\" (UID: \"9a8f400e-4946-4dd4-b6d0-890cbca44ead\") " pod="openshift-ingress/e2e-migrate-2e9331f5-gw-openshift-default-76bb964575-szww7"
Jul 17 20:26:23.016654 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:23.016613    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9a8f400e-4946-4dd4-b6d0-890cbca44ead-credential-socket\") pod \"e2e-migrate-2e9331f5-gw-openshift-default-76bb964575-szww7\" (UID: \"9a8f400e-4946-4dd4-b6d0-890cbca44ead\") " pod="openshift-ingress/e2e-migrate-2e9331f5-gw-openshift-default-76bb964575-szww7"
Jul 17 20:26:23.016883 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:23.016851    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9a8f400e-4946-4dd4-b6d0-890cbca44ead-workload-socket\") pod \"e2e-migrate-2e9331f5-gw-openshift-default-76bb964575-szww7\" (UID: \"9a8f400e-4946-4dd4-b6d0-890cbca44ead\") " pod="openshift-ingress/e2e-migrate-2e9331f5-gw-openshift-default-76bb964575-szww7"
Jul 17 20:26:23.017012 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:23.016893    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9a8f400e-4946-4dd4-b6d0-890cbca44ead-istio-data\") pod \"e2e-migrate-2e9331f5-gw-openshift-default-76bb964575-szww7\" (UID: \"9a8f400e-4946-4dd4-b6d0-890cbca44ead\") " pod="openshift-ingress/e2e-migrate-2e9331f5-gw-openshift-default-76bb964575-szww7"
Jul 17 20:26:23.017012 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:23.016946    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9a8f400e-4946-4dd4-b6d0-890cbca44ead-workload-certs\") pod \"e2e-migrate-2e9331f5-gw-openshift-default-76bb964575-szww7\" (UID: \"9a8f400e-4946-4dd4-b6d0-890cbca44ead\") " pod="openshift-ingress/e2e-migrate-2e9331f5-gw-openshift-default-76bb964575-szww7"
Jul 17 20:26:23.017168 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:23.017014    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9a8f400e-4946-4dd4-b6d0-890cbca44ead-istiod-ca-cert\") pod \"e2e-migrate-2e9331f5-gw-openshift-default-76bb964575-szww7\" (UID: \"9a8f400e-4946-4dd4-b6d0-890cbca44ead\") " pod="openshift-ingress/e2e-migrate-2e9331f5-gw-openshift-default-76bb964575-szww7"
Jul 17 20:26:23.018512 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:23.018489    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9a8f400e-4946-4dd4-b6d0-890cbca44ead-istio-envoy\") pod \"e2e-migrate-2e9331f5-gw-openshift-default-76bb964575-szww7\" (UID: \"9a8f400e-4946-4dd4-b6d0-890cbca44ead\") " pod="openshift-ingress/e2e-migrate-2e9331f5-gw-openshift-default-76bb964575-szww7"
Jul 17 20:26:23.018653 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:23.018633    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9a8f400e-4946-4dd4-b6d0-890cbca44ead-istio-podinfo\") pod \"e2e-migrate-2e9331f5-gw-openshift-default-76bb964575-szww7\" (UID: \"9a8f400e-4946-4dd4-b6d0-890cbca44ead\") " pod="openshift-ingress/e2e-migrate-2e9331f5-gw-openshift-default-76bb964575-szww7"
Jul 17 20:26:23.023818 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:23.023799    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9a8f400e-4946-4dd4-b6d0-890cbca44ead-istio-token\") pod \"e2e-migrate-2e9331f5-gw-openshift-default-76bb964575-szww7\" (UID: \"9a8f400e-4946-4dd4-b6d0-890cbca44ead\") " pod="openshift-ingress/e2e-migrate-2e9331f5-gw-openshift-default-76bb964575-szww7"
Jul 17 20:26:23.024000 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:23.023980    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zx6gd\" (UniqueName: \"kubernetes.io/projected/9a8f400e-4946-4dd4-b6d0-890cbca44ead-kube-api-access-zx6gd\") pod \"e2e-migrate-2e9331f5-gw-openshift-default-76bb964575-szww7\" (UID: \"9a8f400e-4946-4dd4-b6d0-890cbca44ead\") " pod="openshift-ingress/e2e-migrate-2e9331f5-gw-openshift-default-76bb964575-szww7"
Jul 17 20:26:23.094551 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:23.094463    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-2e9331f5-gw-openshift-default-76bb964575-szww7"
Jul 17 20:26:23.236878 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:23.236847    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-2e9331f5-gw-openshift-default-76bb964575-szww7"]
Jul 17 20:26:23.239203 ip-10-0-141-177 kubenswrapper[2572]: W0717 20:26:23.239174    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a8f400e_4946_4dd4_b6d0_890cbca44ead.slice/crio-e94cab9448d457602e2a588f9ad719cca5095acf96f1017fc407373851b3810f WatchSource:0}: Error finding container e94cab9448d457602e2a588f9ad719cca5095acf96f1017fc407373851b3810f: Status 404 returned error can't find the container with id e94cab9448d457602e2a588f9ad719cca5095acf96f1017fc407373851b3810f
Jul 17 20:26:23.241838 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:23.241803    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 17 20:26:23.242243 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:23.241889    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 17 20:26:23.242243 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:23.241941    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 17 20:26:23.538379 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:23.538343    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-2e9331f5-gw-openshift-default-76bb964575-szww7" event={"ID":"9a8f400e-4946-4dd4-b6d0-890cbca44ead","Type":"ContainerStarted","Data":"d5203df0945999d3b0087f7fd41a3938d07be5cf56c0578caadb3ce23e132d13"}
Jul 17 20:26:23.538579 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:23.538397    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-2e9331f5-gw-openshift-default-76bb964575-szww7" event={"ID":"9a8f400e-4946-4dd4-b6d0-890cbca44ead","Type":"ContainerStarted","Data":"e94cab9448d457602e2a588f9ad719cca5095acf96f1017fc407373851b3810f"}
Jul 17 20:26:23.563857 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:23.563805    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-2e9331f5-gw-openshift-default-76bb964575-szww7" podStartSLOduration=1.563789536 podStartE2EDuration="1.563789536s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 20:26:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 20:26:23.562903365 +0000 UTC m=+1808.404399003" watchObservedRunningTime="2026-07-17 20:26:23.563789536 +0000 UTC m=+1808.405285172"
Jul 17 20:26:23.963945 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:23.963916    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:26:24.095350 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:24.095312    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-2e9331f5-gw-openshift-default-76bb964575-szww7"
Jul 17 20:26:24.100763 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:24.100738    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-2e9331f5-gw-openshift-default-76bb964575-szww7"
Jul 17 20:26:24.181851 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:24.181816    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-2e9331f5-6bf695dbbb-h4bbt"]
Jul 17 20:26:24.182500 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:24.182475    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cafc8ddb-438c-42b2-bfaa-48968198e4af" containerName="maas-api"
Jul 17 20:26:24.182657 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:24.182643    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="cafc8ddb-438c-42b2-bfaa-48968198e4af" containerName="maas-api"
Jul 17 20:26:24.182804 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:24.182783    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3900dba8-8e73-4e48-82f6-63da768e8014" containerName="istio-proxy"
Jul 17 20:26:24.182804 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:24.182803    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="3900dba8-8e73-4e48-82f6-63da768e8014" containerName="istio-proxy"
Jul 17 20:26:24.183082 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:24.182934    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="3900dba8-8e73-4e48-82f6-63da768e8014" containerName="istio-proxy"
Jul 17 20:26:24.186607 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:24.186586    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2e9331f5-6bf695dbbb-h4bbt"
Jul 17 20:26:24.189084 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:24.189050    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-2e9331f5-serving-cert\""
Jul 17 20:26:24.197560 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:24.197021    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-2e9331f5-6bf695dbbb-h4bbt"]
Jul 17 20:26:24.250650 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:24.250620    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:26:24.329886 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:24.329846    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tspck\" (UniqueName: \"kubernetes.io/projected/a085c166-af4d-486c-8375-5fafe73b3d2d-kube-api-access-tspck\") pod \"maas-api-e2e-migrate-2e9331f5-6bf695dbbb-h4bbt\" (UID: \"a085c166-af4d-486c-8375-5fafe73b3d2d\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2e9331f5-6bf695dbbb-h4bbt"
Jul 17 20:26:24.330115 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:24.329947    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a085c166-af4d-486c-8375-5fafe73b3d2d-maas-api-tls\") pod \"maas-api-e2e-migrate-2e9331f5-6bf695dbbb-h4bbt\" (UID: \"a085c166-af4d-486c-8375-5fafe73b3d2d\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2e9331f5-6bf695dbbb-h4bbt"
Jul 17 20:26:24.330115 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:24.330035    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a085c166-af4d-486c-8375-5fafe73b3d2d-openshift-service-ca\") pod \"maas-api-e2e-migrate-2e9331f5-6bf695dbbb-h4bbt\" (UID: \"a085c166-af4d-486c-8375-5fafe73b3d2d\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2e9331f5-6bf695dbbb-h4bbt"
Jul 17 20:26:24.430583 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:24.430547    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a085c166-af4d-486c-8375-5fafe73b3d2d-openshift-service-ca\") pod \"maas-api-e2e-migrate-2e9331f5-6bf695dbbb-h4bbt\" (UID: \"a085c166-af4d-486c-8375-5fafe73b3d2d\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2e9331f5-6bf695dbbb-h4bbt"
Jul 17 20:26:24.430786 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:24.430600    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tspck\" (UniqueName: \"kubernetes.io/projected/a085c166-af4d-486c-8375-5fafe73b3d2d-kube-api-access-tspck\") pod \"maas-api-e2e-migrate-2e9331f5-6bf695dbbb-h4bbt\" (UID: \"a085c166-af4d-486c-8375-5fafe73b3d2d\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2e9331f5-6bf695dbbb-h4bbt"
Jul 17 20:26:24.430786 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:24.430645    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a085c166-af4d-486c-8375-5fafe73b3d2d-maas-api-tls\") pod \"maas-api-e2e-migrate-2e9331f5-6bf695dbbb-h4bbt\" (UID: \"a085c166-af4d-486c-8375-5fafe73b3d2d\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2e9331f5-6bf695dbbb-h4bbt"
Jul 17 20:26:24.430786 ip-10-0-141-177 kubenswrapper[2572]: E0717 20:26:24.430740    2572 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-migrate-2e9331f5-serving-cert: secret "maas-api-e2e-migrate-2e9331f5-serving-cert" not found
Jul 17 20:26:24.430951 ip-10-0-141-177 kubenswrapper[2572]: E0717 20:26:24.430802    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a085c166-af4d-486c-8375-5fafe73b3d2d-maas-api-tls podName:a085c166-af4d-486c-8375-5fafe73b3d2d nodeName:}" failed. No retries permitted until 2026-07-17 20:26:24.930779867 +0000 UTC m=+1809.772275482 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/a085c166-af4d-486c-8375-5fafe73b3d2d-maas-api-tls") pod "maas-api-e2e-migrate-2e9331f5-6bf695dbbb-h4bbt" (UID: "a085c166-af4d-486c-8375-5fafe73b3d2d") : secret "maas-api-e2e-migrate-2e9331f5-serving-cert" not found
Jul 17 20:26:24.431296 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:24.431276    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a085c166-af4d-486c-8375-5fafe73b3d2d-openshift-service-ca\") pod \"maas-api-e2e-migrate-2e9331f5-6bf695dbbb-h4bbt\" (UID: \"a085c166-af4d-486c-8375-5fafe73b3d2d\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2e9331f5-6bf695dbbb-h4bbt"
Jul 17 20:26:24.455057 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:24.455030    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tspck\" (UniqueName: \"kubernetes.io/projected/a085c166-af4d-486c-8375-5fafe73b3d2d-kube-api-access-tspck\") pod \"maas-api-e2e-migrate-2e9331f5-6bf695dbbb-h4bbt\" (UID: \"a085c166-af4d-486c-8375-5fafe73b3d2d\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2e9331f5-6bf695dbbb-h4bbt"
Jul 17 20:26:24.543772 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:24.543687    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-2e9331f5-gw-openshift-default-76bb964575-szww7"
Jul 17 20:26:24.544802 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:24.544784    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-2e9331f5-gw-openshift-default-76bb964575-szww7"
Jul 17 20:26:24.557022 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:24.556982    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:26:24.936740 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:24.936651    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a085c166-af4d-486c-8375-5fafe73b3d2d-maas-api-tls\") pod \"maas-api-e2e-migrate-2e9331f5-6bf695dbbb-h4bbt\" (UID: \"a085c166-af4d-486c-8375-5fafe73b3d2d\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2e9331f5-6bf695dbbb-h4bbt"
Jul 17 20:26:24.939112 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:24.939094    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a085c166-af4d-486c-8375-5fafe73b3d2d-maas-api-tls\") pod \"maas-api-e2e-migrate-2e9331f5-6bf695dbbb-h4bbt\" (UID: \"a085c166-af4d-486c-8375-5fafe73b3d2d\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2e9331f5-6bf695dbbb-h4bbt"
Jul 17 20:26:25.103132 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:25.103094    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2e9331f5-6bf695dbbb-h4bbt"
Jul 17 20:26:25.121046 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:25.120984    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:26:25.226395 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:25.226353    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:26:25.242921 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:25.242892    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-2e9331f5-6bf695dbbb-h4bbt"]
Jul 17 20:26:25.244692 ip-10-0-141-177 kubenswrapper[2572]: W0717 20:26:25.244670    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda085c166_af4d_486c_8375_5fafe73b3d2d.slice/crio-17190941d77c5ec93230d3ac5dbf9a0cd69f86f1e83d02bcce167fc2a2cb44d7 WatchSource:0}: Error finding container 17190941d77c5ec93230d3ac5dbf9a0cd69f86f1e83d02bcce167fc2a2cb44d7: Status 404 returned error can't find the container with id 17190941d77c5ec93230d3ac5dbf9a0cd69f86f1e83d02bcce167fc2a2cb44d7
Jul 17 20:26:25.549722 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:25.549690    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2e9331f5-6bf695dbbb-h4bbt" event={"ID":"a085c166-af4d-486c-8375-5fafe73b3d2d","Type":"ContainerStarted","Data":"17190941d77c5ec93230d3ac5dbf9a0cd69f86f1e83d02bcce167fc2a2cb44d7"}
Jul 17 20:26:26.555511 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:26.555477    2572 generic.go:356] "Generic (PLEG): container finished" podID="a085c166-af4d-486c-8375-5fafe73b3d2d" containerID="dffe795233e5c842eb82ff0df217c5ba7ebc7148e01e97279c1767dc3a61fd14" exitCode=1
Jul 17 20:26:26.555971 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:26.555566    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2e9331f5-6bf695dbbb-h4bbt" event={"ID":"a085c166-af4d-486c-8375-5fafe73b3d2d","Type":"ContainerDied","Data":"dffe795233e5c842eb82ff0df217c5ba7ebc7148e01e97279c1767dc3a61fd14"}
Jul 17 20:26:26.555971 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:26.555850    2572 scope.go:117] "RemoveContainer" containerID="dffe795233e5c842eb82ff0df217c5ba7ebc7148e01e97279c1767dc3a61fd14"
Jul 17 20:26:27.563639 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:27.563539    2572 generic.go:356] "Generic (PLEG): container finished" podID="a085c166-af4d-486c-8375-5fafe73b3d2d" containerID="f55134b5c9200786f7faf8200a5f94e29ff3e7c166e0f29a87d058c770cdafff" exitCode=1
Jul 17 20:26:27.563639 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:27.563621    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2e9331f5-6bf695dbbb-h4bbt" event={"ID":"a085c166-af4d-486c-8375-5fafe73b3d2d","Type":"ContainerDied","Data":"f55134b5c9200786f7faf8200a5f94e29ff3e7c166e0f29a87d058c770cdafff"}
Jul 17 20:26:27.564166 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:27.563687    2572 scope.go:117] "RemoveContainer" containerID="dffe795233e5c842eb82ff0df217c5ba7ebc7148e01e97279c1767dc3a61fd14"
Jul 17 20:26:27.564166 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:27.564013    2572 scope.go:117] "RemoveContainer" containerID="f55134b5c9200786f7faf8200a5f94e29ff3e7c166e0f29a87d058c770cdafff"
Jul 17 20:26:27.564316 ip-10-0-141-177 kubenswrapper[2572]: E0717 20:26:27.564294    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-migrate-2e9331f5-6bf695dbbb-h4bbt_odh-ai-gateway-infra(a085c166-af4d-486c-8375-5fafe73b3d2d)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2e9331f5-6bf695dbbb-h4bbt" podUID="a085c166-af4d-486c-8375-5fafe73b3d2d"
Jul 17 20:26:28.570682 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:28.570655    2572 scope.go:117] "RemoveContainer" containerID="f55134b5c9200786f7faf8200a5f94e29ff3e7c166e0f29a87d058c770cdafff"
Jul 17 20:26:28.571090 ip-10-0-141-177 kubenswrapper[2572]: E0717 20:26:28.570829    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-migrate-2e9331f5-6bf695dbbb-h4bbt_odh-ai-gateway-infra(a085c166-af4d-486c-8375-5fafe73b3d2d)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2e9331f5-6bf695dbbb-h4bbt" podUID="a085c166-af4d-486c-8375-5fafe73b3d2d"
Jul 17 20:26:30.103474 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:30.103428    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2e9331f5-6bf695dbbb-h4bbt"
Jul 17 20:26:30.103951 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:30.103927    2572 scope.go:117] "RemoveContainer" containerID="f55134b5c9200786f7faf8200a5f94e29ff3e7c166e0f29a87d058c770cdafff"
Jul 17 20:26:30.104213 ip-10-0-141-177 kubenswrapper[2572]: E0717 20:26:30.104188    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-migrate-2e9331f5-6bf695dbbb-h4bbt_odh-ai-gateway-infra(a085c166-af4d-486c-8375-5fafe73b3d2d)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2e9331f5-6bf695dbbb-h4bbt" podUID="a085c166-af4d-486c-8375-5fafe73b3d2d"
Jul 17 20:26:30.901715 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:30.901683    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:26:31.053507 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:31.053461    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:26:35.104106 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:35.104051    2572 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2e9331f5-6bf695dbbb-h4bbt"
Jul 17 20:26:35.104542 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:35.104487    2572 scope.go:117] "RemoveContainer" containerID="f55134b5c9200786f7faf8200a5f94e29ff3e7c166e0f29a87d058c770cdafff"
Jul 17 20:26:35.104688 ip-10-0-141-177 kubenswrapper[2572]: E0717 20:26:35.104667    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-migrate-2e9331f5-6bf695dbbb-h4bbt_odh-ai-gateway-infra(a085c166-af4d-486c-8375-5fafe73b3d2d)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2e9331f5-6bf695dbbb-h4bbt" podUID="a085c166-af4d-486c-8375-5fafe73b3d2d"
Jul 17 20:26:35.609412 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:35.609379    2572 generic.go:356] "Generic (PLEG): container finished" podID="9a8f400e-4946-4dd4-b6d0-890cbca44ead" containerID="d5203df0945999d3b0087f7fd41a3938d07be5cf56c0578caadb3ce23e132d13" exitCode=0
Jul 17 20:26:35.609589 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:35.609417    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-2e9331f5-gw-openshift-default-76bb964575-szww7" event={"ID":"9a8f400e-4946-4dd4-b6d0-890cbca44ead","Type":"ContainerDied","Data":"d5203df0945999d3b0087f7fd41a3938d07be5cf56c0578caadb3ce23e132d13"}
Jul 17 20:26:35.609881 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:35.609866    2572 scope.go:117] "RemoveContainer" containerID="d5203df0945999d3b0087f7fd41a3938d07be5cf56c0578caadb3ce23e132d13"
Jul 17 20:26:35.610912 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:35.610884    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 17 20:26:35.610965 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:35.610950    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 17 20:26:35.611001 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:35.610979    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 17 20:26:36.616103 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:36.616049    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-2e9331f5-gw-openshift-default-76bb964575-szww7" event={"ID":"9a8f400e-4946-4dd4-b6d0-890cbca44ead","Type":"ContainerStarted","Data":"b2c6e7bca346484595131bc296bcb8b2ae8aedd6c0167dec162554552611cdc9"}
Jul 17 20:26:36.985204 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:36.985172    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:26:37.084104 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:37.084052    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:26:37.095214 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:37.095187    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-2e9331f5-gw-openshift-default-76bb964575-szww7"
Jul 17 20:26:37.096367 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:37.096344    2572 patch_prober.go:28] interesting pod/e2e-migrate-2e9331f5-gw-openshift-default-76bb964575-szww7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body=
Jul 17 20:26:37.096504 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:37.096402    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-2e9331f5-gw-openshift-default-76bb964575-szww7" podUID="9a8f400e-4946-4dd4-b6d0-890cbca44ead" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused"
Jul 17 20:26:38.095345 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:38.095312    2572 patch_prober.go:28] interesting pod/e2e-migrate-2e9331f5-gw-openshift-default-76bb964575-szww7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body=
Jul 17 20:26:38.095754 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:38.095366    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-2e9331f5-gw-openshift-default-76bb964575-szww7" podUID="9a8f400e-4946-4dd4-b6d0-890cbca44ead" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused"
Jul 17 20:26:39.095168 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:39.095134    2572 patch_prober.go:28] interesting pod/e2e-migrate-2e9331f5-gw-openshift-default-76bb964575-szww7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body=
Jul 17 20:26:39.095349 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:39.095199    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-2e9331f5-gw-openshift-default-76bb964575-szww7" podUID="9a8f400e-4946-4dd4-b6d0-890cbca44ead" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused"
Jul 17 20:26:39.543946 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:39.543911    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-2e9331f5-gw-openshift-default-76bb964575-szww7"
Jul 17 20:26:40.095430 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:40.095394    2572 patch_prober.go:28] interesting pod/e2e-migrate-2e9331f5-gw-openshift-default-76bb964575-szww7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body=
Jul 17 20:26:40.095687 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:40.095456    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-2e9331f5-gw-openshift-default-76bb964575-szww7" podUID="9a8f400e-4946-4dd4-b6d0-890cbca44ead" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused"
Jul 17 20:26:40.598048 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:40.598003    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:26:41.098464 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:41.098438    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-2e9331f5-gw-openshift-default-76bb964575-szww7"
Jul 17 20:26:41.099422 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:41.099405    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-2e9331f5-gw-openshift-default-76bb964575-szww7"
Jul 17 20:26:45.751186 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:45.751157    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:26:45.854245 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:45.854215    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:26:46.681702 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:46.681666    2572 scope.go:117] "RemoveContainer" containerID="f55134b5c9200786f7faf8200a5f94e29ff3e7c166e0f29a87d058c770cdafff"
Jul 17 20:26:47.675033 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:47.674955    2572 generic.go:356] "Generic (PLEG): container finished" podID="a085c166-af4d-486c-8375-5fafe73b3d2d" containerID="b31385338cc80700ca5809b598a28d06b2ae38c83139c2bf9a3e91f387930f48" exitCode=1
Jul 17 20:26:47.675427 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:47.675029    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2e9331f5-6bf695dbbb-h4bbt" event={"ID":"a085c166-af4d-486c-8375-5fafe73b3d2d","Type":"ContainerDied","Data":"b31385338cc80700ca5809b598a28d06b2ae38c83139c2bf9a3e91f387930f48"}
Jul 17 20:26:47.675427 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:47.675116    2572 scope.go:117] "RemoveContainer" containerID="f55134b5c9200786f7faf8200a5f94e29ff3e7c166e0f29a87d058c770cdafff"
Jul 17 20:26:47.675516 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:47.675450    2572 scope.go:117] "RemoveContainer" containerID="b31385338cc80700ca5809b598a28d06b2ae38c83139c2bf9a3e91f387930f48"
Jul 17 20:26:47.675688 ip-10-0-141-177 kubenswrapper[2572]: E0717 20:26:47.675667    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 20s restarting failed container=maas-api pod=maas-api-e2e-migrate-2e9331f5-6bf695dbbb-h4bbt_odh-ai-gateway-infra(a085c166-af4d-486c-8375-5fafe73b3d2d)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2e9331f5-6bf695dbbb-h4bbt" podUID="a085c166-af4d-486c-8375-5fafe73b3d2d"
Jul 17 20:26:50.103188 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:50.103156    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2e9331f5-6bf695dbbb-h4bbt"
Jul 17 20:26:50.103684 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:50.103522    2572 scope.go:117] "RemoveContainer" containerID="b31385338cc80700ca5809b598a28d06b2ae38c83139c2bf9a3e91f387930f48"
Jul 17 20:26:50.103757 ip-10-0-141-177 kubenswrapper[2572]: E0717 20:26:50.103697    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 20s restarting failed container=maas-api pod=maas-api-e2e-migrate-2e9331f5-6bf695dbbb-h4bbt_odh-ai-gateway-infra(a085c166-af4d-486c-8375-5fafe73b3d2d)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2e9331f5-6bf695dbbb-h4bbt" podUID="a085c166-af4d-486c-8375-5fafe73b3d2d"
Jul 17 20:26:55.103525 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:55.103492    2572 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2e9331f5-6bf695dbbb-h4bbt"
Jul 17 20:26:55.103914 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:26:55.103855    2572 scope.go:117] "RemoveContainer" containerID="b31385338cc80700ca5809b598a28d06b2ae38c83139c2bf9a3e91f387930f48"
Jul 17 20:26:55.104045 ip-10-0-141-177 kubenswrapper[2572]: E0717 20:26:55.104025    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 20s restarting failed container=maas-api pod=maas-api-e2e-migrate-2e9331f5-6bf695dbbb-h4bbt_odh-ai-gateway-infra(a085c166-af4d-486c-8375-5fafe73b3d2d)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2e9331f5-6bf695dbbb-h4bbt" podUID="a085c166-af4d-486c-8375-5fafe73b3d2d"
Jul 17 20:27:06.681209 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:27:06.681177    2572 scope.go:117] "RemoveContainer" containerID="b31385338cc80700ca5809b598a28d06b2ae38c83139c2bf9a3e91f387930f48"
Jul 17 20:27:06.681661 ip-10-0-141-177 kubenswrapper[2572]: E0717 20:27:06.681358    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 20s restarting failed container=maas-api pod=maas-api-e2e-migrate-2e9331f5-6bf695dbbb-h4bbt_odh-ai-gateway-infra(a085c166-af4d-486c-8375-5fafe73b3d2d)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2e9331f5-6bf695dbbb-h4bbt" podUID="a085c166-af4d-486c-8375-5fafe73b3d2d"
Jul 17 20:27:18.681930 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:27:18.681901    2572 scope.go:117] "RemoveContainer" containerID="b31385338cc80700ca5809b598a28d06b2ae38c83139c2bf9a3e91f387930f48"
Jul 17 20:27:19.847391 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:27:19.847357    2572 generic.go:356] "Generic (PLEG): container finished" podID="a085c166-af4d-486c-8375-5fafe73b3d2d" containerID="12bed4a8ec5ee355fabcd2a45c419ebf816c1a354f0de421d55f5aaef22394e9" exitCode=1
Jul 17 20:27:19.847923 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:27:19.847412    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2e9331f5-6bf695dbbb-h4bbt" event={"ID":"a085c166-af4d-486c-8375-5fafe73b3d2d","Type":"ContainerDied","Data":"12bed4a8ec5ee355fabcd2a45c419ebf816c1a354f0de421d55f5aaef22394e9"}
Jul 17 20:27:19.847923 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:27:19.847488    2572 scope.go:117] "RemoveContainer" containerID="b31385338cc80700ca5809b598a28d06b2ae38c83139c2bf9a3e91f387930f48"
Jul 17 20:27:19.847923 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:27:19.847870    2572 scope.go:117] "RemoveContainer" containerID="12bed4a8ec5ee355fabcd2a45c419ebf816c1a354f0de421d55f5aaef22394e9"
Jul 17 20:27:19.848164 ip-10-0-141-177 kubenswrapper[2572]: E0717 20:27:19.848140    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-migrate-2e9331f5-6bf695dbbb-h4bbt_odh-ai-gateway-infra(a085c166-af4d-486c-8375-5fafe73b3d2d)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2e9331f5-6bf695dbbb-h4bbt" podUID="a085c166-af4d-486c-8375-5fafe73b3d2d"
Jul 17 20:27:20.104266 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:27:20.104179    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2e9331f5-6bf695dbbb-h4bbt"
Jul 17 20:27:20.855508 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:27:20.855481    2572 scope.go:117] "RemoveContainer" containerID="12bed4a8ec5ee355fabcd2a45c419ebf816c1a354f0de421d55f5aaef22394e9"
Jul 17 20:27:20.855890 ip-10-0-141-177 kubenswrapper[2572]: E0717 20:27:20.855657    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-migrate-2e9331f5-6bf695dbbb-h4bbt_odh-ai-gateway-infra(a085c166-af4d-486c-8375-5fafe73b3d2d)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2e9331f5-6bf695dbbb-h4bbt" podUID="a085c166-af4d-486c-8375-5fafe73b3d2d"
Jul 17 20:27:25.103900 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:27:25.103849    2572 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2e9331f5-6bf695dbbb-h4bbt"
Jul 17 20:27:25.104350 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:27:25.104289    2572 scope.go:117] "RemoveContainer" containerID="12bed4a8ec5ee355fabcd2a45c419ebf816c1a354f0de421d55f5aaef22394e9"
Jul 17 20:27:25.104489 ip-10-0-141-177 kubenswrapper[2572]: E0717 20:27:25.104467    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-migrate-2e9331f5-6bf695dbbb-h4bbt_odh-ai-gateway-infra(a085c166-af4d-486c-8375-5fafe73b3d2d)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2e9331f5-6bf695dbbb-h4bbt" podUID="a085c166-af4d-486c-8375-5fafe73b3d2d"
Jul 17 20:27:28.584698 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:27:28.584659    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-2e9331f5-gw-openshift-default-76bb964575-szww7"]
Jul 17 20:27:28.585162 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:27:28.584904    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-2e9331f5-gw-openshift-default-76bb964575-szww7" podUID="9a8f400e-4946-4dd4-b6d0-890cbca44ead" containerName="istio-proxy" containerID="cri-o://b2c6e7bca346484595131bc296bcb8b2ae8aedd6c0167dec162554552611cdc9" gracePeriod=30
Jul 17 20:27:28.620747 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:27:28.620718    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:27:30.270767 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:27:30.270731    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:27:33.743001 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:27:33.742945    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-2e9331f5-6bf695dbbb-h4bbt"]
Jul 17 20:27:33.797124 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:27:33.797040    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:27:33.858321 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:27:33.858261    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-2e9331f5-gw-openshift-default-76bb964575-szww7"
Jul 17 20:27:33.906124 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:27:33.906097    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2e9331f5-6bf695dbbb-h4bbt"
Jul 17 20:27:33.930306 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:27:33.930278    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2e9331f5-6bf695dbbb-h4bbt"
Jul 17 20:27:33.930306 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:27:33.930295    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2e9331f5-6bf695dbbb-h4bbt" event={"ID":"a085c166-af4d-486c-8375-5fafe73b3d2d","Type":"ContainerDied","Data":"17190941d77c5ec93230d3ac5dbf9a0cd69f86f1e83d02bcce167fc2a2cb44d7"}
Jul 17 20:27:33.930550 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:27:33.930359    2572 scope.go:117] "RemoveContainer" containerID="12bed4a8ec5ee355fabcd2a45c419ebf816c1a354f0de421d55f5aaef22394e9"
Jul 17 20:27:33.932504 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:27:33.932477    2572 generic.go:356] "Generic (PLEG): container finished" podID="9a8f400e-4946-4dd4-b6d0-890cbca44ead" containerID="b2c6e7bca346484595131bc296bcb8b2ae8aedd6c0167dec162554552611cdc9" exitCode=0
Jul 17 20:27:33.932612 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:27:33.932521    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-2e9331f5-gw-openshift-default-76bb964575-szww7" event={"ID":"9a8f400e-4946-4dd4-b6d0-890cbca44ead","Type":"ContainerDied","Data":"b2c6e7bca346484595131bc296bcb8b2ae8aedd6c0167dec162554552611cdc9"}
Jul 17 20:27:33.932612 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:27:33.932562    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-2e9331f5-gw-openshift-default-76bb964575-szww7" event={"ID":"9a8f400e-4946-4dd4-b6d0-890cbca44ead","Type":"ContainerDied","Data":"e94cab9448d457602e2a588f9ad719cca5095acf96f1017fc407373851b3810f"}
Jul 17 20:27:33.932612 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:27:33.932524    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-2e9331f5-gw-openshift-default-76bb964575-szww7"
Jul 17 20:27:33.940244 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:27:33.940228    2572 scope.go:117] "RemoveContainer" containerID="b2c6e7bca346484595131bc296bcb8b2ae8aedd6c0167dec162554552611cdc9"
Jul 17 20:27:33.948516 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:27:33.948488    2572 scope.go:117] "RemoveContainer" containerID="d5203df0945999d3b0087f7fd41a3938d07be5cf56c0578caadb3ce23e132d13"
Jul 17 20:27:33.956248 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:27:33.956228    2572 scope.go:117] "RemoveContainer" containerID="b2c6e7bca346484595131bc296bcb8b2ae8aedd6c0167dec162554552611cdc9"
Jul 17 20:27:33.956567 ip-10-0-141-177 kubenswrapper[2572]: E0717 20:27:33.956539    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b2c6e7bca346484595131bc296bcb8b2ae8aedd6c0167dec162554552611cdc9\": container with ID starting with b2c6e7bca346484595131bc296bcb8b2ae8aedd6c0167dec162554552611cdc9 not found: ID does not exist" containerID="b2c6e7bca346484595131bc296bcb8b2ae8aedd6c0167dec162554552611cdc9"
Jul 17 20:27:33.956657 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:27:33.956568    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b2c6e7bca346484595131bc296bcb8b2ae8aedd6c0167dec162554552611cdc9"} err="failed to get container status \"b2c6e7bca346484595131bc296bcb8b2ae8aedd6c0167dec162554552611cdc9\": rpc error: code = NotFound desc = could not find container \"b2c6e7bca346484595131bc296bcb8b2ae8aedd6c0167dec162554552611cdc9\": container with ID starting with b2c6e7bca346484595131bc296bcb8b2ae8aedd6c0167dec162554552611cdc9 not found: ID does not exist"
Jul 17 20:27:33.956657 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:27:33.956585    2572 scope.go:117] "RemoveContainer" containerID="d5203df0945999d3b0087f7fd41a3938d07be5cf56c0578caadb3ce23e132d13"
Jul 17 20:27:33.956833 ip-10-0-141-177 kubenswrapper[2572]: E0717 20:27:33.956818    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d5203df0945999d3b0087f7fd41a3938d07be5cf56c0578caadb3ce23e132d13\": container with ID starting with d5203df0945999d3b0087f7fd41a3938d07be5cf56c0578caadb3ce23e132d13 not found: ID does not exist" containerID="d5203df0945999d3b0087f7fd41a3938d07be5cf56c0578caadb3ce23e132d13"
Jul 17 20:27:33.956893 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:27:33.956837    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5203df0945999d3b0087f7fd41a3938d07be5cf56c0578caadb3ce23e132d13"} err="failed to get container status \"d5203df0945999d3b0087f7fd41a3938d07be5cf56c0578caadb3ce23e132d13\": rpc error: code = NotFound desc = could not find container \"d5203df0945999d3b0087f7fd41a3938d07be5cf56c0578caadb3ce23e132d13\": container with ID starting with d5203df0945999d3b0087f7fd41a3938d07be5cf56c0578caadb3ce23e132d13 not found: ID does not exist"
Jul 17 20:27:34.010706 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:27:34.010675    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tspck\" (UniqueName: \"kubernetes.io/projected/a085c166-af4d-486c-8375-5fafe73b3d2d-kube-api-access-tspck\") pod \"a085c166-af4d-486c-8375-5fafe73b3d2d\" (UID: \"a085c166-af4d-486c-8375-5fafe73b3d2d\") "
Jul 17 20:27:34.010882 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:27:34.010742    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9a8f400e-4946-4dd4-b6d0-890cbca44ead-istio-podinfo\") pod \"9a8f400e-4946-4dd4-b6d0-890cbca44ead\" (UID: \"9a8f400e-4946-4dd4-b6d0-890cbca44ead\") "
Jul 17 20:27:34.010952 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:27:34.010875    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9a8f400e-4946-4dd4-b6d0-890cbca44ead-workload-socket\") pod \"9a8f400e-4946-4dd4-b6d0-890cbca44ead\" (UID: \"9a8f400e-4946-4dd4-b6d0-890cbca44ead\") "
Jul 17 20:27:34.010952 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:27:34.010910    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a085c166-af4d-486c-8375-5fafe73b3d2d-openshift-service-ca\") pod \"a085c166-af4d-486c-8375-5fafe73b3d2d\" (UID: \"a085c166-af4d-486c-8375-5fafe73b3d2d\") "
Jul 17 20:27:34.010952 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:27:34.010945    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9a8f400e-4946-4dd4-b6d0-890cbca44ead-istio-data\") pod \"9a8f400e-4946-4dd4-b6d0-890cbca44ead\" (UID: \"9a8f400e-4946-4dd4-b6d0-890cbca44ead\") "
Jul 17 20:27:34.011140 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:27:34.010968    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9a8f400e-4946-4dd4-b6d0-890cbca44ead-istio-token\") pod \"9a8f400e-4946-4dd4-b6d0-890cbca44ead\" (UID: \"9a8f400e-4946-4dd4-b6d0-890cbca44ead\") "
Jul 17 20:27:34.011140 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:27:34.011013    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a085c166-af4d-486c-8375-5fafe73b3d2d-maas-api-tls\") pod \"a085c166-af4d-486c-8375-5fafe73b3d2d\" (UID: \"a085c166-af4d-486c-8375-5fafe73b3d2d\") "
Jul 17 20:27:34.011140 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:27:34.011086    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9a8f400e-4946-4dd4-b6d0-890cbca44ead-workload-certs\") pod \"9a8f400e-4946-4dd4-b6d0-890cbca44ead\" (UID: \"9a8f400e-4946-4dd4-b6d0-890cbca44ead\") "
Jul 17 20:27:34.011140 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:27:34.011110    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9a8f400e-4946-4dd4-b6d0-890cbca44ead-credential-socket\") pod \"9a8f400e-4946-4dd4-b6d0-890cbca44ead\" (UID: \"9a8f400e-4946-4dd4-b6d0-890cbca44ead\") "
Jul 17 20:27:34.011343 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:27:34.011169    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9a8f400e-4946-4dd4-b6d0-890cbca44ead-istio-envoy\") pod \"9a8f400e-4946-4dd4-b6d0-890cbca44ead\" (UID: \"9a8f400e-4946-4dd4-b6d0-890cbca44ead\") "
Jul 17 20:27:34.011343 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:27:34.011218    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9a8f400e-4946-4dd4-b6d0-890cbca44ead-istiod-ca-cert\") pod \"9a8f400e-4946-4dd4-b6d0-890cbca44ead\" (UID: \"9a8f400e-4946-4dd4-b6d0-890cbca44ead\") "
Jul 17 20:27:34.011343 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:27:34.011247    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zx6gd\" (UniqueName: \"kubernetes.io/projected/9a8f400e-4946-4dd4-b6d0-890cbca44ead-kube-api-access-zx6gd\") pod \"9a8f400e-4946-4dd4-b6d0-890cbca44ead\" (UID: \"9a8f400e-4946-4dd4-b6d0-890cbca44ead\") "
Jul 17 20:27:34.011343 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:27:34.011250    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9a8f400e-4946-4dd4-b6d0-890cbca44ead-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "9a8f400e-4946-4dd4-b6d0-890cbca44ead" (UID: "9a8f400e-4946-4dd4-b6d0-890cbca44ead"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 20:27:34.011539 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:27:34.011380    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a085c166-af4d-486c-8375-5fafe73b3d2d-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "a085c166-af4d-486c-8375-5fafe73b3d2d" (UID: "a085c166-af4d-486c-8375-5fafe73b3d2d"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 20:27:34.012113 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:27:34.011650    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9a8f400e-4946-4dd4-b6d0-890cbca44ead-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "9a8f400e-4946-4dd4-b6d0-890cbca44ead" (UID: "9a8f400e-4946-4dd4-b6d0-890cbca44ead"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 20:27:34.012113 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:27:34.011747    2572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9a8f400e-4946-4dd4-b6d0-890cbca44ead-credential-socket\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Jul 17 20:27:34.012113 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:27:34.011767    2572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9a8f400e-4946-4dd4-b6d0-890cbca44ead-workload-socket\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Jul 17 20:27:34.012113 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:27:34.011816    2572 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a085c166-af4d-486c-8375-5fafe73b3d2d-openshift-service-ca\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Jul 17 20:27:34.012113 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:27:34.011832    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9a8f400e-4946-4dd4-b6d0-890cbca44ead-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "9a8f400e-4946-4dd4-b6d0-890cbca44ead" (UID: "9a8f400e-4946-4dd4-b6d0-890cbca44ead"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 20:27:34.012113 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:27:34.011896    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9a8f400e-4946-4dd4-b6d0-890cbca44ead-istio-data" (OuterVolumeSpecName: "istio-data") pod "9a8f400e-4946-4dd4-b6d0-890cbca44ead" (UID: "9a8f400e-4946-4dd4-b6d0-890cbca44ead"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 20:27:34.012566 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:27:34.012136    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9a8f400e-4946-4dd4-b6d0-890cbca44ead-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "9a8f400e-4946-4dd4-b6d0-890cbca44ead" (UID: "9a8f400e-4946-4dd4-b6d0-890cbca44ead"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 20:27:34.013327 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:27:34.013301    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9a8f400e-4946-4dd4-b6d0-890cbca44ead-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "9a8f400e-4946-4dd4-b6d0-890cbca44ead" (UID: "9a8f400e-4946-4dd4-b6d0-890cbca44ead"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 17 20:27:34.013689 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:27:34.013663    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a085c166-af4d-486c-8375-5fafe73b3d2d-kube-api-access-tspck" (OuterVolumeSpecName: "kube-api-access-tspck") pod "a085c166-af4d-486c-8375-5fafe73b3d2d" (UID: "a085c166-af4d-486c-8375-5fafe73b3d2d"). InnerVolumeSpecName "kube-api-access-tspck". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 20:27:34.013814 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:27:34.013780    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9a8f400e-4946-4dd4-b6d0-890cbca44ead-kube-api-access-zx6gd" (OuterVolumeSpecName: "kube-api-access-zx6gd") pod "9a8f400e-4946-4dd4-b6d0-890cbca44ead" (UID: "9a8f400e-4946-4dd4-b6d0-890cbca44ead"). InnerVolumeSpecName "kube-api-access-zx6gd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 20:27:34.013814 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:27:34.013784    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9a8f400e-4946-4dd4-b6d0-890cbca44ead-istio-token" (OuterVolumeSpecName: "istio-token") pod "9a8f400e-4946-4dd4-b6d0-890cbca44ead" (UID: "9a8f400e-4946-4dd4-b6d0-890cbca44ead"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 20:27:34.014380 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:27:34.014359    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a085c166-af4d-486c-8375-5fafe73b3d2d-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "a085c166-af4d-486c-8375-5fafe73b3d2d" (UID: "a085c166-af4d-486c-8375-5fafe73b3d2d"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 20:27:34.014547 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:27:34.014532    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9a8f400e-4946-4dd4-b6d0-890cbca44ead-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "9a8f400e-4946-4dd4-b6d0-890cbca44ead" (UID: "9a8f400e-4946-4dd4-b6d0-890cbca44ead"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 20:27:34.112663 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:27:34.112602    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tspck\" (UniqueName: \"kubernetes.io/projected/a085c166-af4d-486c-8375-5fafe73b3d2d-kube-api-access-tspck\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Jul 17 20:27:34.112663 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:27:34.112623    2572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9a8f400e-4946-4dd4-b6d0-890cbca44ead-istio-podinfo\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Jul 17 20:27:34.112663 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:27:34.112632    2572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9a8f400e-4946-4dd4-b6d0-890cbca44ead-istio-data\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Jul 17 20:27:34.112663 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:27:34.112640    2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9a8f400e-4946-4dd4-b6d0-890cbca44ead-istio-token\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Jul 17 20:27:34.112663 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:27:34.112647    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a085c166-af4d-486c-8375-5fafe73b3d2d-maas-api-tls\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Jul 17 20:27:34.112663 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:27:34.112654    2572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9a8f400e-4946-4dd4-b6d0-890cbca44ead-workload-certs\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Jul 17 20:27:34.112663 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:27:34.112661    2572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9a8f400e-4946-4dd4-b6d0-890cbca44ead-istio-envoy\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Jul 17 20:27:34.112951 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:27:34.112669    2572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9a8f400e-4946-4dd4-b6d0-890cbca44ead-istiod-ca-cert\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Jul 17 20:27:34.112951 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:27:34.112677    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zx6gd\" (UniqueName: \"kubernetes.io/projected/9a8f400e-4946-4dd4-b6d0-890cbca44ead-kube-api-access-zx6gd\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Jul 17 20:27:34.253977 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:27:34.253947    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-2e9331f5-6bf695dbbb-h4bbt"]
Jul 17 20:27:34.257975 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:27:34.257953    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-2e9331f5-6bf695dbbb-h4bbt"]
Jul 17 20:27:34.267747 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:27:34.267717    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-2e9331f5-gw-openshift-default-76bb964575-szww7"]
Jul 17 20:27:34.271532 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:27:34.271510    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-2e9331f5-gw-openshift-default-76bb964575-szww7"]
Jul 17 20:27:34.945740 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:27:34.945655    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:27:35.165811 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:27:35.165783    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:27:35.687511 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:27:35.687478    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9a8f400e-4946-4dd4-b6d0-890cbca44ead" path="/var/lib/kubelet/pods/9a8f400e-4946-4dd4-b6d0-890cbca44ead/volumes"
Jul 17 20:27:35.687891 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:27:35.687878    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a085c166-af4d-486c-8375-5fafe73b3d2d" path="/var/lib/kubelet/pods/a085c166-af4d-486c-8375-5fafe73b3d2d/volumes"
Jul 17 20:27:40.391134 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:27:40.391035    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:27:40.491603 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:27:40.491570    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:27:40.613441 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:27:40.613412    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:27:40.667037 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:27:40.666961    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-9a08062a-openshift-default-77b8795769-xbmgm"]
Jul 17 20:27:40.667377 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:27:40.667364    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a8f400e-4946-4dd4-b6d0-890cbca44ead" containerName="istio-proxy"
Jul 17 20:27:40.667423 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:27:40.667378    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a8f400e-4946-4dd4-b6d0-890cbca44ead" containerName="istio-proxy"
Jul 17 20:27:40.667423 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:27:40.667387    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a085c166-af4d-486c-8375-5fafe73b3d2d" containerName="maas-api"
Jul 17 20:27:40.667423 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:27:40.667392    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="a085c166-af4d-486c-8375-5fafe73b3d2d" containerName="maas-api"
Jul 17 20:27:40.667423 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:27:40.667412    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a8f400e-4946-4dd4-b6d0-890cbca44ead" containerName="istio-proxy"
Jul 17 20:27:40.667423 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:27:40.667418    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a8f400e-4946-4dd4-b6d0-890cbca44ead" containerName="istio-proxy"
Jul 17 20:27:40.667579 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:27:40.667429    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a085c166-af4d-486c-8375-5fafe73b3d2d" containerName="maas-api"
Jul 17 20:27:40.667579 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:27:40.667434    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="a085c166-af4d-486c-8375-5fafe73b3d2d" containerName="maas-api"
Jul 17 20:27:40.667579 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:27:40.667440    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a085c166-af4d-486c-8375-5fafe73b3d2d" containerName="maas-api"
Jul 17 20:27:40.667579 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:27:40.667445    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="a085c166-af4d-486c-8375-5fafe73b3d2d" containerName="maas-api"
Jul 17 20:27:40.667579 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:27:40.667501    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="a085c166-af4d-486c-8375-5fafe73b3d2d" containerName="maas-api"
Jul 17 20:27:40.667579 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:27:40.667509    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="a085c166-af4d-486c-8375-5fafe73b3d2d" containerName="maas-api"
Jul 17 20:27:40.667579 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:27:40.667517    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="9a8f400e-4946-4dd4-b6d0-890cbca44ead" containerName="istio-proxy"
Jul 17 20:27:40.667579 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:27:40.667523    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="9a8f400e-4946-4dd4-b6d0-890cbca44ead" containerName="istio-proxy"
Jul 17 20:27:40.672200 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:27:40.672183    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-9a08062a-openshift-default-77b8795769-xbmgm"
Jul 17 20:27:40.675284 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:27:40.675263    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-9a08062a-openshift-default-dockercfg-cwmzc\""
Jul 17 20:27:40.701032 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:27:40.701004    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-9a08062a-openshift-default-77b8795769-xbmgm"]
Jul 17 20:27:40.715452 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:27:40.715427    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:27:40.771305 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:27:40.771281    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aaac1299-9d0e-4e3c-9f43-b4656b49d404-istio-data\") pod \"e2e-ait-9a08062a-openshift-default-77b8795769-xbmgm\" (UID: \"aaac1299-9d0e-4e3c-9f43-b4656b49d404\") " pod="openshift-ingress/e2e-ait-9a08062a-openshift-default-77b8795769-xbmgm"
Jul 17 20:27:40.771443 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:27:40.771335    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aaac1299-9d0e-4e3c-9f43-b4656b49d404-workload-certs\") pod \"e2e-ait-9a08062a-openshift-default-77b8795769-xbmgm\" (UID: \"aaac1299-9d0e-4e3c-9f43-b4656b49d404\") " pod="openshift-ingress/e2e-ait-9a08062a-openshift-default-77b8795769-xbmgm"
Jul 17 20:27:40.771443 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:27:40.771369    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aaac1299-9d0e-4e3c-9f43-b4656b49d404-workload-socket\") pod \"e2e-ait-9a08062a-openshift-default-77b8795769-xbmgm\" (UID: \"aaac1299-9d0e-4e3c-9f43-b4656b49d404\") " pod="openshift-ingress/e2e-ait-9a08062a-openshift-default-77b8795769-xbmgm"
Jul 17 20:27:40.771443 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:27:40.771384    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aaac1299-9d0e-4e3c-9f43-b4656b49d404-credential-socket\") pod \"e2e-ait-9a08062a-openshift-default-77b8795769-xbmgm\" (UID: \"aaac1299-9d0e-4e3c-9f43-b4656b49d404\") " pod="openshift-ingress/e2e-ait-9a08062a-openshift-default-77b8795769-xbmgm"
Jul 17 20:27:40.771443 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:27:40.771405    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aaac1299-9d0e-4e3c-9f43-b4656b49d404-istio-token\") pod \"e2e-ait-9a08062a-openshift-default-77b8795769-xbmgm\" (UID: \"aaac1299-9d0e-4e3c-9f43-b4656b49d404\") " pod="openshift-ingress/e2e-ait-9a08062a-openshift-default-77b8795769-xbmgm"
Jul 17 20:27:40.771681 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:27:40.771523    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p9pgw\" (UniqueName: \"kubernetes.io/projected/aaac1299-9d0e-4e3c-9f43-b4656b49d404-kube-api-access-p9pgw\") pod \"e2e-ait-9a08062a-openshift-default-77b8795769-xbmgm\" (UID: \"aaac1299-9d0e-4e3c-9f43-b4656b49d404\") " pod="openshift-ingress/e2e-ait-9a08062a-openshift-default-77b8795769-xbmgm"
Jul 17 20:27:40.771681 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:27:40.771570    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aaac1299-9d0e-4e3c-9f43-b4656b49d404-istiod-ca-cert\") pod \"e2e-ait-9a08062a-openshift-default-77b8795769-xbmgm\" (UID: \"aaac1299-9d0e-4e3c-9f43-b4656b49d404\") " pod="openshift-ingress/e2e-ait-9a08062a-openshift-default-77b8795769-xbmgm"
Jul 17 20:27:40.771681 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:27:40.771648    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aaac1299-9d0e-4e3c-9f43-b4656b49d404-istio-envoy\") pod \"e2e-ait-9a08062a-openshift-default-77b8795769-xbmgm\" (UID: \"aaac1299-9d0e-4e3c-9f43-b4656b49d404\") " pod="openshift-ingress/e2e-ait-9a08062a-openshift-default-77b8795769-xbmgm"
Jul 17 20:27:40.771681 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:27:40.771678    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aaac1299-9d0e-4e3c-9f43-b4656b49d404-istio-podinfo\") pod \"e2e-ait-9a08062a-openshift-default-77b8795769-xbmgm\" (UID: \"aaac1299-9d0e-4e3c-9f43-b4656b49d404\") " pod="openshift-ingress/e2e-ait-9a08062a-openshift-default-77b8795769-xbmgm"
Jul 17 20:27:40.872358 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:27:40.872325    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aaac1299-9d0e-4e3c-9f43-b4656b49d404-istio-data\") pod \"e2e-ait-9a08062a-openshift-default-77b8795769-xbmgm\" (UID: \"aaac1299-9d0e-4e3c-9f43-b4656b49d404\") " pod="openshift-ingress/e2e-ait-9a08062a-openshift-default-77b8795769-xbmgm"
Jul 17 20:27:40.872479 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:27:40.872382    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aaac1299-9d0e-4e3c-9f43-b4656b49d404-workload-certs\") pod \"e2e-ait-9a08062a-openshift-default-77b8795769-xbmgm\" (UID: \"aaac1299-9d0e-4e3c-9f43-b4656b49d404\") " pod="openshift-ingress/e2e-ait-9a08062a-openshift-default-77b8795769-xbmgm"
Jul 17 20:27:40.872479 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:27:40.872416    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aaac1299-9d0e-4e3c-9f43-b4656b49d404-workload-socket\") pod \"e2e-ait-9a08062a-openshift-default-77b8795769-xbmgm\" (UID: \"aaac1299-9d0e-4e3c-9f43-b4656b49d404\") " pod="openshift-ingress/e2e-ait-9a08062a-openshift-default-77b8795769-xbmgm"
Jul 17 20:27:40.872479 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:27:40.872432    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aaac1299-9d0e-4e3c-9f43-b4656b49d404-credential-socket\") pod \"e2e-ait-9a08062a-openshift-default-77b8795769-xbmgm\" (UID: \"aaac1299-9d0e-4e3c-9f43-b4656b49d404\") " pod="openshift-ingress/e2e-ait-9a08062a-openshift-default-77b8795769-xbmgm"
Jul 17 20:27:40.872479 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:27:40.872458    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aaac1299-9d0e-4e3c-9f43-b4656b49d404-istio-token\") pod \"e2e-ait-9a08062a-openshift-default-77b8795769-xbmgm\" (UID: \"aaac1299-9d0e-4e3c-9f43-b4656b49d404\") " pod="openshift-ingress/e2e-ait-9a08062a-openshift-default-77b8795769-xbmgm"
Jul 17 20:27:40.872673 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:27:40.872498    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p9pgw\" (UniqueName: \"kubernetes.io/projected/aaac1299-9d0e-4e3c-9f43-b4656b49d404-kube-api-access-p9pgw\") pod \"e2e-ait-9a08062a-openshift-default-77b8795769-xbmgm\" (UID: \"aaac1299-9d0e-4e3c-9f43-b4656b49d404\") " pod="openshift-ingress/e2e-ait-9a08062a-openshift-default-77b8795769-xbmgm"
Jul 17 20:27:40.872673 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:27:40.872641    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aaac1299-9d0e-4e3c-9f43-b4656b49d404-istiod-ca-cert\") pod \"e2e-ait-9a08062a-openshift-default-77b8795769-xbmgm\" (UID: \"aaac1299-9d0e-4e3c-9f43-b4656b49d404\") " pod="openshift-ingress/e2e-ait-9a08062a-openshift-default-77b8795769-xbmgm"
Jul 17 20:27:40.872790 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:27:40.872717    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aaac1299-9d0e-4e3c-9f43-b4656b49d404-istio-envoy\") pod \"e2e-ait-9a08062a-openshift-default-77b8795769-xbmgm\" (UID: \"aaac1299-9d0e-4e3c-9f43-b4656b49d404\") " pod="openshift-ingress/e2e-ait-9a08062a-openshift-default-77b8795769-xbmgm"
Jul 17 20:27:40.872790 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:27:40.872749    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aaac1299-9d0e-4e3c-9f43-b4656b49d404-istio-podinfo\") pod \"e2e-ait-9a08062a-openshift-default-77b8795769-xbmgm\" (UID: \"aaac1299-9d0e-4e3c-9f43-b4656b49d404\") " pod="openshift-ingress/e2e-ait-9a08062a-openshift-default-77b8795769-xbmgm"
Jul 17 20:27:40.872790 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:27:40.872758    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aaac1299-9d0e-4e3c-9f43-b4656b49d404-workload-certs\") pod \"e2e-ait-9a08062a-openshift-default-77b8795769-xbmgm\" (UID: \"aaac1299-9d0e-4e3c-9f43-b4656b49d404\") " pod="openshift-ingress/e2e-ait-9a08062a-openshift-default-77b8795769-xbmgm"
Jul 17 20:27:40.872790 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:27:40.872717    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aaac1299-9d0e-4e3c-9f43-b4656b49d404-istio-data\") pod \"e2e-ait-9a08062a-openshift-default-77b8795769-xbmgm\" (UID: \"aaac1299-9d0e-4e3c-9f43-b4656b49d404\") " pod="openshift-ingress/e2e-ait-9a08062a-openshift-default-77b8795769-xbmgm"
Jul 17 20:27:40.872965 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:27:40.872845    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aaac1299-9d0e-4e3c-9f43-b4656b49d404-workload-socket\") pod \"e2e-ait-9a08062a-openshift-default-77b8795769-xbmgm\" (UID: \"aaac1299-9d0e-4e3c-9f43-b4656b49d404\") " pod="openshift-ingress/e2e-ait-9a08062a-openshift-default-77b8795769-xbmgm"
Jul 17 20:27:40.873259 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:27:40.873235    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aaac1299-9d0e-4e3c-9f43-b4656b49d404-credential-socket\") pod \"e2e-ait-9a08062a-openshift-default-77b8795769-xbmgm\" (UID: \"aaac1299-9d0e-4e3c-9f43-b4656b49d404\") " pod="openshift-ingress/e2e-ait-9a08062a-openshift-default-77b8795769-xbmgm"
Jul 17 20:27:40.873356 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:27:40.873338    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aaac1299-9d0e-4e3c-9f43-b4656b49d404-istiod-ca-cert\") pod \"e2e-ait-9a08062a-openshift-default-77b8795769-xbmgm\" (UID: \"aaac1299-9d0e-4e3c-9f43-b4656b49d404\") " pod="openshift-ingress/e2e-ait-9a08062a-openshift-default-77b8795769-xbmgm"
Jul 17 20:27:40.874973 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:27:40.874953    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aaac1299-9d0e-4e3c-9f43-b4656b49d404-istio-envoy\") pod \"e2e-ait-9a08062a-openshift-default-77b8795769-xbmgm\" (UID: \"aaac1299-9d0e-4e3c-9f43-b4656b49d404\") " pod="openshift-ingress/e2e-ait-9a08062a-openshift-default-77b8795769-xbmgm"
Jul 17 20:27:40.875077 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:27:40.875008    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aaac1299-9d0e-4e3c-9f43-b4656b49d404-istio-podinfo\") pod \"e2e-ait-9a08062a-openshift-default-77b8795769-xbmgm\" (UID: \"aaac1299-9d0e-4e3c-9f43-b4656b49d404\") " pod="openshift-ingress/e2e-ait-9a08062a-openshift-default-77b8795769-xbmgm"
Jul 17 20:27:40.881675 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:27:40.881656    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aaac1299-9d0e-4e3c-9f43-b4656b49d404-istio-token\") pod \"e2e-ait-9a08062a-openshift-default-77b8795769-xbmgm\" (UID: \"aaac1299-9d0e-4e3c-9f43-b4656b49d404\") " pod="openshift-ingress/e2e-ait-9a08062a-openshift-default-77b8795769-xbmgm"
Jul 17 20:27:40.881848 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:27:40.881831    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p9pgw\" (UniqueName: \"kubernetes.io/projected/aaac1299-9d0e-4e3c-9f43-b4656b49d404-kube-api-access-p9pgw\") pod \"e2e-ait-9a08062a-openshift-default-77b8795769-xbmgm\" (UID: \"aaac1299-9d0e-4e3c-9f43-b4656b49d404\") " pod="openshift-ingress/e2e-ait-9a08062a-openshift-default-77b8795769-xbmgm"
Jul 17 20:27:40.983957 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:27:40.983778    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-9a08062a-openshift-default-77b8795769-xbmgm"
Jul 17 20:27:41.124366 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:27:41.124342    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-9a08062a-openshift-default-77b8795769-xbmgm"]
Jul 17 20:27:41.127365 ip-10-0-141-177 kubenswrapper[2572]: W0717 20:27:41.127337    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaaac1299_9d0e_4e3c_9f43_b4656b49d404.slice/crio-f8e6200176eb01f6bda1e005959d2214294a08267d4dad2c1be51b7ca235a342 WatchSource:0}: Error finding container f8e6200176eb01f6bda1e005959d2214294a08267d4dad2c1be51b7ca235a342: Status 404 returned error can't find the container with id f8e6200176eb01f6bda1e005959d2214294a08267d4dad2c1be51b7ca235a342
Jul 17 20:27:41.129681 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:27:41.129649    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 17 20:27:41.129756 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:27:41.129713    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 17 20:27:41.129756 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:27:41.129743    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 17 20:27:41.718750 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:27:41.718718    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:27:41.817030 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:27:41.817000    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:27:41.881518 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:27:41.881488    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-9a08062a-59db5ccf78-b8qsc"]
Jul 17 20:27:41.881924 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:27:41.881909    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a085c166-af4d-486c-8375-5fafe73b3d2d" containerName="maas-api"
Jul 17 20:27:41.881924 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:27:41.881924    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="a085c166-af4d-486c-8375-5fafe73b3d2d" containerName="maas-api"
Jul 17 20:27:41.882032 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:27:41.882004    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="a085c166-af4d-486c-8375-5fafe73b3d2d" containerName="maas-api"
Jul 17 20:27:41.882032 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:27:41.882013    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="a085c166-af4d-486c-8375-5fafe73b3d2d" containerName="maas-api"
Jul 17 20:27:41.885647 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:27:41.885624    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9a08062a-59db5ccf78-b8qsc"
Jul 17 20:27:41.888054 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:27:41.888023    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-9a08062a-serving-cert\""
Jul 17 20:27:41.897651 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:27:41.897616    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-9a08062a-59db5ccf78-b8qsc"]
Jul 17 20:27:41.912835 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:27:41.912810    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:27:41.982131 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:27:41.982023    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g48jp\" (UniqueName: \"kubernetes.io/projected/e3a98707-0b58-4694-87bd-8cf67586fb7e-kube-api-access-g48jp\") pod \"maas-api-e2e-ait-9a08062a-59db5ccf78-b8qsc\" (UID: \"e3a98707-0b58-4694-87bd-8cf67586fb7e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9a08062a-59db5ccf78-b8qsc"
Jul 17 20:27:41.982131 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:27:41.982098    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e3a98707-0b58-4694-87bd-8cf67586fb7e-maas-api-tls\") pod \"maas-api-e2e-ait-9a08062a-59db5ccf78-b8qsc\" (UID: \"e3a98707-0b58-4694-87bd-8cf67586fb7e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9a08062a-59db5ccf78-b8qsc"
Jul 17 20:27:41.982131 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:27:41.982128    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e3a98707-0b58-4694-87bd-8cf67586fb7e-openshift-service-ca\") pod \"maas-api-e2e-ait-9a08062a-59db5ccf78-b8qsc\" (UID: \"e3a98707-0b58-4694-87bd-8cf67586fb7e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9a08062a-59db5ccf78-b8qsc"
Jul 17 20:27:41.992311 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:27:41.992280    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-9a08062a-openshift-default-77b8795769-xbmgm" event={"ID":"aaac1299-9d0e-4e3c-9f43-b4656b49d404","Type":"ContainerStarted","Data":"471bb75d2c0a2ef1e2604baeaf59f9bf46f64063f78522a4d7050dc478e8ebf3"}
Jul 17 20:27:41.992451 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:27:41.992336    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-9a08062a-openshift-default-77b8795769-xbmgm" event={"ID":"aaac1299-9d0e-4e3c-9f43-b4656b49d404","Type":"ContainerStarted","Data":"f8e6200176eb01f6bda1e005959d2214294a08267d4dad2c1be51b7ca235a342"}
Jul 17 20:27:42.017336 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:27:42.017291    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-9a08062a-openshift-default-77b8795769-xbmgm" podStartSLOduration=2.017278434 podStartE2EDuration="2.017278434s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 20:27:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 20:27:42.016694424 +0000 UTC m=+1886.858190082" watchObservedRunningTime="2026-07-17 20:27:42.017278434 +0000 UTC m=+1886.858774070"
Jul 17 20:27:42.055922 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:27:42.055896    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:27:42.083310 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:27:42.083278    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g48jp\" (UniqueName: \"kubernetes.io/projected/e3a98707-0b58-4694-87bd-8cf67586fb7e-kube-api-access-g48jp\") pod \"maas-api-e2e-ait-9a08062a-59db5ccf78-b8qsc\" (UID: \"e3a98707-0b58-4694-87bd-8cf67586fb7e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9a08062a-59db5ccf78-b8qsc"
Jul 17 20:27:42.083455 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:27:42.083331    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e3a98707-0b58-4694-87bd-8cf67586fb7e-maas-api-tls\") pod \"maas-api-e2e-ait-9a08062a-59db5ccf78-b8qsc\" (UID: \"e3a98707-0b58-4694-87bd-8cf67586fb7e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9a08062a-59db5ccf78-b8qsc"
Jul 17 20:27:42.083455 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:27:42.083366    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e3a98707-0b58-4694-87bd-8cf67586fb7e-openshift-service-ca\") pod \"maas-api-e2e-ait-9a08062a-59db5ccf78-b8qsc\" (UID: \"e3a98707-0b58-4694-87bd-8cf67586fb7e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9a08062a-59db5ccf78-b8qsc"
Jul 17 20:27:42.084176 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:27:42.084159    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e3a98707-0b58-4694-87bd-8cf67586fb7e-openshift-service-ca\") pod \"maas-api-e2e-ait-9a08062a-59db5ccf78-b8qsc\" (UID: \"e3a98707-0b58-4694-87bd-8cf67586fb7e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9a08062a-59db5ccf78-b8qsc"
Jul 17 20:27:42.085822 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:27:42.085797    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e3a98707-0b58-4694-87bd-8cf67586fb7e-maas-api-tls\") pod \"maas-api-e2e-ait-9a08062a-59db5ccf78-b8qsc\" (UID: \"e3a98707-0b58-4694-87bd-8cf67586fb7e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9a08062a-59db5ccf78-b8qsc"
Jul 17 20:27:42.091550 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:27:42.091529    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g48jp\" (UniqueName: \"kubernetes.io/projected/e3a98707-0b58-4694-87bd-8cf67586fb7e-kube-api-access-g48jp\") pod \"maas-api-e2e-ait-9a08062a-59db5ccf78-b8qsc\" (UID: \"e3a98707-0b58-4694-87bd-8cf67586fb7e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9a08062a-59db5ccf78-b8qsc"
Jul 17 20:27:42.199707 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:27:42.199669    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9a08062a-59db5ccf78-b8qsc"
Jul 17 20:27:42.333040 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:27:42.333008    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-9a08062a-59db5ccf78-b8qsc"]
Jul 17 20:27:42.334543 ip-10-0-141-177 kubenswrapper[2572]: W0717 20:27:42.334518    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3a98707_0b58_4694_87bd_8cf67586fb7e.slice/crio-3c47c08d25ee6729a9da2643670ec26a74826b26fd251b8060ee34dabdd80982 WatchSource:0}: Error finding container 3c47c08d25ee6729a9da2643670ec26a74826b26fd251b8060ee34dabdd80982: Status 404 returned error can't find the container with id 3c47c08d25ee6729a9da2643670ec26a74826b26fd251b8060ee34dabdd80982
Jul 17 20:27:42.402667 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:27:42.402637    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:27:42.503549 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:27:42.503465    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:27:42.985047 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:27:42.985016    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-9a08062a-openshift-default-77b8795769-xbmgm"
Jul 17 20:27:42.990363 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:27:42.990332    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-9a08062a-openshift-default-77b8795769-xbmgm"
Jul 17 20:27:42.998976 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:27:42.998947    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9a08062a-59db5ccf78-b8qsc" event={"ID":"e3a98707-0b58-4694-87bd-8cf67586fb7e","Type":"ContainerStarted","Data":"7b3efabf58cf2a48fbfaf9c2689e77d8c9fdb0078eb869324b105ea8f157ab8f"}
Jul 17 20:27:42.999201 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:27:42.998996    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9a08062a-59db5ccf78-b8qsc" event={"ID":"e3a98707-0b58-4694-87bd-8cf67586fb7e","Type":"ContainerStarted","Data":"3c47c08d25ee6729a9da2643670ec26a74826b26fd251b8060ee34dabdd80982"}
Jul 17 20:27:42.999201 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:27:42.999166    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-9a08062a-openshift-default-77b8795769-xbmgm"
Jul 17 20:27:42.999285 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:27:42.999207    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9a08062a-59db5ccf78-b8qsc"
Jul 17 20:27:43.000200 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:27:43.000179    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-9a08062a-openshift-default-77b8795769-xbmgm"
Jul 17 20:27:43.850324 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:27:43.850296    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:27:44.005463 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:27:44.005433    2572 generic.go:356] "Generic (PLEG): container finished" podID="e3a98707-0b58-4694-87bd-8cf67586fb7e" containerID="7b3efabf58cf2a48fbfaf9c2689e77d8c9fdb0078eb869324b105ea8f157ab8f" exitCode=1
Jul 17 20:27:44.005903 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:27:44.005516    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9a08062a-59db5ccf78-b8qsc" event={"ID":"e3a98707-0b58-4694-87bd-8cf67586fb7e","Type":"ContainerDied","Data":"7b3efabf58cf2a48fbfaf9c2689e77d8c9fdb0078eb869324b105ea8f157ab8f"}
Jul 17 20:27:44.005903 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:27:44.005735    2572 scope.go:117] "RemoveContainer" containerID="7b3efabf58cf2a48fbfaf9c2689e77d8c9fdb0078eb869324b105ea8f157ab8f"
Jul 17 20:27:45.012087 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:27:45.011982    2572 generic.go:356] "Generic (PLEG): container finished" podID="e3a98707-0b58-4694-87bd-8cf67586fb7e" containerID="12b789055fd9af7044f7037672e49398b55c1b3dfb2e4092d3ba8634dc1a1af9" exitCode=1
Jul 17 20:27:45.012507 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:27:45.012062    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9a08062a-59db5ccf78-b8qsc" event={"ID":"e3a98707-0b58-4694-87bd-8cf67586fb7e","Type":"ContainerDied","Data":"12b789055fd9af7044f7037672e49398b55c1b3dfb2e4092d3ba8634dc1a1af9"}
Jul 17 20:27:45.012507 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:27:45.012160    2572 scope.go:117] "RemoveContainer" containerID="7b3efabf58cf2a48fbfaf9c2689e77d8c9fdb0078eb869324b105ea8f157ab8f"
Jul 17 20:27:45.012507 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:27:45.012402    2572 scope.go:117] "RemoveContainer" containerID="12b789055fd9af7044f7037672e49398b55c1b3dfb2e4092d3ba8634dc1a1af9"
Jul 17 20:27:45.012733 ip-10-0-141-177 kubenswrapper[2572]: E0717 20:27:45.012605    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-ait-9a08062a-59db5ccf78-b8qsc_odh-ai-gateway-infra(e3a98707-0b58-4694-87bd-8cf67586fb7e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9a08062a-59db5ccf78-b8qsc" podUID="e3a98707-0b58-4694-87bd-8cf67586fb7e"
Jul 17 20:27:46.019443 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:27:46.019415    2572 scope.go:117] "RemoveContainer" containerID="12b789055fd9af7044f7037672e49398b55c1b3dfb2e4092d3ba8634dc1a1af9"
Jul 17 20:27:46.019809 ip-10-0-141-177 kubenswrapper[2572]: E0717 20:27:46.019631    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-ait-9a08062a-59db5ccf78-b8qsc_odh-ai-gateway-infra(e3a98707-0b58-4694-87bd-8cf67586fb7e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9a08062a-59db5ccf78-b8qsc" podUID="e3a98707-0b58-4694-87bd-8cf67586fb7e"
Jul 17 20:27:47.999685 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:27:47.999658    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9a08062a-59db5ccf78-b8qsc"
Jul 17 20:27:48.000116 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:27:48.000101    2572 scope.go:117] "RemoveContainer" containerID="12b789055fd9af7044f7037672e49398b55c1b3dfb2e4092d3ba8634dc1a1af9"
Jul 17 20:27:48.000349 ip-10-0-141-177 kubenswrapper[2572]: E0717 20:27:48.000282    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-ait-9a08062a-59db5ccf78-b8qsc_odh-ai-gateway-infra(e3a98707-0b58-4694-87bd-8cf67586fb7e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9a08062a-59db5ccf78-b8qsc" podUID="e3a98707-0b58-4694-87bd-8cf67586fb7e"
Jul 17 20:27:49.849930 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:27:49.849891    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:27:52.200768 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:27:52.200729    2572 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9a08062a-59db5ccf78-b8qsc"
Jul 17 20:27:52.201296 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:27:52.201189    2572 scope.go:117] "RemoveContainer" containerID="12b789055fd9af7044f7037672e49398b55c1b3dfb2e4092d3ba8634dc1a1af9"
Jul 17 20:27:52.201405 ip-10-0-141-177 kubenswrapper[2572]: E0717 20:27:52.201384    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-ait-9a08062a-59db5ccf78-b8qsc_odh-ai-gateway-infra(e3a98707-0b58-4694-87bd-8cf67586fb7e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9a08062a-59db5ccf78-b8qsc" podUID="e3a98707-0b58-4694-87bd-8cf67586fb7e"
Jul 17 20:27:53.063186 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:27:53.063147    2572 generic.go:356] "Generic (PLEG): container finished" podID="aaac1299-9d0e-4e3c-9f43-b4656b49d404" containerID="471bb75d2c0a2ef1e2604baeaf59f9bf46f64063f78522a4d7050dc478e8ebf3" exitCode=0
Jul 17 20:27:53.063414 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:27:53.063222    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-9a08062a-openshift-default-77b8795769-xbmgm" event={"ID":"aaac1299-9d0e-4e3c-9f43-b4656b49d404","Type":"ContainerDied","Data":"471bb75d2c0a2ef1e2604baeaf59f9bf46f64063f78522a4d7050dc478e8ebf3"}
Jul 17 20:27:53.063676 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:27:53.063657    2572 scope.go:117] "RemoveContainer" containerID="471bb75d2c0a2ef1e2604baeaf59f9bf46f64063f78522a4d7050dc478e8ebf3"
Jul 17 20:27:53.064710 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:27:53.064683    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 17 20:27:53.064765 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:27:53.064751    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 17 20:27:53.064806 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:27:53.064780    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 17 20:27:54.077651 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:27:54.077616    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-9a08062a-openshift-default-77b8795769-xbmgm" event={"ID":"aaac1299-9d0e-4e3c-9f43-b4656b49d404","Type":"ContainerStarted","Data":"0e70e566367fac54ae2310d1e67c8a135e29f7dab5aa8ced6e8c1bbd524ef59c"}
Jul 17 20:27:54.984397 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:27:54.984351    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-9a08062a-openshift-default-77b8795769-xbmgm"
Jul 17 20:27:54.985693 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:27:54.985661    2572 patch_prober.go:28] interesting pod/e2e-ait-9a08062a-openshift-default-77b8795769-xbmgm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body=
Jul 17 20:27:54.985838 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:27:54.985724    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-9a08062a-openshift-default-77b8795769-xbmgm" podUID="aaac1299-9d0e-4e3c-9f43-b4656b49d404" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused"
Jul 17 20:27:55.984449 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:27:55.984418    2572 patch_prober.go:28] interesting pod/e2e-ait-9a08062a-openshift-default-77b8795769-xbmgm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body=
Jul 17 20:27:55.984842 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:27:55.984471    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-9a08062a-openshift-default-77b8795769-xbmgm" podUID="aaac1299-9d0e-4e3c-9f43-b4656b49d404" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused"
Jul 17 20:27:56.984669 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:27:56.984631    2572 patch_prober.go:28] interesting pod/e2e-ait-9a08062a-openshift-default-77b8795769-xbmgm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body=
Jul 17 20:27:56.985077 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:27:56.984685    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-9a08062a-openshift-default-77b8795769-xbmgm" podUID="aaac1299-9d0e-4e3c-9f43-b4656b49d404" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused"
Jul 17 20:27:57.985151 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:27:57.985107    2572 patch_prober.go:28] interesting pod/e2e-ait-9a08062a-openshift-default-77b8795769-xbmgm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body=
Jul 17 20:27:57.985581 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:27:57.985169    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-9a08062a-openshift-default-77b8795769-xbmgm" podUID="aaac1299-9d0e-4e3c-9f43-b4656b49d404" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused"
Jul 17 20:27:57.999239 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:27:57.999214    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-9a08062a-openshift-default-77b8795769-xbmgm"
Jul 17 20:27:58.988395 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:27:58.988366    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-9a08062a-openshift-default-77b8795769-xbmgm"
Jul 17 20:27:58.989235 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:27:58.989214    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-9a08062a-openshift-default-77b8795769-xbmgm"
Jul 17 20:28:06.682034 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:28:06.682003    2572 scope.go:117] "RemoveContainer" containerID="12b789055fd9af7044f7037672e49398b55c1b3dfb2e4092d3ba8634dc1a1af9"
Jul 17 20:28:06.682465 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:28:06.682299    2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 17 20:28:07.144302 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:28:07.144265    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9a08062a-59db5ccf78-b8qsc" event={"ID":"e3a98707-0b58-4694-87bd-8cf67586fb7e","Type":"ContainerStarted","Data":"75fa8196d0afa93153abc30ddebf16dc097cb33c4d08c2dd6d674e8180d52f45"}
Jul 17 20:28:07.144645 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:28:07.144620    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9a08062a-59db5ccf78-b8qsc"
Jul 17 20:28:07.163819 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:28:07.163766    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9a08062a-59db5ccf78-b8qsc" podStartSLOduration=25.051485556 podStartE2EDuration="26.163750812s" totalImagesPullingTime="1.112265256s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 20:27:41 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 20:27:43.054664673 +0000 UTC m=+1887.896160312" watchObservedRunningTime="2026-07-17 20:28:07.163750812 +0000 UTC m=+1912.005246490"
Jul 17 20:28:08.151031 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:28:08.151003    2572 generic.go:356] "Generic (PLEG): container finished" podID="e3a98707-0b58-4694-87bd-8cf67586fb7e" containerID="75fa8196d0afa93153abc30ddebf16dc097cb33c4d08c2dd6d674e8180d52f45" exitCode=1
Jul 17 20:28:08.151486 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:28:08.151089    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9a08062a-59db5ccf78-b8qsc" event={"ID":"e3a98707-0b58-4694-87bd-8cf67586fb7e","Type":"ContainerDied","Data":"75fa8196d0afa93153abc30ddebf16dc097cb33c4d08c2dd6d674e8180d52f45"}
Jul 17 20:28:08.151486 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:28:08.151130    2572 scope.go:117] "RemoveContainer" containerID="12b789055fd9af7044f7037672e49398b55c1b3dfb2e4092d3ba8634dc1a1af9"
Jul 17 20:28:08.151486 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:28:08.151458    2572 scope.go:117] "RemoveContainer" containerID="75fa8196d0afa93153abc30ddebf16dc097cb33c4d08c2dd6d674e8180d52f45"
Jul 17 20:28:08.151706 ip-10-0-141-177 kubenswrapper[2572]: E0717 20:28:08.151683    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 20s restarting failed container=maas-api pod=maas-api-e2e-ait-9a08062a-59db5ccf78-b8qsc_odh-ai-gateway-infra(e3a98707-0b58-4694-87bd-8cf67586fb7e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9a08062a-59db5ccf78-b8qsc" podUID="e3a98707-0b58-4694-87bd-8cf67586fb7e"
Jul 17 20:28:09.158048 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:28:09.158021    2572 scope.go:117] "RemoveContainer" containerID="75fa8196d0afa93153abc30ddebf16dc097cb33c4d08c2dd6d674e8180d52f45"
Jul 17 20:28:09.158428 ip-10-0-141-177 kubenswrapper[2572]: E0717 20:28:09.158224    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 20s restarting failed container=maas-api pod=maas-api-e2e-ait-9a08062a-59db5ccf78-b8qsc_odh-ai-gateway-infra(e3a98707-0b58-4694-87bd-8cf67586fb7e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9a08062a-59db5ccf78-b8qsc" podUID="e3a98707-0b58-4694-87bd-8cf67586fb7e"
Jul 17 20:28:12.200295 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:28:12.200255    2572 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9a08062a-59db5ccf78-b8qsc"
Jul 17 20:28:12.200696 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:28:12.200601    2572 scope.go:117] "RemoveContainer" containerID="75fa8196d0afa93153abc30ddebf16dc097cb33c4d08c2dd6d674e8180d52f45"
Jul 17 20:28:12.200776 ip-10-0-141-177 kubenswrapper[2572]: E0717 20:28:12.200755    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 20s restarting failed container=maas-api pod=maas-api-e2e-ait-9a08062a-59db5ccf78-b8qsc_odh-ai-gateway-infra(e3a98707-0b58-4694-87bd-8cf67586fb7e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9a08062a-59db5ccf78-b8qsc" podUID="e3a98707-0b58-4694-87bd-8cf67586fb7e"
Jul 17 20:28:22.681732 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:28:22.681703    2572 scope.go:117] "RemoveContainer" containerID="75fa8196d0afa93153abc30ddebf16dc097cb33c4d08c2dd6d674e8180d52f45"
Jul 17 20:28:22.682172 ip-10-0-141-177 kubenswrapper[2572]: E0717 20:28:22.681878    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 20s restarting failed container=maas-api pod=maas-api-e2e-ait-9a08062a-59db5ccf78-b8qsc_odh-ai-gateway-infra(e3a98707-0b58-4694-87bd-8cf67586fb7e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9a08062a-59db5ccf78-b8qsc" podUID="e3a98707-0b58-4694-87bd-8cf67586fb7e"
Jul 17 20:28:33.682115 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:28:33.682055    2572 scope.go:117] "RemoveContainer" containerID="75fa8196d0afa93153abc30ddebf16dc097cb33c4d08c2dd6d674e8180d52f45"
Jul 17 20:28:34.287580 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:28:34.287544    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9a08062a-59db5ccf78-b8qsc" event={"ID":"e3a98707-0b58-4694-87bd-8cf67586fb7e","Type":"ContainerStarted","Data":"fe5a5c1e30d4f348642389162ba8f8b8ebae6d0624d4752a7028b4ed8c279a46"}
Jul 17 20:28:34.287770 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:28:34.287755    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9a08062a-59db5ccf78-b8qsc"
Jul 17 20:28:35.293728 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:28:35.293693    2572 generic.go:356] "Generic (PLEG): container finished" podID="e3a98707-0b58-4694-87bd-8cf67586fb7e" containerID="fe5a5c1e30d4f348642389162ba8f8b8ebae6d0624d4752a7028b4ed8c279a46" exitCode=1
Jul 17 20:28:35.294159 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:28:35.293754    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9a08062a-59db5ccf78-b8qsc" event={"ID":"e3a98707-0b58-4694-87bd-8cf67586fb7e","Type":"ContainerDied","Data":"fe5a5c1e30d4f348642389162ba8f8b8ebae6d0624d4752a7028b4ed8c279a46"}
Jul 17 20:28:35.294159 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:28:35.293794    2572 scope.go:117] "RemoveContainer" containerID="75fa8196d0afa93153abc30ddebf16dc097cb33c4d08c2dd6d674e8180d52f45"
Jul 17 20:28:35.294159 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:28:35.293995    2572 scope.go:117] "RemoveContainer" containerID="fe5a5c1e30d4f348642389162ba8f8b8ebae6d0624d4752a7028b4ed8c279a46"
Jul 17 20:28:35.294347 ip-10-0-141-177 kubenswrapper[2572]: E0717 20:28:35.294224    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-ait-9a08062a-59db5ccf78-b8qsc_odh-ai-gateway-infra(e3a98707-0b58-4694-87bd-8cf67586fb7e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9a08062a-59db5ccf78-b8qsc" podUID="e3a98707-0b58-4694-87bd-8cf67586fb7e"
Jul 17 20:28:36.300822 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:28:36.300792    2572 scope.go:117] "RemoveContainer" containerID="fe5a5c1e30d4f348642389162ba8f8b8ebae6d0624d4752a7028b4ed8c279a46"
Jul 17 20:28:36.301307 ip-10-0-141-177 kubenswrapper[2572]: E0717 20:28:36.301037    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-ait-9a08062a-59db5ccf78-b8qsc_odh-ai-gateway-infra(e3a98707-0b58-4694-87bd-8cf67586fb7e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9a08062a-59db5ccf78-b8qsc" podUID="e3a98707-0b58-4694-87bd-8cf67586fb7e"
Jul 17 20:28:42.200814 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:28:42.200777    2572 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9a08062a-59db5ccf78-b8qsc"
Jul 17 20:28:42.201275 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:28:42.201259    2572 scope.go:117] "RemoveContainer" containerID="fe5a5c1e30d4f348642389162ba8f8b8ebae6d0624d4752a7028b4ed8c279a46"
Jul 17 20:28:42.201495 ip-10-0-141-177 kubenswrapper[2572]: E0717 20:28:42.201476    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-ait-9a08062a-59db5ccf78-b8qsc_odh-ai-gateway-infra(e3a98707-0b58-4694-87bd-8cf67586fb7e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9a08062a-59db5ccf78-b8qsc" podUID="e3a98707-0b58-4694-87bd-8cf67586fb7e"
Jul 17 20:28:53.681418 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:28:53.681382    2572 scope.go:117] "RemoveContainer" containerID="fe5a5c1e30d4f348642389162ba8f8b8ebae6d0624d4752a7028b4ed8c279a46"
Jul 17 20:28:53.681841 ip-10-0-141-177 kubenswrapper[2572]: E0717 20:28:53.681635    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-ait-9a08062a-59db5ccf78-b8qsc_odh-ai-gateway-infra(e3a98707-0b58-4694-87bd-8cf67586fb7e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9a08062a-59db5ccf78-b8qsc" podUID="e3a98707-0b58-4694-87bd-8cf67586fb7e"
Jul 17 20:29:04.681240 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:29:04.681210    2572 scope.go:117] "RemoveContainer" containerID="fe5a5c1e30d4f348642389162ba8f8b8ebae6d0624d4752a7028b4ed8c279a46"
Jul 17 20:29:04.681712 ip-10-0-141-177 kubenswrapper[2572]: E0717 20:29:04.681413    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-ait-9a08062a-59db5ccf78-b8qsc_odh-ai-gateway-infra(e3a98707-0b58-4694-87bd-8cf67586fb7e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9a08062a-59db5ccf78-b8qsc" podUID="e3a98707-0b58-4694-87bd-8cf67586fb7e"
Jul 17 20:29:16.682018 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:29:16.681992    2572 scope.go:117] "RemoveContainer" containerID="fe5a5c1e30d4f348642389162ba8f8b8ebae6d0624d4752a7028b4ed8c279a46"
Jul 17 20:29:17.502689 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:29:17.502653    2572 generic.go:356] "Generic (PLEG): container finished" podID="e3a98707-0b58-4694-87bd-8cf67586fb7e" containerID="f1b2c2d34fc24290b4c7d50af517b05fb3eb64e2445124be6b6b93fc9721ed93" exitCode=1
Jul 17 20:29:17.502886 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:29:17.502736    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9a08062a-59db5ccf78-b8qsc" event={"ID":"e3a98707-0b58-4694-87bd-8cf67586fb7e","Type":"ContainerDied","Data":"f1b2c2d34fc24290b4c7d50af517b05fb3eb64e2445124be6b6b93fc9721ed93"}
Jul 17 20:29:17.502886 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:29:17.502808    2572 scope.go:117] "RemoveContainer" containerID="fe5a5c1e30d4f348642389162ba8f8b8ebae6d0624d4752a7028b4ed8c279a46"
Jul 17 20:29:17.503216 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:29:17.503197    2572 scope.go:117] "RemoveContainer" containerID="f1b2c2d34fc24290b4c7d50af517b05fb3eb64e2445124be6b6b93fc9721ed93"
Jul 17 20:29:17.503449 ip-10-0-141-177 kubenswrapper[2572]: E0717 20:29:17.503428    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-e2e-ait-9a08062a-59db5ccf78-b8qsc_odh-ai-gateway-infra(e3a98707-0b58-4694-87bd-8cf67586fb7e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9a08062a-59db5ccf78-b8qsc" podUID="e3a98707-0b58-4694-87bd-8cf67586fb7e"
Jul 17 20:29:19.288602 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:29:19.288567    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9a08062a-59db5ccf78-b8qsc"
Jul 17 20:29:19.289004 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:29:19.288986    2572 scope.go:117] "RemoveContainer" containerID="f1b2c2d34fc24290b4c7d50af517b05fb3eb64e2445124be6b6b93fc9721ed93"
Jul 17 20:29:19.289262 ip-10-0-141-177 kubenswrapper[2572]: E0717 20:29:19.289239    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-e2e-ait-9a08062a-59db5ccf78-b8qsc_odh-ai-gateway-infra(e3a98707-0b58-4694-87bd-8cf67586fb7e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9a08062a-59db5ccf78-b8qsc" podUID="e3a98707-0b58-4694-87bd-8cf67586fb7e"
Jul 17 20:29:22.199923 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:29:22.199887    2572 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9a08062a-59db5ccf78-b8qsc"
Jul 17 20:29:22.200327 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:29:22.200253    2572 scope.go:117] "RemoveContainer" containerID="f1b2c2d34fc24290b4c7d50af517b05fb3eb64e2445124be6b6b93fc9721ed93"
Jul 17 20:29:22.200445 ip-10-0-141-177 kubenswrapper[2572]: E0717 20:29:22.200425    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-e2e-ait-9a08062a-59db5ccf78-b8qsc_odh-ai-gateway-infra(e3a98707-0b58-4694-87bd-8cf67586fb7e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9a08062a-59db5ccf78-b8qsc" podUID="e3a98707-0b58-4694-87bd-8cf67586fb7e"
Jul 17 20:29:33.681774 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:29:33.681747    2572 scope.go:117] "RemoveContainer" containerID="f1b2c2d34fc24290b4c7d50af517b05fb3eb64e2445124be6b6b93fc9721ed93"
Jul 17 20:29:33.682176 ip-10-0-141-177 kubenswrapper[2572]: E0717 20:29:33.681931    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-e2e-ait-9a08062a-59db5ccf78-b8qsc_odh-ai-gateway-infra(e3a98707-0b58-4694-87bd-8cf67586fb7e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9a08062a-59db5ccf78-b8qsc" podUID="e3a98707-0b58-4694-87bd-8cf67586fb7e"
Jul 17 20:29:48.681612 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:29:48.681574    2572 scope.go:117] "RemoveContainer" containerID="f1b2c2d34fc24290b4c7d50af517b05fb3eb64e2445124be6b6b93fc9721ed93"
Jul 17 20:29:48.682159 ip-10-0-141-177 kubenswrapper[2572]: E0717 20:29:48.681831    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-e2e-ait-9a08062a-59db5ccf78-b8qsc_odh-ai-gateway-infra(e3a98707-0b58-4694-87bd-8cf67586fb7e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9a08062a-59db5ccf78-b8qsc" podUID="e3a98707-0b58-4694-87bd-8cf67586fb7e"
Jul 17 20:29:55.615546 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:29:55.615511    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:29:55.702914 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:29:55.702881    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:30:02.424876 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:30:02.424834    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:30:03.681662 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:30:03.681629    2572 scope.go:117] "RemoveContainer" containerID="f1b2c2d34fc24290b4c7d50af517b05fb3eb64e2445124be6b6b93fc9721ed93"
Jul 17 20:30:03.682040 ip-10-0-141-177 kubenswrapper[2572]: E0717 20:30:03.681804    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-e2e-ait-9a08062a-59db5ccf78-b8qsc_odh-ai-gateway-infra(e3a98707-0b58-4694-87bd-8cf67586fb7e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9a08062a-59db5ccf78-b8qsc" podUID="e3a98707-0b58-4694-87bd-8cf67586fb7e"
Jul 17 20:30:14.681695 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:30:14.681663    2572 scope.go:117] "RemoveContainer" containerID="f1b2c2d34fc24290b4c7d50af517b05fb3eb64e2445124be6b6b93fc9721ed93"
Jul 17 20:30:14.682107 ip-10-0-141-177 kubenswrapper[2572]: E0717 20:30:14.681849    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-e2e-ait-9a08062a-59db5ccf78-b8qsc_odh-ai-gateway-infra(e3a98707-0b58-4694-87bd-8cf67586fb7e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9a08062a-59db5ccf78-b8qsc" podUID="e3a98707-0b58-4694-87bd-8cf67586fb7e"
Jul 17 20:30:27.681447 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:30:27.681416    2572 scope.go:117] "RemoveContainer" containerID="f1b2c2d34fc24290b4c7d50af517b05fb3eb64e2445124be6b6b93fc9721ed93"
Jul 17 20:30:27.682023 ip-10-0-141-177 kubenswrapper[2572]: E0717 20:30:27.681605    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-e2e-ait-9a08062a-59db5ccf78-b8qsc_odh-ai-gateway-infra(e3a98707-0b58-4694-87bd-8cf67586fb7e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9a08062a-59db5ccf78-b8qsc" podUID="e3a98707-0b58-4694-87bd-8cf67586fb7e"
Jul 17 20:30:38.682016 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:30:38.681929    2572 scope.go:117] "RemoveContainer" containerID="f1b2c2d34fc24290b4c7d50af517b05fb3eb64e2445124be6b6b93fc9721ed93"
Jul 17 20:30:39.921058 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:30:39.920974    2572 generic.go:356] "Generic (PLEG): container finished" podID="e3a98707-0b58-4694-87bd-8cf67586fb7e" containerID="d2c785c3bc3af0a46588ff1a784d5673a2145ef288d1af9e5d44cd6449dc5452" exitCode=1
Jul 17 20:30:39.921058 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:30:39.921041    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9a08062a-59db5ccf78-b8qsc" event={"ID":"e3a98707-0b58-4694-87bd-8cf67586fb7e","Type":"ContainerDied","Data":"d2c785c3bc3af0a46588ff1a784d5673a2145ef288d1af9e5d44cd6449dc5452"}
Jul 17 20:30:39.921537 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:30:39.921117    2572 scope.go:117] "RemoveContainer" containerID="f1b2c2d34fc24290b4c7d50af517b05fb3eb64e2445124be6b6b93fc9721ed93"
Jul 17 20:30:39.921537 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:30:39.921418    2572 scope.go:117] "RemoveContainer" containerID="d2c785c3bc3af0a46588ff1a784d5673a2145ef288d1af9e5d44cd6449dc5452"
Jul 17 20:30:39.921618 ip-10-0-141-177 kubenswrapper[2572]: E0717 20:30:39.921603    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-e2e-ait-9a08062a-59db5ccf78-b8qsc_odh-ai-gateway-infra(e3a98707-0b58-4694-87bd-8cf67586fb7e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9a08062a-59db5ccf78-b8qsc" podUID="e3a98707-0b58-4694-87bd-8cf67586fb7e"
Jul 17 20:30:42.200296 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:30:42.200266    2572 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9a08062a-59db5ccf78-b8qsc"
Jul 17 20:30:42.200686 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:30:42.200669    2572 scope.go:117] "RemoveContainer" containerID="d2c785c3bc3af0a46588ff1a784d5673a2145ef288d1af9e5d44cd6449dc5452"
Jul 17 20:30:42.200865 ip-10-0-141-177 kubenswrapper[2572]: E0717 20:30:42.200847    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-e2e-ait-9a08062a-59db5ccf78-b8qsc_odh-ai-gateway-infra(e3a98707-0b58-4694-87bd-8cf67586fb7e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9a08062a-59db5ccf78-b8qsc" podUID="e3a98707-0b58-4694-87bd-8cf67586fb7e"
Jul 17 20:30:44.288246 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:30:44.288200    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9a08062a-59db5ccf78-b8qsc"
Jul 17 20:30:44.288661 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:30:44.288574    2572 scope.go:117] "RemoveContainer" containerID="d2c785c3bc3af0a46588ff1a784d5673a2145ef288d1af9e5d44cd6449dc5452"
Jul 17 20:30:44.288760 ip-10-0-141-177 kubenswrapper[2572]: E0717 20:30:44.288741    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-e2e-ait-9a08062a-59db5ccf78-b8qsc_odh-ai-gateway-infra(e3a98707-0b58-4694-87bd-8cf67586fb7e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9a08062a-59db5ccf78-b8qsc" podUID="e3a98707-0b58-4694-87bd-8cf67586fb7e"
Jul 17 20:30:58.681668 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:30:58.681638    2572 scope.go:117] "RemoveContainer" containerID="d2c785c3bc3af0a46588ff1a784d5673a2145ef288d1af9e5d44cd6449dc5452"
Jul 17 20:30:58.682150 ip-10-0-141-177 kubenswrapper[2572]: E0717 20:30:58.681817    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-e2e-ait-9a08062a-59db5ccf78-b8qsc_odh-ai-gateway-infra(e3a98707-0b58-4694-87bd-8cf67586fb7e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9a08062a-59db5ccf78-b8qsc" podUID="e3a98707-0b58-4694-87bd-8cf67586fb7e"
Jul 17 20:31:09.682474 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:31:09.682442    2572 scope.go:117] "RemoveContainer" containerID="d2c785c3bc3af0a46588ff1a784d5673a2145ef288d1af9e5d44cd6449dc5452"
Jul 17 20:31:09.682992 ip-10-0-141-177 kubenswrapper[2572]: E0717 20:31:09.682596    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-e2e-ait-9a08062a-59db5ccf78-b8qsc_odh-ai-gateway-infra(e3a98707-0b58-4694-87bd-8cf67586fb7e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9a08062a-59db5ccf78-b8qsc" podUID="e3a98707-0b58-4694-87bd-8cf67586fb7e"
Jul 17 20:31:14.542315 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:31:14.542276    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:31:20.682168 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:31:20.682133    2572 scope.go:117] "RemoveContainer" containerID="d2c785c3bc3af0a46588ff1a784d5673a2145ef288d1af9e5d44cd6449dc5452"
Jul 17 20:31:20.682593 ip-10-0-141-177 kubenswrapper[2572]: E0717 20:31:20.682417    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-e2e-ait-9a08062a-59db5ccf78-b8qsc_odh-ai-gateway-infra(e3a98707-0b58-4694-87bd-8cf67586fb7e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9a08062a-59db5ccf78-b8qsc" podUID="e3a98707-0b58-4694-87bd-8cf67586fb7e"
Jul 17 20:31:31.809460 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:31:31.809426    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:31:31.907478 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:31:31.907449    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:31:35.684430 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:31:35.684393    2572 scope.go:117] "RemoveContainer" containerID="d2c785c3bc3af0a46588ff1a784d5673a2145ef288d1af9e5d44cd6449dc5452"
Jul 17 20:31:35.684880 ip-10-0-141-177 kubenswrapper[2572]: E0717 20:31:35.684616    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-e2e-ait-9a08062a-59db5ccf78-b8qsc_odh-ai-gateway-infra(e3a98707-0b58-4694-87bd-8cf67586fb7e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9a08062a-59db5ccf78-b8qsc" podUID="e3a98707-0b58-4694-87bd-8cf67586fb7e"
Jul 17 20:31:37.678382 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:31:37.678350    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:31:37.784176 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:31:37.784135    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:31:50.682310 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:31:50.682276    2572 scope.go:117] "RemoveContainer" containerID="d2c785c3bc3af0a46588ff1a784d5673a2145ef288d1af9e5d44cd6449dc5452"
Jul 17 20:31:50.682715 ip-10-0-141-177 kubenswrapper[2572]: E0717 20:31:50.682524    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-e2e-ait-9a08062a-59db5ccf78-b8qsc_odh-ai-gateway-infra(e3a98707-0b58-4694-87bd-8cf67586fb7e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9a08062a-59db5ccf78-b8qsc" podUID="e3a98707-0b58-4694-87bd-8cf67586fb7e"
Jul 17 20:32:03.682042 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:32:03.681996    2572 scope.go:117] "RemoveContainer" containerID="d2c785c3bc3af0a46588ff1a784d5673a2145ef288d1af9e5d44cd6449dc5452"
Jul 17 20:32:03.682547 ip-10-0-141-177 kubenswrapper[2572]: E0717 20:32:03.682275    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-e2e-ait-9a08062a-59db5ccf78-b8qsc_odh-ai-gateway-infra(e3a98707-0b58-4694-87bd-8cf67586fb7e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9a08062a-59db5ccf78-b8qsc" podUID="e3a98707-0b58-4694-87bd-8cf67586fb7e"
Jul 17 20:32:14.681781 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:32:14.681749    2572 scope.go:117] "RemoveContainer" containerID="d2c785c3bc3af0a46588ff1a784d5673a2145ef288d1af9e5d44cd6449dc5452"
Jul 17 20:32:14.682209 ip-10-0-141-177 kubenswrapper[2572]: E0717 20:32:14.681955    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-e2e-ait-9a08062a-59db5ccf78-b8qsc_odh-ai-gateway-infra(e3a98707-0b58-4694-87bd-8cf67586fb7e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9a08062a-59db5ccf78-b8qsc" podUID="e3a98707-0b58-4694-87bd-8cf67586fb7e"
Jul 17 20:32:28.681685 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:32:28.681656    2572 scope.go:117] "RemoveContainer" containerID="d2c785c3bc3af0a46588ff1a784d5673a2145ef288d1af9e5d44cd6449dc5452"
Jul 17 20:32:28.682106 ip-10-0-141-177 kubenswrapper[2572]: E0717 20:32:28.681854    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-e2e-ait-9a08062a-59db5ccf78-b8qsc_odh-ai-gateway-infra(e3a98707-0b58-4694-87bd-8cf67586fb7e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9a08062a-59db5ccf78-b8qsc" podUID="e3a98707-0b58-4694-87bd-8cf67586fb7e"
Jul 17 20:32:40.681491 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:32:40.681459    2572 scope.go:117] "RemoveContainer" containerID="d2c785c3bc3af0a46588ff1a784d5673a2145ef288d1af9e5d44cd6449dc5452"
Jul 17 20:32:40.681951 ip-10-0-141-177 kubenswrapper[2572]: E0717 20:32:40.681653    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-e2e-ait-9a08062a-59db5ccf78-b8qsc_odh-ai-gateway-infra(e3a98707-0b58-4694-87bd-8cf67586fb7e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9a08062a-59db5ccf78-b8qsc" podUID="e3a98707-0b58-4694-87bd-8cf67586fb7e"
Jul 17 20:32:51.681636 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:32:51.681605    2572 scope.go:117] "RemoveContainer" containerID="d2c785c3bc3af0a46588ff1a784d5673a2145ef288d1af9e5d44cd6449dc5452"
Jul 17 20:32:51.682015 ip-10-0-141-177 kubenswrapper[2572]: E0717 20:32:51.681846    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-e2e-ait-9a08062a-59db5ccf78-b8qsc_odh-ai-gateway-infra(e3a98707-0b58-4694-87bd-8cf67586fb7e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9a08062a-59db5ccf78-b8qsc" podUID="e3a98707-0b58-4694-87bd-8cf67586fb7e"
Jul 17 20:33:03.681906 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:33:03.681868    2572 scope.go:117] "RemoveContainer" containerID="d2c785c3bc3af0a46588ff1a784d5673a2145ef288d1af9e5d44cd6449dc5452"
Jul 17 20:33:03.684294 ip-10-0-141-177 kubenswrapper[2572]: E0717 20:33:03.682137    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-e2e-ait-9a08062a-59db5ccf78-b8qsc_odh-ai-gateway-infra(e3a98707-0b58-4694-87bd-8cf67586fb7e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9a08062a-59db5ccf78-b8qsc" podUID="e3a98707-0b58-4694-87bd-8cf67586fb7e"
Jul 17 20:33:17.681792 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:33:17.681760    2572 scope.go:117] "RemoveContainer" containerID="d2c785c3bc3af0a46588ff1a784d5673a2145ef288d1af9e5d44cd6449dc5452"
Jul 17 20:33:17.682238 ip-10-0-141-177 kubenswrapper[2572]: E0717 20:33:17.681953    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-e2e-ait-9a08062a-59db5ccf78-b8qsc_odh-ai-gateway-infra(e3a98707-0b58-4694-87bd-8cf67586fb7e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9a08062a-59db5ccf78-b8qsc" podUID="e3a98707-0b58-4694-87bd-8cf67586fb7e"
Jul 17 20:33:32.682018 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:33:32.681985    2572 scope.go:117] "RemoveContainer" containerID="d2c785c3bc3af0a46588ff1a784d5673a2145ef288d1af9e5d44cd6449dc5452"
Jul 17 20:33:32.682427 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:33:32.682344    2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 17 20:33:33.790338 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:33:33.790308    2572 generic.go:356] "Generic (PLEG): container finished" podID="e3a98707-0b58-4694-87bd-8cf67586fb7e" containerID="eaf8542dffd4e80248d0e809e5c7b4aa9bb615bee7335e59c6db96f9eced91a0" exitCode=1
Jul 17 20:33:33.790744 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:33:33.790383    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9a08062a-59db5ccf78-b8qsc" event={"ID":"e3a98707-0b58-4694-87bd-8cf67586fb7e","Type":"ContainerDied","Data":"eaf8542dffd4e80248d0e809e5c7b4aa9bb615bee7335e59c6db96f9eced91a0"}
Jul 17 20:33:33.790744 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:33:33.790442    2572 scope.go:117] "RemoveContainer" containerID="d2c785c3bc3af0a46588ff1a784d5673a2145ef288d1af9e5d44cd6449dc5452"
Jul 17 20:33:33.790841 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:33:33.790799    2572 scope.go:117] "RemoveContainer" containerID="eaf8542dffd4e80248d0e809e5c7b4aa9bb615bee7335e59c6db96f9eced91a0"
Jul 17 20:33:33.791034 ip-10-0-141-177 kubenswrapper[2572]: E0717 20:33:33.791015    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-9a08062a-59db5ccf78-b8qsc_odh-ai-gateway-infra(e3a98707-0b58-4694-87bd-8cf67586fb7e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9a08062a-59db5ccf78-b8qsc" podUID="e3a98707-0b58-4694-87bd-8cf67586fb7e"
Jul 17 20:33:34.288377 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:33:34.288342    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9a08062a-59db5ccf78-b8qsc"
Jul 17 20:33:34.797296 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:33:34.797268    2572 scope.go:117] "RemoveContainer" containerID="eaf8542dffd4e80248d0e809e5c7b4aa9bb615bee7335e59c6db96f9eced91a0"
Jul 17 20:33:34.797660 ip-10-0-141-177 kubenswrapper[2572]: E0717 20:33:34.797440    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-9a08062a-59db5ccf78-b8qsc_odh-ai-gateway-infra(e3a98707-0b58-4694-87bd-8cf67586fb7e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9a08062a-59db5ccf78-b8qsc" podUID="e3a98707-0b58-4694-87bd-8cf67586fb7e"
Jul 17 20:33:42.200134 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:33:42.200027    2572 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9a08062a-59db5ccf78-b8qsc"
Jul 17 20:33:42.200524 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:33:42.200432    2572 scope.go:117] "RemoveContainer" containerID="eaf8542dffd4e80248d0e809e5c7b4aa9bb615bee7335e59c6db96f9eced91a0"
Jul 17 20:33:42.200642 ip-10-0-141-177 kubenswrapper[2572]: E0717 20:33:42.200622    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-9a08062a-59db5ccf78-b8qsc_odh-ai-gateway-infra(e3a98707-0b58-4694-87bd-8cf67586fb7e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9a08062a-59db5ccf78-b8qsc" podUID="e3a98707-0b58-4694-87bd-8cf67586fb7e"
Jul 17 20:33:47.045948 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:33:47.045914    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-9a08062a-openshift-default-77b8795769-xbmgm"]
Jul 17 20:33:47.046505 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:33:47.046131    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-9a08062a-openshift-default-77b8795769-xbmgm" podUID="aaac1299-9d0e-4e3c-9f43-b4656b49d404" containerName="istio-proxy" containerID="cri-o://0e70e566367fac54ae2310d1e67c8a135e29f7dab5aa8ced6e8c1bbd524ef59c" gracePeriod=30
Jul 17 20:33:47.102804 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:33:47.102768    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:33:48.456043 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:33:48.456011    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:33:52.300861 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:33:52.300835    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-9a08062a-openshift-default-77b8795769-xbmgm"
Jul 17 20:33:52.436996 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:33:52.436963    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aaac1299-9d0e-4e3c-9f43-b4656b49d404-istio-data\") pod \"aaac1299-9d0e-4e3c-9f43-b4656b49d404\" (UID: \"aaac1299-9d0e-4e3c-9f43-b4656b49d404\") "
Jul 17 20:33:52.437204 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:33:52.437006    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p9pgw\" (UniqueName: \"kubernetes.io/projected/aaac1299-9d0e-4e3c-9f43-b4656b49d404-kube-api-access-p9pgw\") pod \"aaac1299-9d0e-4e3c-9f43-b4656b49d404\" (UID: \"aaac1299-9d0e-4e3c-9f43-b4656b49d404\") "
Jul 17 20:33:52.437204 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:33:52.437032    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aaac1299-9d0e-4e3c-9f43-b4656b49d404-istio-envoy\") pod \"aaac1299-9d0e-4e3c-9f43-b4656b49d404\" (UID: \"aaac1299-9d0e-4e3c-9f43-b4656b49d404\") "
Jul 17 20:33:52.437204 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:33:52.437087    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aaac1299-9d0e-4e3c-9f43-b4656b49d404-istio-podinfo\") pod \"aaac1299-9d0e-4e3c-9f43-b4656b49d404\" (UID: \"aaac1299-9d0e-4e3c-9f43-b4656b49d404\") "
Jul 17 20:33:52.437204 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:33:52.437128    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aaac1299-9d0e-4e3c-9f43-b4656b49d404-workload-certs\") pod \"aaac1299-9d0e-4e3c-9f43-b4656b49d404\" (UID: \"aaac1299-9d0e-4e3c-9f43-b4656b49d404\") "
Jul 17 20:33:52.437204 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:33:52.437167    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aaac1299-9d0e-4e3c-9f43-b4656b49d404-credential-socket\") pod \"aaac1299-9d0e-4e3c-9f43-b4656b49d404\" (UID: \"aaac1299-9d0e-4e3c-9f43-b4656b49d404\") "
Jul 17 20:33:52.437204 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:33:52.437198    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aaac1299-9d0e-4e3c-9f43-b4656b49d404-istiod-ca-cert\") pod \"aaac1299-9d0e-4e3c-9f43-b4656b49d404\" (UID: \"aaac1299-9d0e-4e3c-9f43-b4656b49d404\") "
Jul 17 20:33:52.437557 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:33:52.437300    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aaac1299-9d0e-4e3c-9f43-b4656b49d404-workload-socket\") pod \"aaac1299-9d0e-4e3c-9f43-b4656b49d404\" (UID: \"aaac1299-9d0e-4e3c-9f43-b4656b49d404\") "
Jul 17 20:33:52.437557 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:33:52.437341    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aaac1299-9d0e-4e3c-9f43-b4656b49d404-istio-token\") pod \"aaac1299-9d0e-4e3c-9f43-b4656b49d404\" (UID: \"aaac1299-9d0e-4e3c-9f43-b4656b49d404\") "
Jul 17 20:33:52.437663 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:33:52.437607    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aaac1299-9d0e-4e3c-9f43-b4656b49d404-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "aaac1299-9d0e-4e3c-9f43-b4656b49d404" (UID: "aaac1299-9d0e-4e3c-9f43-b4656b49d404"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 20:33:52.437725 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:33:52.437714    2572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aaac1299-9d0e-4e3c-9f43-b4656b49d404-credential-socket\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Jul 17 20:33:52.437966 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:33:52.437889    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aaac1299-9d0e-4e3c-9f43-b4656b49d404-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "aaac1299-9d0e-4e3c-9f43-b4656b49d404" (UID: "aaac1299-9d0e-4e3c-9f43-b4656b49d404"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 20:33:52.438104 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:33:52.438003    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aaac1299-9d0e-4e3c-9f43-b4656b49d404-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "aaac1299-9d0e-4e3c-9f43-b4656b49d404" (UID: "aaac1299-9d0e-4e3c-9f43-b4656b49d404"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 20:33:52.438104 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:33:52.438040    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aaac1299-9d0e-4e3c-9f43-b4656b49d404-istio-data" (OuterVolumeSpecName: "istio-data") pod "aaac1299-9d0e-4e3c-9f43-b4656b49d404" (UID: "aaac1299-9d0e-4e3c-9f43-b4656b49d404"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 20:33:52.438210 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:33:52.438189    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aaac1299-9d0e-4e3c-9f43-b4656b49d404-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "aaac1299-9d0e-4e3c-9f43-b4656b49d404" (UID: "aaac1299-9d0e-4e3c-9f43-b4656b49d404"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 20:33:52.439483 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:33:52.439460    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aaac1299-9d0e-4e3c-9f43-b4656b49d404-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "aaac1299-9d0e-4e3c-9f43-b4656b49d404" (UID: "aaac1299-9d0e-4e3c-9f43-b4656b49d404"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 20:33:52.439574 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:33:52.439543    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/aaac1299-9d0e-4e3c-9f43-b4656b49d404-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "aaac1299-9d0e-4e3c-9f43-b4656b49d404" (UID: "aaac1299-9d0e-4e3c-9f43-b4656b49d404"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 17 20:33:52.439734 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:33:52.439715    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aaac1299-9d0e-4e3c-9f43-b4656b49d404-kube-api-access-p9pgw" (OuterVolumeSpecName: "kube-api-access-p9pgw") pod "aaac1299-9d0e-4e3c-9f43-b4656b49d404" (UID: "aaac1299-9d0e-4e3c-9f43-b4656b49d404"). InnerVolumeSpecName "kube-api-access-p9pgw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 20:33:52.439790 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:33:52.439746    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aaac1299-9d0e-4e3c-9f43-b4656b49d404-istio-token" (OuterVolumeSpecName: "istio-token") pod "aaac1299-9d0e-4e3c-9f43-b4656b49d404" (UID: "aaac1299-9d0e-4e3c-9f43-b4656b49d404"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 20:33:52.538961 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:33:52.538919    2572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aaac1299-9d0e-4e3c-9f43-b4656b49d404-istio-podinfo\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Jul 17 20:33:52.538961 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:33:52.538951    2572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aaac1299-9d0e-4e3c-9f43-b4656b49d404-workload-certs\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Jul 17 20:33:52.538961 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:33:52.538959    2572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aaac1299-9d0e-4e3c-9f43-b4656b49d404-istiod-ca-cert\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Jul 17 20:33:52.538961 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:33:52.538967    2572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aaac1299-9d0e-4e3c-9f43-b4656b49d404-workload-socket\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Jul 17 20:33:52.538961 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:33:52.538976    2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aaac1299-9d0e-4e3c-9f43-b4656b49d404-istio-token\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Jul 17 20:33:52.539309 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:33:52.538986    2572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aaac1299-9d0e-4e3c-9f43-b4656b49d404-istio-data\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Jul 17 20:33:52.539309 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:33:52.538994    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p9pgw\" (UniqueName: \"kubernetes.io/projected/aaac1299-9d0e-4e3c-9f43-b4656b49d404-kube-api-access-p9pgw\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Jul 17 20:33:52.539309 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:33:52.539002    2572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aaac1299-9d0e-4e3c-9f43-b4656b49d404-istio-envoy\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Jul 17 20:33:52.889509 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:33:52.889472    2572 generic.go:356] "Generic (PLEG): container finished" podID="aaac1299-9d0e-4e3c-9f43-b4656b49d404" containerID="0e70e566367fac54ae2310d1e67c8a135e29f7dab5aa8ced6e8c1bbd524ef59c" exitCode=0
Jul 17 20:33:52.889680 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:33:52.889525    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-9a08062a-openshift-default-77b8795769-xbmgm"
Jul 17 20:33:52.889680 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:33:52.889558    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-9a08062a-openshift-default-77b8795769-xbmgm" event={"ID":"aaac1299-9d0e-4e3c-9f43-b4656b49d404","Type":"ContainerDied","Data":"0e70e566367fac54ae2310d1e67c8a135e29f7dab5aa8ced6e8c1bbd524ef59c"}
Jul 17 20:33:52.889680 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:33:52.889617    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-9a08062a-openshift-default-77b8795769-xbmgm" event={"ID":"aaac1299-9d0e-4e3c-9f43-b4656b49d404","Type":"ContainerDied","Data":"f8e6200176eb01f6bda1e005959d2214294a08267d4dad2c1be51b7ca235a342"}
Jul 17 20:33:52.889680 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:33:52.889640    2572 scope.go:117] "RemoveContainer" containerID="0e70e566367fac54ae2310d1e67c8a135e29f7dab5aa8ced6e8c1bbd524ef59c"
Jul 17 20:33:52.899326 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:33:52.899308    2572 scope.go:117] "RemoveContainer" containerID="471bb75d2c0a2ef1e2604baeaf59f9bf46f64063f78522a4d7050dc478e8ebf3"
Jul 17 20:33:52.907516 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:33:52.907497    2572 scope.go:117] "RemoveContainer" containerID="0e70e566367fac54ae2310d1e67c8a135e29f7dab5aa8ced6e8c1bbd524ef59c"
Jul 17 20:33:52.907803 ip-10-0-141-177 kubenswrapper[2572]: E0717 20:33:52.907783    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0e70e566367fac54ae2310d1e67c8a135e29f7dab5aa8ced6e8c1bbd524ef59c\": container with ID starting with 0e70e566367fac54ae2310d1e67c8a135e29f7dab5aa8ced6e8c1bbd524ef59c not found: ID does not exist" containerID="0e70e566367fac54ae2310d1e67c8a135e29f7dab5aa8ced6e8c1bbd524ef59c"
Jul 17 20:33:52.907881 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:33:52.907816    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0e70e566367fac54ae2310d1e67c8a135e29f7dab5aa8ced6e8c1bbd524ef59c"} err="failed to get container status \"0e70e566367fac54ae2310d1e67c8a135e29f7dab5aa8ced6e8c1bbd524ef59c\": rpc error: code = NotFound desc = could not find container \"0e70e566367fac54ae2310d1e67c8a135e29f7dab5aa8ced6e8c1bbd524ef59c\": container with ID starting with 0e70e566367fac54ae2310d1e67c8a135e29f7dab5aa8ced6e8c1bbd524ef59c not found: ID does not exist"
Jul 17 20:33:52.907881 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:33:52.907842    2572 scope.go:117] "RemoveContainer" containerID="471bb75d2c0a2ef1e2604baeaf59f9bf46f64063f78522a4d7050dc478e8ebf3"
Jul 17 20:33:52.908178 ip-10-0-141-177 kubenswrapper[2572]: E0717 20:33:52.908142    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"471bb75d2c0a2ef1e2604baeaf59f9bf46f64063f78522a4d7050dc478e8ebf3\": container with ID starting with 471bb75d2c0a2ef1e2604baeaf59f9bf46f64063f78522a4d7050dc478e8ebf3 not found: ID does not exist" containerID="471bb75d2c0a2ef1e2604baeaf59f9bf46f64063f78522a4d7050dc478e8ebf3"
Jul 17 20:33:52.908240 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:33:52.908185    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"471bb75d2c0a2ef1e2604baeaf59f9bf46f64063f78522a4d7050dc478e8ebf3"} err="failed to get container status \"471bb75d2c0a2ef1e2604baeaf59f9bf46f64063f78522a4d7050dc478e8ebf3\": rpc error: code = NotFound desc = could not find container \"471bb75d2c0a2ef1e2604baeaf59f9bf46f64063f78522a4d7050dc478e8ebf3\": container with ID starting with 471bb75d2c0a2ef1e2604baeaf59f9bf46f64063f78522a4d7050dc478e8ebf3 not found: ID does not exist"
Jul 17 20:33:52.914041 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:33:52.914015    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-9a08062a-openshift-default-77b8795769-xbmgm"]
Jul 17 20:33:52.917695 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:33:52.917670    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-9a08062a-openshift-default-77b8795769-xbmgm"]
Jul 17 20:33:53.244469 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:33:53.244425    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-9a08062a-59db5ccf78-b8qsc"]
Jul 17 20:33:53.270990 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:33:53.270956    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:33:53.371496 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:33:53.371469    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:33:53.389656 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:33:53.389633    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9a08062a-59db5ccf78-b8qsc"
Jul 17 20:33:53.446143 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:33:53.446110    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e3a98707-0b58-4694-87bd-8cf67586fb7e-openshift-service-ca\") pod \"e3a98707-0b58-4694-87bd-8cf67586fb7e\" (UID: \"e3a98707-0b58-4694-87bd-8cf67586fb7e\") "
Jul 17 20:33:53.446306 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:33:53.446261    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e3a98707-0b58-4694-87bd-8cf67586fb7e-maas-api-tls\") pod \"e3a98707-0b58-4694-87bd-8cf67586fb7e\" (UID: \"e3a98707-0b58-4694-87bd-8cf67586fb7e\") "
Jul 17 20:33:53.446352 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:33:53.446310    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g48jp\" (UniqueName: \"kubernetes.io/projected/e3a98707-0b58-4694-87bd-8cf67586fb7e-kube-api-access-g48jp\") pod \"e3a98707-0b58-4694-87bd-8cf67586fb7e\" (UID: \"e3a98707-0b58-4694-87bd-8cf67586fb7e\") "
Jul 17 20:33:53.446531 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:33:53.446510    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e3a98707-0b58-4694-87bd-8cf67586fb7e-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "e3a98707-0b58-4694-87bd-8cf67586fb7e" (UID: "e3a98707-0b58-4694-87bd-8cf67586fb7e"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 20:33:53.446653 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:33:53.446638    2572 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e3a98707-0b58-4694-87bd-8cf67586fb7e-openshift-service-ca\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Jul 17 20:33:53.448297 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:33:53.448273    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e3a98707-0b58-4694-87bd-8cf67586fb7e-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "e3a98707-0b58-4694-87bd-8cf67586fb7e" (UID: "e3a98707-0b58-4694-87bd-8cf67586fb7e"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 20:33:53.448350 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:33:53.448314    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e3a98707-0b58-4694-87bd-8cf67586fb7e-kube-api-access-g48jp" (OuterVolumeSpecName: "kube-api-access-g48jp") pod "e3a98707-0b58-4694-87bd-8cf67586fb7e" (UID: "e3a98707-0b58-4694-87bd-8cf67586fb7e"). InnerVolumeSpecName "kube-api-access-g48jp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 20:33:53.547666 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:33:53.547574    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e3a98707-0b58-4694-87bd-8cf67586fb7e-maas-api-tls\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Jul 17 20:33:53.547666 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:33:53.547605    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g48jp\" (UniqueName: \"kubernetes.io/projected/e3a98707-0b58-4694-87bd-8cf67586fb7e-kube-api-access-g48jp\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Jul 17 20:33:53.687963 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:33:53.687922    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aaac1299-9d0e-4e3c-9f43-b4656b49d404" path="/var/lib/kubelet/pods/aaac1299-9d0e-4e3c-9f43-b4656b49d404/volumes"
Jul 17 20:33:53.896434 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:33:53.896347    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9a08062a-59db5ccf78-b8qsc"
Jul 17 20:33:53.896607 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:33:53.896345    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9a08062a-59db5ccf78-b8qsc" event={"ID":"e3a98707-0b58-4694-87bd-8cf67586fb7e","Type":"ContainerDied","Data":"3c47c08d25ee6729a9da2643670ec26a74826b26fd251b8060ee34dabdd80982"}
Jul 17 20:33:53.896607 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:33:53.896478    2572 scope.go:117] "RemoveContainer" containerID="eaf8542dffd4e80248d0e809e5c7b4aa9bb615bee7335e59c6db96f9eced91a0"
Jul 17 20:33:53.913656 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:33:53.913630    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-9a08062a-59db5ccf78-b8qsc"]
Jul 17 20:33:53.917730 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:33:53.917710    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-9a08062a-59db5ccf78-b8qsc"]
Jul 17 20:33:55.687270 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:33:55.687229    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e3a98707-0b58-4694-87bd-8cf67586fb7e" path="/var/lib/kubelet/pods/e3a98707-0b58-4694-87bd-8cf67586fb7e/volumes"
Jul 17 20:33:59.128529 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:33:59.128497    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:33:59.229874 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:33:59.229839    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:33:59.386415 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:33:59.386330    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-d1a20513-openshift-default-7dbf4d5567-tqqkb"]
Jul 17 20:33:59.386907 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:33:59.386888    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e3a98707-0b58-4694-87bd-8cf67586fb7e" containerName="maas-api"
Jul 17 20:33:59.386907 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:33:59.386907    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="e3a98707-0b58-4694-87bd-8cf67586fb7e" containerName="maas-api"
Jul 17 20:33:59.387027 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:33:59.386918    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aaac1299-9d0e-4e3c-9f43-b4656b49d404" containerName="istio-proxy"
Jul 17 20:33:59.387027 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:33:59.386924    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="aaac1299-9d0e-4e3c-9f43-b4656b49d404" containerName="istio-proxy"
Jul 17 20:33:59.387027 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:33:59.386931    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e3a98707-0b58-4694-87bd-8cf67586fb7e" containerName="maas-api"
Jul 17 20:33:59.387027 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:33:59.386936    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="e3a98707-0b58-4694-87bd-8cf67586fb7e" containerName="maas-api"
Jul 17 20:33:59.387027 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:33:59.386955    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e3a98707-0b58-4694-87bd-8cf67586fb7e" containerName="maas-api"
Jul 17 20:33:59.387027 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:33:59.386963    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="e3a98707-0b58-4694-87bd-8cf67586fb7e" containerName="maas-api"
Jul 17 20:33:59.387027 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:33:59.386978    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aaac1299-9d0e-4e3c-9f43-b4656b49d404" containerName="istio-proxy"
Jul 17 20:33:59.387027 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:33:59.386984    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="aaac1299-9d0e-4e3c-9f43-b4656b49d404" containerName="istio-proxy"
Jul 17 20:33:59.387027 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:33:59.386991    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e3a98707-0b58-4694-87bd-8cf67586fb7e" containerName="maas-api"
Jul 17 20:33:59.387027 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:33:59.386996    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="e3a98707-0b58-4694-87bd-8cf67586fb7e" containerName="maas-api"
Jul 17 20:33:59.387027 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:33:59.387003    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e3a98707-0b58-4694-87bd-8cf67586fb7e" containerName="maas-api"
Jul 17 20:33:59.387027 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:33:59.387007    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="e3a98707-0b58-4694-87bd-8cf67586fb7e" containerName="maas-api"
Jul 17 20:33:59.387027 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:33:59.387015    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e3a98707-0b58-4694-87bd-8cf67586fb7e" containerName="maas-api"
Jul 17 20:33:59.387027 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:33:59.387022    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="e3a98707-0b58-4694-87bd-8cf67586fb7e" containerName="maas-api"
Jul 17 20:33:59.387553 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:33:59.387105    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="e3a98707-0b58-4694-87bd-8cf67586fb7e" containerName="maas-api"
Jul 17 20:33:59.387553 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:33:59.387114    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="e3a98707-0b58-4694-87bd-8cf67586fb7e" containerName="maas-api"
Jul 17 20:33:59.387553 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:33:59.387119    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="e3a98707-0b58-4694-87bd-8cf67586fb7e" containerName="maas-api"
Jul 17 20:33:59.387553 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:33:59.387125    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="e3a98707-0b58-4694-87bd-8cf67586fb7e" containerName="maas-api"
Jul 17 20:33:59.387553 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:33:59.387132    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="e3a98707-0b58-4694-87bd-8cf67586fb7e" containerName="maas-api"
Jul 17 20:33:59.387553 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:33:59.387137    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="aaac1299-9d0e-4e3c-9f43-b4656b49d404" containerName="istio-proxy"
Jul 17 20:33:59.387553 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:33:59.387144    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="aaac1299-9d0e-4e3c-9f43-b4656b49d404" containerName="istio-proxy"
Jul 17 20:33:59.387553 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:33:59.387149    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="e3a98707-0b58-4694-87bd-8cf67586fb7e" containerName="maas-api"
Jul 17 20:33:59.391502 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:33:59.391480    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-d1a20513-openshift-default-7dbf4d5567-tqqkb"
Jul 17 20:33:59.395247 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:33:59.395230    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-d1a20513-openshift-default-dockercfg-nbl6d\""
Jul 17 20:33:59.409329 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:33:59.409309    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-d1a20513-openshift-default-7dbf4d5567-tqqkb"]
Jul 17 20:33:59.438191 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:33:59.438165    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:33:59.504125 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:33:59.504097    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/79a67beb-deef-40c6-8011-680c1bcf020b-istio-podinfo\") pod \"e2e-derive-d1a20513-openshift-default-7dbf4d5567-tqqkb\" (UID: \"79a67beb-deef-40c6-8011-680c1bcf020b\") " pod="openshift-ingress/e2e-derive-d1a20513-openshift-default-7dbf4d5567-tqqkb"
Jul 17 20:33:59.504282 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:33:59.504135    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/79a67beb-deef-40c6-8011-680c1bcf020b-istio-token\") pod \"e2e-derive-d1a20513-openshift-default-7dbf4d5567-tqqkb\" (UID: \"79a67beb-deef-40c6-8011-680c1bcf020b\") " pod="openshift-ingress/e2e-derive-d1a20513-openshift-default-7dbf4d5567-tqqkb"
Jul 17 20:33:59.504282 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:33:59.504196    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/79a67beb-deef-40c6-8011-680c1bcf020b-credential-socket\") pod \"e2e-derive-d1a20513-openshift-default-7dbf4d5567-tqqkb\" (UID: \"79a67beb-deef-40c6-8011-680c1bcf020b\") " pod="openshift-ingress/e2e-derive-d1a20513-openshift-default-7dbf4d5567-tqqkb"
Jul 17 20:33:59.504282 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:33:59.504224    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/79a67beb-deef-40c6-8011-680c1bcf020b-workload-certs\") pod \"e2e-derive-d1a20513-openshift-default-7dbf4d5567-tqqkb\" (UID: \"79a67beb-deef-40c6-8011-680c1bcf020b\") " pod="openshift-ingress/e2e-derive-d1a20513-openshift-default-7dbf4d5567-tqqkb"
Jul 17 20:33:59.504282 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:33:59.504251    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/79a67beb-deef-40c6-8011-680c1bcf020b-workload-socket\") pod \"e2e-derive-d1a20513-openshift-default-7dbf4d5567-tqqkb\" (UID: \"79a67beb-deef-40c6-8011-680c1bcf020b\") " pod="openshift-ingress/e2e-derive-d1a20513-openshift-default-7dbf4d5567-tqqkb"
Jul 17 20:33:59.504282 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:33:59.504277    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dmzh8\" (UniqueName: \"kubernetes.io/projected/79a67beb-deef-40c6-8011-680c1bcf020b-kube-api-access-dmzh8\") pod \"e2e-derive-d1a20513-openshift-default-7dbf4d5567-tqqkb\" (UID: \"79a67beb-deef-40c6-8011-680c1bcf020b\") " pod="openshift-ingress/e2e-derive-d1a20513-openshift-default-7dbf4d5567-tqqkb"
Jul 17 20:33:59.504571 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:33:59.504325    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/79a67beb-deef-40c6-8011-680c1bcf020b-istio-data\") pod \"e2e-derive-d1a20513-openshift-default-7dbf4d5567-tqqkb\" (UID: \"79a67beb-deef-40c6-8011-680c1bcf020b\") " pod="openshift-ingress/e2e-derive-d1a20513-openshift-default-7dbf4d5567-tqqkb"
Jul 17 20:33:59.504571 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:33:59.504348    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/79a67beb-deef-40c6-8011-680c1bcf020b-istiod-ca-cert\") pod \"e2e-derive-d1a20513-openshift-default-7dbf4d5567-tqqkb\" (UID: \"79a67beb-deef-40c6-8011-680c1bcf020b\") " pod="openshift-ingress/e2e-derive-d1a20513-openshift-default-7dbf4d5567-tqqkb"
Jul 17 20:33:59.504571 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:33:59.504405    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/79a67beb-deef-40c6-8011-680c1bcf020b-istio-envoy\") pod \"e2e-derive-d1a20513-openshift-default-7dbf4d5567-tqqkb\" (UID: \"79a67beb-deef-40c6-8011-680c1bcf020b\") " pod="openshift-ingress/e2e-derive-d1a20513-openshift-default-7dbf4d5567-tqqkb"
Jul 17 20:33:59.605890 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:33:59.605854    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/79a67beb-deef-40c6-8011-680c1bcf020b-credential-socket\") pod \"e2e-derive-d1a20513-openshift-default-7dbf4d5567-tqqkb\" (UID: \"79a67beb-deef-40c6-8011-680c1bcf020b\") " pod="openshift-ingress/e2e-derive-d1a20513-openshift-default-7dbf4d5567-tqqkb"
Jul 17 20:33:59.605890 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:33:59.605894    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/79a67beb-deef-40c6-8011-680c1bcf020b-workload-certs\") pod \"e2e-derive-d1a20513-openshift-default-7dbf4d5567-tqqkb\" (UID: \"79a67beb-deef-40c6-8011-680c1bcf020b\") " pod="openshift-ingress/e2e-derive-d1a20513-openshift-default-7dbf4d5567-tqqkb"
Jul 17 20:33:59.606147 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:33:59.605917    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/79a67beb-deef-40c6-8011-680c1bcf020b-workload-socket\") pod \"e2e-derive-d1a20513-openshift-default-7dbf4d5567-tqqkb\" (UID: \"79a67beb-deef-40c6-8011-680c1bcf020b\") " pod="openshift-ingress/e2e-derive-d1a20513-openshift-default-7dbf4d5567-tqqkb"
Jul 17 20:33:59.606147 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:33:59.605942    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dmzh8\" (UniqueName: \"kubernetes.io/projected/79a67beb-deef-40c6-8011-680c1bcf020b-kube-api-access-dmzh8\") pod \"e2e-derive-d1a20513-openshift-default-7dbf4d5567-tqqkb\" (UID: \"79a67beb-deef-40c6-8011-680c1bcf020b\") " pod="openshift-ingress/e2e-derive-d1a20513-openshift-default-7dbf4d5567-tqqkb"
Jul 17 20:33:59.606147 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:33:59.606100    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/79a67beb-deef-40c6-8011-680c1bcf020b-istio-data\") pod \"e2e-derive-d1a20513-openshift-default-7dbf4d5567-tqqkb\" (UID: \"79a67beb-deef-40c6-8011-680c1bcf020b\") " pod="openshift-ingress/e2e-derive-d1a20513-openshift-default-7dbf4d5567-tqqkb"
Jul 17 20:33:59.606319 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:33:59.606151    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/79a67beb-deef-40c6-8011-680c1bcf020b-istiod-ca-cert\") pod \"e2e-derive-d1a20513-openshift-default-7dbf4d5567-tqqkb\" (UID: \"79a67beb-deef-40c6-8011-680c1bcf020b\") " pod="openshift-ingress/e2e-derive-d1a20513-openshift-default-7dbf4d5567-tqqkb"
Jul 17 20:33:59.606319 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:33:59.606193    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/79a67beb-deef-40c6-8011-680c1bcf020b-istio-envoy\") pod \"e2e-derive-d1a20513-openshift-default-7dbf4d5567-tqqkb\" (UID: \"79a67beb-deef-40c6-8011-680c1bcf020b\") " pod="openshift-ingress/e2e-derive-d1a20513-openshift-default-7dbf4d5567-tqqkb"
Jul 17 20:33:59.606319 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:33:59.606265    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/79a67beb-deef-40c6-8011-680c1bcf020b-workload-certs\") pod \"e2e-derive-d1a20513-openshift-default-7dbf4d5567-tqqkb\" (UID: \"79a67beb-deef-40c6-8011-680c1bcf020b\") " pod="openshift-ingress/e2e-derive-d1a20513-openshift-default-7dbf4d5567-tqqkb"
Jul 17 20:33:59.606319 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:33:59.606295    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/79a67beb-deef-40c6-8011-680c1bcf020b-istio-podinfo\") pod \"e2e-derive-d1a20513-openshift-default-7dbf4d5567-tqqkb\" (UID: \"79a67beb-deef-40c6-8011-680c1bcf020b\") " pod="openshift-ingress/e2e-derive-d1a20513-openshift-default-7dbf4d5567-tqqkb"
Jul 17 20:33:59.606496 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:33:59.606331    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/79a67beb-deef-40c6-8011-680c1bcf020b-istio-token\") pod \"e2e-derive-d1a20513-openshift-default-7dbf4d5567-tqqkb\" (UID: \"79a67beb-deef-40c6-8011-680c1bcf020b\") " pod="openshift-ingress/e2e-derive-d1a20513-openshift-default-7dbf4d5567-tqqkb"
Jul 17 20:33:59.606496 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:33:59.606346    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/79a67beb-deef-40c6-8011-680c1bcf020b-credential-socket\") pod \"e2e-derive-d1a20513-openshift-default-7dbf4d5567-tqqkb\" (UID: \"79a67beb-deef-40c6-8011-680c1bcf020b\") " pod="openshift-ingress/e2e-derive-d1a20513-openshift-default-7dbf4d5567-tqqkb"
Jul 17 20:33:59.606496 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:33:59.606415    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/79a67beb-deef-40c6-8011-680c1bcf020b-workload-socket\") pod \"e2e-derive-d1a20513-openshift-default-7dbf4d5567-tqqkb\" (UID: \"79a67beb-deef-40c6-8011-680c1bcf020b\") " pod="openshift-ingress/e2e-derive-d1a20513-openshift-default-7dbf4d5567-tqqkb"
Jul 17 20:33:59.606496 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:33:59.606453    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/79a67beb-deef-40c6-8011-680c1bcf020b-istio-data\") pod \"e2e-derive-d1a20513-openshift-default-7dbf4d5567-tqqkb\" (UID: \"79a67beb-deef-40c6-8011-680c1bcf020b\") " pod="openshift-ingress/e2e-derive-d1a20513-openshift-default-7dbf4d5567-tqqkb"
Jul 17 20:33:59.606757 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:33:59.606740    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/79a67beb-deef-40c6-8011-680c1bcf020b-istiod-ca-cert\") pod \"e2e-derive-d1a20513-openshift-default-7dbf4d5567-tqqkb\" (UID: \"79a67beb-deef-40c6-8011-680c1bcf020b\") " pod="openshift-ingress/e2e-derive-d1a20513-openshift-default-7dbf4d5567-tqqkb"
Jul 17 20:33:59.608460 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:33:59.608427    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/79a67beb-deef-40c6-8011-680c1bcf020b-istio-envoy\") pod \"e2e-derive-d1a20513-openshift-default-7dbf4d5567-tqqkb\" (UID: \"79a67beb-deef-40c6-8011-680c1bcf020b\") " pod="openshift-ingress/e2e-derive-d1a20513-openshift-default-7dbf4d5567-tqqkb"
Jul 17 20:33:59.608647 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:33:59.608629    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/79a67beb-deef-40c6-8011-680c1bcf020b-istio-podinfo\") pod \"e2e-derive-d1a20513-openshift-default-7dbf4d5567-tqqkb\" (UID: \"79a67beb-deef-40c6-8011-680c1bcf020b\") " pod="openshift-ingress/e2e-derive-d1a20513-openshift-default-7dbf4d5567-tqqkb"
Jul 17 20:33:59.615626 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:33:59.615603    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/79a67beb-deef-40c6-8011-680c1bcf020b-istio-token\") pod \"e2e-derive-d1a20513-openshift-default-7dbf4d5567-tqqkb\" (UID: \"79a67beb-deef-40c6-8011-680c1bcf020b\") " pod="openshift-ingress/e2e-derive-d1a20513-openshift-default-7dbf4d5567-tqqkb"
Jul 17 20:33:59.617699 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:33:59.617680    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dmzh8\" (UniqueName: \"kubernetes.io/projected/79a67beb-deef-40c6-8011-680c1bcf020b-kube-api-access-dmzh8\") pod \"e2e-derive-d1a20513-openshift-default-7dbf4d5567-tqqkb\" (UID: \"79a67beb-deef-40c6-8011-680c1bcf020b\") " pod="openshift-ingress/e2e-derive-d1a20513-openshift-default-7dbf4d5567-tqqkb"
Jul 17 20:33:59.704119 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:33:59.704024    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-d1a20513-openshift-default-7dbf4d5567-tqqkb"
Jul 17 20:33:59.842271 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:33:59.842245    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-d1a20513-openshift-default-7dbf4d5567-tqqkb"]
Jul 17 20:33:59.844269 ip-10-0-141-177 kubenswrapper[2572]: W0717 20:33:59.844238    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79a67beb_deef_40c6_8011_680c1bcf020b.slice/crio-19a9f665c15ff20e141dddf9a5cbc1251fda6298b9c68955122bb4625a79b769 WatchSource:0}: Error finding container 19a9f665c15ff20e141dddf9a5cbc1251fda6298b9c68955122bb4625a79b769: Status 404 returned error can't find the container with id 19a9f665c15ff20e141dddf9a5cbc1251fda6298b9c68955122bb4625a79b769
Jul 17 20:33:59.846398 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:33:59.846357    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 17 20:33:59.846490 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:33:59.846448    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 17 20:33:59.846537 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:33:59.846492    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 17 20:33:59.939453 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:33:59.939419    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-d1a20513-openshift-default-7dbf4d5567-tqqkb" event={"ID":"79a67beb-deef-40c6-8011-680c1bcf020b","Type":"ContainerStarted","Data":"61f060cbc5d0a12e2f145f847e49b9cf28b55aaa114dd510eb6fe873082d1c10"}
Jul 17 20:33:59.939639 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:33:59.939498    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-d1a20513-openshift-default-7dbf4d5567-tqqkb" event={"ID":"79a67beb-deef-40c6-8011-680c1bcf020b","Type":"ContainerStarted","Data":"19a9f665c15ff20e141dddf9a5cbc1251fda6298b9c68955122bb4625a79b769"}
Jul 17 20:33:59.964733 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:33:59.964619    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-d1a20513-openshift-default-7dbf4d5567-tqqkb" podStartSLOduration=0.964599182 podStartE2EDuration="964.599182ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 20:33:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 20:33:59.961345791 +0000 UTC m=+2264.802841452" watchObservedRunningTime="2026-07-17 20:33:59.964599182 +0000 UTC m=+2264.806094820"
Jul 17 20:34:00.634315 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:34:00.634275    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:34:00.704978 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:34:00.704943    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-d1a20513-openshift-default-7dbf4d5567-tqqkb"
Jul 17 20:34:00.711156 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:34:00.710897    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-d1a20513-openshift-default-7dbf4d5567-tqqkb"
Jul 17 20:34:00.717635 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:34:00.717600    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:34:00.723941 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:34:00.723915    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-d1a20513-5fdc747bc5-rzrs6"]
Jul 17 20:34:00.724544 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:34:00.724528    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e3a98707-0b58-4694-87bd-8cf67586fb7e" containerName="maas-api"
Jul 17 20:34:00.724593 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:34:00.724548    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="e3a98707-0b58-4694-87bd-8cf67586fb7e" containerName="maas-api"
Jul 17 20:34:00.724655 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:34:00.724644    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="e3a98707-0b58-4694-87bd-8cf67586fb7e" containerName="maas-api"
Jul 17 20:34:00.728249 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:34:00.728231    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-d1a20513-5fdc747bc5-rzrs6"
Jul 17 20:34:00.730498 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:34:00.730481    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-d1a20513-serving-cert\""
Jul 17 20:34:00.742871 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:34:00.742844    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-d1a20513-5fdc747bc5-rzrs6"]
Jul 17 20:34:00.802042 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:34:00.802012    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:34:00.819670 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:34:00.819644    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-99wpv\" (UniqueName: \"kubernetes.io/projected/adf1a2d2-84ab-4aa1-a745-11412fa97fdb-kube-api-access-99wpv\") pod \"maas-api-e2e-derive-d1a20513-5fdc747bc5-rzrs6\" (UID: \"adf1a2d2-84ab-4aa1-a745-11412fa97fdb\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-d1a20513-5fdc747bc5-rzrs6"
Jul 17 20:34:00.819844 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:34:00.819752    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/adf1a2d2-84ab-4aa1-a745-11412fa97fdb-openshift-service-ca\") pod \"maas-api-e2e-derive-d1a20513-5fdc747bc5-rzrs6\" (UID: \"adf1a2d2-84ab-4aa1-a745-11412fa97fdb\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-d1a20513-5fdc747bc5-rzrs6"
Jul 17 20:34:00.819844 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:34:00.819791    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/adf1a2d2-84ab-4aa1-a745-11412fa97fdb-maas-api-tls\") pod \"maas-api-e2e-derive-d1a20513-5fdc747bc5-rzrs6\" (UID: \"adf1a2d2-84ab-4aa1-a745-11412fa97fdb\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-d1a20513-5fdc747bc5-rzrs6"
Jul 17 20:34:00.920948 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:34:00.920858    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-99wpv\" (UniqueName: \"kubernetes.io/projected/adf1a2d2-84ab-4aa1-a745-11412fa97fdb-kube-api-access-99wpv\") pod \"maas-api-e2e-derive-d1a20513-5fdc747bc5-rzrs6\" (UID: \"adf1a2d2-84ab-4aa1-a745-11412fa97fdb\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-d1a20513-5fdc747bc5-rzrs6"
Jul 17 20:34:00.921135 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:34:00.920954    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/adf1a2d2-84ab-4aa1-a745-11412fa97fdb-openshift-service-ca\") pod \"maas-api-e2e-derive-d1a20513-5fdc747bc5-rzrs6\" (UID: \"adf1a2d2-84ab-4aa1-a745-11412fa97fdb\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-d1a20513-5fdc747bc5-rzrs6"
Jul 17 20:34:00.921135 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:34:00.920980    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/adf1a2d2-84ab-4aa1-a745-11412fa97fdb-maas-api-tls\") pod \"maas-api-e2e-derive-d1a20513-5fdc747bc5-rzrs6\" (UID: \"adf1a2d2-84ab-4aa1-a745-11412fa97fdb\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-d1a20513-5fdc747bc5-rzrs6"
Jul 17 20:34:00.921653 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:34:00.921631    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/adf1a2d2-84ab-4aa1-a745-11412fa97fdb-openshift-service-ca\") pod \"maas-api-e2e-derive-d1a20513-5fdc747bc5-rzrs6\" (UID: \"adf1a2d2-84ab-4aa1-a745-11412fa97fdb\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-d1a20513-5fdc747bc5-rzrs6"
Jul 17 20:34:00.923415 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:34:00.923389    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/adf1a2d2-84ab-4aa1-a745-11412fa97fdb-maas-api-tls\") pod \"maas-api-e2e-derive-d1a20513-5fdc747bc5-rzrs6\" (UID: \"adf1a2d2-84ab-4aa1-a745-11412fa97fdb\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-d1a20513-5fdc747bc5-rzrs6"
Jul 17 20:34:00.933451 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:34:00.933432    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-99wpv\" (UniqueName: \"kubernetes.io/projected/adf1a2d2-84ab-4aa1-a745-11412fa97fdb-kube-api-access-99wpv\") pod \"maas-api-e2e-derive-d1a20513-5fdc747bc5-rzrs6\" (UID: \"adf1a2d2-84ab-4aa1-a745-11412fa97fdb\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-d1a20513-5fdc747bc5-rzrs6"
Jul 17 20:34:00.944578 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:34:00.944549    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-d1a20513-openshift-default-7dbf4d5567-tqqkb"
Jul 17 20:34:00.945434 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:34:00.945418    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-d1a20513-openshift-default-7dbf4d5567-tqqkb"
Jul 17 20:34:01.002163 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:34:01.002133    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:34:01.041234 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:34:01.041209    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-d1a20513-5fdc747bc5-rzrs6"
Jul 17 20:34:01.181317 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:34:01.181294    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-d1a20513-5fdc747bc5-rzrs6"]
Jul 17 20:34:01.183181 ip-10-0-141-177 kubenswrapper[2572]: W0717 20:34:01.183150    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podadf1a2d2_84ab_4aa1_a745_11412fa97fdb.slice/crio-248ecf584bb09dfafc4a6e2c761403fa8b81de021f821367432d5558dda6fe8e WatchSource:0}: Error finding container 248ecf584bb09dfafc4a6e2c761403fa8b81de021f821367432d5558dda6fe8e: Status 404 returned error can't find the container with id 248ecf584bb09dfafc4a6e2c761403fa8b81de021f821367432d5558dda6fe8e
Jul 17 20:34:01.502154 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:34:01.502124    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:34:01.598362 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:34:01.598243    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:34:01.950666 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:34:01.950631    2572 generic.go:356] "Generic (PLEG): container finished" podID="adf1a2d2-84ab-4aa1-a745-11412fa97fdb" containerID="c2d4412f1c63f05bb207fc33a4f4b7da6542e57b39ef397ee3e3df1357b83bc0" exitCode=1
Jul 17 20:34:01.951147 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:34:01.950717    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-d1a20513-5fdc747bc5-rzrs6" event={"ID":"adf1a2d2-84ab-4aa1-a745-11412fa97fdb","Type":"ContainerDied","Data":"c2d4412f1c63f05bb207fc33a4f4b7da6542e57b39ef397ee3e3df1357b83bc0"}
Jul 17 20:34:01.951147 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:34:01.950774    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-d1a20513-5fdc747bc5-rzrs6" event={"ID":"adf1a2d2-84ab-4aa1-a745-11412fa97fdb","Type":"ContainerStarted","Data":"248ecf584bb09dfafc4a6e2c761403fa8b81de021f821367432d5558dda6fe8e"}
Jul 17 20:34:01.951147 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:34:01.950962    2572 scope.go:117] "RemoveContainer" containerID="c2d4412f1c63f05bb207fc33a4f4b7da6542e57b39ef397ee3e3df1357b83bc0"
Jul 17 20:34:02.957255 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:34:02.957169    2572 generic.go:356] "Generic (PLEG): container finished" podID="adf1a2d2-84ab-4aa1-a745-11412fa97fdb" containerID="fb6be2b83e50acd025e6bf9f3e4dfc52ec90aa00da1520cabc90321eaf4acf4e" exitCode=1
Jul 17 20:34:02.957659 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:34:02.957253    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-d1a20513-5fdc747bc5-rzrs6" event={"ID":"adf1a2d2-84ab-4aa1-a745-11412fa97fdb","Type":"ContainerDied","Data":"fb6be2b83e50acd025e6bf9f3e4dfc52ec90aa00da1520cabc90321eaf4acf4e"}
Jul 17 20:34:02.957659 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:34:02.957303    2572 scope.go:117] "RemoveContainer" containerID="c2d4412f1c63f05bb207fc33a4f4b7da6542e57b39ef397ee3e3df1357b83bc0"
Jul 17 20:34:02.957659 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:34:02.957558    2572 scope.go:117] "RemoveContainer" containerID="fb6be2b83e50acd025e6bf9f3e4dfc52ec90aa00da1520cabc90321eaf4acf4e"
Jul 17 20:34:02.957817 ip-10-0-141-177 kubenswrapper[2572]: E0717 20:34:02.957758    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-derive-d1a20513-5fdc747bc5-rzrs6_odh-ai-gateway-infra(adf1a2d2-84ab-4aa1-a745-11412fa97fdb)\"" pod="odh-ai-gateway-infra/maas-api-e2e-derive-d1a20513-5fdc747bc5-rzrs6" podUID="adf1a2d2-84ab-4aa1-a745-11412fa97fdb"
Jul 17 20:34:03.964182 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:34:03.964154    2572 scope.go:117] "RemoveContainer" containerID="fb6be2b83e50acd025e6bf9f3e4dfc52ec90aa00da1520cabc90321eaf4acf4e"
Jul 17 20:34:03.964588 ip-10-0-141-177 kubenswrapper[2572]: E0717 20:34:03.964353    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-derive-d1a20513-5fdc747bc5-rzrs6_odh-ai-gateway-infra(adf1a2d2-84ab-4aa1-a745-11412fa97fdb)\"" pod="odh-ai-gateway-infra/maas-api-e2e-derive-d1a20513-5fdc747bc5-rzrs6" podUID="adf1a2d2-84ab-4aa1-a745-11412fa97fdb"
Jul 17 20:34:06.041478 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:34:06.041444    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-d1a20513-5fdc747bc5-rzrs6"
Jul 17 20:34:06.041865 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:34:06.041854    2572 scope.go:117] "RemoveContainer" containerID="fb6be2b83e50acd025e6bf9f3e4dfc52ec90aa00da1520cabc90321eaf4acf4e"
Jul 17 20:34:06.042051 ip-10-0-141-177 kubenswrapper[2572]: E0717 20:34:06.042032    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-derive-d1a20513-5fdc747bc5-rzrs6_odh-ai-gateway-infra(adf1a2d2-84ab-4aa1-a745-11412fa97fdb)\"" pod="odh-ai-gateway-infra/maas-api-e2e-derive-d1a20513-5fdc747bc5-rzrs6" podUID="adf1a2d2-84ab-4aa1-a745-11412fa97fdb"
Jul 17 20:34:08.925236 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:34:08.925199    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:34:09.020966 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:34:09.020935    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:34:11.041660 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:34:11.041620    2572 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="odh-ai-gateway-infra/maas-api-e2e-derive-d1a20513-5fdc747bc5-rzrs6"
Jul 17 20:34:11.042187 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:34:11.042167    2572 scope.go:117] "RemoveContainer" containerID="fb6be2b83e50acd025e6bf9f3e4dfc52ec90aa00da1520cabc90321eaf4acf4e"
Jul 17 20:34:11.042435 ip-10-0-141-177 kubenswrapper[2572]: E0717 20:34:11.042402    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-derive-d1a20513-5fdc747bc5-rzrs6_odh-ai-gateway-infra(adf1a2d2-84ab-4aa1-a745-11412fa97fdb)\"" pod="odh-ai-gateway-infra/maas-api-e2e-derive-d1a20513-5fdc747bc5-rzrs6" podUID="adf1a2d2-84ab-4aa1-a745-11412fa97fdb"
Jul 17 20:34:12.706142 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:34:12.706102    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:34:16.092832 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:34:16.091519    2572 patch_prober.go:28] interesting pod/e2e-derive-d1a20513-openshift-default-7dbf4d5567-tqqkb container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": read tcp 10.134.0.2:49926->10.134.0.50:15021: read: connection reset by peer" start-of-body=
Jul 17 20:34:16.092832 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:34:16.091587    2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-derive-d1a20513-openshift-default-7dbf4d5567-tqqkb" podUID="79a67beb-deef-40c6-8011-680c1bcf020b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": read tcp 10.134.0.2:49926->10.134.0.50:15021: read: connection reset by peer"
Jul 17 20:34:17.030654 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:34:17.030622    2572 generic.go:356] "Generic (PLEG): container finished" podID="79a67beb-deef-40c6-8011-680c1bcf020b" containerID="61f060cbc5d0a12e2f145f847e49b9cf28b55aaa114dd510eb6fe873082d1c10" exitCode=0
Jul 17 20:34:17.030852 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:34:17.030679    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-d1a20513-openshift-default-7dbf4d5567-tqqkb" event={"ID":"79a67beb-deef-40c6-8011-680c1bcf020b","Type":"ContainerDied","Data":"61f060cbc5d0a12e2f145f847e49b9cf28b55aaa114dd510eb6fe873082d1c10"}
Jul 17 20:34:17.031164 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:34:17.031144    2572 scope.go:117] "RemoveContainer" containerID="61f060cbc5d0a12e2f145f847e49b9cf28b55aaa114dd510eb6fe873082d1c10"
Jul 17 20:34:17.032123 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:34:17.032090    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 17 20:34:17.032236 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:34:17.032175    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 17 20:34:17.032236 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:34:17.032227    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 17 20:34:18.051801 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:34:18.051753    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-d1a20513-openshift-default-7dbf4d5567-tqqkb" event={"ID":"79a67beb-deef-40c6-8011-680c1bcf020b","Type":"ContainerStarted","Data":"eb8b140daa0dafec481db68d610adbd73de4857be433d2d0405c33e8fdb312cc"}
Jul 17 20:34:18.705102 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:34:18.705049    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-d1a20513-openshift-default-7dbf4d5567-tqqkb"
Jul 17 20:34:18.705333 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:34:18.705311    2572 patch_prober.go:28] interesting pod/e2e-derive-d1a20513-openshift-default-7dbf4d5567-tqqkb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" start-of-body=
Jul 17 20:34:18.705415 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:34:18.705397    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-d1a20513-openshift-default-7dbf4d5567-tqqkb" podUID="79a67beb-deef-40c6-8011-680c1bcf020b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused"
Jul 17 20:34:19.705083 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:34:19.705047    2572 patch_prober.go:28] interesting pod/e2e-derive-d1a20513-openshift-default-7dbf4d5567-tqqkb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" start-of-body=
Jul 17 20:34:19.705554 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:34:19.705117    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-d1a20513-openshift-default-7dbf4d5567-tqqkb" podUID="79a67beb-deef-40c6-8011-680c1bcf020b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused"
Jul 17 20:34:20.704669 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:34:20.704630    2572 patch_prober.go:28] interesting pod/e2e-derive-d1a20513-openshift-default-7dbf4d5567-tqqkb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" start-of-body=
Jul 17 20:34:20.704852 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:34:20.704688    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-d1a20513-openshift-default-7dbf4d5567-tqqkb" podUID="79a67beb-deef-40c6-8011-680c1bcf020b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused"
Jul 17 20:34:21.704540 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:34:21.704506    2572 patch_prober.go:28] interesting pod/e2e-derive-d1a20513-openshift-default-7dbf4d5567-tqqkb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" start-of-body=
Jul 17 20:34:21.704918 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:34:21.704561    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-d1a20513-openshift-default-7dbf4d5567-tqqkb" podUID="79a67beb-deef-40c6-8011-680c1bcf020b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused"
Jul 17 20:34:22.708358 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:34:22.708329    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-d1a20513-openshift-default-7dbf4d5567-tqqkb"
Jul 17 20:34:22.708757 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:34:22.708583    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-d1a20513-openshift-default-7dbf4d5567-tqqkb"
Jul 17 20:34:22.709315 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:34:22.709295    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-d1a20513-openshift-default-7dbf4d5567-tqqkb"
Jul 17 20:34:23.681775 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:34:23.681742    2572 scope.go:117] "RemoveContainer" containerID="fb6be2b83e50acd025e6bf9f3e4dfc52ec90aa00da1520cabc90321eaf4acf4e"
Jul 17 20:34:24.086990 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:34:24.086957    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-d1a20513-5fdc747bc5-rzrs6" event={"ID":"adf1a2d2-84ab-4aa1-a745-11412fa97fdb","Type":"ContainerStarted","Data":"c1689702dbae5217f2a15ecf49ea7a2f91bedfc37ad5df5f8ce43f41de579e86"}
Jul 17 20:34:24.087341 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:34:24.087321    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-d1a20513-5fdc747bc5-rzrs6"
Jul 17 20:34:24.112114 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:34:24.112057    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-d1a20513-5fdc747bc5-rzrs6" podStartSLOduration=23.151493046 podStartE2EDuration="24.112043973s" totalImagesPullingTime="960.550927ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 20:34:00 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 20:34:24.11164838 +0000 UTC m=+2288.953144016" watchObservedRunningTime="2026-07-17 20:34:24.112043973 +0000 UTC m=+2288.953539610"
Jul 17 20:34:25.093007 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:34:25.092960    2572 generic.go:356] "Generic (PLEG): container finished" podID="adf1a2d2-84ab-4aa1-a745-11412fa97fdb" containerID="c1689702dbae5217f2a15ecf49ea7a2f91bedfc37ad5df5f8ce43f41de579e86" exitCode=1
Jul 17 20:34:25.093516 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:34:25.093028    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-d1a20513-5fdc747bc5-rzrs6" event={"ID":"adf1a2d2-84ab-4aa1-a745-11412fa97fdb","Type":"ContainerDied","Data":"c1689702dbae5217f2a15ecf49ea7a2f91bedfc37ad5df5f8ce43f41de579e86"}
Jul 17 20:34:25.093516 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:34:25.093098    2572 scope.go:117] "RemoveContainer" containerID="fb6be2b83e50acd025e6bf9f3e4dfc52ec90aa00da1520cabc90321eaf4acf4e"
Jul 17 20:34:25.093516 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:34:25.093359    2572 scope.go:117] "RemoveContainer" containerID="c1689702dbae5217f2a15ecf49ea7a2f91bedfc37ad5df5f8ce43f41de579e86"
Jul 17 20:34:25.093680 ip-10-0-141-177 kubenswrapper[2572]: E0717 20:34:25.093577    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 20s restarting failed container=maas-api pod=maas-api-e2e-derive-d1a20513-5fdc747bc5-rzrs6_odh-ai-gateway-infra(adf1a2d2-84ab-4aa1-a745-11412fa97fdb)\"" pod="odh-ai-gateway-infra/maas-api-e2e-derive-d1a20513-5fdc747bc5-rzrs6" podUID="adf1a2d2-84ab-4aa1-a745-11412fa97fdb"
Jul 17 20:34:26.099450 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:34:26.099422    2572 scope.go:117] "RemoveContainer" containerID="c1689702dbae5217f2a15ecf49ea7a2f91bedfc37ad5df5f8ce43f41de579e86"
Jul 17 20:34:26.099865 ip-10-0-141-177 kubenswrapper[2572]: E0717 20:34:26.099600    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 20s restarting failed container=maas-api pod=maas-api-e2e-derive-d1a20513-5fdc747bc5-rzrs6_odh-ai-gateway-infra(adf1a2d2-84ab-4aa1-a745-11412fa97fdb)\"" pod="odh-ai-gateway-infra/maas-api-e2e-derive-d1a20513-5fdc747bc5-rzrs6" podUID="adf1a2d2-84ab-4aa1-a745-11412fa97fdb"
Jul 17 20:34:31.042245 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:34:31.042209    2572 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="odh-ai-gateway-infra/maas-api-e2e-derive-d1a20513-5fdc747bc5-rzrs6"
Jul 17 20:34:31.042659 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:34:31.042608    2572 scope.go:117] "RemoveContainer" containerID="c1689702dbae5217f2a15ecf49ea7a2f91bedfc37ad5df5f8ce43f41de579e86"
Jul 17 20:34:31.042794 ip-10-0-141-177 kubenswrapper[2572]: E0717 20:34:31.042774    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 20s restarting failed container=maas-api pod=maas-api-e2e-derive-d1a20513-5fdc747bc5-rzrs6_odh-ai-gateway-infra(adf1a2d2-84ab-4aa1-a745-11412fa97fdb)\"" pod="odh-ai-gateway-infra/maas-api-e2e-derive-d1a20513-5fdc747bc5-rzrs6" podUID="adf1a2d2-84ab-4aa1-a745-11412fa97fdb"
Jul 17 20:34:44.681558 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:34:44.681528    2572 scope.go:117] "RemoveContainer" containerID="c1689702dbae5217f2a15ecf49ea7a2f91bedfc37ad5df5f8ce43f41de579e86"
Jul 17 20:34:45.200762 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:34:45.200731    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-d1a20513-5fdc747bc5-rzrs6" event={"ID":"adf1a2d2-84ab-4aa1-a745-11412fa97fdb","Type":"ContainerStarted","Data":"94b317d5d9cf73910a53383b1ad1c3f437587fa775cdd5ab0bb074d36f68fcf4"}
Jul 17 20:34:45.200960 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:34:45.200939    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-d1a20513-5fdc747bc5-rzrs6"
Jul 17 20:34:46.206993 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:34:46.206961    2572 generic.go:356] "Generic (PLEG): container finished" podID="adf1a2d2-84ab-4aa1-a745-11412fa97fdb" containerID="94b317d5d9cf73910a53383b1ad1c3f437587fa775cdd5ab0bb074d36f68fcf4" exitCode=1
Jul 17 20:34:46.207440 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:34:46.207022    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-d1a20513-5fdc747bc5-rzrs6" event={"ID":"adf1a2d2-84ab-4aa1-a745-11412fa97fdb","Type":"ContainerDied","Data":"94b317d5d9cf73910a53383b1ad1c3f437587fa775cdd5ab0bb074d36f68fcf4"}
Jul 17 20:34:46.207440 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:34:46.207101    2572 scope.go:117] "RemoveContainer" containerID="c1689702dbae5217f2a15ecf49ea7a2f91bedfc37ad5df5f8ce43f41de579e86"
Jul 17 20:34:46.207440 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:34:46.207305    2572 scope.go:117] "RemoveContainer" containerID="94b317d5d9cf73910a53383b1ad1c3f437587fa775cdd5ab0bb074d36f68fcf4"
Jul 17 20:34:46.207567 ip-10-0-141-177 kubenswrapper[2572]: E0717 20:34:46.207523    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-derive-d1a20513-5fdc747bc5-rzrs6_odh-ai-gateway-infra(adf1a2d2-84ab-4aa1-a745-11412fa97fdb)\"" pod="odh-ai-gateway-infra/maas-api-e2e-derive-d1a20513-5fdc747bc5-rzrs6" podUID="adf1a2d2-84ab-4aa1-a745-11412fa97fdb"
Jul 17 20:34:47.214241 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:34:47.214179    2572 scope.go:117] "RemoveContainer" containerID="94b317d5d9cf73910a53383b1ad1c3f437587fa775cdd5ab0bb074d36f68fcf4"
Jul 17 20:34:47.214694 ip-10-0-141-177 kubenswrapper[2572]: E0717 20:34:47.214423    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-derive-d1a20513-5fdc747bc5-rzrs6_odh-ai-gateway-infra(adf1a2d2-84ab-4aa1-a745-11412fa97fdb)\"" pod="odh-ai-gateway-infra/maas-api-e2e-derive-d1a20513-5fdc747bc5-rzrs6" podUID="adf1a2d2-84ab-4aa1-a745-11412fa97fdb"
Jul 17 20:34:51.041604 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:34:51.041564    2572 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="odh-ai-gateway-infra/maas-api-e2e-derive-d1a20513-5fdc747bc5-rzrs6"
Jul 17 20:34:51.042110 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:34:51.041947    2572 scope.go:117] "RemoveContainer" containerID="94b317d5d9cf73910a53383b1ad1c3f437587fa775cdd5ab0bb074d36f68fcf4"
Jul 17 20:34:51.042175 ip-10-0-141-177 kubenswrapper[2572]: E0717 20:34:51.042154    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-derive-d1a20513-5fdc747bc5-rzrs6_odh-ai-gateway-infra(adf1a2d2-84ab-4aa1-a745-11412fa97fdb)\"" pod="odh-ai-gateway-infra/maas-api-e2e-derive-d1a20513-5fdc747bc5-rzrs6" podUID="adf1a2d2-84ab-4aa1-a745-11412fa97fdb"
Jul 17 20:35:03.682384 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:35:03.682351    2572 scope.go:117] "RemoveContainer" containerID="94b317d5d9cf73910a53383b1ad1c3f437587fa775cdd5ab0bb074d36f68fcf4"
Jul 17 20:35:03.682765 ip-10-0-141-177 kubenswrapper[2572]: E0717 20:35:03.682522    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-derive-d1a20513-5fdc747bc5-rzrs6_odh-ai-gateway-infra(adf1a2d2-84ab-4aa1-a745-11412fa97fdb)\"" pod="odh-ai-gateway-infra/maas-api-e2e-derive-d1a20513-5fdc747bc5-rzrs6" podUID="adf1a2d2-84ab-4aa1-a745-11412fa97fdb"
Jul 17 20:35:17.681481 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:35:17.681447    2572 scope.go:117] "RemoveContainer" containerID="94b317d5d9cf73910a53383b1ad1c3f437587fa775cdd5ab0bb074d36f68fcf4"
Jul 17 20:35:17.681956 ip-10-0-141-177 kubenswrapper[2572]: E0717 20:35:17.681667    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-derive-d1a20513-5fdc747bc5-rzrs6_odh-ai-gateway-infra(adf1a2d2-84ab-4aa1-a745-11412fa97fdb)\"" pod="odh-ai-gateway-infra/maas-api-e2e-derive-d1a20513-5fdc747bc5-rzrs6" podUID="adf1a2d2-84ab-4aa1-a745-11412fa97fdb"
Jul 17 20:35:32.681919 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:35:32.681888    2572 scope.go:117] "RemoveContainer" containerID="94b317d5d9cf73910a53383b1ad1c3f437587fa775cdd5ab0bb074d36f68fcf4"
Jul 17 20:35:33.445412 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:35:33.445376    2572 generic.go:356] "Generic (PLEG): container finished" podID="adf1a2d2-84ab-4aa1-a745-11412fa97fdb" containerID="3f6d2be2b45a6685f36c5dacf405cff37a44104672405c2b34ad2399379426b5" exitCode=1
Jul 17 20:35:33.445591 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:35:33.445431    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-d1a20513-5fdc747bc5-rzrs6" event={"ID":"adf1a2d2-84ab-4aa1-a745-11412fa97fdb","Type":"ContainerDied","Data":"3f6d2be2b45a6685f36c5dacf405cff37a44104672405c2b34ad2399379426b5"}
Jul 17 20:35:33.445591 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:35:33.445478    2572 scope.go:117] "RemoveContainer" containerID="94b317d5d9cf73910a53383b1ad1c3f437587fa775cdd5ab0bb074d36f68fcf4"
Jul 17 20:35:33.445844 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:35:33.445823    2572 scope.go:117] "RemoveContainer" containerID="3f6d2be2b45a6685f36c5dacf405cff37a44104672405c2b34ad2399379426b5"
Jul 17 20:35:33.446145 ip-10-0-141-177 kubenswrapper[2572]: E0717 20:35:33.446115    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-e2e-derive-d1a20513-5fdc747bc5-rzrs6_odh-ai-gateway-infra(adf1a2d2-84ab-4aa1-a745-11412fa97fdb)\"" pod="odh-ai-gateway-infra/maas-api-e2e-derive-d1a20513-5fdc747bc5-rzrs6" podUID="adf1a2d2-84ab-4aa1-a745-11412fa97fdb"
Jul 17 20:35:35.201901 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:35:35.201871    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-d1a20513-5fdc747bc5-rzrs6"
Jul 17 20:35:35.202291 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:35:35.202269    2572 scope.go:117] "RemoveContainer" containerID="3f6d2be2b45a6685f36c5dacf405cff37a44104672405c2b34ad2399379426b5"
Jul 17 20:35:35.202481 ip-10-0-141-177 kubenswrapper[2572]: E0717 20:35:35.202460    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-e2e-derive-d1a20513-5fdc747bc5-rzrs6_odh-ai-gateway-infra(adf1a2d2-84ab-4aa1-a745-11412fa97fdb)\"" pod="odh-ai-gateway-infra/maas-api-e2e-derive-d1a20513-5fdc747bc5-rzrs6" podUID="adf1a2d2-84ab-4aa1-a745-11412fa97fdb"
Jul 17 20:35:41.042159 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:35:41.042122    2572 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="odh-ai-gateway-infra/maas-api-e2e-derive-d1a20513-5fdc747bc5-rzrs6"
Jul 17 20:35:41.042642 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:35:41.042598    2572 scope.go:117] "RemoveContainer" containerID="3f6d2be2b45a6685f36c5dacf405cff37a44104672405c2b34ad2399379426b5"
Jul 17 20:35:41.042828 ip-10-0-141-177 kubenswrapper[2572]: E0717 20:35:41.042806    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-e2e-derive-d1a20513-5fdc747bc5-rzrs6_odh-ai-gateway-infra(adf1a2d2-84ab-4aa1-a745-11412fa97fdb)\"" pod="odh-ai-gateway-infra/maas-api-e2e-derive-d1a20513-5fdc747bc5-rzrs6" podUID="adf1a2d2-84ab-4aa1-a745-11412fa97fdb"
Jul 17 20:35:52.681968 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:35:52.681938    2572 scope.go:117] "RemoveContainer" containerID="3f6d2be2b45a6685f36c5dacf405cff37a44104672405c2b34ad2399379426b5"
Jul 17 20:35:52.682466 ip-10-0-141-177 kubenswrapper[2572]: E0717 20:35:52.682150    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-e2e-derive-d1a20513-5fdc747bc5-rzrs6_odh-ai-gateway-infra(adf1a2d2-84ab-4aa1-a745-11412fa97fdb)\"" pod="odh-ai-gateway-infra/maas-api-e2e-derive-d1a20513-5fdc747bc5-rzrs6" podUID="adf1a2d2-84ab-4aa1-a745-11412fa97fdb"
Jul 17 20:36:04.681619 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:36:04.681588    2572 scope.go:117] "RemoveContainer" containerID="3f6d2be2b45a6685f36c5dacf405cff37a44104672405c2b34ad2399379426b5"
Jul 17 20:36:04.682013 ip-10-0-141-177 kubenswrapper[2572]: E0717 20:36:04.681799    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-e2e-derive-d1a20513-5fdc747bc5-rzrs6_odh-ai-gateway-infra(adf1a2d2-84ab-4aa1-a745-11412fa97fdb)\"" pod="odh-ai-gateway-infra/maas-api-e2e-derive-d1a20513-5fdc747bc5-rzrs6" podUID="adf1a2d2-84ab-4aa1-a745-11412fa97fdb"
Jul 17 20:36:15.685334 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:36:15.685300    2572 scope.go:117] "RemoveContainer" containerID="3f6d2be2b45a6685f36c5dacf405cff37a44104672405c2b34ad2399379426b5"
Jul 17 20:36:15.685755 ip-10-0-141-177 kubenswrapper[2572]: E0717 20:36:15.685567    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-e2e-derive-d1a20513-5fdc747bc5-rzrs6_odh-ai-gateway-infra(adf1a2d2-84ab-4aa1-a745-11412fa97fdb)\"" pod="odh-ai-gateway-infra/maas-api-e2e-derive-d1a20513-5fdc747bc5-rzrs6" podUID="adf1a2d2-84ab-4aa1-a745-11412fa97fdb"
Jul 17 20:36:30.681467 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:36:30.681428    2572 scope.go:117] "RemoveContainer" containerID="3f6d2be2b45a6685f36c5dacf405cff37a44104672405c2b34ad2399379426b5"
Jul 17 20:36:30.681967 ip-10-0-141-177 kubenswrapper[2572]: E0717 20:36:30.681584    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-e2e-derive-d1a20513-5fdc747bc5-rzrs6_odh-ai-gateway-infra(adf1a2d2-84ab-4aa1-a745-11412fa97fdb)\"" pod="odh-ai-gateway-infra/maas-api-e2e-derive-d1a20513-5fdc747bc5-rzrs6" podUID="adf1a2d2-84ab-4aa1-a745-11412fa97fdb"
Jul 17 20:36:32.694587 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:36:32.694555    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:36:32.781292 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:36:32.781261    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:36:35.611462 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:36:35.611427    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:36:35.717340 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:36:35.717305    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:36:42.681764 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:36:42.681685    2572 scope.go:117] "RemoveContainer" containerID="3f6d2be2b45a6685f36c5dacf405cff37a44104672405c2b34ad2399379426b5"
Jul 17 20:36:42.682164 ip-10-0-141-177 kubenswrapper[2572]: E0717 20:36:42.681867    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-e2e-derive-d1a20513-5fdc747bc5-rzrs6_odh-ai-gateway-infra(adf1a2d2-84ab-4aa1-a745-11412fa97fdb)\"" pod="odh-ai-gateway-infra/maas-api-e2e-derive-d1a20513-5fdc747bc5-rzrs6" podUID="adf1a2d2-84ab-4aa1-a745-11412fa97fdb"
Jul 17 20:36:54.681888 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:36:54.681857    2572 scope.go:117] "RemoveContainer" containerID="3f6d2be2b45a6685f36c5dacf405cff37a44104672405c2b34ad2399379426b5"
Jul 17 20:36:55.859611 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:36:55.859580    2572 generic.go:356] "Generic (PLEG): container finished" podID="adf1a2d2-84ab-4aa1-a745-11412fa97fdb" containerID="693c81180cb4a68787f3685c734a22c3ed21a4835b766931c71dac36abb5b415" exitCode=1
Jul 17 20:36:55.860015 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:36:55.859642    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-d1a20513-5fdc747bc5-rzrs6" event={"ID":"adf1a2d2-84ab-4aa1-a745-11412fa97fdb","Type":"ContainerDied","Data":"693c81180cb4a68787f3685c734a22c3ed21a4835b766931c71dac36abb5b415"}
Jul 17 20:36:55.860015 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:36:55.859691    2572 scope.go:117] "RemoveContainer" containerID="3f6d2be2b45a6685f36c5dacf405cff37a44104672405c2b34ad2399379426b5"
Jul 17 20:36:55.860167 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:36:55.860042    2572 scope.go:117] "RemoveContainer" containerID="693c81180cb4a68787f3685c734a22c3ed21a4835b766931c71dac36abb5b415"
Jul 17 20:36:55.860335 ip-10-0-141-177 kubenswrapper[2572]: E0717 20:36:55.860302    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-e2e-derive-d1a20513-5fdc747bc5-rzrs6_odh-ai-gateway-infra(adf1a2d2-84ab-4aa1-a745-11412fa97fdb)\"" pod="odh-ai-gateway-infra/maas-api-e2e-derive-d1a20513-5fdc747bc5-rzrs6" podUID="adf1a2d2-84ab-4aa1-a745-11412fa97fdb"
Jul 17 20:37:00.201948 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:37:00.201916    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-d1a20513-5fdc747bc5-rzrs6"
Jul 17 20:37:00.202361 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:37:00.202321    2572 scope.go:117] "RemoveContainer" containerID="693c81180cb4a68787f3685c734a22c3ed21a4835b766931c71dac36abb5b415"
Jul 17 20:37:00.202522 ip-10-0-141-177 kubenswrapper[2572]: E0717 20:37:00.202502    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-e2e-derive-d1a20513-5fdc747bc5-rzrs6_odh-ai-gateway-infra(adf1a2d2-84ab-4aa1-a745-11412fa97fdb)\"" pod="odh-ai-gateway-infra/maas-api-e2e-derive-d1a20513-5fdc747bc5-rzrs6" podUID="adf1a2d2-84ab-4aa1-a745-11412fa97fdb"
Jul 17 20:37:01.042115 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:37:01.042061    2572 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="odh-ai-gateway-infra/maas-api-e2e-derive-d1a20513-5fdc747bc5-rzrs6"
Jul 17 20:37:01.042481 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:37:01.042467    2572 scope.go:117] "RemoveContainer" containerID="693c81180cb4a68787f3685c734a22c3ed21a4835b766931c71dac36abb5b415"
Jul 17 20:37:01.042658 ip-10-0-141-177 kubenswrapper[2572]: E0717 20:37:01.042639    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-e2e-derive-d1a20513-5fdc747bc5-rzrs6_odh-ai-gateway-infra(adf1a2d2-84ab-4aa1-a745-11412fa97fdb)\"" pod="odh-ai-gateway-infra/maas-api-e2e-derive-d1a20513-5fdc747bc5-rzrs6" podUID="adf1a2d2-84ab-4aa1-a745-11412fa97fdb"
Jul 17 20:37:05.072796 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:37:05.072762    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-d1a20513-openshift-default-7dbf4d5567-tqqkb"]
Jul 17 20:37:05.073334 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:37:05.072956    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-d1a20513-openshift-default-7dbf4d5567-tqqkb" podUID="79a67beb-deef-40c6-8011-680c1bcf020b" containerName="istio-proxy" containerID="cri-o://eb8b140daa0dafec481db68d610adbd73de4857be433d2d0405c33e8fdb312cc" gracePeriod=30
Jul 17 20:37:05.098791 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:37:05.098761    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:37:05.209107 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:37:05.209050    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:37:07.711714 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:37:07.711676    2572 patch_prober.go:28] interesting pod/e2e-derive-d1a20513-openshift-default-7dbf4d5567-tqqkb container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 17 20:37:07.712116 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:37:07.711749    2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-derive-d1a20513-openshift-default-7dbf4d5567-tqqkb" podUID="79a67beb-deef-40c6-8011-680c1bcf020b" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 17 20:37:10.334890 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:37:10.334865    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-d1a20513-openshift-default-7dbf4d5567-tqqkb"
Jul 17 20:37:10.453507 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:37:10.453482    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/79a67beb-deef-40c6-8011-680c1bcf020b-istio-data\") pod \"79a67beb-deef-40c6-8011-680c1bcf020b\" (UID: \"79a67beb-deef-40c6-8011-680c1bcf020b\") "
Jul 17 20:37:10.453661 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:37:10.453535    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/79a67beb-deef-40c6-8011-680c1bcf020b-workload-certs\") pod \"79a67beb-deef-40c6-8011-680c1bcf020b\" (UID: \"79a67beb-deef-40c6-8011-680c1bcf020b\") "
Jul 17 20:37:10.453661 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:37:10.453568    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/79a67beb-deef-40c6-8011-680c1bcf020b-workload-socket\") pod \"79a67beb-deef-40c6-8011-680c1bcf020b\" (UID: \"79a67beb-deef-40c6-8011-680c1bcf020b\") "
Jul 17 20:37:10.453661 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:37:10.453615    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/79a67beb-deef-40c6-8011-680c1bcf020b-istio-envoy\") pod \"79a67beb-deef-40c6-8011-680c1bcf020b\" (UID: \"79a67beb-deef-40c6-8011-680c1bcf020b\") "
Jul 17 20:37:10.453661 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:37:10.453653    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/79a67beb-deef-40c6-8011-680c1bcf020b-istiod-ca-cert\") pod \"79a67beb-deef-40c6-8011-680c1bcf020b\" (UID: \"79a67beb-deef-40c6-8011-680c1bcf020b\") "
Jul 17 20:37:10.453862 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:37:10.453679    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dmzh8\" (UniqueName: \"kubernetes.io/projected/79a67beb-deef-40c6-8011-680c1bcf020b-kube-api-access-dmzh8\") pod \"79a67beb-deef-40c6-8011-680c1bcf020b\" (UID: \"79a67beb-deef-40c6-8011-680c1bcf020b\") "
Jul 17 20:37:10.453862 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:37:10.453752    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/79a67beb-deef-40c6-8011-680c1bcf020b-istio-podinfo\") pod \"79a67beb-deef-40c6-8011-680c1bcf020b\" (UID: \"79a67beb-deef-40c6-8011-680c1bcf020b\") "
Jul 17 20:37:10.453862 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:37:10.453792    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/79a67beb-deef-40c6-8011-680c1bcf020b-credential-socket\") pod \"79a67beb-deef-40c6-8011-680c1bcf020b\" (UID: \"79a67beb-deef-40c6-8011-680c1bcf020b\") "
Jul 17 20:37:10.453862 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:37:10.453834    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/79a67beb-deef-40c6-8011-680c1bcf020b-istio-token\") pod \"79a67beb-deef-40c6-8011-680c1bcf020b\" (UID: \"79a67beb-deef-40c6-8011-680c1bcf020b\") "
Jul 17 20:37:10.454094 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:37:10.453791    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/79a67beb-deef-40c6-8011-680c1bcf020b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "79a67beb-deef-40c6-8011-680c1bcf020b" (UID: "79a67beb-deef-40c6-8011-680c1bcf020b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 20:37:10.454094 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:37:10.453912    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/79a67beb-deef-40c6-8011-680c1bcf020b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "79a67beb-deef-40c6-8011-680c1bcf020b" (UID: "79a67beb-deef-40c6-8011-680c1bcf020b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 20:37:10.454094 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:37:10.454014    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/79a67beb-deef-40c6-8011-680c1bcf020b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "79a67beb-deef-40c6-8011-680c1bcf020b" (UID: "79a67beb-deef-40c6-8011-680c1bcf020b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 20:37:10.454293 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:37:10.454257    2572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/79a67beb-deef-40c6-8011-680c1bcf020b-workload-certs\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Jul 17 20:37:10.454293 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:37:10.454285    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/79a67beb-deef-40c6-8011-680c1bcf020b-istio-data" (OuterVolumeSpecName: "istio-data") pod "79a67beb-deef-40c6-8011-680c1bcf020b" (UID: "79a67beb-deef-40c6-8011-680c1bcf020b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 20:37:10.454461 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:37:10.454298    2572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/79a67beb-deef-40c6-8011-680c1bcf020b-workload-socket\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Jul 17 20:37:10.454461 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:37:10.454318    2572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/79a67beb-deef-40c6-8011-680c1bcf020b-credential-socket\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Jul 17 20:37:10.454461 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:37:10.454381    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/79a67beb-deef-40c6-8011-680c1bcf020b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "79a67beb-deef-40c6-8011-680c1bcf020b" (UID: "79a67beb-deef-40c6-8011-680c1bcf020b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 20:37:10.455896 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:37:10.455865    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/79a67beb-deef-40c6-8011-680c1bcf020b-kube-api-access-dmzh8" (OuterVolumeSpecName: "kube-api-access-dmzh8") pod "79a67beb-deef-40c6-8011-680c1bcf020b" (UID: "79a67beb-deef-40c6-8011-680c1bcf020b"). InnerVolumeSpecName "kube-api-access-dmzh8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 20:37:10.455974 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:37:10.455898    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/79a67beb-deef-40c6-8011-680c1bcf020b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "79a67beb-deef-40c6-8011-680c1bcf020b" (UID: "79a67beb-deef-40c6-8011-680c1bcf020b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 17 20:37:10.456374 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:37:10.456356    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/79a67beb-deef-40c6-8011-680c1bcf020b-istio-token" (OuterVolumeSpecName: "istio-token") pod "79a67beb-deef-40c6-8011-680c1bcf020b" (UID: "79a67beb-deef-40c6-8011-680c1bcf020b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 20:37:10.456374 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:37:10.456359    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/79a67beb-deef-40c6-8011-680c1bcf020b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "79a67beb-deef-40c6-8011-680c1bcf020b" (UID: "79a67beb-deef-40c6-8011-680c1bcf020b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 20:37:10.480277 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:37:10.480252    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-d1a20513-5fdc747bc5-rzrs6"]
Jul 17 20:37:10.509752 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:37:10.509715    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:37:10.555393 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:37:10.555366    2572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/79a67beb-deef-40c6-8011-680c1bcf020b-istio-podinfo\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Jul 17 20:37:10.555393 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:37:10.555391    2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/79a67beb-deef-40c6-8011-680c1bcf020b-istio-token\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Jul 17 20:37:10.555554 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:37:10.555400    2572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/79a67beb-deef-40c6-8011-680c1bcf020b-istio-data\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Jul 17 20:37:10.555554 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:37:10.555408    2572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/79a67beb-deef-40c6-8011-680c1bcf020b-istio-envoy\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Jul 17 20:37:10.555554 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:37:10.555415    2572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/79a67beb-deef-40c6-8011-680c1bcf020b-istiod-ca-cert\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Jul 17 20:37:10.555554 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:37:10.555423    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dmzh8\" (UniqueName: \"kubernetes.io/projected/79a67beb-deef-40c6-8011-680c1bcf020b-kube-api-access-dmzh8\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Jul 17 20:37:10.604796 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:37:10.604507    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-d1a20513-5fdc747bc5-rzrs6"
Jul 17 20:37:10.656683 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:37:10.656611    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/adf1a2d2-84ab-4aa1-a745-11412fa97fdb-maas-api-tls\") pod \"adf1a2d2-84ab-4aa1-a745-11412fa97fdb\" (UID: \"adf1a2d2-84ab-4aa1-a745-11412fa97fdb\") "
Jul 17 20:37:10.656683 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:37:10.656667    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/adf1a2d2-84ab-4aa1-a745-11412fa97fdb-openshift-service-ca\") pod \"adf1a2d2-84ab-4aa1-a745-11412fa97fdb\" (UID: \"adf1a2d2-84ab-4aa1-a745-11412fa97fdb\") "
Jul 17 20:37:10.656869 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:37:10.656721    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-99wpv\" (UniqueName: \"kubernetes.io/projected/adf1a2d2-84ab-4aa1-a745-11412fa97fdb-kube-api-access-99wpv\") pod \"adf1a2d2-84ab-4aa1-a745-11412fa97fdb\" (UID: \"adf1a2d2-84ab-4aa1-a745-11412fa97fdb\") "
Jul 17 20:37:10.657093 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:37:10.657020    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/adf1a2d2-84ab-4aa1-a745-11412fa97fdb-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "adf1a2d2-84ab-4aa1-a745-11412fa97fdb" (UID: "adf1a2d2-84ab-4aa1-a745-11412fa97fdb"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 20:37:10.658642 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:37:10.658618    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/adf1a2d2-84ab-4aa1-a745-11412fa97fdb-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "adf1a2d2-84ab-4aa1-a745-11412fa97fdb" (UID: "adf1a2d2-84ab-4aa1-a745-11412fa97fdb"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 20:37:10.658746 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:37:10.658731    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/adf1a2d2-84ab-4aa1-a745-11412fa97fdb-kube-api-access-99wpv" (OuterVolumeSpecName: "kube-api-access-99wpv") pod "adf1a2d2-84ab-4aa1-a745-11412fa97fdb" (UID: "adf1a2d2-84ab-4aa1-a745-11412fa97fdb"). InnerVolumeSpecName "kube-api-access-99wpv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 20:37:10.758558 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:37:10.758525    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/adf1a2d2-84ab-4aa1-a745-11412fa97fdb-maas-api-tls\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Jul 17 20:37:10.758558 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:37:10.758559    2572 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/adf1a2d2-84ab-4aa1-a745-11412fa97fdb-openshift-service-ca\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Jul 17 20:37:10.758740 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:37:10.758573    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-99wpv\" (UniqueName: \"kubernetes.io/projected/adf1a2d2-84ab-4aa1-a745-11412fa97fdb-kube-api-access-99wpv\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Jul 17 20:37:10.936577 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:37:10.936497    2572 generic.go:356] "Generic (PLEG): container finished" podID="79a67beb-deef-40c6-8011-680c1bcf020b" containerID="eb8b140daa0dafec481db68d610adbd73de4857be433d2d0405c33e8fdb312cc" exitCode=0
Jul 17 20:37:10.936577 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:37:10.936548    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-d1a20513-openshift-default-7dbf4d5567-tqqkb"
Jul 17 20:37:10.936807 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:37:10.936582    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-d1a20513-openshift-default-7dbf4d5567-tqqkb" event={"ID":"79a67beb-deef-40c6-8011-680c1bcf020b","Type":"ContainerDied","Data":"eb8b140daa0dafec481db68d610adbd73de4857be433d2d0405c33e8fdb312cc"}
Jul 17 20:37:10.936807 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:37:10.936637    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-d1a20513-openshift-default-7dbf4d5567-tqqkb" event={"ID":"79a67beb-deef-40c6-8011-680c1bcf020b","Type":"ContainerDied","Data":"19a9f665c15ff20e141dddf9a5cbc1251fda6298b9c68955122bb4625a79b769"}
Jul 17 20:37:10.936807 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:37:10.936672    2572 scope.go:117] "RemoveContainer" containerID="eb8b140daa0dafec481db68d610adbd73de4857be433d2d0405c33e8fdb312cc"
Jul 17 20:37:10.937870 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:37:10.937848    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-d1a20513-5fdc747bc5-rzrs6"
Jul 17 20:37:10.937999 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:37:10.937841    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-d1a20513-5fdc747bc5-rzrs6" event={"ID":"adf1a2d2-84ab-4aa1-a745-11412fa97fdb","Type":"ContainerDied","Data":"248ecf584bb09dfafc4a6e2c761403fa8b81de021f821367432d5558dda6fe8e"}
Jul 17 20:37:10.947092 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:37:10.947054    2572 scope.go:117] "RemoveContainer" containerID="61f060cbc5d0a12e2f145f847e49b9cf28b55aaa114dd510eb6fe873082d1c10"
Jul 17 20:37:10.955794 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:37:10.955775    2572 scope.go:117] "RemoveContainer" containerID="eb8b140daa0dafec481db68d610adbd73de4857be433d2d0405c33e8fdb312cc"
Jul 17 20:37:10.956030 ip-10-0-141-177 kubenswrapper[2572]: E0717 20:37:10.956011    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eb8b140daa0dafec481db68d610adbd73de4857be433d2d0405c33e8fdb312cc\": container with ID starting with eb8b140daa0dafec481db68d610adbd73de4857be433d2d0405c33e8fdb312cc not found: ID does not exist" containerID="eb8b140daa0dafec481db68d610adbd73de4857be433d2d0405c33e8fdb312cc"
Jul 17 20:37:10.956129 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:37:10.956041    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eb8b140daa0dafec481db68d610adbd73de4857be433d2d0405c33e8fdb312cc"} err="failed to get container status \"eb8b140daa0dafec481db68d610adbd73de4857be433d2d0405c33e8fdb312cc\": rpc error: code = NotFound desc = could not find container \"eb8b140daa0dafec481db68d610adbd73de4857be433d2d0405c33e8fdb312cc\": container with ID starting with eb8b140daa0dafec481db68d610adbd73de4857be433d2d0405c33e8fdb312cc not found: ID does not exist"
Jul 17 20:37:10.956129 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:37:10.956087    2572 scope.go:117] "RemoveContainer" containerID="61f060cbc5d0a12e2f145f847e49b9cf28b55aaa114dd510eb6fe873082d1c10"
Jul 17 20:37:10.956334 ip-10-0-141-177 kubenswrapper[2572]: E0717 20:37:10.956316    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"61f060cbc5d0a12e2f145f847e49b9cf28b55aaa114dd510eb6fe873082d1c10\": container with ID starting with 61f060cbc5d0a12e2f145f847e49b9cf28b55aaa114dd510eb6fe873082d1c10 not found: ID does not exist" containerID="61f060cbc5d0a12e2f145f847e49b9cf28b55aaa114dd510eb6fe873082d1c10"
Jul 17 20:37:10.956374 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:37:10.956341    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"61f060cbc5d0a12e2f145f847e49b9cf28b55aaa114dd510eb6fe873082d1c10"} err="failed to get container status \"61f060cbc5d0a12e2f145f847e49b9cf28b55aaa114dd510eb6fe873082d1c10\": rpc error: code = NotFound desc = could not find container \"61f060cbc5d0a12e2f145f847e49b9cf28b55aaa114dd510eb6fe873082d1c10\": container with ID starting with 61f060cbc5d0a12e2f145f847e49b9cf28b55aaa114dd510eb6fe873082d1c10 not found: ID does not exist"
Jul 17 20:37:10.956374 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:37:10.956358    2572 scope.go:117] "RemoveContainer" containerID="693c81180cb4a68787f3685c734a22c3ed21a4835b766931c71dac36abb5b415"
Jul 17 20:37:10.964499 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:37:10.964482    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-d1a20513-openshift-default-7dbf4d5567-tqqkb"]
Jul 17 20:37:10.975028 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:37:10.970958    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-d1a20513-openshift-default-7dbf4d5567-tqqkb"]
Jul 17 20:37:10.987344 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:37:10.987324    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-d1a20513-5fdc747bc5-rzrs6"]
Jul 17 20:37:10.991169 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:37:10.991148    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-d1a20513-5fdc747bc5-rzrs6"]
Jul 17 20:37:11.313643 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:37:11.313607    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:37:11.687992 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:37:11.687910    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="79a67beb-deef-40c6-8011-680c1bcf020b" path="/var/lib/kubelet/pods/79a67beb-deef-40c6-8011-680c1bcf020b/volumes"
Jul 17 20:37:11.688368 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:37:11.688317    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="adf1a2d2-84ab-4aa1-a745-11412fa97fdb" path="/var/lib/kubelet/pods/adf1a2d2-84ab-4aa1-a745-11412fa97fdb/volumes"
Jul 17 20:37:16.618553 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:37:16.618519    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:37:17.073931 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:37:17.073898    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:37:17.174614 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:37:17.174587    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:37:17.592814 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:37:17.592732    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:37:17.683663 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:37:17.683622    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:37:17.757438 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:37:17.757402    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:37:19.184314 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:37:19.184278    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:37:25.308220 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:37:25.308185    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:37:25.379203 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:37:25.379170    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:37:25.680133 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:37:25.680036    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:37:51.641005 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:37:51.640964    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:37:57.484481 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:37:57.484446    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:37:57.587086 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:37:57.587032    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:37:57.682583 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:37:57.682544    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:38:10.928970 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:38:10.928886    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:38:13.576525 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:38:13.576483    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:38:19.448897 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:38:19.448864    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:38:19.554676 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:38:19.554646    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:38:19.650261 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:38:19.650234    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:38:23.940767 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:38:23.940734    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:38:23.998492 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:38:23.998450    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:38:30.145221 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:38:30.145184    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:38:30.932491 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:38:30.932439    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:38:36.944126 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:38:36.944089    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:38:37.058711 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:38:37.058679    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:38:37.201025 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:38:37.200941    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:38:37.297484 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:38:37.297451    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:38:38.015255 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:38:38.015223    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:38:38.108259 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:38:38.108228    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:38:38.208264 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:38:38.208233    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:38:39.822402 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:38:39.822365    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:38:45.862797 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:38:45.862765    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:38:45.925767 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:38:45.925740    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:38:46.517768 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:38:46.517730    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:38:52.622999 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:38:52.622967    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:38:53.117270 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:38:53.117236    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-2c0bc539-openshift-default-6f94cfc5dc-p8p6t"]
Jul 17 20:38:53.117707 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:38:53.117689    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="adf1a2d2-84ab-4aa1-a745-11412fa97fdb" containerName="maas-api"
Jul 17 20:38:53.117803 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:38:53.117710    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="adf1a2d2-84ab-4aa1-a745-11412fa97fdb" containerName="maas-api"
Jul 17 20:38:53.117803 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:38:53.117721    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="adf1a2d2-84ab-4aa1-a745-11412fa97fdb" containerName="maas-api"
Jul 17 20:38:53.117803 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:38:53.117729    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="adf1a2d2-84ab-4aa1-a745-11412fa97fdb" containerName="maas-api"
Jul 17 20:38:53.117803 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:38:53.117745    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="adf1a2d2-84ab-4aa1-a745-11412fa97fdb" containerName="maas-api"
Jul 17 20:38:53.117803 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:38:53.117754    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="adf1a2d2-84ab-4aa1-a745-11412fa97fdb" containerName="maas-api"
Jul 17 20:38:53.117803 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:38:53.117764    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="adf1a2d2-84ab-4aa1-a745-11412fa97fdb" containerName="maas-api"
Jul 17 20:38:53.117803 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:38:53.117772    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="adf1a2d2-84ab-4aa1-a745-11412fa97fdb" containerName="maas-api"
Jul 17 20:38:53.117803 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:38:53.117785    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="79a67beb-deef-40c6-8011-680c1bcf020b" containerName="istio-proxy"
Jul 17 20:38:53.117803 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:38:53.117794    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="79a67beb-deef-40c6-8011-680c1bcf020b" containerName="istio-proxy"
Jul 17 20:38:53.118255 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:38:53.117809    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="adf1a2d2-84ab-4aa1-a745-11412fa97fdb" containerName="maas-api"
Jul 17 20:38:53.118255 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:38:53.117818    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="adf1a2d2-84ab-4aa1-a745-11412fa97fdb" containerName="maas-api"
Jul 17 20:38:53.118255 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:38:53.117830    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="adf1a2d2-84ab-4aa1-a745-11412fa97fdb" containerName="maas-api"
Jul 17 20:38:53.118255 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:38:53.117838    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="adf1a2d2-84ab-4aa1-a745-11412fa97fdb" containerName="maas-api"
Jul 17 20:38:53.118255 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:38:53.117940    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="adf1a2d2-84ab-4aa1-a745-11412fa97fdb" containerName="maas-api"
Jul 17 20:38:53.118255 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:38:53.117951    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="adf1a2d2-84ab-4aa1-a745-11412fa97fdb" containerName="maas-api"
Jul 17 20:38:53.118255 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:38:53.117961    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="adf1a2d2-84ab-4aa1-a745-11412fa97fdb" containerName="maas-api"
Jul 17 20:38:53.118255 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:38:53.117971    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="adf1a2d2-84ab-4aa1-a745-11412fa97fdb" containerName="maas-api"
Jul 17 20:38:53.118255 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:38:53.117980    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="79a67beb-deef-40c6-8011-680c1bcf020b" containerName="istio-proxy"
Jul 17 20:38:53.118255 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:38:53.117991    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="79a67beb-deef-40c6-8011-680c1bcf020b" containerName="istio-proxy"
Jul 17 20:38:53.121362 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:38:53.121343    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-2c0bc539-openshift-default-6f94cfc5dc-p8p6t"
Jul 17 20:38:53.123970 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:38:53.123952    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-2c0bc539-openshift-default-dockercfg-6mcvd\""
Jul 17 20:38:53.134532 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:38:53.134508    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-2c0bc539-openshift-default-6f94cfc5dc-p8p6t"]
Jul 17 20:38:53.222732 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:38:53.222696    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c6cec37f-61da-4174-8ad7-4e5c47197974-istiod-ca-cert\") pod \"e2e-mt-2c0bc539-openshift-default-6f94cfc5dc-p8p6t\" (UID: \"c6cec37f-61da-4174-8ad7-4e5c47197974\") " pod="openshift-ingress/e2e-mt-2c0bc539-openshift-default-6f94cfc5dc-p8p6t"
Jul 17 20:38:53.222732 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:38:53.222736    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c6cec37f-61da-4174-8ad7-4e5c47197974-istio-envoy\") pod \"e2e-mt-2c0bc539-openshift-default-6f94cfc5dc-p8p6t\" (UID: \"c6cec37f-61da-4174-8ad7-4e5c47197974\") " pod="openshift-ingress/e2e-mt-2c0bc539-openshift-default-6f94cfc5dc-p8p6t"
Jul 17 20:38:53.222954 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:38:53.222757    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7966k\" (UniqueName: \"kubernetes.io/projected/c6cec37f-61da-4174-8ad7-4e5c47197974-kube-api-access-7966k\") pod \"e2e-mt-2c0bc539-openshift-default-6f94cfc5dc-p8p6t\" (UID: \"c6cec37f-61da-4174-8ad7-4e5c47197974\") " pod="openshift-ingress/e2e-mt-2c0bc539-openshift-default-6f94cfc5dc-p8p6t"
Jul 17 20:38:53.222954 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:38:53.222806    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c6cec37f-61da-4174-8ad7-4e5c47197974-workload-socket\") pod \"e2e-mt-2c0bc539-openshift-default-6f94cfc5dc-p8p6t\" (UID: \"c6cec37f-61da-4174-8ad7-4e5c47197974\") " pod="openshift-ingress/e2e-mt-2c0bc539-openshift-default-6f94cfc5dc-p8p6t"
Jul 17 20:38:53.222954 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:38:53.222843    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c6cec37f-61da-4174-8ad7-4e5c47197974-istio-podinfo\") pod \"e2e-mt-2c0bc539-openshift-default-6f94cfc5dc-p8p6t\" (UID: \"c6cec37f-61da-4174-8ad7-4e5c47197974\") " pod="openshift-ingress/e2e-mt-2c0bc539-openshift-default-6f94cfc5dc-p8p6t"
Jul 17 20:38:53.222954 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:38:53.222880    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c6cec37f-61da-4174-8ad7-4e5c47197974-istio-data\") pod \"e2e-mt-2c0bc539-openshift-default-6f94cfc5dc-p8p6t\" (UID: \"c6cec37f-61da-4174-8ad7-4e5c47197974\") " pod="openshift-ingress/e2e-mt-2c0bc539-openshift-default-6f94cfc5dc-p8p6t"
Jul 17 20:38:53.222954 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:38:53.222932    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c6cec37f-61da-4174-8ad7-4e5c47197974-credential-socket\") pod \"e2e-mt-2c0bc539-openshift-default-6f94cfc5dc-p8p6t\" (UID: \"c6cec37f-61da-4174-8ad7-4e5c47197974\") " pod="openshift-ingress/e2e-mt-2c0bc539-openshift-default-6f94cfc5dc-p8p6t"
Jul 17 20:38:53.223147 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:38:53.222965    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c6cec37f-61da-4174-8ad7-4e5c47197974-workload-certs\") pod \"e2e-mt-2c0bc539-openshift-default-6f94cfc5dc-p8p6t\" (UID: \"c6cec37f-61da-4174-8ad7-4e5c47197974\") " pod="openshift-ingress/e2e-mt-2c0bc539-openshift-default-6f94cfc5dc-p8p6t"
Jul 17 20:38:53.223147 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:38:53.222993    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c6cec37f-61da-4174-8ad7-4e5c47197974-istio-token\") pod \"e2e-mt-2c0bc539-openshift-default-6f94cfc5dc-p8p6t\" (UID: \"c6cec37f-61da-4174-8ad7-4e5c47197974\") " pod="openshift-ingress/e2e-mt-2c0bc539-openshift-default-6f94cfc5dc-p8p6t"
Jul 17 20:38:53.323872 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:38:53.323834    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c6cec37f-61da-4174-8ad7-4e5c47197974-credential-socket\") pod \"e2e-mt-2c0bc539-openshift-default-6f94cfc5dc-p8p6t\" (UID: \"c6cec37f-61da-4174-8ad7-4e5c47197974\") " pod="openshift-ingress/e2e-mt-2c0bc539-openshift-default-6f94cfc5dc-p8p6t"
Jul 17 20:38:53.324049 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:38:53.323883    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c6cec37f-61da-4174-8ad7-4e5c47197974-workload-certs\") pod \"e2e-mt-2c0bc539-openshift-default-6f94cfc5dc-p8p6t\" (UID: \"c6cec37f-61da-4174-8ad7-4e5c47197974\") " pod="openshift-ingress/e2e-mt-2c0bc539-openshift-default-6f94cfc5dc-p8p6t"
Jul 17 20:38:53.324049 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:38:53.323982    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c6cec37f-61da-4174-8ad7-4e5c47197974-istio-token\") pod \"e2e-mt-2c0bc539-openshift-default-6f94cfc5dc-p8p6t\" (UID: \"c6cec37f-61da-4174-8ad7-4e5c47197974\") " pod="openshift-ingress/e2e-mt-2c0bc539-openshift-default-6f94cfc5dc-p8p6t"
Jul 17 20:38:53.324049 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:38:53.324028    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c6cec37f-61da-4174-8ad7-4e5c47197974-istiod-ca-cert\") pod \"e2e-mt-2c0bc539-openshift-default-6f94cfc5dc-p8p6t\" (UID: \"c6cec37f-61da-4174-8ad7-4e5c47197974\") " pod="openshift-ingress/e2e-mt-2c0bc539-openshift-default-6f94cfc5dc-p8p6t"
Jul 17 20:38:53.324215 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:38:53.324100    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c6cec37f-61da-4174-8ad7-4e5c47197974-istio-envoy\") pod \"e2e-mt-2c0bc539-openshift-default-6f94cfc5dc-p8p6t\" (UID: \"c6cec37f-61da-4174-8ad7-4e5c47197974\") " pod="openshift-ingress/e2e-mt-2c0bc539-openshift-default-6f94cfc5dc-p8p6t"
Jul 17 20:38:53.324215 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:38:53.324123    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7966k\" (UniqueName: \"kubernetes.io/projected/c6cec37f-61da-4174-8ad7-4e5c47197974-kube-api-access-7966k\") pod \"e2e-mt-2c0bc539-openshift-default-6f94cfc5dc-p8p6t\" (UID: \"c6cec37f-61da-4174-8ad7-4e5c47197974\") " pod="openshift-ingress/e2e-mt-2c0bc539-openshift-default-6f94cfc5dc-p8p6t"
Jul 17 20:38:53.324215 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:38:53.324155    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c6cec37f-61da-4174-8ad7-4e5c47197974-workload-socket\") pod \"e2e-mt-2c0bc539-openshift-default-6f94cfc5dc-p8p6t\" (UID: \"c6cec37f-61da-4174-8ad7-4e5c47197974\") " pod="openshift-ingress/e2e-mt-2c0bc539-openshift-default-6f94cfc5dc-p8p6t"
Jul 17 20:38:53.324215 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:38:53.324186    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c6cec37f-61da-4174-8ad7-4e5c47197974-istio-podinfo\") pod \"e2e-mt-2c0bc539-openshift-default-6f94cfc5dc-p8p6t\" (UID: \"c6cec37f-61da-4174-8ad7-4e5c47197974\") " pod="openshift-ingress/e2e-mt-2c0bc539-openshift-default-6f94cfc5dc-p8p6t"
Jul 17 20:38:53.324411 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:38:53.324238    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c6cec37f-61da-4174-8ad7-4e5c47197974-istio-data\") pod \"e2e-mt-2c0bc539-openshift-default-6f94cfc5dc-p8p6t\" (UID: \"c6cec37f-61da-4174-8ad7-4e5c47197974\") " pod="openshift-ingress/e2e-mt-2c0bc539-openshift-default-6f94cfc5dc-p8p6t"
Jul 17 20:38:53.324411 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:38:53.324314    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c6cec37f-61da-4174-8ad7-4e5c47197974-credential-socket\") pod \"e2e-mt-2c0bc539-openshift-default-6f94cfc5dc-p8p6t\" (UID: \"c6cec37f-61da-4174-8ad7-4e5c47197974\") " pod="openshift-ingress/e2e-mt-2c0bc539-openshift-default-6f94cfc5dc-p8p6t"
Jul 17 20:38:53.324617 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:38:53.324587    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c6cec37f-61da-4174-8ad7-4e5c47197974-workload-socket\") pod \"e2e-mt-2c0bc539-openshift-default-6f94cfc5dc-p8p6t\" (UID: \"c6cec37f-61da-4174-8ad7-4e5c47197974\") " pod="openshift-ingress/e2e-mt-2c0bc539-openshift-default-6f94cfc5dc-p8p6t"
Jul 17 20:38:53.324692 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:38:53.324629    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c6cec37f-61da-4174-8ad7-4e5c47197974-istio-data\") pod \"e2e-mt-2c0bc539-openshift-default-6f94cfc5dc-p8p6t\" (UID: \"c6cec37f-61da-4174-8ad7-4e5c47197974\") " pod="openshift-ingress/e2e-mt-2c0bc539-openshift-default-6f94cfc5dc-p8p6t"
Jul 17 20:38:53.324786 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:38:53.324768    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c6cec37f-61da-4174-8ad7-4e5c47197974-workload-certs\") pod \"e2e-mt-2c0bc539-openshift-default-6f94cfc5dc-p8p6t\" (UID: \"c6cec37f-61da-4174-8ad7-4e5c47197974\") " pod="openshift-ingress/e2e-mt-2c0bc539-openshift-default-6f94cfc5dc-p8p6t"
Jul 17 20:38:53.324845 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:38:53.324770    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c6cec37f-61da-4174-8ad7-4e5c47197974-istiod-ca-cert\") pod \"e2e-mt-2c0bc539-openshift-default-6f94cfc5dc-p8p6t\" (UID: \"c6cec37f-61da-4174-8ad7-4e5c47197974\") " pod="openshift-ingress/e2e-mt-2c0bc539-openshift-default-6f94cfc5dc-p8p6t"
Jul 17 20:38:53.326534 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:38:53.326516    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c6cec37f-61da-4174-8ad7-4e5c47197974-istio-envoy\") pod \"e2e-mt-2c0bc539-openshift-default-6f94cfc5dc-p8p6t\" (UID: \"c6cec37f-61da-4174-8ad7-4e5c47197974\") " pod="openshift-ingress/e2e-mt-2c0bc539-openshift-default-6f94cfc5dc-p8p6t"
Jul 17 20:38:53.326760 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:38:53.326739    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c6cec37f-61da-4174-8ad7-4e5c47197974-istio-podinfo\") pod \"e2e-mt-2c0bc539-openshift-default-6f94cfc5dc-p8p6t\" (UID: \"c6cec37f-61da-4174-8ad7-4e5c47197974\") " pod="openshift-ingress/e2e-mt-2c0bc539-openshift-default-6f94cfc5dc-p8p6t"
Jul 17 20:38:53.332445 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:38:53.332422    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c6cec37f-61da-4174-8ad7-4e5c47197974-istio-token\") pod \"e2e-mt-2c0bc539-openshift-default-6f94cfc5dc-p8p6t\" (UID: \"c6cec37f-61da-4174-8ad7-4e5c47197974\") " pod="openshift-ingress/e2e-mt-2c0bc539-openshift-default-6f94cfc5dc-p8p6t"
Jul 17 20:38:53.332849 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:38:53.332827    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7966k\" (UniqueName: \"kubernetes.io/projected/c6cec37f-61da-4174-8ad7-4e5c47197974-kube-api-access-7966k\") pod \"e2e-mt-2c0bc539-openshift-default-6f94cfc5dc-p8p6t\" (UID: \"c6cec37f-61da-4174-8ad7-4e5c47197974\") " pod="openshift-ingress/e2e-mt-2c0bc539-openshift-default-6f94cfc5dc-p8p6t"
Jul 17 20:38:53.432033 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:38:53.431885    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-2c0bc539-openshift-default-6f94cfc5dc-p8p6t"
Jul 17 20:38:53.573254 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:38:53.573228    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-2c0bc539-openshift-default-6f94cfc5dc-p8p6t"]
Jul 17 20:38:53.575155 ip-10-0-141-177 kubenswrapper[2572]: W0717 20:38:53.575117    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6cec37f_61da_4174_8ad7_4e5c47197974.slice/crio-356393a0b7ed37ddcbccf2efd704e3d35ea07f9b787f91cd8fd7e77275391e4d WatchSource:0}: Error finding container 356393a0b7ed37ddcbccf2efd704e3d35ea07f9b787f91cd8fd7e77275391e4d: Status 404 returned error can't find the container with id 356393a0b7ed37ddcbccf2efd704e3d35ea07f9b787f91cd8fd7e77275391e4d
Jul 17 20:38:53.577254 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:38:53.577219    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 17 20:38:53.577355 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:38:53.577285    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 17 20:38:53.577355 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:38:53.577316    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 17 20:38:54.223879 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:38:54.223848    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:38:54.455234 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:38:54.455194    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-2c0bc539-openshift-default-6f94cfc5dc-p8p6t" event={"ID":"c6cec37f-61da-4174-8ad7-4e5c47197974","Type":"ContainerStarted","Data":"ab1f522baeb5a39260fd0a9b6ac725ab0481d3262039f89234b1ef3398b950bb"}
Jul 17 20:38:54.455440 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:38:54.455249    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-2c0bc539-openshift-default-6f94cfc5dc-p8p6t" event={"ID":"c6cec37f-61da-4174-8ad7-4e5c47197974","Type":"ContainerStarted","Data":"356393a0b7ed37ddcbccf2efd704e3d35ea07f9b787f91cd8fd7e77275391e4d"}
Jul 17 20:38:54.478207 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:38:54.478086    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-2c0bc539-openshift-default-6f94cfc5dc-p8p6t" podStartSLOduration=1.478049656 podStartE2EDuration="1.478049656s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 20:38:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 20:38:54.477201345 +0000 UTC m=+2559.318697000" watchObservedRunningTime="2026-07-17 20:38:54.478049656 +0000 UTC m=+2559.319545298"
Jul 17 20:38:55.432229 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:38:55.432186    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-2c0bc539-openshift-default-6f94cfc5dc-p8p6t"
Jul 17 20:38:55.437135 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:38:55.437100    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-2c0bc539-openshift-default-6f94cfc5dc-p8p6t"
Jul 17 20:38:55.460161 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:38:55.460121    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-2c0bc539-openshift-default-6f94cfc5dc-p8p6t"
Jul 17 20:38:55.461006 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:38:55.460984    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-2c0bc539-openshift-default-6f94cfc5dc-p8p6t"
Jul 17 20:38:56.374577 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:38:56.374546    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:38:56.459794 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:38:56.459764    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-2c0bc539-6c97779cf5-ltn6w"]
Jul 17 20:38:56.460266 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:38:56.459936    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:38:56.460403 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:38:56.460381    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="79a67beb-deef-40c6-8011-680c1bcf020b" containerName="istio-proxy"
Jul 17 20:38:56.460403 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:38:56.460403    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="79a67beb-deef-40c6-8011-680c1bcf020b" containerName="istio-proxy"
Jul 17 20:38:56.460606 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:38:56.460516    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="adf1a2d2-84ab-4aa1-a745-11412fa97fdb" containerName="maas-api"
Jul 17 20:38:56.460606 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:38:56.460527    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="adf1a2d2-84ab-4aa1-a745-11412fa97fdb" containerName="maas-api"
Jul 17 20:38:56.463800 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:38:56.463784    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-2c0bc539-6c97779cf5-ltn6w"
Jul 17 20:38:56.469324 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:38:56.469301    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-2c0bc539-serving-cert\""
Jul 17 20:38:56.473249 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:38:56.472737    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-2c0bc539-6c97779cf5-ltn6w"]
Jul 17 20:38:56.530456 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:38:56.530418    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:38:56.556846 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:38:56.556807    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d47981bb-f9d0-489e-adf1-e49ce71641f4-openshift-service-ca\") pod \"maas-api-e2e-mt-2c0bc539-6c97779cf5-ltn6w\" (UID: \"d47981bb-f9d0-489e-adf1-e49ce71641f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-2c0bc539-6c97779cf5-ltn6w"
Jul 17 20:38:56.557032 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:38:56.556854    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d47981bb-f9d0-489e-adf1-e49ce71641f4-maas-api-tls\") pod \"maas-api-e2e-mt-2c0bc539-6c97779cf5-ltn6w\" (UID: \"d47981bb-f9d0-489e-adf1-e49ce71641f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-2c0bc539-6c97779cf5-ltn6w"
Jul 17 20:38:56.557032 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:38:56.556929    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hn2jr\" (UniqueName: \"kubernetes.io/projected/d47981bb-f9d0-489e-adf1-e49ce71641f4-kube-api-access-hn2jr\") pod \"maas-api-e2e-mt-2c0bc539-6c97779cf5-ltn6w\" (UID: \"d47981bb-f9d0-489e-adf1-e49ce71641f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-2c0bc539-6c97779cf5-ltn6w"
Jul 17 20:38:56.658192 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:38:56.658055    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d47981bb-f9d0-489e-adf1-e49ce71641f4-openshift-service-ca\") pod \"maas-api-e2e-mt-2c0bc539-6c97779cf5-ltn6w\" (UID: \"d47981bb-f9d0-489e-adf1-e49ce71641f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-2c0bc539-6c97779cf5-ltn6w"
Jul 17 20:38:56.658192 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:38:56.658140    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d47981bb-f9d0-489e-adf1-e49ce71641f4-maas-api-tls\") pod \"maas-api-e2e-mt-2c0bc539-6c97779cf5-ltn6w\" (UID: \"d47981bb-f9d0-489e-adf1-e49ce71641f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-2c0bc539-6c97779cf5-ltn6w"
Jul 17 20:38:56.658192 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:38:56.658180    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hn2jr\" (UniqueName: \"kubernetes.io/projected/d47981bb-f9d0-489e-adf1-e49ce71641f4-kube-api-access-hn2jr\") pod \"maas-api-e2e-mt-2c0bc539-6c97779cf5-ltn6w\" (UID: \"d47981bb-f9d0-489e-adf1-e49ce71641f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-2c0bc539-6c97779cf5-ltn6w"
Jul 17 20:38:56.658494 ip-10-0-141-177 kubenswrapper[2572]: E0717 20:38:56.658249    2572 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-2c0bc539-serving-cert: secret "maas-api-e2e-mt-2c0bc539-serving-cert" not found
Jul 17 20:38:56.658494 ip-10-0-141-177 kubenswrapper[2572]: E0717 20:38:56.658339    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d47981bb-f9d0-489e-adf1-e49ce71641f4-maas-api-tls podName:d47981bb-f9d0-489e-adf1-e49ce71641f4 nodeName:}" failed. No retries permitted until 2026-07-17 20:38:57.158318179 +0000 UTC m=+2561.999813808 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/d47981bb-f9d0-489e-adf1-e49ce71641f4-maas-api-tls") pod "maas-api-e2e-mt-2c0bc539-6c97779cf5-ltn6w" (UID: "d47981bb-f9d0-489e-adf1-e49ce71641f4") : secret "maas-api-e2e-mt-2c0bc539-serving-cert" not found
Jul 17 20:38:56.658816 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:38:56.658789    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d47981bb-f9d0-489e-adf1-e49ce71641f4-openshift-service-ca\") pod \"maas-api-e2e-mt-2c0bc539-6c97779cf5-ltn6w\" (UID: \"d47981bb-f9d0-489e-adf1-e49ce71641f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-2c0bc539-6c97779cf5-ltn6w"
Jul 17 20:38:56.667980 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:38:56.667953    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hn2jr\" (UniqueName: \"kubernetes.io/projected/d47981bb-f9d0-489e-adf1-e49ce71641f4-kube-api-access-hn2jr\") pod \"maas-api-e2e-mt-2c0bc539-6c97779cf5-ltn6w\" (UID: \"d47981bb-f9d0-489e-adf1-e49ce71641f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-2c0bc539-6c97779cf5-ltn6w"
Jul 17 20:38:57.083761 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:38:57.083703    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:38:57.162978 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:38:57.162941    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d47981bb-f9d0-489e-adf1-e49ce71641f4-maas-api-tls\") pod \"maas-api-e2e-mt-2c0bc539-6c97779cf5-ltn6w\" (UID: \"d47981bb-f9d0-489e-adf1-e49ce71641f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-2c0bc539-6c97779cf5-ltn6w"
Jul 17 20:38:57.165515 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:38:57.165488    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d47981bb-f9d0-489e-adf1-e49ce71641f4-maas-api-tls\") pod \"maas-api-e2e-mt-2c0bc539-6c97779cf5-ltn6w\" (UID: \"d47981bb-f9d0-489e-adf1-e49ce71641f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-2c0bc539-6c97779cf5-ltn6w"
Jul 17 20:38:57.184444 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:38:57.184415    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:38:57.378502 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:38:57.378415    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-2c0bc539-6c97779cf5-ltn6w"
Jul 17 20:38:57.725573 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:38:57.725551    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-2c0bc539-6c97779cf5-ltn6w"]
Jul 17 20:38:57.727667 ip-10-0-141-177 kubenswrapper[2572]: W0717 20:38:57.727643    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd47981bb_f9d0_489e_adf1_e49ce71641f4.slice/crio-e159dab7cdb1c40abdadfab5ff2621be6f03f380fa6bd00bacdf608aaeb1e947 WatchSource:0}: Error finding container e159dab7cdb1c40abdadfab5ff2621be6f03f380fa6bd00bacdf608aaeb1e947: Status 404 returned error can't find the container with id e159dab7cdb1c40abdadfab5ff2621be6f03f380fa6bd00bacdf608aaeb1e947
Jul 17 20:38:57.729108 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:38:57.729089    2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 17 20:38:58.478689 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:38:58.478606    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-2c0bc539-6c97779cf5-ltn6w" event={"ID":"d47981bb-f9d0-489e-adf1-e49ce71641f4","Type":"ContainerStarted","Data":"6d4806d2c6611a15c68d04ed31403807560e7d63f75eb22f552c2baae214e9bf"}
Jul 17 20:38:58.478689 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:38:58.478686    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-2c0bc539-6c97779cf5-ltn6w" event={"ID":"d47981bb-f9d0-489e-adf1-e49ce71641f4","Type":"ContainerStarted","Data":"e159dab7cdb1c40abdadfab5ff2621be6f03f380fa6bd00bacdf608aaeb1e947"}
Jul 17 20:38:58.478864 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:38:58.478754    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-2c0bc539-6c97779cf5-ltn6w"
Jul 17 20:38:58.496209 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:38:58.496168    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-2c0bc539-6c97779cf5-ltn6w" podStartSLOduration=2.015703223 podStartE2EDuration="2.496155504s" totalImagesPullingTime="480.452281ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 20:38:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 20:38:58.494732765 +0000 UTC m=+2563.336228424" watchObservedRunningTime="2026-07-17 20:38:58.496155504 +0000 UTC m=+2563.337651141"
Jul 17 20:39:00.846234 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:39:00.846202    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:39:01.498393 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:39:01.498359    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:39:01.593303 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:39:01.593274    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:39:01.911420 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:39:01.911338    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:39:04.490165 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:39:04.490136    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-2c0bc539-6c97779cf5-ltn6w"
Jul 17 20:39:08.191845 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:39:08.191805    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:39:08.292348 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:39:08.292313    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:39:10.462419 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:39:10.462381    2572 patch_prober.go:28] interesting pod/e2e-mt-2c0bc539-openshift-default-6f94cfc5dc-p8p6t container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body=
Jul 17 20:39:10.462931 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:39:10.462445    2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-2c0bc539-openshift-default-6f94cfc5dc-p8p6t" podUID="c6cec37f-61da-4174-8ad7-4e5c47197974" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused"
Jul 17 20:39:10.550166 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:39:10.550135    2572 generic.go:356] "Generic (PLEG): container finished" podID="c6cec37f-61da-4174-8ad7-4e5c47197974" containerID="ab1f522baeb5a39260fd0a9b6ac725ab0481d3262039f89234b1ef3398b950bb" exitCode=0
Jul 17 20:39:10.550366 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:39:10.550213    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-2c0bc539-openshift-default-6f94cfc5dc-p8p6t" event={"ID":"c6cec37f-61da-4174-8ad7-4e5c47197974","Type":"ContainerDied","Data":"ab1f522baeb5a39260fd0a9b6ac725ab0481d3262039f89234b1ef3398b950bb"}
Jul 17 20:39:10.550668 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:39:10.550652    2572 scope.go:117] "RemoveContainer" containerID="ab1f522baeb5a39260fd0a9b6ac725ab0481d3262039f89234b1ef3398b950bb"
Jul 17 20:39:10.551662 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:39:10.551634    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 17 20:39:10.551729 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:39:10.551701    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 17 20:39:10.551770 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:39:10.551732    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 17 20:39:11.560453 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:39:11.560418    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-2c0bc539-openshift-default-6f94cfc5dc-p8p6t" event={"ID":"c6cec37f-61da-4174-8ad7-4e5c47197974","Type":"ContainerStarted","Data":"1d301e98b55e34393fd6703fb998361ac67dd77197d82c4f2bd7113feb7ae263"}
Jul 17 20:39:12.432991 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:39:12.432952    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-2c0bc539-openshift-default-6f94cfc5dc-p8p6t"
Jul 17 20:39:12.433226 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:39:12.433099    2572 patch_prober.go:28] interesting pod/e2e-mt-2c0bc539-openshift-default-6f94cfc5dc-p8p6t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body=
Jul 17 20:39:12.433226 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:39:12.433155    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-2c0bc539-openshift-default-6f94cfc5dc-p8p6t" podUID="c6cec37f-61da-4174-8ad7-4e5c47197974" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused"
Jul 17 20:39:13.432733 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:39:13.432694    2572 patch_prober.go:28] interesting pod/e2e-mt-2c0bc539-openshift-default-6f94cfc5dc-p8p6t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body=
Jul 17 20:39:13.433766 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:39:13.433346    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-2c0bc539-openshift-default-6f94cfc5dc-p8p6t" podUID="c6cec37f-61da-4174-8ad7-4e5c47197974" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused"
Jul 17 20:39:14.432972 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:39:14.432876    2572 patch_prober.go:28] interesting pod/e2e-mt-2c0bc539-openshift-default-6f94cfc5dc-p8p6t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body=
Jul 17 20:39:14.433582 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:39:14.433548    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-2c0bc539-openshift-default-6f94cfc5dc-p8p6t" podUID="c6cec37f-61da-4174-8ad7-4e5c47197974" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused"
Jul 17 20:39:15.436325 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:39:15.436298    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-2c0bc539-openshift-default-6f94cfc5dc-p8p6t"
Jul 17 20:39:15.436771 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:39:15.436573    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-2c0bc539-openshift-default-6f94cfc5dc-p8p6t"
Jul 17 20:39:15.437267 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:39:15.437251    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-2c0bc539-openshift-default-6f94cfc5dc-p8p6t"
Jul 17 20:39:19.251668 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:39:19.251636    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-2c0bc539-6c97779cf5-ltn6w"]
Jul 17 20:39:19.252100 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:39:19.251890    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-2c0bc539-6c97779cf5-ltn6w" podUID="d47981bb-f9d0-489e-adf1-e49ce71641f4" containerName="maas-api" containerID="cri-o://6d4806d2c6611a15c68d04ed31403807560e7d63f75eb22f552c2baae214e9bf" gracePeriod=30
Jul 17 20:39:19.312975 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:39:19.312937    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:39:19.505281 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:39:19.505220    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-2c0bc539-6c97779cf5-ltn6w"
Jul 17 20:39:19.602717 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:39:19.602685    2572 generic.go:356] "Generic (PLEG): container finished" podID="d47981bb-f9d0-489e-adf1-e49ce71641f4" containerID="6d4806d2c6611a15c68d04ed31403807560e7d63f75eb22f552c2baae214e9bf" exitCode=0
Jul 17 20:39:19.602911 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:39:19.602729    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-2c0bc539-6c97779cf5-ltn6w"
Jul 17 20:39:19.602911 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:39:19.602771    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-2c0bc539-6c97779cf5-ltn6w" event={"ID":"d47981bb-f9d0-489e-adf1-e49ce71641f4","Type":"ContainerDied","Data":"6d4806d2c6611a15c68d04ed31403807560e7d63f75eb22f552c2baae214e9bf"}
Jul 17 20:39:19.602911 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:39:19.602829    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-2c0bc539-6c97779cf5-ltn6w" event={"ID":"d47981bb-f9d0-489e-adf1-e49ce71641f4","Type":"ContainerDied","Data":"e159dab7cdb1c40abdadfab5ff2621be6f03f380fa6bd00bacdf608aaeb1e947"}
Jul 17 20:39:19.602911 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:39:19.602858    2572 scope.go:117] "RemoveContainer" containerID="6d4806d2c6611a15c68d04ed31403807560e7d63f75eb22f552c2baae214e9bf"
Jul 17 20:39:19.611291 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:39:19.611274    2572 scope.go:117] "RemoveContainer" containerID="6d4806d2c6611a15c68d04ed31403807560e7d63f75eb22f552c2baae214e9bf"
Jul 17 20:39:19.611519 ip-10-0-141-177 kubenswrapper[2572]: E0717 20:39:19.611501    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6d4806d2c6611a15c68d04ed31403807560e7d63f75eb22f552c2baae214e9bf\": container with ID starting with 6d4806d2c6611a15c68d04ed31403807560e7d63f75eb22f552c2baae214e9bf not found: ID does not exist" containerID="6d4806d2c6611a15c68d04ed31403807560e7d63f75eb22f552c2baae214e9bf"
Jul 17 20:39:19.611587 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:39:19.611529    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d4806d2c6611a15c68d04ed31403807560e7d63f75eb22f552c2baae214e9bf"} err="failed to get container status \"6d4806d2c6611a15c68d04ed31403807560e7d63f75eb22f552c2baae214e9bf\": rpc error: code = NotFound desc = could not find container \"6d4806d2c6611a15c68d04ed31403807560e7d63f75eb22f552c2baae214e9bf\": container with ID starting with 6d4806d2c6611a15c68d04ed31403807560e7d63f75eb22f552c2baae214e9bf not found: ID does not exist"
Jul 17 20:39:19.704532 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:39:19.704501    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d47981bb-f9d0-489e-adf1-e49ce71641f4-openshift-service-ca\") pod \"d47981bb-f9d0-489e-adf1-e49ce71641f4\" (UID: \"d47981bb-f9d0-489e-adf1-e49ce71641f4\") "
Jul 17 20:39:19.704699 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:39:19.704607    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hn2jr\" (UniqueName: \"kubernetes.io/projected/d47981bb-f9d0-489e-adf1-e49ce71641f4-kube-api-access-hn2jr\") pod \"d47981bb-f9d0-489e-adf1-e49ce71641f4\" (UID: \"d47981bb-f9d0-489e-adf1-e49ce71641f4\") "
Jul 17 20:39:19.704699 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:39:19.704647    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d47981bb-f9d0-489e-adf1-e49ce71641f4-maas-api-tls\") pod \"d47981bb-f9d0-489e-adf1-e49ce71641f4\" (UID: \"d47981bb-f9d0-489e-adf1-e49ce71641f4\") "
Jul 17 20:39:19.704918 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:39:19.704892    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d47981bb-f9d0-489e-adf1-e49ce71641f4-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "d47981bb-f9d0-489e-adf1-e49ce71641f4" (UID: "d47981bb-f9d0-489e-adf1-e49ce71641f4"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 20:39:19.706667 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:39:19.706641    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d47981bb-f9d0-489e-adf1-e49ce71641f4-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "d47981bb-f9d0-489e-adf1-e49ce71641f4" (UID: "d47981bb-f9d0-489e-adf1-e49ce71641f4"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 20:39:19.706667 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:39:19.706654    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d47981bb-f9d0-489e-adf1-e49ce71641f4-kube-api-access-hn2jr" (OuterVolumeSpecName: "kube-api-access-hn2jr") pod "d47981bb-f9d0-489e-adf1-e49ce71641f4" (UID: "d47981bb-f9d0-489e-adf1-e49ce71641f4"). InnerVolumeSpecName "kube-api-access-hn2jr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 20:39:19.806183 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:39:19.806105    2572 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d47981bb-f9d0-489e-adf1-e49ce71641f4-openshift-service-ca\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Jul 17 20:39:19.806183 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:39:19.806129    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hn2jr\" (UniqueName: \"kubernetes.io/projected/d47981bb-f9d0-489e-adf1-e49ce71641f4-kube-api-access-hn2jr\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Jul 17 20:39:19.806183 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:39:19.806140    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d47981bb-f9d0-489e-adf1-e49ce71641f4-maas-api-tls\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Jul 17 20:39:19.924865 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:39:19.924838    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-2c0bc539-6c97779cf5-ltn6w"]
Jul 17 20:39:19.928970 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:39:19.928945    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-2c0bc539-6c97779cf5-ltn6w"]
Jul 17 20:39:21.688860 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:39:21.688818    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d47981bb-f9d0-489e-adf1-e49ce71641f4" path="/var/lib/kubelet/pods/d47981bb-f9d0-489e-adf1-e49ce71641f4/volumes"
Jul 17 20:39:22.485757 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:39:22.485714    2572 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-mt-2c0bc539-6c97779cf5-ltn6w" podUID="d47981bb-f9d0-489e-adf1-e49ce71641f4" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.53:8443/health\": context deadline exceeded"
Jul 17 20:39:23.634124 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:39:23.634087    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:39:29.353396 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:39:29.353362    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:39:29.453981 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:39:29.453940    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:39:34.258587 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:39:34.258552    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-2c0bc539-openshift-default-6f94cfc5dc-p8p6t"]
Jul 17 20:39:34.259003 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:39:34.258775    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-2c0bc539-openshift-default-6f94cfc5dc-p8p6t" podUID="c6cec37f-61da-4174-8ad7-4e5c47197974" containerName="istio-proxy" containerID="cri-o://1d301e98b55e34393fd6703fb998361ac67dd77197d82c4f2bd7113feb7ae263" gracePeriod=30
Jul 17 20:39:34.281352 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:39:34.281316    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:39:34.507693 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:39:34.507657    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:39:34.637962 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:39:34.637883    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:39:34.733847 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:39:34.733812    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:39:34.853317 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:39:34.853284    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:39:39.522384 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:39:39.522362    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-2c0bc539-openshift-default-6f94cfc5dc-p8p6t"
Jul 17 20:39:39.598424 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:39:39.598353    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c6cec37f-61da-4174-8ad7-4e5c47197974-istio-envoy\") pod \"c6cec37f-61da-4174-8ad7-4e5c47197974\" (UID: \"c6cec37f-61da-4174-8ad7-4e5c47197974\") "
Jul 17 20:39:39.598424 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:39:39.598403    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c6cec37f-61da-4174-8ad7-4e5c47197974-workload-socket\") pod \"c6cec37f-61da-4174-8ad7-4e5c47197974\" (UID: \"c6cec37f-61da-4174-8ad7-4e5c47197974\") "
Jul 17 20:39:39.598642 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:39:39.598463    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c6cec37f-61da-4174-8ad7-4e5c47197974-credential-socket\") pod \"c6cec37f-61da-4174-8ad7-4e5c47197974\" (UID: \"c6cec37f-61da-4174-8ad7-4e5c47197974\") "
Jul 17 20:39:39.598642 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:39:39.598487    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c6cec37f-61da-4174-8ad7-4e5c47197974-istiod-ca-cert\") pod \"c6cec37f-61da-4174-8ad7-4e5c47197974\" (UID: \"c6cec37f-61da-4174-8ad7-4e5c47197974\") "
Jul 17 20:39:39.598642 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:39:39.598514    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7966k\" (UniqueName: \"kubernetes.io/projected/c6cec37f-61da-4174-8ad7-4e5c47197974-kube-api-access-7966k\") pod \"c6cec37f-61da-4174-8ad7-4e5c47197974\" (UID: \"c6cec37f-61da-4174-8ad7-4e5c47197974\") "
Jul 17 20:39:39.598642 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:39:39.598528    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c6cec37f-61da-4174-8ad7-4e5c47197974-workload-certs\") pod \"c6cec37f-61da-4174-8ad7-4e5c47197974\" (UID: \"c6cec37f-61da-4174-8ad7-4e5c47197974\") "
Jul 17 20:39:39.598642 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:39:39.598550    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c6cec37f-61da-4174-8ad7-4e5c47197974-istio-podinfo\") pod \"c6cec37f-61da-4174-8ad7-4e5c47197974\" (UID: \"c6cec37f-61da-4174-8ad7-4e5c47197974\") "
Jul 17 20:39:39.598906 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:39:39.598715    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c6cec37f-61da-4174-8ad7-4e5c47197974-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c6cec37f-61da-4174-8ad7-4e5c47197974" (UID: "c6cec37f-61da-4174-8ad7-4e5c47197974"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 20:39:39.598906 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:39:39.598790    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c6cec37f-61da-4174-8ad7-4e5c47197974-istio-token\") pod \"c6cec37f-61da-4174-8ad7-4e5c47197974\" (UID: \"c6cec37f-61da-4174-8ad7-4e5c47197974\") "
Jul 17 20:39:39.598906 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:39:39.598826    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c6cec37f-61da-4174-8ad7-4e5c47197974-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c6cec37f-61da-4174-8ad7-4e5c47197974" (UID: "c6cec37f-61da-4174-8ad7-4e5c47197974"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 20:39:39.598906 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:39:39.598842    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c6cec37f-61da-4174-8ad7-4e5c47197974-istio-data\") pod \"c6cec37f-61da-4174-8ad7-4e5c47197974\" (UID: \"c6cec37f-61da-4174-8ad7-4e5c47197974\") "
Jul 17 20:39:39.598906 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:39:39.598842    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c6cec37f-61da-4174-8ad7-4e5c47197974-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c6cec37f-61da-4174-8ad7-4e5c47197974" (UID: "c6cec37f-61da-4174-8ad7-4e5c47197974"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 20:39:39.599168 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:39:39.598909    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c6cec37f-61da-4174-8ad7-4e5c47197974-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c6cec37f-61da-4174-8ad7-4e5c47197974" (UID: "c6cec37f-61da-4174-8ad7-4e5c47197974"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 20:39:39.599319 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:39:39.599247    2572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c6cec37f-61da-4174-8ad7-4e5c47197974-istiod-ca-cert\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Jul 17 20:39:39.599319 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:39:39.599269    2572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c6cec37f-61da-4174-8ad7-4e5c47197974-workload-certs\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Jul 17 20:39:39.599319 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:39:39.599282    2572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c6cec37f-61da-4174-8ad7-4e5c47197974-workload-socket\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Jul 17 20:39:39.599319 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:39:39.599294    2572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c6cec37f-61da-4174-8ad7-4e5c47197974-credential-socket\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Jul 17 20:39:39.599908 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:39:39.599884    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c6cec37f-61da-4174-8ad7-4e5c47197974-istio-data" (OuterVolumeSpecName: "istio-data") pod "c6cec37f-61da-4174-8ad7-4e5c47197974" (UID: "c6cec37f-61da-4174-8ad7-4e5c47197974"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 20:39:39.600637 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:39:39.600612    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c6cec37f-61da-4174-8ad7-4e5c47197974-kube-api-access-7966k" (OuterVolumeSpecName: "kube-api-access-7966k") pod "c6cec37f-61da-4174-8ad7-4e5c47197974" (UID: "c6cec37f-61da-4174-8ad7-4e5c47197974"). InnerVolumeSpecName "kube-api-access-7966k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 20:39:39.600816 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:39:39.600801    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c6cec37f-61da-4174-8ad7-4e5c47197974-istio-token" (OuterVolumeSpecName: "istio-token") pod "c6cec37f-61da-4174-8ad7-4e5c47197974" (UID: "c6cec37f-61da-4174-8ad7-4e5c47197974"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 20:39:39.601006 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:39:39.600977    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c6cec37f-61da-4174-8ad7-4e5c47197974-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c6cec37f-61da-4174-8ad7-4e5c47197974" (UID: "c6cec37f-61da-4174-8ad7-4e5c47197974"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 20:39:39.601006 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:39:39.600983    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c6cec37f-61da-4174-8ad7-4e5c47197974-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c6cec37f-61da-4174-8ad7-4e5c47197974" (UID: "c6cec37f-61da-4174-8ad7-4e5c47197974"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 17 20:39:39.700081 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:39:39.700046    2572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c6cec37f-61da-4174-8ad7-4e5c47197974-istio-envoy\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Jul 17 20:39:39.700182 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:39:39.700083    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7966k\" (UniqueName: \"kubernetes.io/projected/c6cec37f-61da-4174-8ad7-4e5c47197974-kube-api-access-7966k\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Jul 17 20:39:39.700182 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:39:39.700096    2572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c6cec37f-61da-4174-8ad7-4e5c47197974-istio-podinfo\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Jul 17 20:39:39.700182 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:39:39.700106    2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c6cec37f-61da-4174-8ad7-4e5c47197974-istio-token\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Jul 17 20:39:39.700182 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:39:39.700114    2572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c6cec37f-61da-4174-8ad7-4e5c47197974-istio-data\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Jul 17 20:39:39.713918 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:39:39.713890    2572 generic.go:356] "Generic (PLEG): container finished" podID="c6cec37f-61da-4174-8ad7-4e5c47197974" containerID="1d301e98b55e34393fd6703fb998361ac67dd77197d82c4f2bd7113feb7ae263" exitCode=0
Jul 17 20:39:39.714028 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:39:39.713941    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-2c0bc539-openshift-default-6f94cfc5dc-p8p6t"
Jul 17 20:39:39.714028 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:39:39.713967    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-2c0bc539-openshift-default-6f94cfc5dc-p8p6t" event={"ID":"c6cec37f-61da-4174-8ad7-4e5c47197974","Type":"ContainerDied","Data":"1d301e98b55e34393fd6703fb998361ac67dd77197d82c4f2bd7113feb7ae263"}
Jul 17 20:39:39.714028 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:39:39.714024    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-2c0bc539-openshift-default-6f94cfc5dc-p8p6t" event={"ID":"c6cec37f-61da-4174-8ad7-4e5c47197974","Type":"ContainerDied","Data":"356393a0b7ed37ddcbccf2efd704e3d35ea07f9b787f91cd8fd7e77275391e4d"}
Jul 17 20:39:39.714162 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:39:39.714053    2572 scope.go:117] "RemoveContainer" containerID="1d301e98b55e34393fd6703fb998361ac67dd77197d82c4f2bd7113feb7ae263"
Jul 17 20:39:39.723518 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:39:39.723504    2572 scope.go:117] "RemoveContainer" containerID="ab1f522baeb5a39260fd0a9b6ac725ab0481d3262039f89234b1ef3398b950bb"
Jul 17 20:39:39.731502 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:39:39.731481    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-2c0bc539-openshift-default-6f94cfc5dc-p8p6t"]
Jul 17 20:39:39.731739 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:39:39.731720    2572 scope.go:117] "RemoveContainer" containerID="1d301e98b55e34393fd6703fb998361ac67dd77197d82c4f2bd7113feb7ae263"
Jul 17 20:39:39.731985 ip-10-0-141-177 kubenswrapper[2572]: E0717 20:39:39.731966    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1d301e98b55e34393fd6703fb998361ac67dd77197d82c4f2bd7113feb7ae263\": container with ID starting with 1d301e98b55e34393fd6703fb998361ac67dd77197d82c4f2bd7113feb7ae263 not found: ID does not exist" containerID="1d301e98b55e34393fd6703fb998361ac67dd77197d82c4f2bd7113feb7ae263"
Jul 17 20:39:39.732042 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:39:39.731992    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1d301e98b55e34393fd6703fb998361ac67dd77197d82c4f2bd7113feb7ae263"} err="failed to get container status \"1d301e98b55e34393fd6703fb998361ac67dd77197d82c4f2bd7113feb7ae263\": rpc error: code = NotFound desc = could not find container \"1d301e98b55e34393fd6703fb998361ac67dd77197d82c4f2bd7113feb7ae263\": container with ID starting with 1d301e98b55e34393fd6703fb998361ac67dd77197d82c4f2bd7113feb7ae263 not found: ID does not exist"
Jul 17 20:39:39.732042 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:39:39.732008    2572 scope.go:117] "RemoveContainer" containerID="ab1f522baeb5a39260fd0a9b6ac725ab0481d3262039f89234b1ef3398b950bb"
Jul 17 20:39:39.732283 ip-10-0-141-177 kubenswrapper[2572]: E0717 20:39:39.732267    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ab1f522baeb5a39260fd0a9b6ac725ab0481d3262039f89234b1ef3398b950bb\": container with ID starting with ab1f522baeb5a39260fd0a9b6ac725ab0481d3262039f89234b1ef3398b950bb not found: ID does not exist" containerID="ab1f522baeb5a39260fd0a9b6ac725ab0481d3262039f89234b1ef3398b950bb"
Jul 17 20:39:39.732323 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:39:39.732288    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ab1f522baeb5a39260fd0a9b6ac725ab0481d3262039f89234b1ef3398b950bb"} err="failed to get container status \"ab1f522baeb5a39260fd0a9b6ac725ab0481d3262039f89234b1ef3398b950bb\": rpc error: code = NotFound desc = could not find container \"ab1f522baeb5a39260fd0a9b6ac725ab0481d3262039f89234b1ef3398b950bb\": container with ID starting with ab1f522baeb5a39260fd0a9b6ac725ab0481d3262039f89234b1ef3398b950bb not found: ID does not exist"
Jul 17 20:39:39.738813 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:39:39.738794    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-2c0bc539-openshift-default-6f94cfc5dc-p8p6t"]
Jul 17 20:39:40.490454 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:39:40.490424    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:39:40.603460 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:39:40.603428    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:39:40.690457 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:39:40.690424    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:39:40.798242 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:39:40.798161    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:39:41.691473 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:39:41.691442    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c6cec37f-61da-4174-8ad7-4e5c47197974" path="/var/lib/kubelet/pods/c6cec37f-61da-4174-8ad7-4e5c47197974/volumes"
Jul 17 20:39:46.541699 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:39:46.541668    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:39:46.647880 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:39:46.647850    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:39:53.280789 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:39:53.280758    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:39:53.550471 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:39:53.550387    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-6d55d2b6-openshift-default-799c59b65f-knxxs"]
Jul 17 20:39:53.550778 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:39:53.550767    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c6cec37f-61da-4174-8ad7-4e5c47197974" containerName="istio-proxy"
Jul 17 20:39:53.550824 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:39:53.550780    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="c6cec37f-61da-4174-8ad7-4e5c47197974" containerName="istio-proxy"
Jul 17 20:39:53.550824 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:39:53.550792    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d47981bb-f9d0-489e-adf1-e49ce71641f4" containerName="maas-api"
Jul 17 20:39:53.550824 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:39:53.550798    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="d47981bb-f9d0-489e-adf1-e49ce71641f4" containerName="maas-api"
Jul 17 20:39:53.550921 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:39:53.550881    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="c6cec37f-61da-4174-8ad7-4e5c47197974" containerName="istio-proxy"
Jul 17 20:39:53.550921 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:39:53.550889    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="d47981bb-f9d0-489e-adf1-e49ce71641f4" containerName="maas-api"
Jul 17 20:39:53.553931 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:39:53.553916    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-6d55d2b6-openshift-default-799c59b65f-knxxs"
Jul 17 20:39:53.556499 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:39:53.556479    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-6d55d2b6-openshift-default-dockercfg-9wn6p\""
Jul 17 20:39:53.563869 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:39:53.563848    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-6d55d2b6-openshift-default-799c59b65f-knxxs"]
Jul 17 20:39:53.587464 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:39:53.587438    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:39:53.727623 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:39:53.727592    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cgflh\" (UniqueName: \"kubernetes.io/projected/91b9f26f-cec4-4f22-b512-6e6eaec459de-kube-api-access-cgflh\") pod \"e2e-mt-6d55d2b6-openshift-default-799c59b65f-knxxs\" (UID: \"91b9f26f-cec4-4f22-b512-6e6eaec459de\") " pod="openshift-ingress/e2e-mt-6d55d2b6-openshift-default-799c59b65f-knxxs"
Jul 17 20:39:53.727623 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:39:53.727625    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/91b9f26f-cec4-4f22-b512-6e6eaec459de-istiod-ca-cert\") pod \"e2e-mt-6d55d2b6-openshift-default-799c59b65f-knxxs\" (UID: \"91b9f26f-cec4-4f22-b512-6e6eaec459de\") " pod="openshift-ingress/e2e-mt-6d55d2b6-openshift-default-799c59b65f-knxxs"
Jul 17 20:39:53.727865 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:39:53.727647    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/91b9f26f-cec4-4f22-b512-6e6eaec459de-workload-certs\") pod \"e2e-mt-6d55d2b6-openshift-default-799c59b65f-knxxs\" (UID: \"91b9f26f-cec4-4f22-b512-6e6eaec459de\") " pod="openshift-ingress/e2e-mt-6d55d2b6-openshift-default-799c59b65f-knxxs"
Jul 17 20:39:53.727865 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:39:53.727747    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/91b9f26f-cec4-4f22-b512-6e6eaec459de-istio-data\") pod \"e2e-mt-6d55d2b6-openshift-default-799c59b65f-knxxs\" (UID: \"91b9f26f-cec4-4f22-b512-6e6eaec459de\") " pod="openshift-ingress/e2e-mt-6d55d2b6-openshift-default-799c59b65f-knxxs"
Jul 17 20:39:53.727865 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:39:53.727777    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/91b9f26f-cec4-4f22-b512-6e6eaec459de-istio-token\") pod \"e2e-mt-6d55d2b6-openshift-default-799c59b65f-knxxs\" (UID: \"91b9f26f-cec4-4f22-b512-6e6eaec459de\") " pod="openshift-ingress/e2e-mt-6d55d2b6-openshift-default-799c59b65f-knxxs"
Jul 17 20:39:53.727865 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:39:53.727808    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/91b9f26f-cec4-4f22-b512-6e6eaec459de-istio-podinfo\") pod \"e2e-mt-6d55d2b6-openshift-default-799c59b65f-knxxs\" (UID: \"91b9f26f-cec4-4f22-b512-6e6eaec459de\") " pod="openshift-ingress/e2e-mt-6d55d2b6-openshift-default-799c59b65f-knxxs"
Jul 17 20:39:53.727865 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:39:53.727860    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/91b9f26f-cec4-4f22-b512-6e6eaec459de-workload-socket\") pod \"e2e-mt-6d55d2b6-openshift-default-799c59b65f-knxxs\" (UID: \"91b9f26f-cec4-4f22-b512-6e6eaec459de\") " pod="openshift-ingress/e2e-mt-6d55d2b6-openshift-default-799c59b65f-knxxs"
Jul 17 20:39:53.728165 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:39:53.727926    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/91b9f26f-cec4-4f22-b512-6e6eaec459de-istio-envoy\") pod \"e2e-mt-6d55d2b6-openshift-default-799c59b65f-knxxs\" (UID: \"91b9f26f-cec4-4f22-b512-6e6eaec459de\") " pod="openshift-ingress/e2e-mt-6d55d2b6-openshift-default-799c59b65f-knxxs"
Jul 17 20:39:53.728165 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:39:53.727964    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/91b9f26f-cec4-4f22-b512-6e6eaec459de-credential-socket\") pod \"e2e-mt-6d55d2b6-openshift-default-799c59b65f-knxxs\" (UID: \"91b9f26f-cec4-4f22-b512-6e6eaec459de\") " pod="openshift-ingress/e2e-mt-6d55d2b6-openshift-default-799c59b65f-knxxs"
Jul 17 20:39:53.828591 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:39:53.828521    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/91b9f26f-cec4-4f22-b512-6e6eaec459de-workload-socket\") pod \"e2e-mt-6d55d2b6-openshift-default-799c59b65f-knxxs\" (UID: \"91b9f26f-cec4-4f22-b512-6e6eaec459de\") " pod="openshift-ingress/e2e-mt-6d55d2b6-openshift-default-799c59b65f-knxxs"
Jul 17 20:39:53.828591 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:39:53.828566    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/91b9f26f-cec4-4f22-b512-6e6eaec459de-istio-envoy\") pod \"e2e-mt-6d55d2b6-openshift-default-799c59b65f-knxxs\" (UID: \"91b9f26f-cec4-4f22-b512-6e6eaec459de\") " pod="openshift-ingress/e2e-mt-6d55d2b6-openshift-default-799c59b65f-knxxs"
Jul 17 20:39:53.828805 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:39:53.828593    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/91b9f26f-cec4-4f22-b512-6e6eaec459de-credential-socket\") pod \"e2e-mt-6d55d2b6-openshift-default-799c59b65f-knxxs\" (UID: \"91b9f26f-cec4-4f22-b512-6e6eaec459de\") " pod="openshift-ingress/e2e-mt-6d55d2b6-openshift-default-799c59b65f-knxxs"
Jul 17 20:39:53.828805 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:39:53.828622    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cgflh\" (UniqueName: \"kubernetes.io/projected/91b9f26f-cec4-4f22-b512-6e6eaec459de-kube-api-access-cgflh\") pod \"e2e-mt-6d55d2b6-openshift-default-799c59b65f-knxxs\" (UID: \"91b9f26f-cec4-4f22-b512-6e6eaec459de\") " pod="openshift-ingress/e2e-mt-6d55d2b6-openshift-default-799c59b65f-knxxs"
Jul 17 20:39:53.828805 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:39:53.828648    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/91b9f26f-cec4-4f22-b512-6e6eaec459de-istiod-ca-cert\") pod \"e2e-mt-6d55d2b6-openshift-default-799c59b65f-knxxs\" (UID: \"91b9f26f-cec4-4f22-b512-6e6eaec459de\") " pod="openshift-ingress/e2e-mt-6d55d2b6-openshift-default-799c59b65f-knxxs"
Jul 17 20:39:53.828805 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:39:53.828678    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/91b9f26f-cec4-4f22-b512-6e6eaec459de-workload-certs\") pod \"e2e-mt-6d55d2b6-openshift-default-799c59b65f-knxxs\" (UID: \"91b9f26f-cec4-4f22-b512-6e6eaec459de\") " pod="openshift-ingress/e2e-mt-6d55d2b6-openshift-default-799c59b65f-knxxs"
Jul 17 20:39:53.828805 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:39:53.828754    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/91b9f26f-cec4-4f22-b512-6e6eaec459de-istio-data\") pod \"e2e-mt-6d55d2b6-openshift-default-799c59b65f-knxxs\" (UID: \"91b9f26f-cec4-4f22-b512-6e6eaec459de\") " pod="openshift-ingress/e2e-mt-6d55d2b6-openshift-default-799c59b65f-knxxs"
Jul 17 20:39:53.828805 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:39:53.828799    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/91b9f26f-cec4-4f22-b512-6e6eaec459de-istio-token\") pod \"e2e-mt-6d55d2b6-openshift-default-799c59b65f-knxxs\" (UID: \"91b9f26f-cec4-4f22-b512-6e6eaec459de\") " pod="openshift-ingress/e2e-mt-6d55d2b6-openshift-default-799c59b65f-knxxs"
Jul 17 20:39:53.829140 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:39:53.828834    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/91b9f26f-cec4-4f22-b512-6e6eaec459de-istio-podinfo\") pod \"e2e-mt-6d55d2b6-openshift-default-799c59b65f-knxxs\" (UID: \"91b9f26f-cec4-4f22-b512-6e6eaec459de\") " pod="openshift-ingress/e2e-mt-6d55d2b6-openshift-default-799c59b65f-knxxs"
Jul 17 20:39:53.829140 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:39:53.828971    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/91b9f26f-cec4-4f22-b512-6e6eaec459de-workload-socket\") pod \"e2e-mt-6d55d2b6-openshift-default-799c59b65f-knxxs\" (UID: \"91b9f26f-cec4-4f22-b512-6e6eaec459de\") " pod="openshift-ingress/e2e-mt-6d55d2b6-openshift-default-799c59b65f-knxxs"
Jul 17 20:39:53.829140 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:39:53.829038    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/91b9f26f-cec4-4f22-b512-6e6eaec459de-credential-socket\") pod \"e2e-mt-6d55d2b6-openshift-default-799c59b65f-knxxs\" (UID: \"91b9f26f-cec4-4f22-b512-6e6eaec459de\") " pod="openshift-ingress/e2e-mt-6d55d2b6-openshift-default-799c59b65f-knxxs"
Jul 17 20:39:53.829296 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:39:53.829266    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/91b9f26f-cec4-4f22-b512-6e6eaec459de-workload-certs\") pod \"e2e-mt-6d55d2b6-openshift-default-799c59b65f-knxxs\" (UID: \"91b9f26f-cec4-4f22-b512-6e6eaec459de\") " pod="openshift-ingress/e2e-mt-6d55d2b6-openshift-default-799c59b65f-knxxs"
Jul 17 20:39:53.829397 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:39:53.829376    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/91b9f26f-cec4-4f22-b512-6e6eaec459de-istiod-ca-cert\") pod \"e2e-mt-6d55d2b6-openshift-default-799c59b65f-knxxs\" (UID: \"91b9f26f-cec4-4f22-b512-6e6eaec459de\") " pod="openshift-ingress/e2e-mt-6d55d2b6-openshift-default-799c59b65f-knxxs"
Jul 17 20:39:53.829508 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:39:53.829446    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/91b9f26f-cec4-4f22-b512-6e6eaec459de-istio-data\") pod \"e2e-mt-6d55d2b6-openshift-default-799c59b65f-knxxs\" (UID: \"91b9f26f-cec4-4f22-b512-6e6eaec459de\") " pod="openshift-ingress/e2e-mt-6d55d2b6-openshift-default-799c59b65f-knxxs"
Jul 17 20:39:53.830805 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:39:53.830781    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/91b9f26f-cec4-4f22-b512-6e6eaec459de-istio-envoy\") pod \"e2e-mt-6d55d2b6-openshift-default-799c59b65f-knxxs\" (UID: \"91b9f26f-cec4-4f22-b512-6e6eaec459de\") " pod="openshift-ingress/e2e-mt-6d55d2b6-openshift-default-799c59b65f-knxxs"
Jul 17 20:39:53.831347 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:39:53.831330    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/91b9f26f-cec4-4f22-b512-6e6eaec459de-istio-podinfo\") pod \"e2e-mt-6d55d2b6-openshift-default-799c59b65f-knxxs\" (UID: \"91b9f26f-cec4-4f22-b512-6e6eaec459de\") " pod="openshift-ingress/e2e-mt-6d55d2b6-openshift-default-799c59b65f-knxxs"
Jul 17 20:39:53.837057 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:39:53.837031    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/91b9f26f-cec4-4f22-b512-6e6eaec459de-istio-token\") pod \"e2e-mt-6d55d2b6-openshift-default-799c59b65f-knxxs\" (UID: \"91b9f26f-cec4-4f22-b512-6e6eaec459de\") " pod="openshift-ingress/e2e-mt-6d55d2b6-openshift-default-799c59b65f-knxxs"
Jul 17 20:39:53.837239 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:39:53.837223    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cgflh\" (UniqueName: \"kubernetes.io/projected/91b9f26f-cec4-4f22-b512-6e6eaec459de-kube-api-access-cgflh\") pod \"e2e-mt-6d55d2b6-openshift-default-799c59b65f-knxxs\" (UID: \"91b9f26f-cec4-4f22-b512-6e6eaec459de\") " pod="openshift-ingress/e2e-mt-6d55d2b6-openshift-default-799c59b65f-knxxs"
Jul 17 20:39:53.858597 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:39:53.858575    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:39:53.865621 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:39:53.865600    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-6d55d2b6-openshift-default-799c59b65f-knxxs"
Jul 17 20:39:54.000692 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:39:54.000668    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-6d55d2b6-openshift-default-799c59b65f-knxxs"]
Jul 17 20:39:54.003040 ip-10-0-141-177 kubenswrapper[2572]: W0717 20:39:54.003013    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91b9f26f_cec4_4f22_b512_6e6eaec459de.slice/crio-e79739be9bcdcd7edf179e4fdc8031ad3adfbbc0bbad01cb0e829d8f7e693b2a WatchSource:0}: Error finding container e79739be9bcdcd7edf179e4fdc8031ad3adfbbc0bbad01cb0e829d8f7e693b2a: Status 404 returned error can't find the container with id e79739be9bcdcd7edf179e4fdc8031ad3adfbbc0bbad01cb0e829d8f7e693b2a
Jul 17 20:39:54.005197 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:39:54.005164    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 17 20:39:54.005315 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:39:54.005236    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 17 20:39:54.005315 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:39:54.005264    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 17 20:39:54.790176 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:39:54.790144    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-6d55d2b6-openshift-default-799c59b65f-knxxs" event={"ID":"91b9f26f-cec4-4f22-b512-6e6eaec459de","Type":"ContainerStarted","Data":"6b84dcf6c2cd3b39bed536019251ac443b37f9907b6cb784b44ced5533438efc"}
Jul 17 20:39:54.790548 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:39:54.790200    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-6d55d2b6-openshift-default-799c59b65f-knxxs" event={"ID":"91b9f26f-cec4-4f22-b512-6e6eaec459de","Type":"ContainerStarted","Data":"e79739be9bcdcd7edf179e4fdc8031ad3adfbbc0bbad01cb0e829d8f7e693b2a"}
Jul 17 20:39:54.816271 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:39:54.816213    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-6d55d2b6-openshift-default-799c59b65f-knxxs" podStartSLOduration=1.816198454 podStartE2EDuration="1.816198454s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 20:39:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 20:39:54.815118863 +0000 UTC m=+2619.656614500" watchObservedRunningTime="2026-07-17 20:39:54.816198454 +0000 UTC m=+2619.657694091"
Jul 17 20:39:54.866144 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:39:54.866116    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-6d55d2b6-openshift-default-799c59b65f-knxxs"
Jul 17 20:39:55.870996 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:39:55.870960    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-6d55d2b6-openshift-default-799c59b65f-knxxs"
Jul 17 20:39:56.697406 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:39:56.697365    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:39:56.781862 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:39:56.781829    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-6d55d2b6-5cbcf49f6d-v2r9w"]
Jul 17 20:39:56.782256 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:39:56.782241    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c6cec37f-61da-4174-8ad7-4e5c47197974" containerName="istio-proxy"
Jul 17 20:39:56.782326 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:39:56.782259    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="c6cec37f-61da-4174-8ad7-4e5c47197974" containerName="istio-proxy"
Jul 17 20:39:56.782421 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:39:56.782406    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="c6cec37f-61da-4174-8ad7-4e5c47197974" containerName="istio-proxy"
Jul 17 20:39:56.785819 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:39:56.785802    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-6d55d2b6-5cbcf49f6d-v2r9w"
Jul 17 20:39:56.788506 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:39:56.788486    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-6d55d2b6-serving-cert\""
Jul 17 20:39:56.798632 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:39:56.798606    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-6d55d2b6-5cbcf49f6d-v2r9w"]
Jul 17 20:39:56.800778 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:39:56.800753    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:39:56.804381 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:39:56.804360    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-6d55d2b6-openshift-default-799c59b65f-knxxs"
Jul 17 20:39:56.805514 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:39:56.805490    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-6d55d2b6-openshift-default-799c59b65f-knxxs"
Jul 17 20:39:56.854463 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:39:56.854430    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jfl5b\" (UniqueName: \"kubernetes.io/projected/ad90a0d9-bf19-455b-b233-c3c0697e069f-kube-api-access-jfl5b\") pod \"maas-api-e2e-mt-6d55d2b6-5cbcf49f6d-v2r9w\" (UID: \"ad90a0d9-bf19-455b-b233-c3c0697e069f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-6d55d2b6-5cbcf49f6d-v2r9w"
Jul 17 20:39:56.854642 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:39:56.854486    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ad90a0d9-bf19-455b-b233-c3c0697e069f-openshift-service-ca\") pod \"maas-api-e2e-mt-6d55d2b6-5cbcf49f6d-v2r9w\" (UID: \"ad90a0d9-bf19-455b-b233-c3c0697e069f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-6d55d2b6-5cbcf49f6d-v2r9w"
Jul 17 20:39:56.854738 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:39:56.854712    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ad90a0d9-bf19-455b-b233-c3c0697e069f-maas-api-tls\") pod \"maas-api-e2e-mt-6d55d2b6-5cbcf49f6d-v2r9w\" (UID: \"ad90a0d9-bf19-455b-b233-c3c0697e069f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-6d55d2b6-5cbcf49f6d-v2r9w"
Jul 17 20:39:56.894391 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:39:56.894353    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:39:56.955285 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:39:56.955186    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ad90a0d9-bf19-455b-b233-c3c0697e069f-maas-api-tls\") pod \"maas-api-e2e-mt-6d55d2b6-5cbcf49f6d-v2r9w\" (UID: \"ad90a0d9-bf19-455b-b233-c3c0697e069f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-6d55d2b6-5cbcf49f6d-v2r9w"
Jul 17 20:39:56.955285 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:39:56.955243    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jfl5b\" (UniqueName: \"kubernetes.io/projected/ad90a0d9-bf19-455b-b233-c3c0697e069f-kube-api-access-jfl5b\") pod \"maas-api-e2e-mt-6d55d2b6-5cbcf49f6d-v2r9w\" (UID: \"ad90a0d9-bf19-455b-b233-c3c0697e069f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-6d55d2b6-5cbcf49f6d-v2r9w"
Jul 17 20:39:56.955516 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:39:56.955288    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ad90a0d9-bf19-455b-b233-c3c0697e069f-openshift-service-ca\") pod \"maas-api-e2e-mt-6d55d2b6-5cbcf49f6d-v2r9w\" (UID: \"ad90a0d9-bf19-455b-b233-c3c0697e069f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-6d55d2b6-5cbcf49f6d-v2r9w"
Jul 17 20:39:56.956017 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:39:56.955996    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ad90a0d9-bf19-455b-b233-c3c0697e069f-openshift-service-ca\") pod \"maas-api-e2e-mt-6d55d2b6-5cbcf49f6d-v2r9w\" (UID: \"ad90a0d9-bf19-455b-b233-c3c0697e069f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-6d55d2b6-5cbcf49f6d-v2r9w"
Jul 17 20:39:56.958290 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:39:56.958264    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ad90a0d9-bf19-455b-b233-c3c0697e069f-maas-api-tls\") pod \"maas-api-e2e-mt-6d55d2b6-5cbcf49f6d-v2r9w\" (UID: \"ad90a0d9-bf19-455b-b233-c3c0697e069f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-6d55d2b6-5cbcf49f6d-v2r9w"
Jul 17 20:39:56.966284 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:39:56.966258    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jfl5b\" (UniqueName: \"kubernetes.io/projected/ad90a0d9-bf19-455b-b233-c3c0697e069f-kube-api-access-jfl5b\") pod \"maas-api-e2e-mt-6d55d2b6-5cbcf49f6d-v2r9w\" (UID: \"ad90a0d9-bf19-455b-b233-c3c0697e069f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-6d55d2b6-5cbcf49f6d-v2r9w"
Jul 17 20:39:57.016707 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:39:57.016679    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:39:57.097459 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:39:57.097433    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-6d55d2b6-5cbcf49f6d-v2r9w"
Jul 17 20:39:57.233406 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:39:57.233381    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-6d55d2b6-5cbcf49f6d-v2r9w"]
Jul 17 20:39:57.235367 ip-10-0-141-177 kubenswrapper[2572]: W0717 20:39:57.235337    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad90a0d9_bf19_455b_b233_c3c0697e069f.slice/crio-d33acb771af1d5e8f798744838112f244e0c71a58ff1e0cf53cf12f324255f11 WatchSource:0}: Error finding container d33acb771af1d5e8f798744838112f244e0c71a58ff1e0cf53cf12f324255f11: Status 404 returned error can't find the container with id d33acb771af1d5e8f798744838112f244e0c71a58ff1e0cf53cf12f324255f11
Jul 17 20:39:57.352864 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:39:57.352831    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:39:57.453753 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:39:57.453726    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:39:57.810286 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:39:57.810253    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-6d55d2b6-5cbcf49f6d-v2r9w" event={"ID":"ad90a0d9-bf19-455b-b233-c3c0697e069f","Type":"ContainerStarted","Data":"4ef44139888722addb469ebfbf9694779eeb0a4d1ae7a141f05eb3009b78c694"}
Jul 17 20:39:57.810466 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:39:57.810305    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-6d55d2b6-5cbcf49f6d-v2r9w" event={"ID":"ad90a0d9-bf19-455b-b233-c3c0697e069f","Type":"ContainerStarted","Data":"d33acb771af1d5e8f798744838112f244e0c71a58ff1e0cf53cf12f324255f11"}
Jul 17 20:39:57.810536 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:39:57.810466    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-6d55d2b6-5cbcf49f6d-v2r9w"
Jul 17 20:39:57.830434 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:39:57.830339    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-6d55d2b6-5cbcf49f6d-v2r9w" podStartSLOduration=1.498069879 podStartE2EDuration="1.83032384s" totalImagesPullingTime="332.253961ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 20:39:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 20:39:57.828604543 +0000 UTC m=+2622.670100200" watchObservedRunningTime="2026-07-17 20:39:57.83032384 +0000 UTC m=+2622.671819477"
Jul 17 20:40:01.149549 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:40:01.149513    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:40:03.821904 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:40:03.821878    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-6d55d2b6-5cbcf49f6d-v2r9w"
Jul 17 20:40:07.422811 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:40:07.422775    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:40:10.880458 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:40:10.880428    2572 generic.go:356] "Generic (PLEG): container finished" podID="91b9f26f-cec4-4f22-b512-6e6eaec459de" containerID="6b84dcf6c2cd3b39bed536019251ac443b37f9907b6cb784b44ced5533438efc" exitCode=0
Jul 17 20:40:10.880883 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:40:10.880503    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-6d55d2b6-openshift-default-799c59b65f-knxxs" event={"ID":"91b9f26f-cec4-4f22-b512-6e6eaec459de","Type":"ContainerDied","Data":"6b84dcf6c2cd3b39bed536019251ac443b37f9907b6cb784b44ced5533438efc"}
Jul 17 20:40:10.880883 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:40:10.880857    2572 scope.go:117] "RemoveContainer" containerID="6b84dcf6c2cd3b39bed536019251ac443b37f9907b6cb784b44ced5533438efc"
Jul 17 20:40:10.881806 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:40:10.881777    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 17 20:40:10.881868 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:40:10.881844    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 17 20:40:10.881913 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:40:10.881900    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 17 20:40:11.804903 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:40:11.804872    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-6d55d2b6-openshift-default-799c59b65f-knxxs"
Jul 17 20:40:11.886996 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:40:11.886958    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-6d55d2b6-openshift-default-799c59b65f-knxxs" event={"ID":"91b9f26f-cec4-4f22-b512-6e6eaec459de","Type":"ContainerStarted","Data":"33df96806a7ad1f5b127da37515765b92a4b41b6a02cda5610a01df3d06f056a"}
Jul 17 20:40:12.866732 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:40:12.866697    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-6d55d2b6-openshift-default-799c59b65f-knxxs"
Jul 17 20:40:12.868080 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:40:12.868041    2572 patch_prober.go:28] interesting pod/e2e-mt-6d55d2b6-openshift-default-799c59b65f-knxxs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body=
Jul 17 20:40:12.868174 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:40:12.868113    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-6d55d2b6-openshift-default-799c59b65f-knxxs" podUID="91b9f26f-cec4-4f22-b512-6e6eaec459de" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused"
Jul 17 20:40:13.866364 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:40:13.866332    2572 patch_prober.go:28] interesting pod/e2e-mt-6d55d2b6-openshift-default-799c59b65f-knxxs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body=
Jul 17 20:40:13.866733 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:40:13.866383    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-6d55d2b6-openshift-default-799c59b65f-knxxs" podUID="91b9f26f-cec4-4f22-b512-6e6eaec459de" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused"
Jul 17 20:40:14.866610 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:40:14.866575    2572 patch_prober.go:28] interesting pod/e2e-mt-6d55d2b6-openshift-default-799c59b65f-knxxs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body=
Jul 17 20:40:14.867001 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:40:14.866628    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-6d55d2b6-openshift-default-799c59b65f-knxxs" podUID="91b9f26f-cec4-4f22-b512-6e6eaec459de" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused"
Jul 17 20:40:15.870087 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:40:15.870045    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-6d55d2b6-openshift-default-799c59b65f-knxxs"
Jul 17 20:40:15.870465 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:40:15.870449    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-6d55d2b6-openshift-default-799c59b65f-knxxs"
Jul 17 20:40:15.871257 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:40:15.871236    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-6d55d2b6-openshift-default-799c59b65f-knxxs"
Jul 17 20:40:16.968844 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:40:16.968811    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:40:39.539707 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:40:39.539673    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-6d55d2b6-5cbcf49f6d-v2r9w"]
Jul 17 20:40:39.540271 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:40:39.539923    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-6d55d2b6-5cbcf49f6d-v2r9w" podUID="ad90a0d9-bf19-455b-b233-c3c0697e069f" containerName="maas-api" containerID="cri-o://4ef44139888722addb469ebfbf9694779eeb0a4d1ae7a141f05eb3009b78c694" gracePeriod=30
Jul 17 20:40:39.567371 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:40:39.567343    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:40:39.792801 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:40:39.792744    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-6d55d2b6-5cbcf49f6d-v2r9w"
Jul 17 20:40:39.890042 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:40:39.890012    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jfl5b\" (UniqueName: \"kubernetes.io/projected/ad90a0d9-bf19-455b-b233-c3c0697e069f-kube-api-access-jfl5b\") pod \"ad90a0d9-bf19-455b-b233-c3c0697e069f\" (UID: \"ad90a0d9-bf19-455b-b233-c3c0697e069f\") "
Jul 17 20:40:39.890225 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:40:39.890121    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ad90a0d9-bf19-455b-b233-c3c0697e069f-openshift-service-ca\") pod \"ad90a0d9-bf19-455b-b233-c3c0697e069f\" (UID: \"ad90a0d9-bf19-455b-b233-c3c0697e069f\") "
Jul 17 20:40:39.890225 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:40:39.890156    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ad90a0d9-bf19-455b-b233-c3c0697e069f-maas-api-tls\") pod \"ad90a0d9-bf19-455b-b233-c3c0697e069f\" (UID: \"ad90a0d9-bf19-455b-b233-c3c0697e069f\") "
Jul 17 20:40:39.890485 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:40:39.890455    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ad90a0d9-bf19-455b-b233-c3c0697e069f-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ad90a0d9-bf19-455b-b233-c3c0697e069f" (UID: "ad90a0d9-bf19-455b-b233-c3c0697e069f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 20:40:39.892231 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:40:39.892209    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ad90a0d9-bf19-455b-b233-c3c0697e069f-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ad90a0d9-bf19-455b-b233-c3c0697e069f" (UID: "ad90a0d9-bf19-455b-b233-c3c0697e069f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 20:40:39.892328 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:40:39.892214    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ad90a0d9-bf19-455b-b233-c3c0697e069f-kube-api-access-jfl5b" (OuterVolumeSpecName: "kube-api-access-jfl5b") pod "ad90a0d9-bf19-455b-b233-c3c0697e069f" (UID: "ad90a0d9-bf19-455b-b233-c3c0697e069f"). InnerVolumeSpecName "kube-api-access-jfl5b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 20:40:39.991460 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:40:39.991432    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jfl5b\" (UniqueName: \"kubernetes.io/projected/ad90a0d9-bf19-455b-b233-c3c0697e069f-kube-api-access-jfl5b\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Jul 17 20:40:39.991460 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:40:39.991455    2572 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ad90a0d9-bf19-455b-b233-c3c0697e069f-openshift-service-ca\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Jul 17 20:40:39.991460 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:40:39.991465    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ad90a0d9-bf19-455b-b233-c3c0697e069f-maas-api-tls\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Jul 17 20:40:40.031392 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:40:40.031364    2572 generic.go:356] "Generic (PLEG): container finished" podID="ad90a0d9-bf19-455b-b233-c3c0697e069f" containerID="4ef44139888722addb469ebfbf9694779eeb0a4d1ae7a141f05eb3009b78c694" exitCode=0
Jul 17 20:40:40.031501 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:40:40.031415    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-6d55d2b6-5cbcf49f6d-v2r9w"
Jul 17 20:40:40.031501 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:40:40.031425    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-6d55d2b6-5cbcf49f6d-v2r9w" event={"ID":"ad90a0d9-bf19-455b-b233-c3c0697e069f","Type":"ContainerDied","Data":"4ef44139888722addb469ebfbf9694779eeb0a4d1ae7a141f05eb3009b78c694"}
Jul 17 20:40:40.031501 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:40:40.031476    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-6d55d2b6-5cbcf49f6d-v2r9w" event={"ID":"ad90a0d9-bf19-455b-b233-c3c0697e069f","Type":"ContainerDied","Data":"d33acb771af1d5e8f798744838112f244e0c71a58ff1e0cf53cf12f324255f11"}
Jul 17 20:40:40.031665 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:40:40.031506    2572 scope.go:117] "RemoveContainer" containerID="4ef44139888722addb469ebfbf9694779eeb0a4d1ae7a141f05eb3009b78c694"
Jul 17 20:40:40.040338 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:40:40.040318    2572 scope.go:117] "RemoveContainer" containerID="4ef44139888722addb469ebfbf9694779eeb0a4d1ae7a141f05eb3009b78c694"
Jul 17 20:40:40.040570 ip-10-0-141-177 kubenswrapper[2572]: E0717 20:40:40.040547    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4ef44139888722addb469ebfbf9694779eeb0a4d1ae7a141f05eb3009b78c694\": container with ID starting with 4ef44139888722addb469ebfbf9694779eeb0a4d1ae7a141f05eb3009b78c694 not found: ID does not exist" containerID="4ef44139888722addb469ebfbf9694779eeb0a4d1ae7a141f05eb3009b78c694"
Jul 17 20:40:40.040651 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:40:40.040582    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ef44139888722addb469ebfbf9694779eeb0a4d1ae7a141f05eb3009b78c694"} err="failed to get container status \"4ef44139888722addb469ebfbf9694779eeb0a4d1ae7a141f05eb3009b78c694\": rpc error: code = NotFound desc = could not find container \"4ef44139888722addb469ebfbf9694779eeb0a4d1ae7a141f05eb3009b78c694\": container with ID starting with 4ef44139888722addb469ebfbf9694779eeb0a4d1ae7a141f05eb3009b78c694 not found: ID does not exist"
Jul 17 20:40:40.052376 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:40:40.052327    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-6d55d2b6-5cbcf49f6d-v2r9w"]
Jul 17 20:40:40.057607 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:40:40.057583    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-6d55d2b6-5cbcf49f6d-v2r9w"]
Jul 17 20:40:41.687327 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:40:41.687296    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ad90a0d9-bf19-455b-b233-c3c0697e069f" path="/var/lib/kubelet/pods/ad90a0d9-bf19-455b-b233-c3c0697e069f/volumes"
Jul 17 20:40:44.164678 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:40:44.164641    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:40:49.246790 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:40:49.246755    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:41:25.608877 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:41:25.608846    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:41:26.311817 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:41:26.311785    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:41:31.763850 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:41:31.763813    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:41:31.864798 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:41:31.864766    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:41:33.515054 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:41:33.515017    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:41:33.616014 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:41:33.615977    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:41:36.289551 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:41:36.289515    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-6d55d2b6-openshift-default-799c59b65f-knxxs"]
Jul 17 20:41:36.289940 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:41:36.289739    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-6d55d2b6-openshift-default-799c59b65f-knxxs" podUID="91b9f26f-cec4-4f22-b512-6e6eaec459de" containerName="istio-proxy" containerID="cri-o://33df96806a7ad1f5b127da37515765b92a4b41b6a02cda5610a01df3d06f056a" gracePeriod=30
Jul 17 20:41:36.322750 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:41:36.322720    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:41:36.577343 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:41:36.577255    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:41:37.574717 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:41:37.574684    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:41:37.672874 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:41:37.672842    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:41:37.775653 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:41:37.775620    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:41:38.532367 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:41:38.532338    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:41:38.703040 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:41:38.702979    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:41:38.862997 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:41:38.862925    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:41:40.114578 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:41:40.114547    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:41:41.553430 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:41:41.553370    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-6d55d2b6-openshift-default-799c59b65f-knxxs"
Jul 17 20:41:41.687811 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:41:41.687786    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/91b9f26f-cec4-4f22-b512-6e6eaec459de-istio-envoy\") pod \"91b9f26f-cec4-4f22-b512-6e6eaec459de\" (UID: \"91b9f26f-cec4-4f22-b512-6e6eaec459de\") "
Jul 17 20:41:41.687983 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:41:41.687827    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/91b9f26f-cec4-4f22-b512-6e6eaec459de-istio-data\") pod \"91b9f26f-cec4-4f22-b512-6e6eaec459de\" (UID: \"91b9f26f-cec4-4f22-b512-6e6eaec459de\") "
Jul 17 20:41:41.687983 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:41:41.687861    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/91b9f26f-cec4-4f22-b512-6e6eaec459de-istio-podinfo\") pod \"91b9f26f-cec4-4f22-b512-6e6eaec459de\" (UID: \"91b9f26f-cec4-4f22-b512-6e6eaec459de\") "
Jul 17 20:41:41.687983 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:41:41.687935    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/91b9f26f-cec4-4f22-b512-6e6eaec459de-istiod-ca-cert\") pod \"91b9f26f-cec4-4f22-b512-6e6eaec459de\" (UID: \"91b9f26f-cec4-4f22-b512-6e6eaec459de\") "
Jul 17 20:41:41.687983 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:41:41.687968    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cgflh\" (UniqueName: \"kubernetes.io/projected/91b9f26f-cec4-4f22-b512-6e6eaec459de-kube-api-access-cgflh\") pod \"91b9f26f-cec4-4f22-b512-6e6eaec459de\" (UID: \"91b9f26f-cec4-4f22-b512-6e6eaec459de\") "
Jul 17 20:41:41.688234 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:41:41.688002    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/91b9f26f-cec4-4f22-b512-6e6eaec459de-workload-certs\") pod \"91b9f26f-cec4-4f22-b512-6e6eaec459de\" (UID: \"91b9f26f-cec4-4f22-b512-6e6eaec459de\") "
Jul 17 20:41:41.688234 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:41:41.688108    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/91b9f26f-cec4-4f22-b512-6e6eaec459de-istio-token\") pod \"91b9f26f-cec4-4f22-b512-6e6eaec459de\" (UID: \"91b9f26f-cec4-4f22-b512-6e6eaec459de\") "
Jul 17 20:41:41.688234 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:41:41.688154    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/91b9f26f-cec4-4f22-b512-6e6eaec459de-workload-socket\") pod \"91b9f26f-cec4-4f22-b512-6e6eaec459de\" (UID: \"91b9f26f-cec4-4f22-b512-6e6eaec459de\") "
Jul 17 20:41:41.688770 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:41:41.688728    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/91b9f26f-cec4-4f22-b512-6e6eaec459de-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "91b9f26f-cec4-4f22-b512-6e6eaec459de" (UID: "91b9f26f-cec4-4f22-b512-6e6eaec459de"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 20:41:41.688908 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:41:41.688744    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/91b9f26f-cec4-4f22-b512-6e6eaec459de-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "91b9f26f-cec4-4f22-b512-6e6eaec459de" (UID: "91b9f26f-cec4-4f22-b512-6e6eaec459de"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 20:41:41.688908 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:41:41.688770    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/91b9f26f-cec4-4f22-b512-6e6eaec459de-istio-data" (OuterVolumeSpecName: "istio-data") pod "91b9f26f-cec4-4f22-b512-6e6eaec459de" (UID: "91b9f26f-cec4-4f22-b512-6e6eaec459de"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 20:41:41.689027 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:41:41.688200    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/91b9f26f-cec4-4f22-b512-6e6eaec459de-credential-socket\") pod \"91b9f26f-cec4-4f22-b512-6e6eaec459de\" (UID: \"91b9f26f-cec4-4f22-b512-6e6eaec459de\") "
Jul 17 20:41:41.689100 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:41:41.689035    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/91b9f26f-cec4-4f22-b512-6e6eaec459de-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "91b9f26f-cec4-4f22-b512-6e6eaec459de" (UID: "91b9f26f-cec4-4f22-b512-6e6eaec459de"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 20:41:41.689418 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:41:41.689384    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/91b9f26f-cec4-4f22-b512-6e6eaec459de-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "91b9f26f-cec4-4f22-b512-6e6eaec459de" (UID: "91b9f26f-cec4-4f22-b512-6e6eaec459de"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 20:41:41.690127 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:41:41.690100    2572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/91b9f26f-cec4-4f22-b512-6e6eaec459de-workload-socket\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Jul 17 20:41:41.690236 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:41:41.690133    2572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/91b9f26f-cec4-4f22-b512-6e6eaec459de-credential-socket\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Jul 17 20:41:41.690236 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:41:41.690148    2572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/91b9f26f-cec4-4f22-b512-6e6eaec459de-istio-data\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Jul 17 20:41:41.690236 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:41:41.690167    2572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/91b9f26f-cec4-4f22-b512-6e6eaec459de-istiod-ca-cert\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Jul 17 20:41:41.690236 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:41:41.690180    2572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/91b9f26f-cec4-4f22-b512-6e6eaec459de-workload-certs\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Jul 17 20:41:41.691407 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:41:41.691290    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/91b9f26f-cec4-4f22-b512-6e6eaec459de-kube-api-access-cgflh" (OuterVolumeSpecName: "kube-api-access-cgflh") pod "91b9f26f-cec4-4f22-b512-6e6eaec459de" (UID: "91b9f26f-cec4-4f22-b512-6e6eaec459de"). InnerVolumeSpecName "kube-api-access-cgflh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 20:41:41.691407 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:41:41.691355    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/91b9f26f-cec4-4f22-b512-6e6eaec459de-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "91b9f26f-cec4-4f22-b512-6e6eaec459de" (UID: "91b9f26f-cec4-4f22-b512-6e6eaec459de"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 17 20:41:41.691574 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:41:41.691432    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/91b9f26f-cec4-4f22-b512-6e6eaec459de-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "91b9f26f-cec4-4f22-b512-6e6eaec459de" (UID: "91b9f26f-cec4-4f22-b512-6e6eaec459de"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 20:41:41.697952 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:41:41.697925    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/91b9f26f-cec4-4f22-b512-6e6eaec459de-istio-token" (OuterVolumeSpecName: "istio-token") pod "91b9f26f-cec4-4f22-b512-6e6eaec459de" (UID: "91b9f26f-cec4-4f22-b512-6e6eaec459de"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 20:41:41.790952 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:41:41.790921    2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/91b9f26f-cec4-4f22-b512-6e6eaec459de-istio-token\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Jul 17 20:41:41.790952 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:41:41.790947    2572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/91b9f26f-cec4-4f22-b512-6e6eaec459de-istio-envoy\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Jul 17 20:41:41.790952 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:41:41.790956    2572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/91b9f26f-cec4-4f22-b512-6e6eaec459de-istio-podinfo\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Jul 17 20:41:41.791169 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:41:41.790966    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cgflh\" (UniqueName: \"kubernetes.io/projected/91b9f26f-cec4-4f22-b512-6e6eaec459de-kube-api-access-cgflh\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Jul 17 20:41:42.345021 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:41:42.344982    2572 generic.go:356] "Generic (PLEG): container finished" podID="91b9f26f-cec4-4f22-b512-6e6eaec459de" containerID="33df96806a7ad1f5b127da37515765b92a4b41b6a02cda5610a01df3d06f056a" exitCode=0
Jul 17 20:41:42.345253 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:41:42.345045    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-6d55d2b6-openshift-default-799c59b65f-knxxs"
Jul 17 20:41:42.345253 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:41:42.345052    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-6d55d2b6-openshift-default-799c59b65f-knxxs" event={"ID":"91b9f26f-cec4-4f22-b512-6e6eaec459de","Type":"ContainerDied","Data":"33df96806a7ad1f5b127da37515765b92a4b41b6a02cda5610a01df3d06f056a"}
Jul 17 20:41:42.345253 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:41:42.345122    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-6d55d2b6-openshift-default-799c59b65f-knxxs" event={"ID":"91b9f26f-cec4-4f22-b512-6e6eaec459de","Type":"ContainerDied","Data":"e79739be9bcdcd7edf179e4fdc8031ad3adfbbc0bbad01cb0e829d8f7e693b2a"}
Jul 17 20:41:42.345253 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:41:42.345160    2572 scope.go:117] "RemoveContainer" containerID="33df96806a7ad1f5b127da37515765b92a4b41b6a02cda5610a01df3d06f056a"
Jul 17 20:41:42.354155 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:41:42.354137    2572 scope.go:117] "RemoveContainer" containerID="6b84dcf6c2cd3b39bed536019251ac443b37f9907b6cb784b44ced5533438efc"
Jul 17 20:41:42.361888 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:41:42.361870    2572 scope.go:117] "RemoveContainer" containerID="33df96806a7ad1f5b127da37515765b92a4b41b6a02cda5610a01df3d06f056a"
Jul 17 20:41:42.362141 ip-10-0-141-177 kubenswrapper[2572]: E0717 20:41:42.362123    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"33df96806a7ad1f5b127da37515765b92a4b41b6a02cda5610a01df3d06f056a\": container with ID starting with 33df96806a7ad1f5b127da37515765b92a4b41b6a02cda5610a01df3d06f056a not found: ID does not exist" containerID="33df96806a7ad1f5b127da37515765b92a4b41b6a02cda5610a01df3d06f056a"
Jul 17 20:41:42.362194 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:41:42.362150    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"33df96806a7ad1f5b127da37515765b92a4b41b6a02cda5610a01df3d06f056a"} err="failed to get container status \"33df96806a7ad1f5b127da37515765b92a4b41b6a02cda5610a01df3d06f056a\": rpc error: code = NotFound desc = could not find container \"33df96806a7ad1f5b127da37515765b92a4b41b6a02cda5610a01df3d06f056a\": container with ID starting with 33df96806a7ad1f5b127da37515765b92a4b41b6a02cda5610a01df3d06f056a not found: ID does not exist"
Jul 17 20:41:42.362194 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:41:42.362168    2572 scope.go:117] "RemoveContainer" containerID="6b84dcf6c2cd3b39bed536019251ac443b37f9907b6cb784b44ced5533438efc"
Jul 17 20:41:42.362409 ip-10-0-141-177 kubenswrapper[2572]: E0717 20:41:42.362395    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6b84dcf6c2cd3b39bed536019251ac443b37f9907b6cb784b44ced5533438efc\": container with ID starting with 6b84dcf6c2cd3b39bed536019251ac443b37f9907b6cb784b44ced5533438efc not found: ID does not exist" containerID="6b84dcf6c2cd3b39bed536019251ac443b37f9907b6cb784b44ced5533438efc"
Jul 17 20:41:42.362461 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:41:42.362411    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6b84dcf6c2cd3b39bed536019251ac443b37f9907b6cb784b44ced5533438efc"} err="failed to get container status \"6b84dcf6c2cd3b39bed536019251ac443b37f9907b6cb784b44ced5533438efc\": rpc error: code = NotFound desc = could not find container \"6b84dcf6c2cd3b39bed536019251ac443b37f9907b6cb784b44ced5533438efc\": container with ID starting with 6b84dcf6c2cd3b39bed536019251ac443b37f9907b6cb784b44ced5533438efc not found: ID does not exist"
Jul 17 20:41:42.366894 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:41:42.366873    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-6d55d2b6-openshift-default-799c59b65f-knxxs"]
Jul 17 20:41:42.370351 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:41:42.370330    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-6d55d2b6-openshift-default-799c59b65f-knxxs"]
Jul 17 20:41:43.688466 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:41:43.688435    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="91b9f26f-cec4-4f22-b512-6e6eaec459de" path="/var/lib/kubelet/pods/91b9f26f-cec4-4f22-b512-6e6eaec459de/volumes"
Jul 17 20:41:45.946207 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:41:45.946171    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:41:46.005147 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:41:46.005113    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:41:46.609883 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:41:46.609848    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:41:52.420354 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:41:52.420322    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:41:52.523162 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:41:52.523124    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:41:52.620637 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:41:52.620601    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:42:03.134378 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:42:03.134343    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:42:03.458934 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:42:03.458847    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:42:24.442203 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:42:24.442168    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:42:30.557087 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:42:30.557036    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:42:30.650308 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:42:30.650275    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:42:30.920492 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:42:30.920410    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:42:31.236877 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:42:31.236848    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-13e7d9-openshift-default-548d5b8f5f-gqgxm"]
Jul 17 20:42:31.237393 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:42:31.237373    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="91b9f26f-cec4-4f22-b512-6e6eaec459de" containerName="istio-proxy"
Jul 17 20:42:31.237482 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:42:31.237395    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="91b9f26f-cec4-4f22-b512-6e6eaec459de" containerName="istio-proxy"
Jul 17 20:42:31.237482 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:42:31.237419    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ad90a0d9-bf19-455b-b233-c3c0697e069f" containerName="maas-api"
Jul 17 20:42:31.237482 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:42:31.237424    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="ad90a0d9-bf19-455b-b233-c3c0697e069f" containerName="maas-api"
Jul 17 20:42:31.237633 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:42:31.237495    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="ad90a0d9-bf19-455b-b233-c3c0697e069f" containerName="maas-api"
Jul 17 20:42:31.237633 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:42:31.237505    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="91b9f26f-cec4-4f22-b512-6e6eaec459de" containerName="istio-proxy"
Jul 17 20:42:31.237633 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:42:31.237515    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="91b9f26f-cec4-4f22-b512-6e6eaec459de" containerName="istio-proxy"
Jul 17 20:42:31.240609 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:42:31.240592    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-13e7d9-openshift-default-548d5b8f5f-gqgxm"
Jul 17 20:42:31.243709 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:42:31.243684    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-13e7d9-openshift-default-dockercfg-pwhf6\""
Jul 17 20:42:31.258796 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:42:31.258775    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-13e7d9-openshift-default-548d5b8f5f-gqgxm"]
Jul 17 20:42:31.273225 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:42:31.273199    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:42:31.359102 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:42:31.359057    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kwspd\" (UniqueName: \"kubernetes.io/projected/26c95fb5-4c3c-43ce-b761-f02e6f28741d-kube-api-access-kwspd\") pod \"e2e-inf-a-13e7d9-openshift-default-548d5b8f5f-gqgxm\" (UID: \"26c95fb5-4c3c-43ce-b761-f02e6f28741d\") " pod="openshift-ingress/e2e-inf-a-13e7d9-openshift-default-548d5b8f5f-gqgxm"
Jul 17 20:42:31.359309 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:42:31.359112    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/26c95fb5-4c3c-43ce-b761-f02e6f28741d-credential-socket\") pod \"e2e-inf-a-13e7d9-openshift-default-548d5b8f5f-gqgxm\" (UID: \"26c95fb5-4c3c-43ce-b761-f02e6f28741d\") " pod="openshift-ingress/e2e-inf-a-13e7d9-openshift-default-548d5b8f5f-gqgxm"
Jul 17 20:42:31.359309 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:42:31.359233    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/26c95fb5-4c3c-43ce-b761-f02e6f28741d-istio-podinfo\") pod \"e2e-inf-a-13e7d9-openshift-default-548d5b8f5f-gqgxm\" (UID: \"26c95fb5-4c3c-43ce-b761-f02e6f28741d\") " pod="openshift-ingress/e2e-inf-a-13e7d9-openshift-default-548d5b8f5f-gqgxm"
Jul 17 20:42:31.359309 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:42:31.359292    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/26c95fb5-4c3c-43ce-b761-f02e6f28741d-workload-certs\") pod \"e2e-inf-a-13e7d9-openshift-default-548d5b8f5f-gqgxm\" (UID: \"26c95fb5-4c3c-43ce-b761-f02e6f28741d\") " pod="openshift-ingress/e2e-inf-a-13e7d9-openshift-default-548d5b8f5f-gqgxm"
Jul 17 20:42:31.359445 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:42:31.359321    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/26c95fb5-4c3c-43ce-b761-f02e6f28741d-istiod-ca-cert\") pod \"e2e-inf-a-13e7d9-openshift-default-548d5b8f5f-gqgxm\" (UID: \"26c95fb5-4c3c-43ce-b761-f02e6f28741d\") " pod="openshift-ingress/e2e-inf-a-13e7d9-openshift-default-548d5b8f5f-gqgxm"
Jul 17 20:42:31.359445 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:42:31.359397    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/26c95fb5-4c3c-43ce-b761-f02e6f28741d-istio-token\") pod \"e2e-inf-a-13e7d9-openshift-default-548d5b8f5f-gqgxm\" (UID: \"26c95fb5-4c3c-43ce-b761-f02e6f28741d\") " pod="openshift-ingress/e2e-inf-a-13e7d9-openshift-default-548d5b8f5f-gqgxm"
Jul 17 20:42:31.359445 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:42:31.359442    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/26c95fb5-4c3c-43ce-b761-f02e6f28741d-workload-socket\") pod \"e2e-inf-a-13e7d9-openshift-default-548d5b8f5f-gqgxm\" (UID: \"26c95fb5-4c3c-43ce-b761-f02e6f28741d\") " pod="openshift-ingress/e2e-inf-a-13e7d9-openshift-default-548d5b8f5f-gqgxm"
Jul 17 20:42:31.359587 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:42:31.359458    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/26c95fb5-4c3c-43ce-b761-f02e6f28741d-istio-envoy\") pod \"e2e-inf-a-13e7d9-openshift-default-548d5b8f5f-gqgxm\" (UID: \"26c95fb5-4c3c-43ce-b761-f02e6f28741d\") " pod="openshift-ingress/e2e-inf-a-13e7d9-openshift-default-548d5b8f5f-gqgxm"
Jul 17 20:42:31.359587 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:42:31.359482    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/26c95fb5-4c3c-43ce-b761-f02e6f28741d-istio-data\") pod \"e2e-inf-a-13e7d9-openshift-default-548d5b8f5f-gqgxm\" (UID: \"26c95fb5-4c3c-43ce-b761-f02e6f28741d\") " pod="openshift-ingress/e2e-inf-a-13e7d9-openshift-default-548d5b8f5f-gqgxm"
Jul 17 20:42:31.460313 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:42:31.460269    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kwspd\" (UniqueName: \"kubernetes.io/projected/26c95fb5-4c3c-43ce-b761-f02e6f28741d-kube-api-access-kwspd\") pod \"e2e-inf-a-13e7d9-openshift-default-548d5b8f5f-gqgxm\" (UID: \"26c95fb5-4c3c-43ce-b761-f02e6f28741d\") " pod="openshift-ingress/e2e-inf-a-13e7d9-openshift-default-548d5b8f5f-gqgxm"
Jul 17 20:42:31.460313 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:42:31.460321    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/26c95fb5-4c3c-43ce-b761-f02e6f28741d-credential-socket\") pod \"e2e-inf-a-13e7d9-openshift-default-548d5b8f5f-gqgxm\" (UID: \"26c95fb5-4c3c-43ce-b761-f02e6f28741d\") " pod="openshift-ingress/e2e-inf-a-13e7d9-openshift-default-548d5b8f5f-gqgxm"
Jul 17 20:42:31.460567 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:42:31.460357    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/26c95fb5-4c3c-43ce-b761-f02e6f28741d-istio-podinfo\") pod \"e2e-inf-a-13e7d9-openshift-default-548d5b8f5f-gqgxm\" (UID: \"26c95fb5-4c3c-43ce-b761-f02e6f28741d\") " pod="openshift-ingress/e2e-inf-a-13e7d9-openshift-default-548d5b8f5f-gqgxm"
Jul 17 20:42:31.460567 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:42:31.460386    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/26c95fb5-4c3c-43ce-b761-f02e6f28741d-workload-certs\") pod \"e2e-inf-a-13e7d9-openshift-default-548d5b8f5f-gqgxm\" (UID: \"26c95fb5-4c3c-43ce-b761-f02e6f28741d\") " pod="openshift-ingress/e2e-inf-a-13e7d9-openshift-default-548d5b8f5f-gqgxm"
Jul 17 20:42:31.460567 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:42:31.460404    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/26c95fb5-4c3c-43ce-b761-f02e6f28741d-istiod-ca-cert\") pod \"e2e-inf-a-13e7d9-openshift-default-548d5b8f5f-gqgxm\" (UID: \"26c95fb5-4c3c-43ce-b761-f02e6f28741d\") " pod="openshift-ingress/e2e-inf-a-13e7d9-openshift-default-548d5b8f5f-gqgxm"
Jul 17 20:42:31.460734 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:42:31.460569    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/26c95fb5-4c3c-43ce-b761-f02e6f28741d-istio-token\") pod \"e2e-inf-a-13e7d9-openshift-default-548d5b8f5f-gqgxm\" (UID: \"26c95fb5-4c3c-43ce-b761-f02e6f28741d\") " pod="openshift-ingress/e2e-inf-a-13e7d9-openshift-default-548d5b8f5f-gqgxm"
Jul 17 20:42:31.460734 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:42:31.460641    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/26c95fb5-4c3c-43ce-b761-f02e6f28741d-workload-socket\") pod \"e2e-inf-a-13e7d9-openshift-default-548d5b8f5f-gqgxm\" (UID: \"26c95fb5-4c3c-43ce-b761-f02e6f28741d\") " pod="openshift-ingress/e2e-inf-a-13e7d9-openshift-default-548d5b8f5f-gqgxm"
Jul 17 20:42:31.460734 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:42:31.460667    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/26c95fb5-4c3c-43ce-b761-f02e6f28741d-istio-envoy\") pod \"e2e-inf-a-13e7d9-openshift-default-548d5b8f5f-gqgxm\" (UID: \"26c95fb5-4c3c-43ce-b761-f02e6f28741d\") " pod="openshift-ingress/e2e-inf-a-13e7d9-openshift-default-548d5b8f5f-gqgxm"
Jul 17 20:42:31.460893 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:42:31.460780    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/26c95fb5-4c3c-43ce-b761-f02e6f28741d-istio-data\") pod \"e2e-inf-a-13e7d9-openshift-default-548d5b8f5f-gqgxm\" (UID: \"26c95fb5-4c3c-43ce-b761-f02e6f28741d\") " pod="openshift-ingress/e2e-inf-a-13e7d9-openshift-default-548d5b8f5f-gqgxm"
Jul 17 20:42:31.460893 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:42:31.460799    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/26c95fb5-4c3c-43ce-b761-f02e6f28741d-credential-socket\") pod \"e2e-inf-a-13e7d9-openshift-default-548d5b8f5f-gqgxm\" (UID: \"26c95fb5-4c3c-43ce-b761-f02e6f28741d\") " pod="openshift-ingress/e2e-inf-a-13e7d9-openshift-default-548d5b8f5f-gqgxm"
Jul 17 20:42:31.461035 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:42:31.461013    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/26c95fb5-4c3c-43ce-b761-f02e6f28741d-workload-socket\") pod \"e2e-inf-a-13e7d9-openshift-default-548d5b8f5f-gqgxm\" (UID: \"26c95fb5-4c3c-43ce-b761-f02e6f28741d\") " pod="openshift-ingress/e2e-inf-a-13e7d9-openshift-default-548d5b8f5f-gqgxm"
Jul 17 20:42:31.461218 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:42:31.461199    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/26c95fb5-4c3c-43ce-b761-f02e6f28741d-istio-data\") pod \"e2e-inf-a-13e7d9-openshift-default-548d5b8f5f-gqgxm\" (UID: \"26c95fb5-4c3c-43ce-b761-f02e6f28741d\") " pod="openshift-ingress/e2e-inf-a-13e7d9-openshift-default-548d5b8f5f-gqgxm"
Jul 17 20:42:31.461292 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:42:31.461231    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/26c95fb5-4c3c-43ce-b761-f02e6f28741d-istiod-ca-cert\") pod \"e2e-inf-a-13e7d9-openshift-default-548d5b8f5f-gqgxm\" (UID: \"26c95fb5-4c3c-43ce-b761-f02e6f28741d\") " pod="openshift-ingress/e2e-inf-a-13e7d9-openshift-default-548d5b8f5f-gqgxm"
Jul 17 20:42:31.461292 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:42:31.461239    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/26c95fb5-4c3c-43ce-b761-f02e6f28741d-workload-certs\") pod \"e2e-inf-a-13e7d9-openshift-default-548d5b8f5f-gqgxm\" (UID: \"26c95fb5-4c3c-43ce-b761-f02e6f28741d\") " pod="openshift-ingress/e2e-inf-a-13e7d9-openshift-default-548d5b8f5f-gqgxm"
Jul 17 20:42:31.463111 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:42:31.463087    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/26c95fb5-4c3c-43ce-b761-f02e6f28741d-istio-envoy\") pod \"e2e-inf-a-13e7d9-openshift-default-548d5b8f5f-gqgxm\" (UID: \"26c95fb5-4c3c-43ce-b761-f02e6f28741d\") " pod="openshift-ingress/e2e-inf-a-13e7d9-openshift-default-548d5b8f5f-gqgxm"
Jul 17 20:42:31.463414 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:42:31.463395    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/26c95fb5-4c3c-43ce-b761-f02e6f28741d-istio-podinfo\") pod \"e2e-inf-a-13e7d9-openshift-default-548d5b8f5f-gqgxm\" (UID: \"26c95fb5-4c3c-43ce-b761-f02e6f28741d\") " pod="openshift-ingress/e2e-inf-a-13e7d9-openshift-default-548d5b8f5f-gqgxm"
Jul 17 20:42:31.469290 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:42:31.469271    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/26c95fb5-4c3c-43ce-b761-f02e6f28741d-istio-token\") pod \"e2e-inf-a-13e7d9-openshift-default-548d5b8f5f-gqgxm\" (UID: \"26c95fb5-4c3c-43ce-b761-f02e6f28741d\") " pod="openshift-ingress/e2e-inf-a-13e7d9-openshift-default-548d5b8f5f-gqgxm"
Jul 17 20:42:31.469596 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:42:31.469575    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kwspd\" (UniqueName: \"kubernetes.io/projected/26c95fb5-4c3c-43ce-b761-f02e6f28741d-kube-api-access-kwspd\") pod \"e2e-inf-a-13e7d9-openshift-default-548d5b8f5f-gqgxm\" (UID: \"26c95fb5-4c3c-43ce-b761-f02e6f28741d\") " pod="openshift-ingress/e2e-inf-a-13e7d9-openshift-default-548d5b8f5f-gqgxm"
Jul 17 20:42:31.550562 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:42:31.550504    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-13e7d9-openshift-default-548d5b8f5f-gqgxm"
Jul 17 20:42:31.694978 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:42:31.694954    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-13e7d9-openshift-default-548d5b8f5f-gqgxm"]
Jul 17 20:42:31.696524 ip-10-0-141-177 kubenswrapper[2572]: W0717 20:42:31.696496    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26c95fb5_4c3c_43ce_b761_f02e6f28741d.slice/crio-c1f8b8b3ef596e6b5971a7eaac5d86f7e3767e8e986ec3eabbbc4bc00950b53a WatchSource:0}: Error finding container c1f8b8b3ef596e6b5971a7eaac5d86f7e3767e8e986ec3eabbbc4bc00950b53a: Status 404 returned error can't find the container with id c1f8b8b3ef596e6b5971a7eaac5d86f7e3767e8e986ec3eabbbc4bc00950b53a
Jul 17 20:42:31.698566 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:42:31.698534    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 17 20:42:31.698647 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:42:31.698602    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 17 20:42:31.698647 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:42:31.698634    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 17 20:42:31.920221 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:42:31.920134    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:42:32.605998 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:42:32.605963    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-13e7d9-openshift-default-548d5b8f5f-gqgxm" event={"ID":"26c95fb5-4c3c-43ce-b761-f02e6f28741d","Type":"ContainerStarted","Data":"e4fb9dce8c68f39433f4bdaf769539ce46ff2a90b76d356ca08b7dbe6c85515e"}
Jul 17 20:42:32.606215 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:42:32.606021    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-13e7d9-openshift-default-548d5b8f5f-gqgxm" event={"ID":"26c95fb5-4c3c-43ce-b761-f02e6f28741d","Type":"ContainerStarted","Data":"c1f8b8b3ef596e6b5971a7eaac5d86f7e3767e8e986ec3eabbbc4bc00950b53a"}
Jul 17 20:42:32.627370 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:42:32.627320    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-13e7d9-openshift-default-548d5b8f5f-gqgxm" podStartSLOduration=1.6273011130000001 podStartE2EDuration="1.627301113s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 20:42:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 20:42:32.626742349 +0000 UTC m=+2777.468238034" watchObservedRunningTime="2026-07-17 20:42:32.627301113 +0000 UTC m=+2777.468796751"
Jul 17 20:42:33.551246 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:42:33.551216    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-13e7d9-openshift-default-548d5b8f5f-gqgxm"
Jul 17 20:42:33.556210 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:42:33.556187    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-13e7d9-openshift-default-548d5b8f5f-gqgxm"
Jul 17 20:42:33.612431 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:42:33.612403    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-13e7d9-openshift-default-548d5b8f5f-gqgxm"
Jul 17 20:42:33.613112 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:42:33.613090    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-13e7d9-openshift-default-548d5b8f5f-gqgxm"
Jul 17 20:42:34.696430 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:42:34.696400    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:42:34.827782 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:42:34.827747    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-13e7d9-59db5d6cbf-j4jgl"]
Jul 17 20:42:34.828307 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:42:34.828283    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="91b9f26f-cec4-4f22-b512-6e6eaec459de" containerName="istio-proxy"
Jul 17 20:42:34.828307 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:42:34.828305    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="91b9f26f-cec4-4f22-b512-6e6eaec459de" containerName="istio-proxy"
Jul 17 20:42:34.831448 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:42:34.831426    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-13e7d9-59db5d6cbf-j4jgl"
Jul 17 20:42:34.833911 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:42:34.833890    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-13e7d9-serving-cert\""
Jul 17 20:42:34.857659 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:42:34.857634    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-13e7d9-59db5d6cbf-j4jgl"]
Jul 17 20:42:34.866133 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:42:34.866107    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:42:34.890172 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:42:34.890149    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/11fbf6e4-c92c-4338-954a-cd2d1e7f5864-maas-api-tls\") pod \"maas-api-e2e-inf-a-13e7d9-59db5d6cbf-j4jgl\" (UID: \"11fbf6e4-c92c-4338-954a-cd2d1e7f5864\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-13e7d9-59db5d6cbf-j4jgl"
Jul 17 20:42:34.890288 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:42:34.890225    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l6rcd\" (UniqueName: \"kubernetes.io/projected/11fbf6e4-c92c-4338-954a-cd2d1e7f5864-kube-api-access-l6rcd\") pod \"maas-api-e2e-inf-a-13e7d9-59db5d6cbf-j4jgl\" (UID: \"11fbf6e4-c92c-4338-954a-cd2d1e7f5864\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-13e7d9-59db5d6cbf-j4jgl"
Jul 17 20:42:34.890288 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:42:34.890260    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/11fbf6e4-c92c-4338-954a-cd2d1e7f5864-openshift-service-ca\") pod \"maas-api-e2e-inf-a-13e7d9-59db5d6cbf-j4jgl\" (UID: \"11fbf6e4-c92c-4338-954a-cd2d1e7f5864\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-13e7d9-59db5d6cbf-j4jgl"
Jul 17 20:42:34.957788 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:42:34.957698    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:42:34.991247 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:42:34.991223    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/11fbf6e4-c92c-4338-954a-cd2d1e7f5864-openshift-service-ca\") pod \"maas-api-e2e-inf-a-13e7d9-59db5d6cbf-j4jgl\" (UID: \"11fbf6e4-c92c-4338-954a-cd2d1e7f5864\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-13e7d9-59db5d6cbf-j4jgl"
Jul 17 20:42:34.991415 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:42:34.991323    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/11fbf6e4-c92c-4338-954a-cd2d1e7f5864-maas-api-tls\") pod \"maas-api-e2e-inf-a-13e7d9-59db5d6cbf-j4jgl\" (UID: \"11fbf6e4-c92c-4338-954a-cd2d1e7f5864\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-13e7d9-59db5d6cbf-j4jgl"
Jul 17 20:42:34.991415 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:42:34.991364    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l6rcd\" (UniqueName: \"kubernetes.io/projected/11fbf6e4-c92c-4338-954a-cd2d1e7f5864-kube-api-access-l6rcd\") pod \"maas-api-e2e-inf-a-13e7d9-59db5d6cbf-j4jgl\" (UID: \"11fbf6e4-c92c-4338-954a-cd2d1e7f5864\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-13e7d9-59db5d6cbf-j4jgl"
Jul 17 20:42:34.991530 ip-10-0-141-177 kubenswrapper[2572]: E0717 20:42:34.991458    2572 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-a-13e7d9-serving-cert: secret "maas-api-e2e-inf-a-13e7d9-serving-cert" not found
Jul 17 20:42:34.991530 ip-10-0-141-177 kubenswrapper[2572]: E0717 20:42:34.991509    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/11fbf6e4-c92c-4338-954a-cd2d1e7f5864-maas-api-tls podName:11fbf6e4-c92c-4338-954a-cd2d1e7f5864 nodeName:}" failed. No retries permitted until 2026-07-17 20:42:35.49149538 +0000 UTC m=+2780.332990998 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/11fbf6e4-c92c-4338-954a-cd2d1e7f5864-maas-api-tls") pod "maas-api-e2e-inf-a-13e7d9-59db5d6cbf-j4jgl" (UID: "11fbf6e4-c92c-4338-954a-cd2d1e7f5864") : secret "maas-api-e2e-inf-a-13e7d9-serving-cert" not found
Jul 17 20:42:34.991870 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:42:34.991852    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/11fbf6e4-c92c-4338-954a-cd2d1e7f5864-openshift-service-ca\") pod \"maas-api-e2e-inf-a-13e7d9-59db5d6cbf-j4jgl\" (UID: \"11fbf6e4-c92c-4338-954a-cd2d1e7f5864\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-13e7d9-59db5d6cbf-j4jgl"
Jul 17 20:42:35.005783 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:42:35.005752    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l6rcd\" (UniqueName: \"kubernetes.io/projected/11fbf6e4-c92c-4338-954a-cd2d1e7f5864-kube-api-access-l6rcd\") pod \"maas-api-e2e-inf-a-13e7d9-59db5d6cbf-j4jgl\" (UID: \"11fbf6e4-c92c-4338-954a-cd2d1e7f5864\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-13e7d9-59db5d6cbf-j4jgl"
Jul 17 20:42:35.108187 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:42:35.108159    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:42:35.495329 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:42:35.495295    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/11fbf6e4-c92c-4338-954a-cd2d1e7f5864-maas-api-tls\") pod \"maas-api-e2e-inf-a-13e7d9-59db5d6cbf-j4jgl\" (UID: \"11fbf6e4-c92c-4338-954a-cd2d1e7f5864\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-13e7d9-59db5d6cbf-j4jgl"
Jul 17 20:42:35.497741 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:42:35.497720    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/11fbf6e4-c92c-4338-954a-cd2d1e7f5864-maas-api-tls\") pod \"maas-api-e2e-inf-a-13e7d9-59db5d6cbf-j4jgl\" (UID: \"11fbf6e4-c92c-4338-954a-cd2d1e7f5864\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-13e7d9-59db5d6cbf-j4jgl"
Jul 17 20:42:35.715241 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:42:35.715209    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:42:35.742988 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:42:35.742956    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-13e7d9-59db5d6cbf-j4jgl"
Jul 17 20:42:35.818990 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:42:35.818958    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:42:35.883246 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:42:35.883223    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-13e7d9-59db5d6cbf-j4jgl"]
Jul 17 20:42:35.885214 ip-10-0-141-177 kubenswrapper[2572]: W0717 20:42:35.885188    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11fbf6e4_c92c_4338_954a_cd2d1e7f5864.slice/crio-dd995a40b8e5dc555e19dbc01b76cce931b1d157b268c0f291a7cba9fc313519 WatchSource:0}: Error finding container dd995a40b8e5dc555e19dbc01b76cce931b1d157b268c0f291a7cba9fc313519: Status 404 returned error can't find the container with id dd995a40b8e5dc555e19dbc01b76cce931b1d157b268c0f291a7cba9fc313519
Jul 17 20:42:36.627871 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:42:36.627803    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-13e7d9-59db5d6cbf-j4jgl" event={"ID":"11fbf6e4-c92c-4338-954a-cd2d1e7f5864","Type":"ContainerStarted","Data":"db81802c16e331d8ddf62902e05be88aecd165921a46a880ec1c24b804f0fec1"}
Jul 17 20:42:36.628056 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:42:36.627890    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-13e7d9-59db5d6cbf-j4jgl" event={"ID":"11fbf6e4-c92c-4338-954a-cd2d1e7f5864","Type":"ContainerStarted","Data":"dd995a40b8e5dc555e19dbc01b76cce931b1d157b268c0f291a7cba9fc313519"}
Jul 17 20:42:36.628056 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:42:36.627950    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-13e7d9-59db5d6cbf-j4jgl"
Jul 17 20:42:36.658454 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:42:36.658368    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-13e7d9-59db5d6cbf-j4jgl" podStartSLOduration=2.142083117 podStartE2EDuration="2.658351125s" totalImagesPullingTime="516.268008ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 20:42:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 20:42:36.654976402 +0000 UTC m=+2781.496472057" watchObservedRunningTime="2026-07-17 20:42:36.658351125 +0000 UTC m=+2781.499846761"
Jul 17 20:42:39.070648 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:42:39.070572    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:42:39.428522 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:42:39.428441    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:42:39.703988 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:42:39.703908    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-5f0f4f-openshift-default-6c774bb7bf-bjch2"]
Jul 17 20:42:39.707543 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:42:39.707506    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-5f0f4f-openshift-default-6c774bb7bf-bjch2"
Jul 17 20:42:39.710438 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:42:39.710417    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-5f0f4f-openshift-default-dockercfg-qnf85\""
Jul 17 20:42:39.726474 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:42:39.726449    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-5f0f4f-openshift-default-6c774bb7bf-bjch2"]
Jul 17 20:42:39.733390 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:42:39.733362    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d3e4eae5-5810-4eb0-ac9b-65affe57385d-istio-data\") pod \"e2e-inf-b-5f0f4f-openshift-default-6c774bb7bf-bjch2\" (UID: \"d3e4eae5-5810-4eb0-ac9b-65affe57385d\") " pod="openshift-ingress/e2e-inf-b-5f0f4f-openshift-default-6c774bb7bf-bjch2"
Jul 17 20:42:39.733570 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:42:39.733541    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d3e4eae5-5810-4eb0-ac9b-65affe57385d-istio-envoy\") pod \"e2e-inf-b-5f0f4f-openshift-default-6c774bb7bf-bjch2\" (UID: \"d3e4eae5-5810-4eb0-ac9b-65affe57385d\") " pod="openshift-ingress/e2e-inf-b-5f0f4f-openshift-default-6c774bb7bf-bjch2"
Jul 17 20:42:39.733697 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:42:39.733675    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d3e4eae5-5810-4eb0-ac9b-65affe57385d-workload-socket\") pod \"e2e-inf-b-5f0f4f-openshift-default-6c774bb7bf-bjch2\" (UID: \"d3e4eae5-5810-4eb0-ac9b-65affe57385d\") " pod="openshift-ingress/e2e-inf-b-5f0f4f-openshift-default-6c774bb7bf-bjch2"
Jul 17 20:42:39.733762 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:42:39.733726    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d3e4eae5-5810-4eb0-ac9b-65affe57385d-istio-podinfo\") pod \"e2e-inf-b-5f0f4f-openshift-default-6c774bb7bf-bjch2\" (UID: \"d3e4eae5-5810-4eb0-ac9b-65affe57385d\") " pod="openshift-ingress/e2e-inf-b-5f0f4f-openshift-default-6c774bb7bf-bjch2"
Jul 17 20:42:39.733846 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:42:39.733786    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d3e4eae5-5810-4eb0-ac9b-65affe57385d-workload-certs\") pod \"e2e-inf-b-5f0f4f-openshift-default-6c774bb7bf-bjch2\" (UID: \"d3e4eae5-5810-4eb0-ac9b-65affe57385d\") " pod="openshift-ingress/e2e-inf-b-5f0f4f-openshift-default-6c774bb7bf-bjch2"
Jul 17 20:42:39.733846 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:42:39.733812    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d3e4eae5-5810-4eb0-ac9b-65affe57385d-istiod-ca-cert\") pod \"e2e-inf-b-5f0f4f-openshift-default-6c774bb7bf-bjch2\" (UID: \"d3e4eae5-5810-4eb0-ac9b-65affe57385d\") " pod="openshift-ingress/e2e-inf-b-5f0f4f-openshift-default-6c774bb7bf-bjch2"
Jul 17 20:42:39.733957 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:42:39.733862    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d3e4eae5-5810-4eb0-ac9b-65affe57385d-credential-socket\") pod \"e2e-inf-b-5f0f4f-openshift-default-6c774bb7bf-bjch2\" (UID: \"d3e4eae5-5810-4eb0-ac9b-65affe57385d\") " pod="openshift-ingress/e2e-inf-b-5f0f4f-openshift-default-6c774bb7bf-bjch2"
Jul 17 20:42:39.734159 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:42:39.734132    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-56xf7\" (UniqueName: \"kubernetes.io/projected/d3e4eae5-5810-4eb0-ac9b-65affe57385d-kube-api-access-56xf7\") pod \"e2e-inf-b-5f0f4f-openshift-default-6c774bb7bf-bjch2\" (UID: \"d3e4eae5-5810-4eb0-ac9b-65affe57385d\") " pod="openshift-ingress/e2e-inf-b-5f0f4f-openshift-default-6c774bb7bf-bjch2"
Jul 17 20:42:39.734266 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:42:39.734215    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d3e4eae5-5810-4eb0-ac9b-65affe57385d-istio-token\") pod \"e2e-inf-b-5f0f4f-openshift-default-6c774bb7bf-bjch2\" (UID: \"d3e4eae5-5810-4eb0-ac9b-65affe57385d\") " pod="openshift-ingress/e2e-inf-b-5f0f4f-openshift-default-6c774bb7bf-bjch2"
Jul 17 20:42:39.767022 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:42:39.766994    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:42:39.835356 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:42:39.835325    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d3e4eae5-5810-4eb0-ac9b-65affe57385d-istio-envoy\") pod \"e2e-inf-b-5f0f4f-openshift-default-6c774bb7bf-bjch2\" (UID: \"d3e4eae5-5810-4eb0-ac9b-65affe57385d\") " pod="openshift-ingress/e2e-inf-b-5f0f4f-openshift-default-6c774bb7bf-bjch2"
Jul 17 20:42:39.835558 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:42:39.835407    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d3e4eae5-5810-4eb0-ac9b-65affe57385d-workload-socket\") pod \"e2e-inf-b-5f0f4f-openshift-default-6c774bb7bf-bjch2\" (UID: \"d3e4eae5-5810-4eb0-ac9b-65affe57385d\") " pod="openshift-ingress/e2e-inf-b-5f0f4f-openshift-default-6c774bb7bf-bjch2"
Jul 17 20:42:39.835558 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:42:39.835436    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d3e4eae5-5810-4eb0-ac9b-65affe57385d-istio-podinfo\") pod \"e2e-inf-b-5f0f4f-openshift-default-6c774bb7bf-bjch2\" (UID: \"d3e4eae5-5810-4eb0-ac9b-65affe57385d\") " pod="openshift-ingress/e2e-inf-b-5f0f4f-openshift-default-6c774bb7bf-bjch2"
Jul 17 20:42:39.835558 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:42:39.835475    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d3e4eae5-5810-4eb0-ac9b-65affe57385d-workload-certs\") pod \"e2e-inf-b-5f0f4f-openshift-default-6c774bb7bf-bjch2\" (UID: \"d3e4eae5-5810-4eb0-ac9b-65affe57385d\") " pod="openshift-ingress/e2e-inf-b-5f0f4f-openshift-default-6c774bb7bf-bjch2"
Jul 17 20:42:39.835558 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:42:39.835498    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d3e4eae5-5810-4eb0-ac9b-65affe57385d-istiod-ca-cert\") pod \"e2e-inf-b-5f0f4f-openshift-default-6c774bb7bf-bjch2\" (UID: \"d3e4eae5-5810-4eb0-ac9b-65affe57385d\") " pod="openshift-ingress/e2e-inf-b-5f0f4f-openshift-default-6c774bb7bf-bjch2"
Jul 17 20:42:39.835558 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:42:39.835527    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d3e4eae5-5810-4eb0-ac9b-65affe57385d-credential-socket\") pod \"e2e-inf-b-5f0f4f-openshift-default-6c774bb7bf-bjch2\" (UID: \"d3e4eae5-5810-4eb0-ac9b-65affe57385d\") " pod="openshift-ingress/e2e-inf-b-5f0f4f-openshift-default-6c774bb7bf-bjch2"
Jul 17 20:42:39.835833 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:42:39.835570    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-56xf7\" (UniqueName: \"kubernetes.io/projected/d3e4eae5-5810-4eb0-ac9b-65affe57385d-kube-api-access-56xf7\") pod \"e2e-inf-b-5f0f4f-openshift-default-6c774bb7bf-bjch2\" (UID: \"d3e4eae5-5810-4eb0-ac9b-65affe57385d\") " pod="openshift-ingress/e2e-inf-b-5f0f4f-openshift-default-6c774bb7bf-bjch2"
Jul 17 20:42:39.835833 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:42:39.835606    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d3e4eae5-5810-4eb0-ac9b-65affe57385d-istio-token\") pod \"e2e-inf-b-5f0f4f-openshift-default-6c774bb7bf-bjch2\" (UID: \"d3e4eae5-5810-4eb0-ac9b-65affe57385d\") " pod="openshift-ingress/e2e-inf-b-5f0f4f-openshift-default-6c774bb7bf-bjch2"
Jul 17 20:42:39.835833 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:42:39.835659    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d3e4eae5-5810-4eb0-ac9b-65affe57385d-istio-data\") pod \"e2e-inf-b-5f0f4f-openshift-default-6c774bb7bf-bjch2\" (UID: \"d3e4eae5-5810-4eb0-ac9b-65affe57385d\") " pod="openshift-ingress/e2e-inf-b-5f0f4f-openshift-default-6c774bb7bf-bjch2"
Jul 17 20:42:39.836000 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:42:39.835926    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d3e4eae5-5810-4eb0-ac9b-65affe57385d-workload-socket\") pod \"e2e-inf-b-5f0f4f-openshift-default-6c774bb7bf-bjch2\" (UID: \"d3e4eae5-5810-4eb0-ac9b-65affe57385d\") " pod="openshift-ingress/e2e-inf-b-5f0f4f-openshift-default-6c774bb7bf-bjch2"
Jul 17 20:42:39.836000 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:42:39.835949    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d3e4eae5-5810-4eb0-ac9b-65affe57385d-credential-socket\") pod \"e2e-inf-b-5f0f4f-openshift-default-6c774bb7bf-bjch2\" (UID: \"d3e4eae5-5810-4eb0-ac9b-65affe57385d\") " pod="openshift-ingress/e2e-inf-b-5f0f4f-openshift-default-6c774bb7bf-bjch2"
Jul 17 20:42:39.836146 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:42:39.836019    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d3e4eae5-5810-4eb0-ac9b-65affe57385d-istio-data\") pod \"e2e-inf-b-5f0f4f-openshift-default-6c774bb7bf-bjch2\" (UID: \"d3e4eae5-5810-4eb0-ac9b-65affe57385d\") " pod="openshift-ingress/e2e-inf-b-5f0f4f-openshift-default-6c774bb7bf-bjch2"
Jul 17 20:42:39.836228 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:42:39.836205    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d3e4eae5-5810-4eb0-ac9b-65affe57385d-workload-certs\") pod \"e2e-inf-b-5f0f4f-openshift-default-6c774bb7bf-bjch2\" (UID: \"d3e4eae5-5810-4eb0-ac9b-65affe57385d\") " pod="openshift-ingress/e2e-inf-b-5f0f4f-openshift-default-6c774bb7bf-bjch2"
Jul 17 20:42:39.836572 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:42:39.836546    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d3e4eae5-5810-4eb0-ac9b-65affe57385d-istiod-ca-cert\") pod \"e2e-inf-b-5f0f4f-openshift-default-6c774bb7bf-bjch2\" (UID: \"d3e4eae5-5810-4eb0-ac9b-65affe57385d\") " pod="openshift-ingress/e2e-inf-b-5f0f4f-openshift-default-6c774bb7bf-bjch2"
Jul 17 20:42:39.838256 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:42:39.838228    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d3e4eae5-5810-4eb0-ac9b-65affe57385d-istio-envoy\") pod \"e2e-inf-b-5f0f4f-openshift-default-6c774bb7bf-bjch2\" (UID: \"d3e4eae5-5810-4eb0-ac9b-65affe57385d\") " pod="openshift-ingress/e2e-inf-b-5f0f4f-openshift-default-6c774bb7bf-bjch2"
Jul 17 20:42:39.838364 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:42:39.838286    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d3e4eae5-5810-4eb0-ac9b-65affe57385d-istio-podinfo\") pod \"e2e-inf-b-5f0f4f-openshift-default-6c774bb7bf-bjch2\" (UID: \"d3e4eae5-5810-4eb0-ac9b-65affe57385d\") " pod="openshift-ingress/e2e-inf-b-5f0f4f-openshift-default-6c774bb7bf-bjch2"
Jul 17 20:42:39.845430 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:42:39.845406    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-56xf7\" (UniqueName: \"kubernetes.io/projected/d3e4eae5-5810-4eb0-ac9b-65affe57385d-kube-api-access-56xf7\") pod \"e2e-inf-b-5f0f4f-openshift-default-6c774bb7bf-bjch2\" (UID: \"d3e4eae5-5810-4eb0-ac9b-65affe57385d\") " pod="openshift-ingress/e2e-inf-b-5f0f4f-openshift-default-6c774bb7bf-bjch2"
Jul 17 20:42:39.845513 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:42:39.845455    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d3e4eae5-5810-4eb0-ac9b-65affe57385d-istio-token\") pod \"e2e-inf-b-5f0f4f-openshift-default-6c774bb7bf-bjch2\" (UID: \"d3e4eae5-5810-4eb0-ac9b-65affe57385d\") " pod="openshift-ingress/e2e-inf-b-5f0f4f-openshift-default-6c774bb7bf-bjch2"
Jul 17 20:42:39.971542 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:42:39.971474    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:42:40.020842 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:42:40.020814    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-5f0f4f-openshift-default-6c774bb7bf-bjch2"
Jul 17 20:42:40.167428 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:42:40.167402    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-5f0f4f-openshift-default-6c774bb7bf-bjch2"]
Jul 17 20:42:40.168662 ip-10-0-141-177 kubenswrapper[2572]: W0717 20:42:40.168629    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3e4eae5_5810_4eb0_ac9b_65affe57385d.slice/crio-584d22400586da20bf9408945c92f26631d6bd560e9d22fa0f97935bec5c54ac WatchSource:0}: Error finding container 584d22400586da20bf9408945c92f26631d6bd560e9d22fa0f97935bec5c54ac: Status 404 returned error can't find the container with id 584d22400586da20bf9408945c92f26631d6bd560e9d22fa0f97935bec5c54ac
Jul 17 20:42:40.170975 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:42:40.170928    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 17 20:42:40.171085 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:42:40.171025    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 17 20:42:40.171133 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:42:40.171089    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 17 20:42:40.653035 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:42:40.653002    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-5f0f4f-openshift-default-6c774bb7bf-bjch2" event={"ID":"d3e4eae5-5810-4eb0-ac9b-65affe57385d","Type":"ContainerStarted","Data":"3fd65f09f720323792431bcf89bf92357bdbe855e13c9f44cd80324be51fa030"}
Jul 17 20:42:40.653225 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:42:40.653053    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-5f0f4f-openshift-default-6c774bb7bf-bjch2" event={"ID":"d3e4eae5-5810-4eb0-ac9b-65affe57385d","Type":"ContainerStarted","Data":"584d22400586da20bf9408945c92f26631d6bd560e9d22fa0f97935bec5c54ac"}
Jul 17 20:42:40.675514 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:42:40.675468    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-5f0f4f-openshift-default-6c774bb7bf-bjch2" podStartSLOduration=1.6754527879999999 podStartE2EDuration="1.675452788s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 20:42:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 20:42:40.672907729 +0000 UTC m=+2785.514403394" watchObservedRunningTime="2026-07-17 20:42:40.675452788 +0000 UTC m=+2785.516948425"
Jul 17 20:42:41.021636 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:42:41.021606    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-5f0f4f-openshift-default-6c774bb7bf-bjch2"
Jul 17 20:42:41.026569 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:42:41.026548    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-5f0f4f-openshift-default-6c774bb7bf-bjch2"
Jul 17 20:42:41.657714 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:42:41.657683    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-5f0f4f-openshift-default-6c774bb7bf-bjch2"
Jul 17 20:42:41.658558 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:42:41.658541    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-5f0f4f-openshift-default-6c774bb7bf-bjch2"
Jul 17 20:42:42.573554 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:42:42.573527    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:42:42.640810 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:42:42.640780    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-13e7d9-59db5d6cbf-j4jgl"
Jul 17 20:42:42.679998 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:42:42.679960    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:42:43.379610 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:42:43.379575    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:42:43.483679 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:42:43.483647    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:42:47.066630 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:42:47.066593    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:42:49.655226 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:42:49.655186    2572 patch_prober.go:28] interesting pod/e2e-inf-a-13e7d9-openshift-default-548d5b8f5f-gqgxm container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 17 20:42:49.655611 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:42:49.655253    2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-13e7d9-openshift-default-548d5b8f5f-gqgxm" podUID="26c95fb5-4c3c-43ce-b761-f02e6f28741d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 17 20:42:49.711088 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:42:49.711038    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:42:49.797445 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:42:49.797409    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:42:50.713215 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:42:50.713107    2572 generic.go:356] "Generic (PLEG): container finished" podID="26c95fb5-4c3c-43ce-b761-f02e6f28741d" containerID="e4fb9dce8c68f39433f4bdaf769539ce46ff2a90b76d356ca08b7dbe6c85515e" exitCode=0
Jul 17 20:42:50.713215 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:42:50.713189    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-13e7d9-openshift-default-548d5b8f5f-gqgxm" event={"ID":"26c95fb5-4c3c-43ce-b761-f02e6f28741d","Type":"ContainerDied","Data":"e4fb9dce8c68f39433f4bdaf769539ce46ff2a90b76d356ca08b7dbe6c85515e"}
Jul 17 20:42:50.713648 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:42:50.713601    2572 scope.go:117] "RemoveContainer" containerID="e4fb9dce8c68f39433f4bdaf769539ce46ff2a90b76d356ca08b7dbe6c85515e"
Jul 17 20:42:50.714694 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:42:50.714668    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 17 20:42:50.714764 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:42:50.714732    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 17 20:42:50.714805 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:42:50.714764    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 17 20:42:51.719918 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:42:51.719882    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-13e7d9-openshift-default-548d5b8f5f-gqgxm" event={"ID":"26c95fb5-4c3c-43ce-b761-f02e6f28741d","Type":"ContainerStarted","Data":"23c0de197f302efeaefce56ffad640d7d79f4660572b63d26b81769333c45798"}
Jul 17 20:42:52.551591 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:42:52.551554    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-13e7d9-openshift-default-548d5b8f5f-gqgxm"
Jul 17 20:42:52.551865 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:42:52.551832    2572 patch_prober.go:28] interesting pod/e2e-inf-a-13e7d9-openshift-default-548d5b8f5f-gqgxm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Jul 17 20:42:52.552116 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:42:52.552088    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-13e7d9-openshift-default-548d5b8f5f-gqgxm" podUID="26c95fb5-4c3c-43ce-b761-f02e6f28741d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Jul 17 20:42:53.551186 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:42:53.551147    2572 patch_prober.go:28] interesting pod/e2e-inf-a-13e7d9-openshift-default-548d5b8f5f-gqgxm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Jul 17 20:42:53.551669 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:42:53.551212    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-13e7d9-openshift-default-548d5b8f5f-gqgxm" podUID="26c95fb5-4c3c-43ce-b761-f02e6f28741d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Jul 17 20:42:53.905493 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:42:53.905377    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:42:54.552059 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:42:54.552015    2572 patch_prober.go:28] interesting pod/e2e-inf-a-13e7d9-openshift-default-548d5b8f5f-gqgxm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Jul 17 20:42:54.552575 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:42:54.552105    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-13e7d9-openshift-default-548d5b8f5f-gqgxm" podUID="26c95fb5-4c3c-43ce-b761-f02e6f28741d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Jul 17 20:42:55.551557 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:42:55.551520    2572 patch_prober.go:28] interesting pod/e2e-inf-a-13e7d9-openshift-default-548d5b8f5f-gqgxm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Jul 17 20:42:55.551735 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:42:55.551579    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-13e7d9-openshift-default-548d5b8f5f-gqgxm" podUID="26c95fb5-4c3c-43ce-b761-f02e6f28741d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Jul 17 20:42:56.555055 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:42:56.555026    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-13e7d9-openshift-default-548d5b8f5f-gqgxm"
Jul 17 20:42:56.555447 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:42:56.555420    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-13e7d9-openshift-default-548d5b8f5f-gqgxm"
Jul 17 20:42:56.556128 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:42:56.556105    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-13e7d9-openshift-default-548d5b8f5f-gqgxm"
Jul 17 20:42:56.594461 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:42:56.594431    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:42:56.687988 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:42:56.687919    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:42:57.693923 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:42:57.693896    2572 patch_prober.go:28] interesting pod/e2e-inf-b-5f0f4f-openshift-default-6c774bb7bf-bjch2 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 17 20:42:57.694292 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:42:57.693951    2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-5f0f4f-openshift-default-6c774bb7bf-bjch2" podUID="d3e4eae5-5810-4eb0-ac9b-65affe57385d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 17 20:42:57.766953 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:42:57.766924    2572 generic.go:356] "Generic (PLEG): container finished" podID="d3e4eae5-5810-4eb0-ac9b-65affe57385d" containerID="3fd65f09f720323792431bcf89bf92357bdbe855e13c9f44cd80324be51fa030" exitCode=0
Jul 17 20:42:57.767093 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:42:57.766994    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-5f0f4f-openshift-default-6c774bb7bf-bjch2" event={"ID":"d3e4eae5-5810-4eb0-ac9b-65affe57385d","Type":"ContainerDied","Data":"3fd65f09f720323792431bcf89bf92357bdbe855e13c9f44cd80324be51fa030"}
Jul 17 20:42:57.767522 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:42:57.767507    2572 scope.go:117] "RemoveContainer" containerID="3fd65f09f720323792431bcf89bf92357bdbe855e13c9f44cd80324be51fa030"
Jul 17 20:42:57.768439 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:42:57.768413    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 17 20:42:57.768495 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:42:57.768476    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 17 20:42:57.768534 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:42:57.768507    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 17 20:42:58.774052 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:42:58.774014    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-5f0f4f-openshift-default-6c774bb7bf-bjch2" event={"ID":"d3e4eae5-5810-4eb0-ac9b-65affe57385d","Type":"ContainerStarted","Data":"f510d9c548c6cd5ccff29dd144a42a6749fd3d5069cfe3ec95e29f18b11240c2"}
Jul 17 20:42:59.021157 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:42:59.021114    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-5f0f4f-openshift-default-6c774bb7bf-bjch2"
Jul 17 20:42:59.021340 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:42:59.021319    2572 patch_prober.go:28] interesting pod/e2e-inf-b-5f0f4f-openshift-default-6c774bb7bf-bjch2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body=
Jul 17 20:42:59.021389 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:42:59.021370    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-5f0f4f-openshift-default-6c774bb7bf-bjch2" podUID="d3e4eae5-5810-4eb0-ac9b-65affe57385d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused"
Jul 17 20:43:00.021978 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:43:00.021941    2572 patch_prober.go:28] interesting pod/e2e-inf-b-5f0f4f-openshift-default-6c774bb7bf-bjch2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body=
Jul 17 20:43:00.022382 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:43:00.022021    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-5f0f4f-openshift-default-6c774bb7bf-bjch2" podUID="d3e4eae5-5810-4eb0-ac9b-65affe57385d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused"
Jul 17 20:43:01.021860 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:43:01.021827    2572 patch_prober.go:28] interesting pod/e2e-inf-b-5f0f4f-openshift-default-6c774bb7bf-bjch2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body=
Jul 17 20:43:01.022037 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:43:01.021909    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-5f0f4f-openshift-default-6c774bb7bf-bjch2" podUID="d3e4eae5-5810-4eb0-ac9b-65affe57385d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused"
Jul 17 20:43:02.021938 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:43:02.021904    2572 patch_prober.go:28] interesting pod/e2e-inf-b-5f0f4f-openshift-default-6c774bb7bf-bjch2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body=
Jul 17 20:43:02.022136 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:43:02.021961    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-5f0f4f-openshift-default-6c774bb7bf-bjch2" podUID="d3e4eae5-5810-4eb0-ac9b-65affe57385d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused"
Jul 17 20:43:03.024808 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:43:03.024780    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-5f0f4f-openshift-default-6c774bb7bf-bjch2"
Jul 17 20:43:03.025237 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:43:03.025170    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-5f0f4f-openshift-default-6c774bb7bf-bjch2"
Jul 17 20:43:03.025762 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:43:03.025741    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-5f0f4f-openshift-default-6c774bb7bf-bjch2"
Jul 17 20:43:04.189250 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:43:04.189214    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:43:04.286212 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:43:04.286178    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:43:05.221615 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:43:05.221584    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:43:28.921682 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:43:28.921651    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:43:45.854379 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:43:45.854345    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:43:46.900842 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:43:46.900810    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:43:47.609261 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:43:47.609226    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:43:47.728969 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:43:47.728936    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:43:57.466497 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:43:57.466459    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-13e7d9-59db5d6cbf-j4jgl"]
Jul 17 20:43:57.466962 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:43:57.466738    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-13e7d9-59db5d6cbf-j4jgl" podUID="11fbf6e4-c92c-4338-954a-cd2d1e7f5864" containerName="maas-api" containerID="cri-o://db81802c16e331d8ddf62902e05be88aecd165921a46a880ec1c24b804f0fec1" gracePeriod=30
Jul 17 20:43:57.499455 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:43:57.499425    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:43:57.636108 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:43:57.636047    2572 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-13e7d9-59db5d6cbf-j4jgl" podUID="11fbf6e4-c92c-4338-954a-cd2d1e7f5864" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.57:8443/health\": dial tcp 10.134.0.57:8443: connect: connection refused"
Jul 17 20:43:57.722927 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:43:57.722874    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-13e7d9-59db5d6cbf-j4jgl"
Jul 17 20:43:57.801700 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:43:57.801665    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/11fbf6e4-c92c-4338-954a-cd2d1e7f5864-openshift-service-ca\") pod \"11fbf6e4-c92c-4338-954a-cd2d1e7f5864\" (UID: \"11fbf6e4-c92c-4338-954a-cd2d1e7f5864\") "
Jul 17 20:43:57.801837 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:43:57.801736    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/11fbf6e4-c92c-4338-954a-cd2d1e7f5864-maas-api-tls\") pod \"11fbf6e4-c92c-4338-954a-cd2d1e7f5864\" (UID: \"11fbf6e4-c92c-4338-954a-cd2d1e7f5864\") "
Jul 17 20:43:57.801837 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:43:57.801802    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l6rcd\" (UniqueName: \"kubernetes.io/projected/11fbf6e4-c92c-4338-954a-cd2d1e7f5864-kube-api-access-l6rcd\") pod \"11fbf6e4-c92c-4338-954a-cd2d1e7f5864\" (UID: \"11fbf6e4-c92c-4338-954a-cd2d1e7f5864\") "
Jul 17 20:43:57.802052 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:43:57.802026    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/11fbf6e4-c92c-4338-954a-cd2d1e7f5864-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "11fbf6e4-c92c-4338-954a-cd2d1e7f5864" (UID: "11fbf6e4-c92c-4338-954a-cd2d1e7f5864"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 20:43:57.803838 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:43:57.803809    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/11fbf6e4-c92c-4338-954a-cd2d1e7f5864-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "11fbf6e4-c92c-4338-954a-cd2d1e7f5864" (UID: "11fbf6e4-c92c-4338-954a-cd2d1e7f5864"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 20:43:57.803946 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:43:57.803884    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/11fbf6e4-c92c-4338-954a-cd2d1e7f5864-kube-api-access-l6rcd" (OuterVolumeSpecName: "kube-api-access-l6rcd") pod "11fbf6e4-c92c-4338-954a-cd2d1e7f5864" (UID: "11fbf6e4-c92c-4338-954a-cd2d1e7f5864"). InnerVolumeSpecName "kube-api-access-l6rcd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 20:43:57.903493 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:43:57.903468    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/11fbf6e4-c92c-4338-954a-cd2d1e7f5864-maas-api-tls\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Jul 17 20:43:57.903493 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:43:57.903493    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l6rcd\" (UniqueName: \"kubernetes.io/projected/11fbf6e4-c92c-4338-954a-cd2d1e7f5864-kube-api-access-l6rcd\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Jul 17 20:43:57.903659 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:43:57.903503    2572 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/11fbf6e4-c92c-4338-954a-cd2d1e7f5864-openshift-service-ca\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Jul 17 20:43:58.081608 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:43:58.081578    2572 generic.go:356] "Generic (PLEG): container finished" podID="11fbf6e4-c92c-4338-954a-cd2d1e7f5864" containerID="db81802c16e331d8ddf62902e05be88aecd165921a46a880ec1c24b804f0fec1" exitCode=0
Jul 17 20:43:58.081769 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:43:58.081623    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-13e7d9-59db5d6cbf-j4jgl"
Jul 17 20:43:58.081769 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:43:58.081635    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-13e7d9-59db5d6cbf-j4jgl" event={"ID":"11fbf6e4-c92c-4338-954a-cd2d1e7f5864","Type":"ContainerDied","Data":"db81802c16e331d8ddf62902e05be88aecd165921a46a880ec1c24b804f0fec1"}
Jul 17 20:43:58.081769 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:43:58.081676    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-13e7d9-59db5d6cbf-j4jgl" event={"ID":"11fbf6e4-c92c-4338-954a-cd2d1e7f5864","Type":"ContainerDied","Data":"dd995a40b8e5dc555e19dbc01b76cce931b1d157b268c0f291a7cba9fc313519"}
Jul 17 20:43:58.081769 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:43:58.081697    2572 scope.go:117] "RemoveContainer" containerID="db81802c16e331d8ddf62902e05be88aecd165921a46a880ec1c24b804f0fec1"
Jul 17 20:43:58.091450 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:43:58.091432    2572 scope.go:117] "RemoveContainer" containerID="db81802c16e331d8ddf62902e05be88aecd165921a46a880ec1c24b804f0fec1"
Jul 17 20:43:58.091704 ip-10-0-141-177 kubenswrapper[2572]: E0717 20:43:58.091682    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"db81802c16e331d8ddf62902e05be88aecd165921a46a880ec1c24b804f0fec1\": container with ID starting with db81802c16e331d8ddf62902e05be88aecd165921a46a880ec1c24b804f0fec1 not found: ID does not exist" containerID="db81802c16e331d8ddf62902e05be88aecd165921a46a880ec1c24b804f0fec1"
Jul 17 20:43:58.091777 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:43:58.091711    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db81802c16e331d8ddf62902e05be88aecd165921a46a880ec1c24b804f0fec1"} err="failed to get container status \"db81802c16e331d8ddf62902e05be88aecd165921a46a880ec1c24b804f0fec1\": rpc error: code = NotFound desc = could not find container \"db81802c16e331d8ddf62902e05be88aecd165921a46a880ec1c24b804f0fec1\": container with ID starting with db81802c16e331d8ddf62902e05be88aecd165921a46a880ec1c24b804f0fec1 not found: ID does not exist"
Jul 17 20:43:58.103364 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:43:58.103337    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-13e7d9-59db5d6cbf-j4jgl"]
Jul 17 20:43:58.107049 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:43:58.107029    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-13e7d9-59db5d6cbf-j4jgl"]
Jul 17 20:43:59.687772 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:43:59.687735    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="11fbf6e4-c92c-4338-954a-cd2d1e7f5864" path="/var/lib/kubelet/pods/11fbf6e4-c92c-4338-954a-cd2d1e7f5864/volumes"
Jul 17 20:44:02.136606 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:02.136574    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:44:08.326439 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:08.326366    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:44:08.433184 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:08.433143    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:44:12.772369 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:12.772335    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-13e7d9-openshift-default-548d5b8f5f-gqgxm"]
Jul 17 20:44:12.772731 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:12.772537    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-13e7d9-openshift-default-548d5b8f5f-gqgxm" podUID="26c95fb5-4c3c-43ce-b761-f02e6f28741d" containerName="istio-proxy" containerID="cri-o://23c0de197f302efeaefce56ffad640d7d79f4660572b63d26b81769333c45798" gracePeriod=30
Jul 17 20:44:12.794130 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:12.794106    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:44:13.036935 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:13.036859    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:44:13.811424 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:13.811394    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:44:13.921553 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:13.921499    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:44:18.016462 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:18.016429    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-13e7d9-openshift-default-548d5b8f5f-gqgxm"
Jul 17 20:44:18.185786 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:18.185688    2572 generic.go:356] "Generic (PLEG): container finished" podID="26c95fb5-4c3c-43ce-b761-f02e6f28741d" containerID="23c0de197f302efeaefce56ffad640d7d79f4660572b63d26b81769333c45798" exitCode=0
Jul 17 20:44:18.185786 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:18.185750    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-13e7d9-openshift-default-548d5b8f5f-gqgxm"
Jul 17 20:44:18.185786 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:18.185773    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-13e7d9-openshift-default-548d5b8f5f-gqgxm" event={"ID":"26c95fb5-4c3c-43ce-b761-f02e6f28741d","Type":"ContainerDied","Data":"23c0de197f302efeaefce56ffad640d7d79f4660572b63d26b81769333c45798"}
Jul 17 20:44:18.186052 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:18.185828    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-13e7d9-openshift-default-548d5b8f5f-gqgxm" event={"ID":"26c95fb5-4c3c-43ce-b761-f02e6f28741d","Type":"ContainerDied","Data":"c1f8b8b3ef596e6b5971a7eaac5d86f7e3767e8e986ec3eabbbc4bc00950b53a"}
Jul 17 20:44:18.186052 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:18.185850    2572 scope.go:117] "RemoveContainer" containerID="23c0de197f302efeaefce56ffad640d7d79f4660572b63d26b81769333c45798"
Jul 17 20:44:18.194782 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:18.194765    2572 scope.go:117] "RemoveContainer" containerID="e4fb9dce8c68f39433f4bdaf769539ce46ff2a90b76d356ca08b7dbe6c85515e"
Jul 17 20:44:18.202275 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:18.202259    2572 scope.go:117] "RemoveContainer" containerID="23c0de197f302efeaefce56ffad640d7d79f4660572b63d26b81769333c45798"
Jul 17 20:44:18.202541 ip-10-0-141-177 kubenswrapper[2572]: E0717 20:44:18.202521    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"23c0de197f302efeaefce56ffad640d7d79f4660572b63d26b81769333c45798\": container with ID starting with 23c0de197f302efeaefce56ffad640d7d79f4660572b63d26b81769333c45798 not found: ID does not exist" containerID="23c0de197f302efeaefce56ffad640d7d79f4660572b63d26b81769333c45798"
Jul 17 20:44:18.202588 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:18.202553    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"23c0de197f302efeaefce56ffad640d7d79f4660572b63d26b81769333c45798"} err="failed to get container status \"23c0de197f302efeaefce56ffad640d7d79f4660572b63d26b81769333c45798\": rpc error: code = NotFound desc = could not find container \"23c0de197f302efeaefce56ffad640d7d79f4660572b63d26b81769333c45798\": container with ID starting with 23c0de197f302efeaefce56ffad640d7d79f4660572b63d26b81769333c45798 not found: ID does not exist"
Jul 17 20:44:18.202588 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:18.202572    2572 scope.go:117] "RemoveContainer" containerID="e4fb9dce8c68f39433f4bdaf769539ce46ff2a90b76d356ca08b7dbe6c85515e"
Jul 17 20:44:18.202802 ip-10-0-141-177 kubenswrapper[2572]: E0717 20:44:18.202784    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e4fb9dce8c68f39433f4bdaf769539ce46ff2a90b76d356ca08b7dbe6c85515e\": container with ID starting with e4fb9dce8c68f39433f4bdaf769539ce46ff2a90b76d356ca08b7dbe6c85515e not found: ID does not exist" containerID="e4fb9dce8c68f39433f4bdaf769539ce46ff2a90b76d356ca08b7dbe6c85515e"
Jul 17 20:44:18.202861 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:18.202809    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e4fb9dce8c68f39433f4bdaf769539ce46ff2a90b76d356ca08b7dbe6c85515e"} err="failed to get container status \"e4fb9dce8c68f39433f4bdaf769539ce46ff2a90b76d356ca08b7dbe6c85515e\": rpc error: code = NotFound desc = could not find container \"e4fb9dce8c68f39433f4bdaf769539ce46ff2a90b76d356ca08b7dbe6c85515e\": container with ID starting with e4fb9dce8c68f39433f4bdaf769539ce46ff2a90b76d356ca08b7dbe6c85515e not found: ID does not exist"
Jul 17 20:44:18.209180 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:18.209161    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/26c95fb5-4c3c-43ce-b761-f02e6f28741d-istio-podinfo\") pod \"26c95fb5-4c3c-43ce-b761-f02e6f28741d\" (UID: \"26c95fb5-4c3c-43ce-b761-f02e6f28741d\") "
Jul 17 20:44:18.209236 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:18.209221    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/26c95fb5-4c3c-43ce-b761-f02e6f28741d-istiod-ca-cert\") pod \"26c95fb5-4c3c-43ce-b761-f02e6f28741d\" (UID: \"26c95fb5-4c3c-43ce-b761-f02e6f28741d\") "
Jul 17 20:44:18.209271 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:18.209241    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/26c95fb5-4c3c-43ce-b761-f02e6f28741d-workload-socket\") pod \"26c95fb5-4c3c-43ce-b761-f02e6f28741d\" (UID: \"26c95fb5-4c3c-43ce-b761-f02e6f28741d\") "
Jul 17 20:44:18.209271 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:18.209258    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/26c95fb5-4c3c-43ce-b761-f02e6f28741d-istio-envoy\") pod \"26c95fb5-4c3c-43ce-b761-f02e6f28741d\" (UID: \"26c95fb5-4c3c-43ce-b761-f02e6f28741d\") "
Jul 17 20:44:18.209350 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:18.209286    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/26c95fb5-4c3c-43ce-b761-f02e6f28741d-istio-data\") pod \"26c95fb5-4c3c-43ce-b761-f02e6f28741d\" (UID: \"26c95fb5-4c3c-43ce-b761-f02e6f28741d\") "
Jul 17 20:44:18.209402 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:18.209351    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/26c95fb5-4c3c-43ce-b761-f02e6f28741d-credential-socket\") pod \"26c95fb5-4c3c-43ce-b761-f02e6f28741d\" (UID: \"26c95fb5-4c3c-43ce-b761-f02e6f28741d\") "
Jul 17 20:44:18.209402 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:18.209367    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/26c95fb5-4c3c-43ce-b761-f02e6f28741d-workload-certs\") pod \"26c95fb5-4c3c-43ce-b761-f02e6f28741d\" (UID: \"26c95fb5-4c3c-43ce-b761-f02e6f28741d\") "
Jul 17 20:44:18.209402 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:18.209392    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kwspd\" (UniqueName: \"kubernetes.io/projected/26c95fb5-4c3c-43ce-b761-f02e6f28741d-kube-api-access-kwspd\") pod \"26c95fb5-4c3c-43ce-b761-f02e6f28741d\" (UID: \"26c95fb5-4c3c-43ce-b761-f02e6f28741d\") "
Jul 17 20:44:18.209554 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:18.209420    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/26c95fb5-4c3c-43ce-b761-f02e6f28741d-istio-token\") pod \"26c95fb5-4c3c-43ce-b761-f02e6f28741d\" (UID: \"26c95fb5-4c3c-43ce-b761-f02e6f28741d\") "
Jul 17 20:44:18.209669 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:18.209556    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/26c95fb5-4c3c-43ce-b761-f02e6f28741d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "26c95fb5-4c3c-43ce-b761-f02e6f28741d" (UID: "26c95fb5-4c3c-43ce-b761-f02e6f28741d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 20:44:18.209733 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:18.209643    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/26c95fb5-4c3c-43ce-b761-f02e6f28741d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "26c95fb5-4c3c-43ce-b761-f02e6f28741d" (UID: "26c95fb5-4c3c-43ce-b761-f02e6f28741d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 20:44:18.209733 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:18.209717    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/26c95fb5-4c3c-43ce-b761-f02e6f28741d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "26c95fb5-4c3c-43ce-b761-f02e6f28741d" (UID: "26c95fb5-4c3c-43ce-b761-f02e6f28741d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 20:44:18.209840 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:18.209741    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/26c95fb5-4c3c-43ce-b761-f02e6f28741d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "26c95fb5-4c3c-43ce-b761-f02e6f28741d" (UID: "26c95fb5-4c3c-43ce-b761-f02e6f28741d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 20:44:18.209840 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:18.209793    2572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/26c95fb5-4c3c-43ce-b761-f02e6f28741d-istiod-ca-cert\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Jul 17 20:44:18.209840 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:18.209817    2572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/26c95fb5-4c3c-43ce-b761-f02e6f28741d-workload-socket\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Jul 17 20:44:18.210431 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:18.210406    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/26c95fb5-4c3c-43ce-b761-f02e6f28741d-istio-data" (OuterVolumeSpecName: "istio-data") pod "26c95fb5-4c3c-43ce-b761-f02e6f28741d" (UID: "26c95fb5-4c3c-43ce-b761-f02e6f28741d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 20:44:18.211373 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:18.211339    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/26c95fb5-4c3c-43ce-b761-f02e6f28741d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "26c95fb5-4c3c-43ce-b761-f02e6f28741d" (UID: "26c95fb5-4c3c-43ce-b761-f02e6f28741d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 17 20:44:18.211616 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:18.211597    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/26c95fb5-4c3c-43ce-b761-f02e6f28741d-kube-api-access-kwspd" (OuterVolumeSpecName: "kube-api-access-kwspd") pod "26c95fb5-4c3c-43ce-b761-f02e6f28741d" (UID: "26c95fb5-4c3c-43ce-b761-f02e6f28741d"). InnerVolumeSpecName "kube-api-access-kwspd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 20:44:18.211684 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:18.211634    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/26c95fb5-4c3c-43ce-b761-f02e6f28741d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "26c95fb5-4c3c-43ce-b761-f02e6f28741d" (UID: "26c95fb5-4c3c-43ce-b761-f02e6f28741d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 20:44:18.211793 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:18.211777    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/26c95fb5-4c3c-43ce-b761-f02e6f28741d-istio-token" (OuterVolumeSpecName: "istio-token") pod "26c95fb5-4c3c-43ce-b761-f02e6f28741d" (UID: "26c95fb5-4c3c-43ce-b761-f02e6f28741d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 20:44:18.311219 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:18.311193    2572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/26c95fb5-4c3c-43ce-b761-f02e6f28741d-credential-socket\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Jul 17 20:44:18.311219 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:18.311217    2572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/26c95fb5-4c3c-43ce-b761-f02e6f28741d-workload-certs\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Jul 17 20:44:18.311219 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:18.311226    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kwspd\" (UniqueName: \"kubernetes.io/projected/26c95fb5-4c3c-43ce-b761-f02e6f28741d-kube-api-access-kwspd\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Jul 17 20:44:18.311440 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:18.311235    2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/26c95fb5-4c3c-43ce-b761-f02e6f28741d-istio-token\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Jul 17 20:44:18.311440 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:18.311244    2572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/26c95fb5-4c3c-43ce-b761-f02e6f28741d-istio-podinfo\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Jul 17 20:44:18.311440 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:18.311252    2572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/26c95fb5-4c3c-43ce-b761-f02e6f28741d-istio-envoy\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Jul 17 20:44:18.311440 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:18.311260    2572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/26c95fb5-4c3c-43ce-b761-f02e6f28741d-istio-data\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Jul 17 20:44:18.510213 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:18.510184    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-13e7d9-openshift-default-548d5b8f5f-gqgxm"]
Jul 17 20:44:18.518739 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:18.518711    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-13e7d9-openshift-default-548d5b8f5f-gqgxm"]
Jul 17 20:44:19.687437 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:19.687405    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="26c95fb5-4c3c-43ce-b761-f02e6f28741d" path="/var/lib/kubelet/pods/26c95fb5-4c3c-43ce-b761-f02e6f28741d/volumes"
Jul 17 20:44:23.727589 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:23.727559    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:44:28.233041 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:28.232970    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:44:34.593555 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:34.593519    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:44:34.662076 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:34.662026    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:44:38.926921 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:38.926889    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-5f0f4f-openshift-default-6c774bb7bf-bjch2"]
Jul 17 20:44:38.927328 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:38.927110    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-5f0f4f-openshift-default-6c774bb7bf-bjch2" podUID="d3e4eae5-5810-4eb0-ac9b-65affe57385d" containerName="istio-proxy" containerID="cri-o://f510d9c548c6cd5ccff29dd144a42a6749fd3d5069cfe3ec95e29f18b11240c2" gracePeriod=30
Jul 17 20:44:38.938268 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:38.938244    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:44:39.170123 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:39.170092    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:44:39.497609 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:39.497575    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:44:39.776896 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:39.776823    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-3a4159-openshift-default-67987bf4cc-dgm5t"]
Jul 17 20:44:39.784086 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:39.784036    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="26c95fb5-4c3c-43ce-b761-f02e6f28741d" containerName="istio-proxy"
Jul 17 20:44:39.784244 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:39.784114    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="26c95fb5-4c3c-43ce-b761-f02e6f28741d" containerName="istio-proxy"
Jul 17 20:44:39.784244 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:39.784160    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="26c95fb5-4c3c-43ce-b761-f02e6f28741d" containerName="istio-proxy"
Jul 17 20:44:39.784244 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:39.784171    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="26c95fb5-4c3c-43ce-b761-f02e6f28741d" containerName="istio-proxy"
Jul 17 20:44:39.784244 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:39.784200    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11fbf6e4-c92c-4338-954a-cd2d1e7f5864" containerName="maas-api"
Jul 17 20:44:39.784244 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:39.784215    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="11fbf6e4-c92c-4338-954a-cd2d1e7f5864" containerName="maas-api"
Jul 17 20:44:39.784487 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:39.784457    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="26c95fb5-4c3c-43ce-b761-f02e6f28741d" containerName="istio-proxy"
Jul 17 20:44:39.784487 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:39.784483    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="11fbf6e4-c92c-4338-954a-cd2d1e7f5864" containerName="maas-api"
Jul 17 20:44:39.787276 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:39.787251    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-3a4159-openshift-default-67987bf4cc-dgm5t"
Jul 17 20:44:39.789737 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:39.789720    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-3a4159-openshift-default-dockercfg-qnbd8\""
Jul 17 20:44:39.794247 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:39.794227    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-3a4159-openshift-default-67987bf4cc-dgm5t"]
Jul 17 20:44:39.821548 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:39.821519    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:44:39.898819 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:39.898789    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/41cfdf1b-df70-4c59-83f3-e096aec9091e-istio-data\") pod \"e2e-api-a-3a4159-openshift-default-67987bf4cc-dgm5t\" (UID: \"41cfdf1b-df70-4c59-83f3-e096aec9091e\") " pod="openshift-ingress/e2e-api-a-3a4159-openshift-default-67987bf4cc-dgm5t"
Jul 17 20:44:39.898819 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:39.898824    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/41cfdf1b-df70-4c59-83f3-e096aec9091e-istiod-ca-cert\") pod \"e2e-api-a-3a4159-openshift-default-67987bf4cc-dgm5t\" (UID: \"41cfdf1b-df70-4c59-83f3-e096aec9091e\") " pod="openshift-ingress/e2e-api-a-3a4159-openshift-default-67987bf4cc-dgm5t"
Jul 17 20:44:39.899029 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:39.898859    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/41cfdf1b-df70-4c59-83f3-e096aec9091e-credential-socket\") pod \"e2e-api-a-3a4159-openshift-default-67987bf4cc-dgm5t\" (UID: \"41cfdf1b-df70-4c59-83f3-e096aec9091e\") " pod="openshift-ingress/e2e-api-a-3a4159-openshift-default-67987bf4cc-dgm5t"
Jul 17 20:44:39.899029 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:39.898912    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-77r96\" (UniqueName: \"kubernetes.io/projected/41cfdf1b-df70-4c59-83f3-e096aec9091e-kube-api-access-77r96\") pod \"e2e-api-a-3a4159-openshift-default-67987bf4cc-dgm5t\" (UID: \"41cfdf1b-df70-4c59-83f3-e096aec9091e\") " pod="openshift-ingress/e2e-api-a-3a4159-openshift-default-67987bf4cc-dgm5t"
Jul 17 20:44:39.899029 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:39.898946    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/41cfdf1b-df70-4c59-83f3-e096aec9091e-workload-certs\") pod \"e2e-api-a-3a4159-openshift-default-67987bf4cc-dgm5t\" (UID: \"41cfdf1b-df70-4c59-83f3-e096aec9091e\") " pod="openshift-ingress/e2e-api-a-3a4159-openshift-default-67987bf4cc-dgm5t"
Jul 17 20:44:39.899029 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:39.898980    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/41cfdf1b-df70-4c59-83f3-e096aec9091e-istio-token\") pod \"e2e-api-a-3a4159-openshift-default-67987bf4cc-dgm5t\" (UID: \"41cfdf1b-df70-4c59-83f3-e096aec9091e\") " pod="openshift-ingress/e2e-api-a-3a4159-openshift-default-67987bf4cc-dgm5t"
Jul 17 20:44:39.899192 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:39.899061    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/41cfdf1b-df70-4c59-83f3-e096aec9091e-istio-podinfo\") pod \"e2e-api-a-3a4159-openshift-default-67987bf4cc-dgm5t\" (UID: \"41cfdf1b-df70-4c59-83f3-e096aec9091e\") " pod="openshift-ingress/e2e-api-a-3a4159-openshift-default-67987bf4cc-dgm5t"
Jul 17 20:44:39.899192 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:39.899153    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/41cfdf1b-df70-4c59-83f3-e096aec9091e-istio-envoy\") pod \"e2e-api-a-3a4159-openshift-default-67987bf4cc-dgm5t\" (UID: \"41cfdf1b-df70-4c59-83f3-e096aec9091e\") " pod="openshift-ingress/e2e-api-a-3a4159-openshift-default-67987bf4cc-dgm5t"
Jul 17 20:44:39.899256 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:39.899224    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/41cfdf1b-df70-4c59-83f3-e096aec9091e-workload-socket\") pod \"e2e-api-a-3a4159-openshift-default-67987bf4cc-dgm5t\" (UID: \"41cfdf1b-df70-4c59-83f3-e096aec9091e\") " pod="openshift-ingress/e2e-api-a-3a4159-openshift-default-67987bf4cc-dgm5t"
Jul 17 20:44:40.000307 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:40.000278    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/41cfdf1b-df70-4c59-83f3-e096aec9091e-workload-socket\") pod \"e2e-api-a-3a4159-openshift-default-67987bf4cc-dgm5t\" (UID: \"41cfdf1b-df70-4c59-83f3-e096aec9091e\") " pod="openshift-ingress/e2e-api-a-3a4159-openshift-default-67987bf4cc-dgm5t"
Jul 17 20:44:40.000762 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:40.000318    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/41cfdf1b-df70-4c59-83f3-e096aec9091e-istio-data\") pod \"e2e-api-a-3a4159-openshift-default-67987bf4cc-dgm5t\" (UID: \"41cfdf1b-df70-4c59-83f3-e096aec9091e\") " pod="openshift-ingress/e2e-api-a-3a4159-openshift-default-67987bf4cc-dgm5t"
Jul 17 20:44:40.000762 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:40.000336    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/41cfdf1b-df70-4c59-83f3-e096aec9091e-istiod-ca-cert\") pod \"e2e-api-a-3a4159-openshift-default-67987bf4cc-dgm5t\" (UID: \"41cfdf1b-df70-4c59-83f3-e096aec9091e\") " pod="openshift-ingress/e2e-api-a-3a4159-openshift-default-67987bf4cc-dgm5t"
Jul 17 20:44:40.000762 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:40.000371    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/41cfdf1b-df70-4c59-83f3-e096aec9091e-credential-socket\") pod \"e2e-api-a-3a4159-openshift-default-67987bf4cc-dgm5t\" (UID: \"41cfdf1b-df70-4c59-83f3-e096aec9091e\") " pod="openshift-ingress/e2e-api-a-3a4159-openshift-default-67987bf4cc-dgm5t"
Jul 17 20:44:40.000762 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:40.000394    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-77r96\" (UniqueName: \"kubernetes.io/projected/41cfdf1b-df70-4c59-83f3-e096aec9091e-kube-api-access-77r96\") pod \"e2e-api-a-3a4159-openshift-default-67987bf4cc-dgm5t\" (UID: \"41cfdf1b-df70-4c59-83f3-e096aec9091e\") " pod="openshift-ingress/e2e-api-a-3a4159-openshift-default-67987bf4cc-dgm5t"
Jul 17 20:44:40.000762 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:40.000412    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/41cfdf1b-df70-4c59-83f3-e096aec9091e-workload-certs\") pod \"e2e-api-a-3a4159-openshift-default-67987bf4cc-dgm5t\" (UID: \"41cfdf1b-df70-4c59-83f3-e096aec9091e\") " pod="openshift-ingress/e2e-api-a-3a4159-openshift-default-67987bf4cc-dgm5t"
Jul 17 20:44:40.000762 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:40.000431    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/41cfdf1b-df70-4c59-83f3-e096aec9091e-istio-token\") pod \"e2e-api-a-3a4159-openshift-default-67987bf4cc-dgm5t\" (UID: \"41cfdf1b-df70-4c59-83f3-e096aec9091e\") " pod="openshift-ingress/e2e-api-a-3a4159-openshift-default-67987bf4cc-dgm5t"
Jul 17 20:44:40.000762 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:40.000468    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/41cfdf1b-df70-4c59-83f3-e096aec9091e-istio-podinfo\") pod \"e2e-api-a-3a4159-openshift-default-67987bf4cc-dgm5t\" (UID: \"41cfdf1b-df70-4c59-83f3-e096aec9091e\") " pod="openshift-ingress/e2e-api-a-3a4159-openshift-default-67987bf4cc-dgm5t"
Jul 17 20:44:40.000762 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:40.000712    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/41cfdf1b-df70-4c59-83f3-e096aec9091e-istio-data\") pod \"e2e-api-a-3a4159-openshift-default-67987bf4cc-dgm5t\" (UID: \"41cfdf1b-df70-4c59-83f3-e096aec9091e\") " pod="openshift-ingress/e2e-api-a-3a4159-openshift-default-67987bf4cc-dgm5t"
Jul 17 20:44:40.000762 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:40.000713    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/41cfdf1b-df70-4c59-83f3-e096aec9091e-istio-envoy\") pod \"e2e-api-a-3a4159-openshift-default-67987bf4cc-dgm5t\" (UID: \"41cfdf1b-df70-4c59-83f3-e096aec9091e\") " pod="openshift-ingress/e2e-api-a-3a4159-openshift-default-67987bf4cc-dgm5t"
Jul 17 20:44:40.001176 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:40.000811    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/41cfdf1b-df70-4c59-83f3-e096aec9091e-credential-socket\") pod \"e2e-api-a-3a4159-openshift-default-67987bf4cc-dgm5t\" (UID: \"41cfdf1b-df70-4c59-83f3-e096aec9091e\") " pod="openshift-ingress/e2e-api-a-3a4159-openshift-default-67987bf4cc-dgm5t"
Jul 17 20:44:40.001176 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:40.000806    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/41cfdf1b-df70-4c59-83f3-e096aec9091e-workload-socket\") pod \"e2e-api-a-3a4159-openshift-default-67987bf4cc-dgm5t\" (UID: \"41cfdf1b-df70-4c59-83f3-e096aec9091e\") " pod="openshift-ingress/e2e-api-a-3a4159-openshift-default-67987bf4cc-dgm5t"
Jul 17 20:44:40.001176 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:40.000837    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/41cfdf1b-df70-4c59-83f3-e096aec9091e-workload-certs\") pod \"e2e-api-a-3a4159-openshift-default-67987bf4cc-dgm5t\" (UID: \"41cfdf1b-df70-4c59-83f3-e096aec9091e\") " pod="openshift-ingress/e2e-api-a-3a4159-openshift-default-67987bf4cc-dgm5t"
Jul 17 20:44:40.001338 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:40.001319    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/41cfdf1b-df70-4c59-83f3-e096aec9091e-istiod-ca-cert\") pod \"e2e-api-a-3a4159-openshift-default-67987bf4cc-dgm5t\" (UID: \"41cfdf1b-df70-4c59-83f3-e096aec9091e\") " pod="openshift-ingress/e2e-api-a-3a4159-openshift-default-67987bf4cc-dgm5t"
Jul 17 20:44:40.002792 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:40.002769    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/41cfdf1b-df70-4c59-83f3-e096aec9091e-istio-envoy\") pod \"e2e-api-a-3a4159-openshift-default-67987bf4cc-dgm5t\" (UID: \"41cfdf1b-df70-4c59-83f3-e096aec9091e\") " pod="openshift-ingress/e2e-api-a-3a4159-openshift-default-67987bf4cc-dgm5t"
Jul 17 20:44:40.003025 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:40.003005    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/41cfdf1b-df70-4c59-83f3-e096aec9091e-istio-podinfo\") pod \"e2e-api-a-3a4159-openshift-default-67987bf4cc-dgm5t\" (UID: \"41cfdf1b-df70-4c59-83f3-e096aec9091e\") " pod="openshift-ingress/e2e-api-a-3a4159-openshift-default-67987bf4cc-dgm5t"
Jul 17 20:44:40.014680 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:40.014657    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/41cfdf1b-df70-4c59-83f3-e096aec9091e-istio-token\") pod \"e2e-api-a-3a4159-openshift-default-67987bf4cc-dgm5t\" (UID: \"41cfdf1b-df70-4c59-83f3-e096aec9091e\") " pod="openshift-ingress/e2e-api-a-3a4159-openshift-default-67987bf4cc-dgm5t"
Jul 17 20:44:40.015974 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:40.015953    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:44:40.017487 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:40.017464    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-77r96\" (UniqueName: \"kubernetes.io/projected/41cfdf1b-df70-4c59-83f3-e096aec9091e-kube-api-access-77r96\") pod \"e2e-api-a-3a4159-openshift-default-67987bf4cc-dgm5t\" (UID: \"41cfdf1b-df70-4c59-83f3-e096aec9091e\") " pod="openshift-ingress/e2e-api-a-3a4159-openshift-default-67987bf4cc-dgm5t"
Jul 17 20:44:40.102585 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:40.102516    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-3a4159-openshift-default-67987bf4cc-dgm5t"
Jul 17 20:44:40.237791 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:40.237764    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-3a4159-openshift-default-67987bf4cc-dgm5t"]
Jul 17 20:44:40.239316 ip-10-0-141-177 kubenswrapper[2572]: W0717 20:44:40.239289    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41cfdf1b_df70_4c59_83f3_e096aec9091e.slice/crio-b4bee00d22313aa933b79c2269d05c8541c6fa688e885ada702dbb73a2f28fad WatchSource:0}: Error finding container b4bee00d22313aa933b79c2269d05c8541c6fa688e885ada702dbb73a2f28fad: Status 404 returned error can't find the container with id b4bee00d22313aa933b79c2269d05c8541c6fa688e885ada702dbb73a2f28fad
Jul 17 20:44:40.241400 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:40.241370    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 17 20:44:40.241469 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:40.241431    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 17 20:44:40.241469 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:40.241459    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 17 20:44:40.300265 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:40.300242    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-3a4159-openshift-default-67987bf4cc-dgm5t" event={"ID":"41cfdf1b-df70-4c59-83f3-e096aec9091e","Type":"ContainerStarted","Data":"2a20b1e29e60b1c3a16c85c332912e38765395726d5dca84849b6e8da7ed33b2"}
Jul 17 20:44:40.300393 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:40.300285    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-3a4159-openshift-default-67987bf4cc-dgm5t" event={"ID":"41cfdf1b-df70-4c59-83f3-e096aec9091e","Type":"ContainerStarted","Data":"b4bee00d22313aa933b79c2269d05c8541c6fa688e885ada702dbb73a2f28fad"}
Jul 17 20:44:40.322875 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:40.322755    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-3a4159-openshift-default-67987bf4cc-dgm5t" podStartSLOduration=1.322709191 podStartE2EDuration="1.322709191s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 20:44:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 20:44:40.321897594 +0000 UTC m=+2905.163393288" watchObservedRunningTime="2026-07-17 20:44:40.322709191 +0000 UTC m=+2905.164204831"
Jul 17 20:44:41.103480 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:41.103447    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-3a4159-openshift-default-67987bf4cc-dgm5t"
Jul 17 20:44:41.108516 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:41.108495    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-3a4159-openshift-default-67987bf4cc-dgm5t"
Jul 17 20:44:41.305410 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:41.305378    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-3a4159-openshift-default-67987bf4cc-dgm5t"
Jul 17 20:44:41.306333 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:41.306313    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-3a4159-openshift-default-67987bf4cc-dgm5t"
Jul 17 20:44:42.272033 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:42.271997    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:44:42.353699 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:42.353665    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:44:42.426481 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:42.426447    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:44:42.526825 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:42.526711    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:44:42.944495 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:42.944416    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:44:43.046092 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:43.046044    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:44:44.183445 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:44.183420    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-5f0f4f-openshift-default-6c774bb7bf-bjch2"
Jul 17 20:44:44.241770 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:44.241747    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d3e4eae5-5810-4eb0-ac9b-65affe57385d-istiod-ca-cert\") pod \"d3e4eae5-5810-4eb0-ac9b-65affe57385d\" (UID: \"d3e4eae5-5810-4eb0-ac9b-65affe57385d\") "
Jul 17 20:44:44.241892 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:44.241788    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d3e4eae5-5810-4eb0-ac9b-65affe57385d-istio-token\") pod \"d3e4eae5-5810-4eb0-ac9b-65affe57385d\" (UID: \"d3e4eae5-5810-4eb0-ac9b-65affe57385d\") "
Jul 17 20:44:44.241892 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:44.241818    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-56xf7\" (UniqueName: \"kubernetes.io/projected/d3e4eae5-5810-4eb0-ac9b-65affe57385d-kube-api-access-56xf7\") pod \"d3e4eae5-5810-4eb0-ac9b-65affe57385d\" (UID: \"d3e4eae5-5810-4eb0-ac9b-65affe57385d\") "
Jul 17 20:44:44.241892 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:44.241839    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d3e4eae5-5810-4eb0-ac9b-65affe57385d-workload-socket\") pod \"d3e4eae5-5810-4eb0-ac9b-65affe57385d\" (UID: \"d3e4eae5-5810-4eb0-ac9b-65affe57385d\") "
Jul 17 20:44:44.241892 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:44.241858    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d3e4eae5-5810-4eb0-ac9b-65affe57385d-credential-socket\") pod \"d3e4eae5-5810-4eb0-ac9b-65affe57385d\" (UID: \"d3e4eae5-5810-4eb0-ac9b-65affe57385d\") "
Jul 17 20:44:44.241892 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:44.241883    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d3e4eae5-5810-4eb0-ac9b-65affe57385d-istio-data\") pod \"d3e4eae5-5810-4eb0-ac9b-65affe57385d\" (UID: \"d3e4eae5-5810-4eb0-ac9b-65affe57385d\") "
Jul 17 20:44:44.242176 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:44.241902    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d3e4eae5-5810-4eb0-ac9b-65affe57385d-istio-podinfo\") pod \"d3e4eae5-5810-4eb0-ac9b-65affe57385d\" (UID: \"d3e4eae5-5810-4eb0-ac9b-65affe57385d\") "
Jul 17 20:44:44.242176 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:44.241981    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d3e4eae5-5810-4eb0-ac9b-65affe57385d-istio-envoy\") pod \"d3e4eae5-5810-4eb0-ac9b-65affe57385d\" (UID: \"d3e4eae5-5810-4eb0-ac9b-65affe57385d\") "
Jul 17 20:44:44.242176 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:44.242029    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d3e4eae5-5810-4eb0-ac9b-65affe57385d-workload-certs\") pod \"d3e4eae5-5810-4eb0-ac9b-65affe57385d\" (UID: \"d3e4eae5-5810-4eb0-ac9b-65affe57385d\") "
Jul 17 20:44:44.242338 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:44.242255    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d3e4eae5-5810-4eb0-ac9b-65affe57385d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d3e4eae5-5810-4eb0-ac9b-65affe57385d" (UID: "d3e4eae5-5810-4eb0-ac9b-65affe57385d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 20:44:44.242338 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:44.242279    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d3e4eae5-5810-4eb0-ac9b-65affe57385d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d3e4eae5-5810-4eb0-ac9b-65affe57385d" (UID: "d3e4eae5-5810-4eb0-ac9b-65affe57385d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 20:44:44.242338 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:44.242292    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d3e4eae5-5810-4eb0-ac9b-65affe57385d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d3e4eae5-5810-4eb0-ac9b-65affe57385d" (UID: "d3e4eae5-5810-4eb0-ac9b-65affe57385d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 20:44:44.242492 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:44.242457    2572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d3e4eae5-5810-4eb0-ac9b-65affe57385d-workload-socket\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Jul 17 20:44:44.242492 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:44.242478    2572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d3e4eae5-5810-4eb0-ac9b-65affe57385d-credential-socket\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Jul 17 20:44:44.242492 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:44.242475    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d3e4eae5-5810-4eb0-ac9b-65affe57385d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d3e4eae5-5810-4eb0-ac9b-65affe57385d" (UID: "d3e4eae5-5810-4eb0-ac9b-65affe57385d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 20:44:44.242648 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:44.242493    2572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d3e4eae5-5810-4eb0-ac9b-65affe57385d-istiod-ca-cert\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Jul 17 20:44:44.243196 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:44.243170    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d3e4eae5-5810-4eb0-ac9b-65affe57385d-istio-data" (OuterVolumeSpecName: "istio-data") pod "d3e4eae5-5810-4eb0-ac9b-65affe57385d" (UID: "d3e4eae5-5810-4eb0-ac9b-65affe57385d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 20:44:44.244086 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:44.244043    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d3e4eae5-5810-4eb0-ac9b-65affe57385d-kube-api-access-56xf7" (OuterVolumeSpecName: "kube-api-access-56xf7") pod "d3e4eae5-5810-4eb0-ac9b-65affe57385d" (UID: "d3e4eae5-5810-4eb0-ac9b-65affe57385d"). InnerVolumeSpecName "kube-api-access-56xf7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 20:44:44.244183 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:44.244137    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d3e4eae5-5810-4eb0-ac9b-65affe57385d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d3e4eae5-5810-4eb0-ac9b-65affe57385d" (UID: "d3e4eae5-5810-4eb0-ac9b-65affe57385d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 20:44:44.244243 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:44.244189    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d3e4eae5-5810-4eb0-ac9b-65affe57385d-istio-token" (OuterVolumeSpecName: "istio-token") pod "d3e4eae5-5810-4eb0-ac9b-65affe57385d" (UID: "d3e4eae5-5810-4eb0-ac9b-65affe57385d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 20:44:44.244243 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:44.244206    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d3e4eae5-5810-4eb0-ac9b-65affe57385d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d3e4eae5-5810-4eb0-ac9b-65affe57385d" (UID: "d3e4eae5-5810-4eb0-ac9b-65affe57385d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 17 20:44:44.321305 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:44.321278    2572 generic.go:356] "Generic (PLEG): container finished" podID="d3e4eae5-5810-4eb0-ac9b-65affe57385d" containerID="f510d9c548c6cd5ccff29dd144a42a6749fd3d5069cfe3ec95e29f18b11240c2" exitCode=0
Jul 17 20:44:44.321420 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:44.321315    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-5f0f4f-openshift-default-6c774bb7bf-bjch2" event={"ID":"d3e4eae5-5810-4eb0-ac9b-65affe57385d","Type":"ContainerDied","Data":"f510d9c548c6cd5ccff29dd144a42a6749fd3d5069cfe3ec95e29f18b11240c2"}
Jul 17 20:44:44.321420 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:44.321319    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-5f0f4f-openshift-default-6c774bb7bf-bjch2"
Jul 17 20:44:44.321420 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:44.321354    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-5f0f4f-openshift-default-6c774bb7bf-bjch2" event={"ID":"d3e4eae5-5810-4eb0-ac9b-65affe57385d","Type":"ContainerDied","Data":"584d22400586da20bf9408945c92f26631d6bd560e9d22fa0f97935bec5c54ac"}
Jul 17 20:44:44.321420 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:44.321375    2572 scope.go:117] "RemoveContainer" containerID="f510d9c548c6cd5ccff29dd144a42a6749fd3d5069cfe3ec95e29f18b11240c2"
Jul 17 20:44:44.330238 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:44.330216    2572 scope.go:117] "RemoveContainer" containerID="3fd65f09f720323792431bcf89bf92357bdbe855e13c9f44cd80324be51fa030"
Jul 17 20:44:44.337855 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:44.337839    2572 scope.go:117] "RemoveContainer" containerID="f510d9c548c6cd5ccff29dd144a42a6749fd3d5069cfe3ec95e29f18b11240c2"
Jul 17 20:44:44.338130 ip-10-0-141-177 kubenswrapper[2572]: E0717 20:44:44.338112    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f510d9c548c6cd5ccff29dd144a42a6749fd3d5069cfe3ec95e29f18b11240c2\": container with ID starting with f510d9c548c6cd5ccff29dd144a42a6749fd3d5069cfe3ec95e29f18b11240c2 not found: ID does not exist" containerID="f510d9c548c6cd5ccff29dd144a42a6749fd3d5069cfe3ec95e29f18b11240c2"
Jul 17 20:44:44.338181 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:44.338139    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f510d9c548c6cd5ccff29dd144a42a6749fd3d5069cfe3ec95e29f18b11240c2"} err="failed to get container status \"f510d9c548c6cd5ccff29dd144a42a6749fd3d5069cfe3ec95e29f18b11240c2\": rpc error: code = NotFound desc = could not find container \"f510d9c548c6cd5ccff29dd144a42a6749fd3d5069cfe3ec95e29f18b11240c2\": container with ID starting with f510d9c548c6cd5ccff29dd144a42a6749fd3d5069cfe3ec95e29f18b11240c2 not found: ID does not exist"
Jul 17 20:44:44.338181 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:44.338159    2572 scope.go:117] "RemoveContainer" containerID="3fd65f09f720323792431bcf89bf92357bdbe855e13c9f44cd80324be51fa030"
Jul 17 20:44:44.338380 ip-10-0-141-177 kubenswrapper[2572]: E0717 20:44:44.338365    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3fd65f09f720323792431bcf89bf92357bdbe855e13c9f44cd80324be51fa030\": container with ID starting with 3fd65f09f720323792431bcf89bf92357bdbe855e13c9f44cd80324be51fa030 not found: ID does not exist" containerID="3fd65f09f720323792431bcf89bf92357bdbe855e13c9f44cd80324be51fa030"
Jul 17 20:44:44.338417 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:44.338385    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3fd65f09f720323792431bcf89bf92357bdbe855e13c9f44cd80324be51fa030"} err="failed to get container status \"3fd65f09f720323792431bcf89bf92357bdbe855e13c9f44cd80324be51fa030\": rpc error: code = NotFound desc = could not find container \"3fd65f09f720323792431bcf89bf92357bdbe855e13c9f44cd80324be51fa030\": container with ID starting with 3fd65f09f720323792431bcf89bf92357bdbe855e13c9f44cd80324be51fa030 not found: ID does not exist"
Jul 17 20:44:44.342997 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:44.342974    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-5f0f4f-openshift-default-6c774bb7bf-bjch2"]
Jul 17 20:44:44.343209 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:44.343193    2572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d3e4eae5-5810-4eb0-ac9b-65affe57385d-istio-data\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Jul 17 20:44:44.343258 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:44.343212    2572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d3e4eae5-5810-4eb0-ac9b-65affe57385d-istio-podinfo\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Jul 17 20:44:44.343258 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:44.343221    2572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d3e4eae5-5810-4eb0-ac9b-65affe57385d-istio-envoy\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Jul 17 20:44:44.343258 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:44.343230    2572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d3e4eae5-5810-4eb0-ac9b-65affe57385d-workload-certs\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Jul 17 20:44:44.343258 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:44.343237    2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d3e4eae5-5810-4eb0-ac9b-65affe57385d-istio-token\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Jul 17 20:44:44.343258 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:44.343245    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-56xf7\" (UniqueName: \"kubernetes.io/projected/d3e4eae5-5810-4eb0-ac9b-65affe57385d-kube-api-access-56xf7\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Jul 17 20:44:44.346491 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:44.346468    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-5f0f4f-openshift-default-6c774bb7bf-bjch2"]
Jul 17 20:44:45.687795 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:45.687763    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d3e4eae5-5810-4eb0-ac9b-65affe57385d" path="/var/lib/kubelet/pods/d3e4eae5-5810-4eb0-ac9b-65affe57385d/volumes"
Jul 17 20:44:46.821423 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:46.821390    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:44:47.222403 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:47.222319    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:44:47.600554 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:47.600519    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-ad0e32-openshift-default-9b9fd644c-plpzm"]
Jul 17 20:44:47.600928 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:47.600915    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d3e4eae5-5810-4eb0-ac9b-65affe57385d" containerName="istio-proxy"
Jul 17 20:44:47.600928 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:47.600928    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="d3e4eae5-5810-4eb0-ac9b-65affe57385d" containerName="istio-proxy"
Jul 17 20:44:47.601036 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:47.600940    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d3e4eae5-5810-4eb0-ac9b-65affe57385d" containerName="istio-proxy"
Jul 17 20:44:47.601036 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:47.600946    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="d3e4eae5-5810-4eb0-ac9b-65affe57385d" containerName="istio-proxy"
Jul 17 20:44:47.601036 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:47.601020    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="d3e4eae5-5810-4eb0-ac9b-65affe57385d" containerName="istio-proxy"
Jul 17 20:44:47.601036 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:47.601029    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="d3e4eae5-5810-4eb0-ac9b-65affe57385d" containerName="istio-proxy"
Jul 17 20:44:47.601036 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:47.601037    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="26c95fb5-4c3c-43ce-b761-f02e6f28741d" containerName="istio-proxy"
Jul 17 20:44:47.604624 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:47.604600    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-ad0e32-openshift-default-9b9fd644c-plpzm"
Jul 17 20:44:47.607904 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:47.607885    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-ad0e32-openshift-default-dockercfg-82blc\""
Jul 17 20:44:47.640157 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:47.640129    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-ad0e32-openshift-default-9b9fd644c-plpzm"]
Jul 17 20:44:47.668248 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:47.668213    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:44:47.672521 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:47.672492    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6f44f845-c345-4ab1-a4ba-26cfef90b608-istio-podinfo\") pod \"e2e-api-b-ad0e32-openshift-default-9b9fd644c-plpzm\" (UID: \"6f44f845-c345-4ab1-a4ba-26cfef90b608\") " pod="openshift-ingress/e2e-api-b-ad0e32-openshift-default-9b9fd644c-plpzm"
Jul 17 20:44:47.672652 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:47.672527    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6f44f845-c345-4ab1-a4ba-26cfef90b608-workload-certs\") pod \"e2e-api-b-ad0e32-openshift-default-9b9fd644c-plpzm\" (UID: \"6f44f845-c345-4ab1-a4ba-26cfef90b608\") " pod="openshift-ingress/e2e-api-b-ad0e32-openshift-default-9b9fd644c-plpzm"
Jul 17 20:44:47.672652 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:47.672575    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6f44f845-c345-4ab1-a4ba-26cfef90b608-istio-envoy\") pod \"e2e-api-b-ad0e32-openshift-default-9b9fd644c-plpzm\" (UID: \"6f44f845-c345-4ab1-a4ba-26cfef90b608\") " pod="openshift-ingress/e2e-api-b-ad0e32-openshift-default-9b9fd644c-plpzm"
Jul 17 20:44:47.672759 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:47.672640    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6f44f845-c345-4ab1-a4ba-26cfef90b608-istio-token\") pod \"e2e-api-b-ad0e32-openshift-default-9b9fd644c-plpzm\" (UID: \"6f44f845-c345-4ab1-a4ba-26cfef90b608\") " pod="openshift-ingress/e2e-api-b-ad0e32-openshift-default-9b9fd644c-plpzm"
Jul 17 20:44:47.672759 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:47.672695    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f44f845-c345-4ab1-a4ba-26cfef90b608-credential-socket\") pod \"e2e-api-b-ad0e32-openshift-default-9b9fd644c-plpzm\" (UID: \"6f44f845-c345-4ab1-a4ba-26cfef90b608\") " pod="openshift-ingress/e2e-api-b-ad0e32-openshift-default-9b9fd644c-plpzm"
Jul 17 20:44:47.672871 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:47.672772    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f44f845-c345-4ab1-a4ba-26cfef90b608-workload-socket\") pod \"e2e-api-b-ad0e32-openshift-default-9b9fd644c-plpzm\" (UID: \"6f44f845-c345-4ab1-a4ba-26cfef90b608\") " pod="openshift-ingress/e2e-api-b-ad0e32-openshift-default-9b9fd644c-plpzm"
Jul 17 20:44:47.672871 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:47.672828    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6f44f845-c345-4ab1-a4ba-26cfef90b608-istiod-ca-cert\") pod \"e2e-api-b-ad0e32-openshift-default-9b9fd644c-plpzm\" (UID: \"6f44f845-c345-4ab1-a4ba-26cfef90b608\") " pod="openshift-ingress/e2e-api-b-ad0e32-openshift-default-9b9fd644c-plpzm"
Jul 17 20:44:47.672972 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:47.672868    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vjwk5\" (UniqueName: \"kubernetes.io/projected/6f44f845-c345-4ab1-a4ba-26cfef90b608-kube-api-access-vjwk5\") pod \"e2e-api-b-ad0e32-openshift-default-9b9fd644c-plpzm\" (UID: \"6f44f845-c345-4ab1-a4ba-26cfef90b608\") " pod="openshift-ingress/e2e-api-b-ad0e32-openshift-default-9b9fd644c-plpzm"
Jul 17 20:44:47.672972 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:47.672893    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6f44f845-c345-4ab1-a4ba-26cfef90b608-istio-data\") pod \"e2e-api-b-ad0e32-openshift-default-9b9fd644c-plpzm\" (UID: \"6f44f845-c345-4ab1-a4ba-26cfef90b608\") " pod="openshift-ingress/e2e-api-b-ad0e32-openshift-default-9b9fd644c-plpzm"
Jul 17 20:44:47.761175 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:47.761146    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:44:47.774425 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:47.774394    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f44f845-c345-4ab1-a4ba-26cfef90b608-workload-socket\") pod \"e2e-api-b-ad0e32-openshift-default-9b9fd644c-plpzm\" (UID: \"6f44f845-c345-4ab1-a4ba-26cfef90b608\") " pod="openshift-ingress/e2e-api-b-ad0e32-openshift-default-9b9fd644c-plpzm"
Jul 17 20:44:47.774562 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:47.774438    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6f44f845-c345-4ab1-a4ba-26cfef90b608-istiod-ca-cert\") pod \"e2e-api-b-ad0e32-openshift-default-9b9fd644c-plpzm\" (UID: \"6f44f845-c345-4ab1-a4ba-26cfef90b608\") " pod="openshift-ingress/e2e-api-b-ad0e32-openshift-default-9b9fd644c-plpzm"
Jul 17 20:44:47.774562 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:47.774465    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vjwk5\" (UniqueName: \"kubernetes.io/projected/6f44f845-c345-4ab1-a4ba-26cfef90b608-kube-api-access-vjwk5\") pod \"e2e-api-b-ad0e32-openshift-default-9b9fd644c-plpzm\" (UID: \"6f44f845-c345-4ab1-a4ba-26cfef90b608\") " pod="openshift-ingress/e2e-api-b-ad0e32-openshift-default-9b9fd644c-plpzm"
Jul 17 20:44:47.774681 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:47.774569    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6f44f845-c345-4ab1-a4ba-26cfef90b608-istio-data\") pod \"e2e-api-b-ad0e32-openshift-default-9b9fd644c-plpzm\" (UID: \"6f44f845-c345-4ab1-a4ba-26cfef90b608\") " pod="openshift-ingress/e2e-api-b-ad0e32-openshift-default-9b9fd644c-plpzm"
Jul 17 20:44:47.774681 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:47.774603    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6f44f845-c345-4ab1-a4ba-26cfef90b608-istio-podinfo\") pod \"e2e-api-b-ad0e32-openshift-default-9b9fd644c-plpzm\" (UID: \"6f44f845-c345-4ab1-a4ba-26cfef90b608\") " pod="openshift-ingress/e2e-api-b-ad0e32-openshift-default-9b9fd644c-plpzm"
Jul 17 20:44:47.774681 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:47.774630    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6f44f845-c345-4ab1-a4ba-26cfef90b608-workload-certs\") pod \"e2e-api-b-ad0e32-openshift-default-9b9fd644c-plpzm\" (UID: \"6f44f845-c345-4ab1-a4ba-26cfef90b608\") " pod="openshift-ingress/e2e-api-b-ad0e32-openshift-default-9b9fd644c-plpzm"
Jul 17 20:44:47.774849 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:47.774681    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6f44f845-c345-4ab1-a4ba-26cfef90b608-istio-envoy\") pod \"e2e-api-b-ad0e32-openshift-default-9b9fd644c-plpzm\" (UID: \"6f44f845-c345-4ab1-a4ba-26cfef90b608\") " pod="openshift-ingress/e2e-api-b-ad0e32-openshift-default-9b9fd644c-plpzm"
Jul 17 20:44:47.774849 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:47.774786    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6f44f845-c345-4ab1-a4ba-26cfef90b608-istio-token\") pod \"e2e-api-b-ad0e32-openshift-default-9b9fd644c-plpzm\" (UID: \"6f44f845-c345-4ab1-a4ba-26cfef90b608\") " pod="openshift-ingress/e2e-api-b-ad0e32-openshift-default-9b9fd644c-plpzm"
Jul 17 20:44:47.774849 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:47.774820    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f44f845-c345-4ab1-a4ba-26cfef90b608-credential-socket\") pod \"e2e-api-b-ad0e32-openshift-default-9b9fd644c-plpzm\" (UID: \"6f44f845-c345-4ab1-a4ba-26cfef90b608\") " pod="openshift-ingress/e2e-api-b-ad0e32-openshift-default-9b9fd644c-plpzm"
Jul 17 20:44:47.774987 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:47.774871    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f44f845-c345-4ab1-a4ba-26cfef90b608-workload-socket\") pod \"e2e-api-b-ad0e32-openshift-default-9b9fd644c-plpzm\" (UID: \"6f44f845-c345-4ab1-a4ba-26cfef90b608\") " pod="openshift-ingress/e2e-api-b-ad0e32-openshift-default-9b9fd644c-plpzm"
Jul 17 20:44:47.775292 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:47.775267    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6f44f845-c345-4ab1-a4ba-26cfef90b608-workload-certs\") pod \"e2e-api-b-ad0e32-openshift-default-9b9fd644c-plpzm\" (UID: \"6f44f845-c345-4ab1-a4ba-26cfef90b608\") " pod="openshift-ingress/e2e-api-b-ad0e32-openshift-default-9b9fd644c-plpzm"
Jul 17 20:44:47.775387 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:47.775304    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6f44f845-c345-4ab1-a4ba-26cfef90b608-istiod-ca-cert\") pod \"e2e-api-b-ad0e32-openshift-default-9b9fd644c-plpzm\" (UID: \"6f44f845-c345-4ab1-a4ba-26cfef90b608\") " pod="openshift-ingress/e2e-api-b-ad0e32-openshift-default-9b9fd644c-plpzm"
Jul 17 20:44:47.775387 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:47.775336    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6f44f845-c345-4ab1-a4ba-26cfef90b608-istio-data\") pod \"e2e-api-b-ad0e32-openshift-default-9b9fd644c-plpzm\" (UID: \"6f44f845-c345-4ab1-a4ba-26cfef90b608\") " pod="openshift-ingress/e2e-api-b-ad0e32-openshift-default-9b9fd644c-plpzm"
Jul 17 20:44:47.775536 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:47.775508    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f44f845-c345-4ab1-a4ba-26cfef90b608-credential-socket\") pod \"e2e-api-b-ad0e32-openshift-default-9b9fd644c-plpzm\" (UID: \"6f44f845-c345-4ab1-a4ba-26cfef90b608\") " pod="openshift-ingress/e2e-api-b-ad0e32-openshift-default-9b9fd644c-plpzm"
Jul 17 20:44:47.776981 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:47.776953    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6f44f845-c345-4ab1-a4ba-26cfef90b608-istio-envoy\") pod \"e2e-api-b-ad0e32-openshift-default-9b9fd644c-plpzm\" (UID: \"6f44f845-c345-4ab1-a4ba-26cfef90b608\") " pod="openshift-ingress/e2e-api-b-ad0e32-openshift-default-9b9fd644c-plpzm"
Jul 17 20:44:47.777356 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:47.777337    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6f44f845-c345-4ab1-a4ba-26cfef90b608-istio-podinfo\") pod \"e2e-api-b-ad0e32-openshift-default-9b9fd644c-plpzm\" (UID: \"6f44f845-c345-4ab1-a4ba-26cfef90b608\") " pod="openshift-ingress/e2e-api-b-ad0e32-openshift-default-9b9fd644c-plpzm"
Jul 17 20:44:47.783200 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:47.783177    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6f44f845-c345-4ab1-a4ba-26cfef90b608-istio-token\") pod \"e2e-api-b-ad0e32-openshift-default-9b9fd644c-plpzm\" (UID: \"6f44f845-c345-4ab1-a4ba-26cfef90b608\") " pod="openshift-ingress/e2e-api-b-ad0e32-openshift-default-9b9fd644c-plpzm"
Jul 17 20:44:47.785855 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:47.785836    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vjwk5\" (UniqueName: \"kubernetes.io/projected/6f44f845-c345-4ab1-a4ba-26cfef90b608-kube-api-access-vjwk5\") pod \"e2e-api-b-ad0e32-openshift-default-9b9fd644c-plpzm\" (UID: \"6f44f845-c345-4ab1-a4ba-26cfef90b608\") " pod="openshift-ingress/e2e-api-b-ad0e32-openshift-default-9b9fd644c-plpzm"
Jul 17 20:44:47.915381 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:47.915291    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-ad0e32-openshift-default-9b9fd644c-plpzm"
Jul 17 20:44:48.054562 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:48.054531    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-ad0e32-openshift-default-9b9fd644c-plpzm"]
Jul 17 20:44:48.057713 ip-10-0-141-177 kubenswrapper[2572]: W0717 20:44:48.057666    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f44f845_c345_4ab1_a4ba_26cfef90b608.slice/crio-7413aa87d7060246d91942b9de2e1f2f6f475642271fa93305a04a3ed0b2be62 WatchSource:0}: Error finding container 7413aa87d7060246d91942b9de2e1f2f6f475642271fa93305a04a3ed0b2be62: Status 404 returned error can't find the container with id 7413aa87d7060246d91942b9de2e1f2f6f475642271fa93305a04a3ed0b2be62
Jul 17 20:44:48.060813 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:48.060762    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 17 20:44:48.060952 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:48.060855    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 17 20:44:48.060952 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:48.060901    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 17 20:44:48.343469 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:48.343425    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-ad0e32-openshift-default-9b9fd644c-plpzm" event={"ID":"6f44f845-c345-4ab1-a4ba-26cfef90b608","Type":"ContainerStarted","Data":"4bc69339b5fca4f9d858f69d794bbdea77d9a6bf781aae059b6bf7137eecc8b8"}
Jul 17 20:44:48.343649 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:48.343491    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-ad0e32-openshift-default-9b9fd644c-plpzm" event={"ID":"6f44f845-c345-4ab1-a4ba-26cfef90b608","Type":"ContainerStarted","Data":"7413aa87d7060246d91942b9de2e1f2f6f475642271fa93305a04a3ed0b2be62"}
Jul 17 20:44:48.365023 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:48.364967    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-ad0e32-openshift-default-9b9fd644c-plpzm" podStartSLOduration=1.364948025 podStartE2EDuration="1.364948025s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 20:44:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 20:44:48.364060087 +0000 UTC m=+2913.205555723" watchObservedRunningTime="2026-07-17 20:44:48.364948025 +0000 UTC m=+2913.206443664"
Jul 17 20:44:48.916420 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:48.916382    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-ad0e32-openshift-default-9b9fd644c-plpzm"
Jul 17 20:44:49.921182 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:49.921149    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-ad0e32-openshift-default-9b9fd644c-plpzm"
Jul 17 20:44:50.265773 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:50.265742    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:44:50.358929 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:50.358896    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:44:50.370721 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:50.370691    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-ad0e32-openshift-default-9b9fd644c-plpzm"
Jul 17 20:44:50.371893 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:50.371864    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-ad0e32-openshift-default-9b9fd644c-plpzm"
Jul 17 20:44:50.448560 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:50.446798    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:44:50.946184 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:50.946146    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:44:51.039464 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:51.039383    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:44:51.140646 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:51.140613    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:44:54.724017 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:54.723976    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:44:56.307553 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:56.307471    2572 patch_prober.go:28] interesting pod/e2e-api-a-3a4159-openshift-default-67987bf4cc-dgm5t container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Jul 17 20:44:56.307553 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:56.307537    2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-3a4159-openshift-default-67987bf4cc-dgm5t" podUID="41cfdf1b-df70-4c59-83f3-e096aec9091e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Jul 17 20:44:56.403392 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:56.403360    2572 generic.go:356] "Generic (PLEG): container finished" podID="41cfdf1b-df70-4c59-83f3-e096aec9091e" containerID="2a20b1e29e60b1c3a16c85c332912e38765395726d5dca84849b6e8da7ed33b2" exitCode=0
Jul 17 20:44:56.403562 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:56.403432    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-3a4159-openshift-default-67987bf4cc-dgm5t" event={"ID":"41cfdf1b-df70-4c59-83f3-e096aec9091e","Type":"ContainerDied","Data":"2a20b1e29e60b1c3a16c85c332912e38765395726d5dca84849b6e8da7ed33b2"}
Jul 17 20:44:56.403848 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:56.403835    2572 scope.go:117] "RemoveContainer" containerID="2a20b1e29e60b1c3a16c85c332912e38765395726d5dca84849b6e8da7ed33b2"
Jul 17 20:44:56.404949 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:56.404920    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 17 20:44:56.405015 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:56.404998    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 17 20:44:56.405052 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:56.405033    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 17 20:44:57.414298 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:57.414255    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-3a4159-openshift-default-67987bf4cc-dgm5t" event={"ID":"41cfdf1b-df70-4c59-83f3-e096aec9091e","Type":"ContainerStarted","Data":"1c2e36d54c30fba3a335342c6367dc5adcf0a8468630abf56164c2b5e41c5f8f"}
Jul 17 20:44:58.103038 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:58.103001    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-3a4159-openshift-default-67987bf4cc-dgm5t"
Jul 17 20:44:58.103232 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:58.103218    2572 patch_prober.go:28] interesting pod/e2e-api-a-3a4159-openshift-default-67987bf4cc-dgm5t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Jul 17 20:44:58.103279 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:58.103263    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-3a4159-openshift-default-67987bf4cc-dgm5t" podUID="41cfdf1b-df70-4c59-83f3-e096aec9091e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Jul 17 20:44:59.103298 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:59.103257    2572 patch_prober.go:28] interesting pod/e2e-api-a-3a4159-openshift-default-67987bf4cc-dgm5t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Jul 17 20:44:59.103776 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:44:59.103322    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-3a4159-openshift-default-67987bf4cc-dgm5t" podUID="41cfdf1b-df70-4c59-83f3-e096aec9091e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Jul 17 20:45:00.103032 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:45:00.102996    2572 patch_prober.go:28] interesting pod/e2e-api-a-3a4159-openshift-default-67987bf4cc-dgm5t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Jul 17 20:45:00.103230 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:45:00.103050    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-3a4159-openshift-default-67987bf4cc-dgm5t" podUID="41cfdf1b-df70-4c59-83f3-e096aec9091e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Jul 17 20:45:01.103229 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:45:01.103192    2572 patch_prober.go:28] interesting pod/e2e-api-a-3a4159-openshift-default-67987bf4cc-dgm5t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Jul 17 20:45:01.103606 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:45:01.103250    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-3a4159-openshift-default-67987bf4cc-dgm5t" podUID="41cfdf1b-df70-4c59-83f3-e096aec9091e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Jul 17 20:45:02.107105 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:45:02.106999    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-3a4159-openshift-default-67987bf4cc-dgm5t"
Jul 17 20:45:02.107530 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:45:02.107388    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-3a4159-openshift-default-67987bf4cc-dgm5t"
Jul 17 20:45:02.108094 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:45:02.108060    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-3a4159-openshift-default-67987bf4cc-dgm5t"
Jul 17 20:45:02.452645 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:45:02.452558    2572 generic.go:356] "Generic (PLEG): container finished" podID="6f44f845-c345-4ab1-a4ba-26cfef90b608" containerID="4bc69339b5fca4f9d858f69d794bbdea77d9a6bf781aae059b6bf7137eecc8b8" exitCode=0
Jul 17 20:45:02.452793 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:45:02.452636    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-ad0e32-openshift-default-9b9fd644c-plpzm" event={"ID":"6f44f845-c345-4ab1-a4ba-26cfef90b608","Type":"ContainerDied","Data":"4bc69339b5fca4f9d858f69d794bbdea77d9a6bf781aae059b6bf7137eecc8b8"}
Jul 17 20:45:02.453157 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:45:02.453134    2572 scope.go:117] "RemoveContainer" containerID="4bc69339b5fca4f9d858f69d794bbdea77d9a6bf781aae059b6bf7137eecc8b8"
Jul 17 20:45:02.454077 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:45:02.454038    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 17 20:45:02.454146 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:45:02.454118    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 17 20:45:02.454193 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:45:02.454151    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 17 20:45:03.208595 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:45:03.208558    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:45:03.315292 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:45:03.315259    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:45:03.462765 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:45:03.462672    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-ad0e32-openshift-default-9b9fd644c-plpzm" event={"ID":"6f44f845-c345-4ab1-a4ba-26cfef90b608","Type":"ContainerStarted","Data":"ef30ab166a604e03fcec593658e3aeac1508d91937544f9f8addfebd2ad5dfd8"}
Jul 17 20:45:03.916481 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:45:03.916445    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-ad0e32-openshift-default-9b9fd644c-plpzm"
Jul 17 20:45:03.917514 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:45:03.917489    2572 patch_prober.go:28] interesting pod/e2e-api-b-ad0e32-openshift-default-9b9fd644c-plpzm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Jul 17 20:45:03.917640 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:45:03.917540    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-ad0e32-openshift-default-9b9fd644c-plpzm" podUID="6f44f845-c345-4ab1-a4ba-26cfef90b608" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Jul 17 20:45:04.916653 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:45:04.916618    2572 patch_prober.go:28] interesting pod/e2e-api-b-ad0e32-openshift-default-9b9fd644c-plpzm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Jul 17 20:45:04.917113 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:45:04.916674    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-ad0e32-openshift-default-9b9fd644c-plpzm" podUID="6f44f845-c345-4ab1-a4ba-26cfef90b608" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Jul 17 20:45:05.370713 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:45:05.370673    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-ad0e32-openshift-default-9b9fd644c-plpzm"
Jul 17 20:45:05.916395 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:45:05.916359    2572 patch_prober.go:28] interesting pod/e2e-api-b-ad0e32-openshift-default-9b9fd644c-plpzm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Jul 17 20:45:05.916611 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:45:05.916412    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-ad0e32-openshift-default-9b9fd644c-plpzm" podUID="6f44f845-c345-4ab1-a4ba-26cfef90b608" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Jul 17 20:45:06.915950 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:45:06.915916    2572 patch_prober.go:28] interesting pod/e2e-api-b-ad0e32-openshift-default-9b9fd644c-plpzm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Jul 17 20:45:06.916372 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:45:06.915982    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-ad0e32-openshift-default-9b9fd644c-plpzm" podUID="6f44f845-c345-4ab1-a4ba-26cfef90b608" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Jul 17 20:45:07.919485 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:45:07.919456    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-ad0e32-openshift-default-9b9fd644c-plpzm"
Jul 17 20:45:07.920402 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:45:07.920381    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-ad0e32-openshift-default-9b9fd644c-plpzm"
Jul 17 20:45:12.030289 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:45:12.030260    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:45:12.250083 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:45:12.250041    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:45:13.072921 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:45:13.072882    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:45:17.844379 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:45:17.844338    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:45:24.235271 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:45:24.235237    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:45:24.326137 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:45:24.326104    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:45:28.655976 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:45:28.655942    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-3a4159-openshift-default-67987bf4cc-dgm5t"]
Jul 17 20:45:28.656399 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:45:28.656197    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-3a4159-openshift-default-67987bf4cc-dgm5t" podUID="41cfdf1b-df70-4c59-83f3-e096aec9091e" containerName="istio-proxy" containerID="cri-o://1c2e36d54c30fba3a335342c6367dc5adcf0a8468630abf56164c2b5e41c5f8f" gracePeriod=30
Jul 17 20:45:28.681266 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:45:28.681194    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:45:28.914435 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:45:28.914351    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:45:32.109438 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:45:32.109402    2572 patch_prober.go:28] interesting pod/e2e-api-a-3a4159-openshift-default-67987bf4cc-dgm5t container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 17 20:45:32.109804 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:45:32.109463    2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-3a4159-openshift-default-67987bf4cc-dgm5t" podUID="41cfdf1b-df70-4c59-83f3-e096aec9091e" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 17 20:45:33.903969 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:45:33.903945    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-3a4159-openshift-default-67987bf4cc-dgm5t"
Jul 17 20:45:34.041853 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:45:34.041826    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/41cfdf1b-df70-4c59-83f3-e096aec9091e-istio-data\") pod \"41cfdf1b-df70-4c59-83f3-e096aec9091e\" (UID: \"41cfdf1b-df70-4c59-83f3-e096aec9091e\") "
Jul 17 20:45:34.042014 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:45:34.041858    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/41cfdf1b-df70-4c59-83f3-e096aec9091e-credential-socket\") pod \"41cfdf1b-df70-4c59-83f3-e096aec9091e\" (UID: \"41cfdf1b-df70-4c59-83f3-e096aec9091e\") "
Jul 17 20:45:34.042014 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:45:34.041898    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-77r96\" (UniqueName: \"kubernetes.io/projected/41cfdf1b-df70-4c59-83f3-e096aec9091e-kube-api-access-77r96\") pod \"41cfdf1b-df70-4c59-83f3-e096aec9091e\" (UID: \"41cfdf1b-df70-4c59-83f3-e096aec9091e\") "
Jul 17 20:45:34.042014 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:45:34.041921    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/41cfdf1b-df70-4c59-83f3-e096aec9091e-workload-certs\") pod \"41cfdf1b-df70-4c59-83f3-e096aec9091e\" (UID: \"41cfdf1b-df70-4c59-83f3-e096aec9091e\") "
Jul 17 20:45:34.042014 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:45:34.041964    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/41cfdf1b-df70-4c59-83f3-e096aec9091e-istio-podinfo\") pod \"41cfdf1b-df70-4c59-83f3-e096aec9091e\" (UID: \"41cfdf1b-df70-4c59-83f3-e096aec9091e\") "
Jul 17 20:45:34.042014 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:45:34.041994    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/41cfdf1b-df70-4c59-83f3-e096aec9091e-istiod-ca-cert\") pod \"41cfdf1b-df70-4c59-83f3-e096aec9091e\" (UID: \"41cfdf1b-df70-4c59-83f3-e096aec9091e\") "
Jul 17 20:45:34.042268 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:45:34.042031    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/41cfdf1b-df70-4c59-83f3-e096aec9091e-workload-socket\") pod \"41cfdf1b-df70-4c59-83f3-e096aec9091e\" (UID: \"41cfdf1b-df70-4c59-83f3-e096aec9091e\") "
Jul 17 20:45:34.042268 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:45:34.042090    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/41cfdf1b-df70-4c59-83f3-e096aec9091e-istio-envoy\") pod \"41cfdf1b-df70-4c59-83f3-e096aec9091e\" (UID: \"41cfdf1b-df70-4c59-83f3-e096aec9091e\") "
Jul 17 20:45:34.042268 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:45:34.042128    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/41cfdf1b-df70-4c59-83f3-e096aec9091e-istio-token\") pod \"41cfdf1b-df70-4c59-83f3-e096aec9091e\" (UID: \"41cfdf1b-df70-4c59-83f3-e096aec9091e\") "
Jul 17 20:45:34.042268 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:45:34.042178    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/41cfdf1b-df70-4c59-83f3-e096aec9091e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "41cfdf1b-df70-4c59-83f3-e096aec9091e" (UID: "41cfdf1b-df70-4c59-83f3-e096aec9091e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 20:45:34.042481 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:45:34.042286    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/41cfdf1b-df70-4c59-83f3-e096aec9091e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "41cfdf1b-df70-4c59-83f3-e096aec9091e" (UID: "41cfdf1b-df70-4c59-83f3-e096aec9091e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 20:45:34.042481 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:45:34.042399    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/41cfdf1b-df70-4c59-83f3-e096aec9091e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "41cfdf1b-df70-4c59-83f3-e096aec9091e" (UID: "41cfdf1b-df70-4c59-83f3-e096aec9091e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 20:45:34.042589 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:45:34.042555    2572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/41cfdf1b-df70-4c59-83f3-e096aec9091e-credential-socket\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Jul 17 20:45:34.042589 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:45:34.042574    2572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/41cfdf1b-df70-4c59-83f3-e096aec9091e-workload-certs\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Jul 17 20:45:34.042589 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:45:34.042587    2572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/41cfdf1b-df70-4c59-83f3-e096aec9091e-workload-socket\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Jul 17 20:45:34.042702 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:45:34.042632    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/41cfdf1b-df70-4c59-83f3-e096aec9091e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "41cfdf1b-df70-4c59-83f3-e096aec9091e" (UID: "41cfdf1b-df70-4c59-83f3-e096aec9091e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 20:45:34.042803 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:45:34.042782    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/41cfdf1b-df70-4c59-83f3-e096aec9091e-istio-data" (OuterVolumeSpecName: "istio-data") pod "41cfdf1b-df70-4c59-83f3-e096aec9091e" (UID: "41cfdf1b-df70-4c59-83f3-e096aec9091e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 20:45:34.044468 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:45:34.044440    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/41cfdf1b-df70-4c59-83f3-e096aec9091e-kube-api-access-77r96" (OuterVolumeSpecName: "kube-api-access-77r96") pod "41cfdf1b-df70-4c59-83f3-e096aec9091e" (UID: "41cfdf1b-df70-4c59-83f3-e096aec9091e"). InnerVolumeSpecName "kube-api-access-77r96". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 20:45:34.044601 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:45:34.044565    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/41cfdf1b-df70-4c59-83f3-e096aec9091e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "41cfdf1b-df70-4c59-83f3-e096aec9091e" (UID: "41cfdf1b-df70-4c59-83f3-e096aec9091e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 20:45:34.044667 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:45:34.044649    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/41cfdf1b-df70-4c59-83f3-e096aec9091e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "41cfdf1b-df70-4c59-83f3-e096aec9091e" (UID: "41cfdf1b-df70-4c59-83f3-e096aec9091e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 17 20:45:34.044667 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:45:34.044658    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/41cfdf1b-df70-4c59-83f3-e096aec9091e-istio-token" (OuterVolumeSpecName: "istio-token") pod "41cfdf1b-df70-4c59-83f3-e096aec9091e" (UID: "41cfdf1b-df70-4c59-83f3-e096aec9091e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 20:45:34.143960 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:45:34.143932    2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/41cfdf1b-df70-4c59-83f3-e096aec9091e-istio-token\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Jul 17 20:45:34.143960 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:45:34.143956    2572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/41cfdf1b-df70-4c59-83f3-e096aec9091e-istio-data\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Jul 17 20:45:34.144158 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:45:34.143966    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-77r96\" (UniqueName: \"kubernetes.io/projected/41cfdf1b-df70-4c59-83f3-e096aec9091e-kube-api-access-77r96\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Jul 17 20:45:34.144158 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:45:34.143977    2572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/41cfdf1b-df70-4c59-83f3-e096aec9091e-istio-podinfo\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Jul 17 20:45:34.144158 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:45:34.143985    2572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/41cfdf1b-df70-4c59-83f3-e096aec9091e-istiod-ca-cert\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Jul 17 20:45:34.144158 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:45:34.143993    2572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/41cfdf1b-df70-4c59-83f3-e096aec9091e-istio-envoy\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Jul 17 20:45:34.643645 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:45:34.643606    2572 generic.go:356] "Generic (PLEG): container finished" podID="41cfdf1b-df70-4c59-83f3-e096aec9091e" containerID="1c2e36d54c30fba3a335342c6367dc5adcf0a8468630abf56164c2b5e41c5f8f" exitCode=0
Jul 17 20:45:34.643842 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:45:34.643658    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-3a4159-openshift-default-67987bf4cc-dgm5t"
Jul 17 20:45:34.643842 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:45:34.643691    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-3a4159-openshift-default-67987bf4cc-dgm5t" event={"ID":"41cfdf1b-df70-4c59-83f3-e096aec9091e","Type":"ContainerDied","Data":"1c2e36d54c30fba3a335342c6367dc5adcf0a8468630abf56164c2b5e41c5f8f"}
Jul 17 20:45:34.643842 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:45:34.643742    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-3a4159-openshift-default-67987bf4cc-dgm5t" event={"ID":"41cfdf1b-df70-4c59-83f3-e096aec9091e","Type":"ContainerDied","Data":"b4bee00d22313aa933b79c2269d05c8541c6fa688e885ada702dbb73a2f28fad"}
Jul 17 20:45:34.643842 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:45:34.643766    2572 scope.go:117] "RemoveContainer" containerID="1c2e36d54c30fba3a335342c6367dc5adcf0a8468630abf56164c2b5e41c5f8f"
Jul 17 20:45:34.653946 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:45:34.653928    2572 scope.go:117] "RemoveContainer" containerID="2a20b1e29e60b1c3a16c85c332912e38765395726d5dca84849b6e8da7ed33b2"
Jul 17 20:45:34.661848 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:45:34.661830    2572 scope.go:117] "RemoveContainer" containerID="1c2e36d54c30fba3a335342c6367dc5adcf0a8468630abf56164c2b5e41c5f8f"
Jul 17 20:45:34.662056 ip-10-0-141-177 kubenswrapper[2572]: E0717 20:45:34.662037    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1c2e36d54c30fba3a335342c6367dc5adcf0a8468630abf56164c2b5e41c5f8f\": container with ID starting with 1c2e36d54c30fba3a335342c6367dc5adcf0a8468630abf56164c2b5e41c5f8f not found: ID does not exist" containerID="1c2e36d54c30fba3a335342c6367dc5adcf0a8468630abf56164c2b5e41c5f8f"
Jul 17 20:45:34.662238 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:45:34.662084    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c2e36d54c30fba3a335342c6367dc5adcf0a8468630abf56164c2b5e41c5f8f"} err="failed to get container status \"1c2e36d54c30fba3a335342c6367dc5adcf0a8468630abf56164c2b5e41c5f8f\": rpc error: code = NotFound desc = could not find container \"1c2e36d54c30fba3a335342c6367dc5adcf0a8468630abf56164c2b5e41c5f8f\": container with ID starting with 1c2e36d54c30fba3a335342c6367dc5adcf0a8468630abf56164c2b5e41c5f8f not found: ID does not exist"
Jul 17 20:45:34.662238 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:45:34.662108    2572 scope.go:117] "RemoveContainer" containerID="2a20b1e29e60b1c3a16c85c332912e38765395726d5dca84849b6e8da7ed33b2"
Jul 17 20:45:34.662378 ip-10-0-141-177 kubenswrapper[2572]: E0717 20:45:34.662360    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2a20b1e29e60b1c3a16c85c332912e38765395726d5dca84849b6e8da7ed33b2\": container with ID starting with 2a20b1e29e60b1c3a16c85c332912e38765395726d5dca84849b6e8da7ed33b2 not found: ID does not exist" containerID="2a20b1e29e60b1c3a16c85c332912e38765395726d5dca84849b6e8da7ed33b2"
Jul 17 20:45:34.662417 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:45:34.662384    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2a20b1e29e60b1c3a16c85c332912e38765395726d5dca84849b6e8da7ed33b2"} err="failed to get container status \"2a20b1e29e60b1c3a16c85c332912e38765395726d5dca84849b6e8da7ed33b2\": rpc error: code = NotFound desc = could not find container \"2a20b1e29e60b1c3a16c85c332912e38765395726d5dca84849b6e8da7ed33b2\": container with ID starting with 2a20b1e29e60b1c3a16c85c332912e38765395726d5dca84849b6e8da7ed33b2 not found: ID does not exist"
Jul 17 20:45:34.672347 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:45:34.672327    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-3a4159-openshift-default-67987bf4cc-dgm5t"]
Jul 17 20:45:34.677925 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:45:34.677902    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-3a4159-openshift-default-67987bf4cc-dgm5t"]
Jul 17 20:45:35.687296 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:45:35.687264    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="41cfdf1b-df70-4c59-83f3-e096aec9091e" path="/var/lib/kubelet/pods/41cfdf1b-df70-4c59-83f3-e096aec9091e/volumes"
Jul 17 20:45:39.739346 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:45:39.739261    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:45:44.170532 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:45:44.170499    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:45:49.356824 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:45:49.356789    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:45:50.273196 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:45:50.273126    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:45:50.350580 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:45:50.350551    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:45:54.899764 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:45:54.899736    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-ad0e32-openshift-default-9b9fd644c-plpzm"]
Jul 17 20:45:54.900214 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:45:54.899950    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-ad0e32-openshift-default-9b9fd644c-plpzm" podUID="6f44f845-c345-4ab1-a4ba-26cfef90b608" containerName="istio-proxy" containerID="cri-o://ef30ab166a604e03fcec593658e3aeac1508d91937544f9f8addfebd2ad5dfd8" gracePeriod=30
Jul 17 20:45:54.926050 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:45:54.926020    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:45:55.243166 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:45:55.243135    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:45:55.547257 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:45:55.547156    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:45:55.932346 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:45:55.932259    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-72eefe-openshift-default-5c67c7c5f9-dzrjf"]
Jul 17 20:45:55.932911 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:45:55.932752    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="41cfdf1b-df70-4c59-83f3-e096aec9091e" containerName="istio-proxy"
Jul 17 20:45:55.932911 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:45:55.932768    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="41cfdf1b-df70-4c59-83f3-e096aec9091e" containerName="istio-proxy"
Jul 17 20:45:55.932911 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:45:55.932779    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="41cfdf1b-df70-4c59-83f3-e096aec9091e" containerName="istio-proxy"
Jul 17 20:45:55.932911 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:45:55.932784    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="41cfdf1b-df70-4c59-83f3-e096aec9091e" containerName="istio-proxy"
Jul 17 20:45:55.932911 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:45:55.932859    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="41cfdf1b-df70-4c59-83f3-e096aec9091e" containerName="istio-proxy"
Jul 17 20:45:55.936085 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:45:55.936051    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-72eefe-openshift-default-5c67c7c5f9-dzrjf"
Jul 17 20:45:55.939209 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:45:55.939187    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-72eefe-openshift-default-dockercfg-5rv98\""
Jul 17 20:45:55.956551 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:45:55.956525    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-72eefe-openshift-default-5c67c7c5f9-dzrjf"]
Jul 17 20:45:55.967099 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:45:55.967060    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:45:56.051266 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:45:56.051227    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/01d75fd3-cb65-4956-81c6-3fba18a4b78c-istio-token\") pod \"e2e-shared-a-72eefe-openshift-default-5c67c7c5f9-dzrjf\" (UID: \"01d75fd3-cb65-4956-81c6-3fba18a4b78c\") " pod="openshift-ingress/e2e-shared-a-72eefe-openshift-default-5c67c7c5f9-dzrjf"
Jul 17 20:45:56.051466 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:45:56.051331    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/01d75fd3-cb65-4956-81c6-3fba18a4b78c-workload-certs\") pod \"e2e-shared-a-72eefe-openshift-default-5c67c7c5f9-dzrjf\" (UID: \"01d75fd3-cb65-4956-81c6-3fba18a4b78c\") " pod="openshift-ingress/e2e-shared-a-72eefe-openshift-default-5c67c7c5f9-dzrjf"
Jul 17 20:45:56.051466 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:45:56.051367    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/01d75fd3-cb65-4956-81c6-3fba18a4b78c-istio-envoy\") pod \"e2e-shared-a-72eefe-openshift-default-5c67c7c5f9-dzrjf\" (UID: \"01d75fd3-cb65-4956-81c6-3fba18a4b78c\") " pod="openshift-ingress/e2e-shared-a-72eefe-openshift-default-5c67c7c5f9-dzrjf"
Jul 17 20:45:56.051466 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:45:56.051389    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/01d75fd3-cb65-4956-81c6-3fba18a4b78c-istio-podinfo\") pod \"e2e-shared-a-72eefe-openshift-default-5c67c7c5f9-dzrjf\" (UID: \"01d75fd3-cb65-4956-81c6-3fba18a4b78c\") " pod="openshift-ingress/e2e-shared-a-72eefe-openshift-default-5c67c7c5f9-dzrjf"
Jul 17 20:45:56.051466 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:45:56.051413    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/01d75fd3-cb65-4956-81c6-3fba18a4b78c-istio-data\") pod \"e2e-shared-a-72eefe-openshift-default-5c67c7c5f9-dzrjf\" (UID: \"01d75fd3-cb65-4956-81c6-3fba18a4b78c\") " pod="openshift-ingress/e2e-shared-a-72eefe-openshift-default-5c67c7c5f9-dzrjf"
Jul 17 20:45:56.051466 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:45:56.051430    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/01d75fd3-cb65-4956-81c6-3fba18a4b78c-credential-socket\") pod \"e2e-shared-a-72eefe-openshift-default-5c67c7c5f9-dzrjf\" (UID: \"01d75fd3-cb65-4956-81c6-3fba18a4b78c\") " pod="openshift-ingress/e2e-shared-a-72eefe-openshift-default-5c67c7c5f9-dzrjf"
Jul 17 20:45:56.051466 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:45:56.051450    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5jv4c\" (UniqueName: \"kubernetes.io/projected/01d75fd3-cb65-4956-81c6-3fba18a4b78c-kube-api-access-5jv4c\") pod \"e2e-shared-a-72eefe-openshift-default-5c67c7c5f9-dzrjf\" (UID: \"01d75fd3-cb65-4956-81c6-3fba18a4b78c\") " pod="openshift-ingress/e2e-shared-a-72eefe-openshift-default-5c67c7c5f9-dzrjf"
Jul 17 20:45:56.051774 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:45:56.051493    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/01d75fd3-cb65-4956-81c6-3fba18a4b78c-workload-socket\") pod \"e2e-shared-a-72eefe-openshift-default-5c67c7c5f9-dzrjf\" (UID: \"01d75fd3-cb65-4956-81c6-3fba18a4b78c\") " pod="openshift-ingress/e2e-shared-a-72eefe-openshift-default-5c67c7c5f9-dzrjf"
Jul 17 20:45:56.051774 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:45:56.051529    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/01d75fd3-cb65-4956-81c6-3fba18a4b78c-istiod-ca-cert\") pod \"e2e-shared-a-72eefe-openshift-default-5c67c7c5f9-dzrjf\" (UID: \"01d75fd3-cb65-4956-81c6-3fba18a4b78c\") " pod="openshift-ingress/e2e-shared-a-72eefe-openshift-default-5c67c7c5f9-dzrjf"
Jul 17 20:45:56.088287 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:45:56.088241    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:45:56.152149 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:45:56.152119    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/01d75fd3-cb65-4956-81c6-3fba18a4b78c-workload-certs\") pod \"e2e-shared-a-72eefe-openshift-default-5c67c7c5f9-dzrjf\" (UID: \"01d75fd3-cb65-4956-81c6-3fba18a4b78c\") " pod="openshift-ingress/e2e-shared-a-72eefe-openshift-default-5c67c7c5f9-dzrjf"
Jul 17 20:45:56.152149 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:45:56.152151    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/01d75fd3-cb65-4956-81c6-3fba18a4b78c-istio-envoy\") pod \"e2e-shared-a-72eefe-openshift-default-5c67c7c5f9-dzrjf\" (UID: \"01d75fd3-cb65-4956-81c6-3fba18a4b78c\") " pod="openshift-ingress/e2e-shared-a-72eefe-openshift-default-5c67c7c5f9-dzrjf"
Jul 17 20:45:56.152334 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:45:56.152177    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/01d75fd3-cb65-4956-81c6-3fba18a4b78c-istio-podinfo\") pod \"e2e-shared-a-72eefe-openshift-default-5c67c7c5f9-dzrjf\" (UID: \"01d75fd3-cb65-4956-81c6-3fba18a4b78c\") " pod="openshift-ingress/e2e-shared-a-72eefe-openshift-default-5c67c7c5f9-dzrjf"
Jul 17 20:45:56.152334 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:45:56.152208    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/01d75fd3-cb65-4956-81c6-3fba18a4b78c-istio-data\") pod \"e2e-shared-a-72eefe-openshift-default-5c67c7c5f9-dzrjf\" (UID: \"01d75fd3-cb65-4956-81c6-3fba18a4b78c\") " pod="openshift-ingress/e2e-shared-a-72eefe-openshift-default-5c67c7c5f9-dzrjf"
Jul 17 20:45:56.152334 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:45:56.152232    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/01d75fd3-cb65-4956-81c6-3fba18a4b78c-credential-socket\") pod \"e2e-shared-a-72eefe-openshift-default-5c67c7c5f9-dzrjf\" (UID: \"01d75fd3-cb65-4956-81c6-3fba18a4b78c\") " pod="openshift-ingress/e2e-shared-a-72eefe-openshift-default-5c67c7c5f9-dzrjf"
Jul 17 20:45:56.152334 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:45:56.152260    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5jv4c\" (UniqueName: \"kubernetes.io/projected/01d75fd3-cb65-4956-81c6-3fba18a4b78c-kube-api-access-5jv4c\") pod \"e2e-shared-a-72eefe-openshift-default-5c67c7c5f9-dzrjf\" (UID: \"01d75fd3-cb65-4956-81c6-3fba18a4b78c\") " pod="openshift-ingress/e2e-shared-a-72eefe-openshift-default-5c67c7c5f9-dzrjf"
Jul 17 20:45:56.152334 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:45:56.152288    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/01d75fd3-cb65-4956-81c6-3fba18a4b78c-workload-socket\") pod \"e2e-shared-a-72eefe-openshift-default-5c67c7c5f9-dzrjf\" (UID: \"01d75fd3-cb65-4956-81c6-3fba18a4b78c\") " pod="openshift-ingress/e2e-shared-a-72eefe-openshift-default-5c67c7c5f9-dzrjf"
Jul 17 20:45:56.152334 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:45:56.152309    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/01d75fd3-cb65-4956-81c6-3fba18a4b78c-istiod-ca-cert\") pod \"e2e-shared-a-72eefe-openshift-default-5c67c7c5f9-dzrjf\" (UID: \"01d75fd3-cb65-4956-81c6-3fba18a4b78c\") " pod="openshift-ingress/e2e-shared-a-72eefe-openshift-default-5c67c7c5f9-dzrjf"
Jul 17 20:45:56.152611 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:45:56.152394    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/01d75fd3-cb65-4956-81c6-3fba18a4b78c-istio-token\") pod \"e2e-shared-a-72eefe-openshift-default-5c67c7c5f9-dzrjf\" (UID: \"01d75fd3-cb65-4956-81c6-3fba18a4b78c\") " pod="openshift-ingress/e2e-shared-a-72eefe-openshift-default-5c67c7c5f9-dzrjf"
Jul 17 20:45:56.152611 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:45:56.152566    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/01d75fd3-cb65-4956-81c6-3fba18a4b78c-workload-certs\") pod \"e2e-shared-a-72eefe-openshift-default-5c67c7c5f9-dzrjf\" (UID: \"01d75fd3-cb65-4956-81c6-3fba18a4b78c\") " pod="openshift-ingress/e2e-shared-a-72eefe-openshift-default-5c67c7c5f9-dzrjf"
Jul 17 20:45:56.152730 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:45:56.152628    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/01d75fd3-cb65-4956-81c6-3fba18a4b78c-istio-data\") pod \"e2e-shared-a-72eefe-openshift-default-5c67c7c5f9-dzrjf\" (UID: \"01d75fd3-cb65-4956-81c6-3fba18a4b78c\") " pod="openshift-ingress/e2e-shared-a-72eefe-openshift-default-5c67c7c5f9-dzrjf"
Jul 17 20:45:56.152792 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:45:56.152765    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/01d75fd3-cb65-4956-81c6-3fba18a4b78c-credential-socket\") pod \"e2e-shared-a-72eefe-openshift-default-5c67c7c5f9-dzrjf\" (UID: \"01d75fd3-cb65-4956-81c6-3fba18a4b78c\") " pod="openshift-ingress/e2e-shared-a-72eefe-openshift-default-5c67c7c5f9-dzrjf"
Jul 17 20:45:56.152865 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:45:56.152842    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/01d75fd3-cb65-4956-81c6-3fba18a4b78c-workload-socket\") pod \"e2e-shared-a-72eefe-openshift-default-5c67c7c5f9-dzrjf\" (UID: \"01d75fd3-cb65-4956-81c6-3fba18a4b78c\") " pod="openshift-ingress/e2e-shared-a-72eefe-openshift-default-5c67c7c5f9-dzrjf"
Jul 17 20:45:56.153153 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:45:56.153125    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/01d75fd3-cb65-4956-81c6-3fba18a4b78c-istiod-ca-cert\") pod \"e2e-shared-a-72eefe-openshift-default-5c67c7c5f9-dzrjf\" (UID: \"01d75fd3-cb65-4956-81c6-3fba18a4b78c\") " pod="openshift-ingress/e2e-shared-a-72eefe-openshift-default-5c67c7c5f9-dzrjf"
Jul 17 20:45:56.154514 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:45:56.154496    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/01d75fd3-cb65-4956-81c6-3fba18a4b78c-istio-envoy\") pod \"e2e-shared-a-72eefe-openshift-default-5c67c7c5f9-dzrjf\" (UID: \"01d75fd3-cb65-4956-81c6-3fba18a4b78c\") " pod="openshift-ingress/e2e-shared-a-72eefe-openshift-default-5c67c7c5f9-dzrjf"
Jul 17 20:45:56.154722 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:45:56.154702    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/01d75fd3-cb65-4956-81c6-3fba18a4b78c-istio-podinfo\") pod \"e2e-shared-a-72eefe-openshift-default-5c67c7c5f9-dzrjf\" (UID: \"01d75fd3-cb65-4956-81c6-3fba18a4b78c\") " pod="openshift-ingress/e2e-shared-a-72eefe-openshift-default-5c67c7c5f9-dzrjf"
Jul 17 20:45:56.166415 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:45:56.166394    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5jv4c\" (UniqueName: \"kubernetes.io/projected/01d75fd3-cb65-4956-81c6-3fba18a4b78c-kube-api-access-5jv4c\") pod \"e2e-shared-a-72eefe-openshift-default-5c67c7c5f9-dzrjf\" (UID: \"01d75fd3-cb65-4956-81c6-3fba18a4b78c\") " pod="openshift-ingress/e2e-shared-a-72eefe-openshift-default-5c67c7c5f9-dzrjf"
Jul 17 20:45:56.167174 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:45:56.167157    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/01d75fd3-cb65-4956-81c6-3fba18a4b78c-istio-token\") pod \"e2e-shared-a-72eefe-openshift-default-5c67c7c5f9-dzrjf\" (UID: \"01d75fd3-cb65-4956-81c6-3fba18a4b78c\") " pod="openshift-ingress/e2e-shared-a-72eefe-openshift-default-5c67c7c5f9-dzrjf"
Jul 17 20:45:56.248085 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:45:56.248048    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-72eefe-openshift-default-5c67c7c5f9-dzrjf"
Jul 17 20:45:56.393679 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:45:56.393655    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-72eefe-openshift-default-5c67c7c5f9-dzrjf"]
Jul 17 20:45:56.395506 ip-10-0-141-177 kubenswrapper[2572]: W0717 20:45:56.395482    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01d75fd3_cb65_4956_81c6_3fba18a4b78c.slice/crio-c37beb39c317f94b8210abd0f5ca49c415b8d6de40e9cb29b9c9b94d38f77022 WatchSource:0}: Error finding container c37beb39c317f94b8210abd0f5ca49c415b8d6de40e9cb29b9c9b94d38f77022: Status 404 returned error can't find the container with id c37beb39c317f94b8210abd0f5ca49c415b8d6de40e9cb29b9c9b94d38f77022
Jul 17 20:45:56.397420 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:45:56.397383    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 17 20:45:56.397490 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:45:56.397452    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 17 20:45:56.397490 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:45:56.397485    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 17 20:45:56.753334 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:45:56.753301    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-72eefe-openshift-default-5c67c7c5f9-dzrjf" event={"ID":"01d75fd3-cb65-4956-81c6-3fba18a4b78c","Type":"ContainerStarted","Data":"577bc8f335984d8100e473790d7e85fc8e3ee234b9375cde03895806205b7182"}
Jul 17 20:45:56.753506 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:45:56.753362    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-72eefe-openshift-default-5c67c7c5f9-dzrjf" event={"ID":"01d75fd3-cb65-4956-81c6-3fba18a4b78c","Type":"ContainerStarted","Data":"c37beb39c317f94b8210abd0f5ca49c415b8d6de40e9cb29b9c9b94d38f77022"}
Jul 17 20:45:56.784214 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:45:56.784161    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-72eefe-openshift-default-5c67c7c5f9-dzrjf" podStartSLOduration=1.784146125 podStartE2EDuration="1.784146125s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 20:45:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 20:45:56.781952962 +0000 UTC m=+2981.623448629" watchObservedRunningTime="2026-07-17 20:45:56.784146125 +0000 UTC m=+2981.625641761"
Jul 17 20:45:57.249211 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:45:57.249176    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-72eefe-openshift-default-5c67c7c5f9-dzrjf"
Jul 17 20:45:57.250876 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:45:57.250851    2572 patch_prober.go:28] interesting pod/e2e-shared-a-72eefe-openshift-default-5c67c7c5f9-dzrjf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused" start-of-body=
Jul 17 20:45:57.250983 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:45:57.250896    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-72eefe-openshift-default-5c67c7c5f9-dzrjf" podUID="01d75fd3-cb65-4956-81c6-3fba18a4b78c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused"
Jul 17 20:45:58.047933 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:45:58.047900    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:45:58.253446 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:45:58.253419    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-72eefe-openshift-default-5c67c7c5f9-dzrjf"
Jul 17 20:45:58.763581 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:45:58.763549    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-72eefe-openshift-default-5c67c7c5f9-dzrjf"
Jul 17 20:45:58.764389 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:45:58.764371    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-72eefe-openshift-default-5c67c7c5f9-dzrjf"
Jul 17 20:45:58.924731 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:45:58.924703    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:45:59.051818 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:45:59.051744    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:45:59.147035 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:45:59.146975    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:45:59.658260 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:45:59.658218    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:45:59.762461 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:45:59.762401    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:45:59.861427 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:45:59.861403    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:46:00.160354 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:46:00.160332    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-ad0e32-openshift-default-9b9fd644c-plpzm"
Jul 17 20:46:00.194114 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:46:00.194043    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6f44f845-c345-4ab1-a4ba-26cfef90b608-istiod-ca-cert\") pod \"6f44f845-c345-4ab1-a4ba-26cfef90b608\" (UID: \"6f44f845-c345-4ab1-a4ba-26cfef90b608\") "
Jul 17 20:46:00.194114 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:46:00.194093    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6f44f845-c345-4ab1-a4ba-26cfef90b608-istio-podinfo\") pod \"6f44f845-c345-4ab1-a4ba-26cfef90b608\" (UID: \"6f44f845-c345-4ab1-a4ba-26cfef90b608\") "
Jul 17 20:46:00.194265 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:46:00.194138    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vjwk5\" (UniqueName: \"kubernetes.io/projected/6f44f845-c345-4ab1-a4ba-26cfef90b608-kube-api-access-vjwk5\") pod \"6f44f845-c345-4ab1-a4ba-26cfef90b608\" (UID: \"6f44f845-c345-4ab1-a4ba-26cfef90b608\") "
Jul 17 20:46:00.194265 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:46:00.194180    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6f44f845-c345-4ab1-a4ba-26cfef90b608-istio-envoy\") pod \"6f44f845-c345-4ab1-a4ba-26cfef90b608\" (UID: \"6f44f845-c345-4ab1-a4ba-26cfef90b608\") "
Jul 17 20:46:00.194347 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:46:00.194295    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6f44f845-c345-4ab1-a4ba-26cfef90b608-istio-token\") pod \"6f44f845-c345-4ab1-a4ba-26cfef90b608\" (UID: \"6f44f845-c345-4ab1-a4ba-26cfef90b608\") "
Jul 17 20:46:00.194402 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:46:00.194353    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6f44f845-c345-4ab1-a4ba-26cfef90b608-istio-data\") pod \"6f44f845-c345-4ab1-a4ba-26cfef90b608\" (UID: \"6f44f845-c345-4ab1-a4ba-26cfef90b608\") "
Jul 17 20:46:00.194458 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:46:00.194412    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f44f845-c345-4ab1-a4ba-26cfef90b608-credential-socket\") pod \"6f44f845-c345-4ab1-a4ba-26cfef90b608\" (UID: \"6f44f845-c345-4ab1-a4ba-26cfef90b608\") "
Jul 17 20:46:00.194512 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:46:00.194468    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6f44f845-c345-4ab1-a4ba-26cfef90b608-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6f44f845-c345-4ab1-a4ba-26cfef90b608" (UID: "6f44f845-c345-4ab1-a4ba-26cfef90b608"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 20:46:00.194512 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:46:00.194505    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6f44f845-c345-4ab1-a4ba-26cfef90b608-workload-certs\") pod \"6f44f845-c345-4ab1-a4ba-26cfef90b608\" (UID: \"6f44f845-c345-4ab1-a4ba-26cfef90b608\") "
Jul 17 20:46:00.194617 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:46:00.194534    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f44f845-c345-4ab1-a4ba-26cfef90b608-workload-socket\") pod \"6f44f845-c345-4ab1-a4ba-26cfef90b608\" (UID: \"6f44f845-c345-4ab1-a4ba-26cfef90b608\") "
Jul 17 20:46:00.195221 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:46:00.194909    2572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6f44f845-c345-4ab1-a4ba-26cfef90b608-istiod-ca-cert\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Jul 17 20:46:00.195447 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:46:00.194914    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f44f845-c345-4ab1-a4ba-26cfef90b608-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6f44f845-c345-4ab1-a4ba-26cfef90b608" (UID: "6f44f845-c345-4ab1-a4ba-26cfef90b608"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 20:46:00.195447 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:46:00.195438    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f44f845-c345-4ab1-a4ba-26cfef90b608-istio-data" (OuterVolumeSpecName: "istio-data") pod "6f44f845-c345-4ab1-a4ba-26cfef90b608" (UID: "6f44f845-c345-4ab1-a4ba-26cfef90b608"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 20:46:00.195637 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:46:00.195169    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f44f845-c345-4ab1-a4ba-26cfef90b608-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6f44f845-c345-4ab1-a4ba-26cfef90b608" (UID: "6f44f845-c345-4ab1-a4ba-26cfef90b608"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 20:46:00.195637 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:46:00.195383    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f44f845-c345-4ab1-a4ba-26cfef90b608-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6f44f845-c345-4ab1-a4ba-26cfef90b608" (UID: "6f44f845-c345-4ab1-a4ba-26cfef90b608"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 20:46:00.196579 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:46:00.196557    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f44f845-c345-4ab1-a4ba-26cfef90b608-istio-token" (OuterVolumeSpecName: "istio-token") pod "6f44f845-c345-4ab1-a4ba-26cfef90b608" (UID: "6f44f845-c345-4ab1-a4ba-26cfef90b608"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 20:46:00.196697 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:46:00.196597    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f44f845-c345-4ab1-a4ba-26cfef90b608-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6f44f845-c345-4ab1-a4ba-26cfef90b608" (UID: "6f44f845-c345-4ab1-a4ba-26cfef90b608"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 20:46:00.196779 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:46:00.196763    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6f44f845-c345-4ab1-a4ba-26cfef90b608-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6f44f845-c345-4ab1-a4ba-26cfef90b608" (UID: "6f44f845-c345-4ab1-a4ba-26cfef90b608"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 17 20:46:00.197289 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:46:00.197271    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f44f845-c345-4ab1-a4ba-26cfef90b608-kube-api-access-vjwk5" (OuterVolumeSpecName: "kube-api-access-vjwk5") pod "6f44f845-c345-4ab1-a4ba-26cfef90b608" (UID: "6f44f845-c345-4ab1-a4ba-26cfef90b608"). InnerVolumeSpecName "kube-api-access-vjwk5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 20:46:00.296327 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:46:00.296297    2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6f44f845-c345-4ab1-a4ba-26cfef90b608-istio-token\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Jul 17 20:46:00.296327 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:46:00.296321    2572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6f44f845-c345-4ab1-a4ba-26cfef90b608-istio-data\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Jul 17 20:46:00.296327 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:46:00.296330    2572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f44f845-c345-4ab1-a4ba-26cfef90b608-credential-socket\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Jul 17 20:46:00.296545 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:46:00.296341    2572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6f44f845-c345-4ab1-a4ba-26cfef90b608-workload-certs\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Jul 17 20:46:00.296545 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:46:00.296349    2572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f44f845-c345-4ab1-a4ba-26cfef90b608-workload-socket\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Jul 17 20:46:00.296545 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:46:00.296358    2572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6f44f845-c345-4ab1-a4ba-26cfef90b608-istio-podinfo\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Jul 17 20:46:00.296545 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:46:00.296368    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vjwk5\" (UniqueName: \"kubernetes.io/projected/6f44f845-c345-4ab1-a4ba-26cfef90b608-kube-api-access-vjwk5\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Jul 17 20:46:00.296545 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:46:00.296377    2572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6f44f845-c345-4ab1-a4ba-26cfef90b608-istio-envoy\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Jul 17 20:46:00.780516 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:46:00.780478    2572 generic.go:356] "Generic (PLEG): container finished" podID="6f44f845-c345-4ab1-a4ba-26cfef90b608" containerID="ef30ab166a604e03fcec593658e3aeac1508d91937544f9f8addfebd2ad5dfd8" exitCode=0
Jul 17 20:46:00.781003 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:46:00.780541    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-ad0e32-openshift-default-9b9fd644c-plpzm"
Jul 17 20:46:00.781003 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:46:00.780559    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-ad0e32-openshift-default-9b9fd644c-plpzm" event={"ID":"6f44f845-c345-4ab1-a4ba-26cfef90b608","Type":"ContainerDied","Data":"ef30ab166a604e03fcec593658e3aeac1508d91937544f9f8addfebd2ad5dfd8"}
Jul 17 20:46:00.781003 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:46:00.780640    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-ad0e32-openshift-default-9b9fd644c-plpzm" event={"ID":"6f44f845-c345-4ab1-a4ba-26cfef90b608","Type":"ContainerDied","Data":"7413aa87d7060246d91942b9de2e1f2f6f475642271fa93305a04a3ed0b2be62"}
Jul 17 20:46:00.781003 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:46:00.780663    2572 scope.go:117] "RemoveContainer" containerID="ef30ab166a604e03fcec593658e3aeac1508d91937544f9f8addfebd2ad5dfd8"
Jul 17 20:46:00.790496 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:46:00.790476    2572 scope.go:117] "RemoveContainer" containerID="4bc69339b5fca4f9d858f69d794bbdea77d9a6bf781aae059b6bf7137eecc8b8"
Jul 17 20:46:00.798919 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:46:00.798897    2572 scope.go:117] "RemoveContainer" containerID="ef30ab166a604e03fcec593658e3aeac1508d91937544f9f8addfebd2ad5dfd8"
Jul 17 20:46:00.799191 ip-10-0-141-177 kubenswrapper[2572]: E0717 20:46:00.799173    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ef30ab166a604e03fcec593658e3aeac1508d91937544f9f8addfebd2ad5dfd8\": container with ID starting with ef30ab166a604e03fcec593658e3aeac1508d91937544f9f8addfebd2ad5dfd8 not found: ID does not exist" containerID="ef30ab166a604e03fcec593658e3aeac1508d91937544f9f8addfebd2ad5dfd8"
Jul 17 20:46:00.799257 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:46:00.799201    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ef30ab166a604e03fcec593658e3aeac1508d91937544f9f8addfebd2ad5dfd8"} err="failed to get container status \"ef30ab166a604e03fcec593658e3aeac1508d91937544f9f8addfebd2ad5dfd8\": rpc error: code = NotFound desc = could not find container \"ef30ab166a604e03fcec593658e3aeac1508d91937544f9f8addfebd2ad5dfd8\": container with ID starting with ef30ab166a604e03fcec593658e3aeac1508d91937544f9f8addfebd2ad5dfd8 not found: ID does not exist"
Jul 17 20:46:00.799257 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:46:00.799219    2572 scope.go:117] "RemoveContainer" containerID="4bc69339b5fca4f9d858f69d794bbdea77d9a6bf781aae059b6bf7137eecc8b8"
Jul 17 20:46:00.799554 ip-10-0-141-177 kubenswrapper[2572]: E0717 20:46:00.799526    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4bc69339b5fca4f9d858f69d794bbdea77d9a6bf781aae059b6bf7137eecc8b8\": container with ID starting with 4bc69339b5fca4f9d858f69d794bbdea77d9a6bf781aae059b6bf7137eecc8b8 not found: ID does not exist" containerID="4bc69339b5fca4f9d858f69d794bbdea77d9a6bf781aae059b6bf7137eecc8b8"
Jul 17 20:46:00.799662 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:46:00.799562    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4bc69339b5fca4f9d858f69d794bbdea77d9a6bf781aae059b6bf7137eecc8b8"} err="failed to get container status \"4bc69339b5fca4f9d858f69d794bbdea77d9a6bf781aae059b6bf7137eecc8b8\": rpc error: code = NotFound desc = could not find container \"4bc69339b5fca4f9d858f69d794bbdea77d9a6bf781aae059b6bf7137eecc8b8\": container with ID starting with 4bc69339b5fca4f9d858f69d794bbdea77d9a6bf781aae059b6bf7137eecc8b8 not found: ID does not exist"
Jul 17 20:46:00.802407 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:46:00.802384    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-ad0e32-openshift-default-9b9fd644c-plpzm"]
Jul 17 20:46:00.808837 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:46:00.808818    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-ad0e32-openshift-default-9b9fd644c-plpzm"]
Jul 17 20:46:01.688175 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:46:01.688143    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6f44f845-c345-4ab1-a4ba-26cfef90b608" path="/var/lib/kubelet/pods/6f44f845-c345-4ab1-a4ba-26cfef90b608/volumes"
Jul 17 20:46:03.248456 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:46:03.248421    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:46:03.539502 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:46:03.539405    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:46:03.814764 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:46:03.814684    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-327614-openshift-default-779fd56f47-zwhfc"]
Jul 17 20:46:03.815133 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:46:03.815120    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f44f845-c345-4ab1-a4ba-26cfef90b608" containerName="istio-proxy"
Jul 17 20:46:03.815185 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:46:03.815134    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f44f845-c345-4ab1-a4ba-26cfef90b608" containerName="istio-proxy"
Jul 17 20:46:03.815223 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:46:03.815209    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="6f44f845-c345-4ab1-a4ba-26cfef90b608" containerName="istio-proxy"
Jul 17 20:46:03.815223 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:46:03.815219    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="6f44f845-c345-4ab1-a4ba-26cfef90b608" containerName="istio-proxy"
Jul 17 20:46:03.815289 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:46:03.815227    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="41cfdf1b-df70-4c59-83f3-e096aec9091e" containerName="istio-proxy"
Jul 17 20:46:03.819898 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:46:03.819876    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-327614-openshift-default-779fd56f47-zwhfc"
Jul 17 20:46:03.822303 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:46:03.822285    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-327614-openshift-default-dockercfg-76hl4\""
Jul 17 20:46:03.834169 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:46:03.834143    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-327614-openshift-default-779fd56f47-zwhfc"]
Jul 17 20:46:03.847353 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:46:03.847321    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:46:03.929972 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:46:03.929938    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1d82fa77-d42a-4c95-97c1-d05777f56e42-istio-podinfo\") pod \"e2e-shared-b-327614-openshift-default-779fd56f47-zwhfc\" (UID: \"1d82fa77-d42a-4c95-97c1-d05777f56e42\") " pod="openshift-ingress/e2e-shared-b-327614-openshift-default-779fd56f47-zwhfc"
Jul 17 20:46:03.930196 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:46:03.929992    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d82fa77-d42a-4c95-97c1-d05777f56e42-credential-socket\") pod \"e2e-shared-b-327614-openshift-default-779fd56f47-zwhfc\" (UID: \"1d82fa77-d42a-4c95-97c1-d05777f56e42\") " pod="openshift-ingress/e2e-shared-b-327614-openshift-default-779fd56f47-zwhfc"
Jul 17 20:46:03.930196 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:46:03.930102    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1d82fa77-d42a-4c95-97c1-d05777f56e42-istio-token\") pod \"e2e-shared-b-327614-openshift-default-779fd56f47-zwhfc\" (UID: \"1d82fa77-d42a-4c95-97c1-d05777f56e42\") " pod="openshift-ingress/e2e-shared-b-327614-openshift-default-779fd56f47-zwhfc"
Jul 17 20:46:03.930405 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:46:03.930202    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1d82fa77-d42a-4c95-97c1-d05777f56e42-istio-envoy\") pod \"e2e-shared-b-327614-openshift-default-779fd56f47-zwhfc\" (UID: \"1d82fa77-d42a-4c95-97c1-d05777f56e42\") " pod="openshift-ingress/e2e-shared-b-327614-openshift-default-779fd56f47-zwhfc"
Jul 17 20:46:03.930405 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:46:03.930252    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1d82fa77-d42a-4c95-97c1-d05777f56e42-istio-data\") pod \"e2e-shared-b-327614-openshift-default-779fd56f47-zwhfc\" (UID: \"1d82fa77-d42a-4c95-97c1-d05777f56e42\") " pod="openshift-ingress/e2e-shared-b-327614-openshift-default-779fd56f47-zwhfc"
Jul 17 20:46:03.930405 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:46:03.930275    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cqqql\" (UniqueName: \"kubernetes.io/projected/1d82fa77-d42a-4c95-97c1-d05777f56e42-kube-api-access-cqqql\") pod \"e2e-shared-b-327614-openshift-default-779fd56f47-zwhfc\" (UID: \"1d82fa77-d42a-4c95-97c1-d05777f56e42\") " pod="openshift-ingress/e2e-shared-b-327614-openshift-default-779fd56f47-zwhfc"
Jul 17 20:46:03.930405 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:46:03.930300    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d82fa77-d42a-4c95-97c1-d05777f56e42-workload-socket\") pod \"e2e-shared-b-327614-openshift-default-779fd56f47-zwhfc\" (UID: \"1d82fa77-d42a-4c95-97c1-d05777f56e42\") " pod="openshift-ingress/e2e-shared-b-327614-openshift-default-779fd56f47-zwhfc"
Jul 17 20:46:03.930405 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:46:03.930332    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1d82fa77-d42a-4c95-97c1-d05777f56e42-workload-certs\") pod \"e2e-shared-b-327614-openshift-default-779fd56f47-zwhfc\" (UID: \"1d82fa77-d42a-4c95-97c1-d05777f56e42\") " pod="openshift-ingress/e2e-shared-b-327614-openshift-default-779fd56f47-zwhfc"
Jul 17 20:46:03.930405 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:46:03.930378    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1d82fa77-d42a-4c95-97c1-d05777f56e42-istiod-ca-cert\") pod \"e2e-shared-b-327614-openshift-default-779fd56f47-zwhfc\" (UID: \"1d82fa77-d42a-4c95-97c1-d05777f56e42\") " pod="openshift-ingress/e2e-shared-b-327614-openshift-default-779fd56f47-zwhfc"
Jul 17 20:46:04.030943 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:46:04.030906    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1d82fa77-d42a-4c95-97c1-d05777f56e42-istio-envoy\") pod \"e2e-shared-b-327614-openshift-default-779fd56f47-zwhfc\" (UID: \"1d82fa77-d42a-4c95-97c1-d05777f56e42\") " pod="openshift-ingress/e2e-shared-b-327614-openshift-default-779fd56f47-zwhfc"
Jul 17 20:46:04.031117 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:46:04.030951    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1d82fa77-d42a-4c95-97c1-d05777f56e42-istio-data\") pod \"e2e-shared-b-327614-openshift-default-779fd56f47-zwhfc\" (UID: \"1d82fa77-d42a-4c95-97c1-d05777f56e42\") " pod="openshift-ingress/e2e-shared-b-327614-openshift-default-779fd56f47-zwhfc"
Jul 17 20:46:04.031117 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:46:04.030973    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cqqql\" (UniqueName: \"kubernetes.io/projected/1d82fa77-d42a-4c95-97c1-d05777f56e42-kube-api-access-cqqql\") pod \"e2e-shared-b-327614-openshift-default-779fd56f47-zwhfc\" (UID: \"1d82fa77-d42a-4c95-97c1-d05777f56e42\") " pod="openshift-ingress/e2e-shared-b-327614-openshift-default-779fd56f47-zwhfc"
Jul 17 20:46:04.031214 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:46:04.031123    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d82fa77-d42a-4c95-97c1-d05777f56e42-workload-socket\") pod \"e2e-shared-b-327614-openshift-default-779fd56f47-zwhfc\" (UID: \"1d82fa77-d42a-4c95-97c1-d05777f56e42\") " pod="openshift-ingress/e2e-shared-b-327614-openshift-default-779fd56f47-zwhfc"
Jul 17 20:46:04.031214 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:46:04.031175    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1d82fa77-d42a-4c95-97c1-d05777f56e42-workload-certs\") pod \"e2e-shared-b-327614-openshift-default-779fd56f47-zwhfc\" (UID: \"1d82fa77-d42a-4c95-97c1-d05777f56e42\") " pod="openshift-ingress/e2e-shared-b-327614-openshift-default-779fd56f47-zwhfc"
Jul 17 20:46:04.031315 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:46:04.031221    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1d82fa77-d42a-4c95-97c1-d05777f56e42-istiod-ca-cert\") pod \"e2e-shared-b-327614-openshift-default-779fd56f47-zwhfc\" (UID: \"1d82fa77-d42a-4c95-97c1-d05777f56e42\") " pod="openshift-ingress/e2e-shared-b-327614-openshift-default-779fd56f47-zwhfc"
Jul 17 20:46:04.031315 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:46:04.031260    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1d82fa77-d42a-4c95-97c1-d05777f56e42-istio-podinfo\") pod \"e2e-shared-b-327614-openshift-default-779fd56f47-zwhfc\" (UID: \"1d82fa77-d42a-4c95-97c1-d05777f56e42\") " pod="openshift-ingress/e2e-shared-b-327614-openshift-default-779fd56f47-zwhfc"
Jul 17 20:46:04.031315 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:46:04.031307    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d82fa77-d42a-4c95-97c1-d05777f56e42-credential-socket\") pod \"e2e-shared-b-327614-openshift-default-779fd56f47-zwhfc\" (UID: \"1d82fa77-d42a-4c95-97c1-d05777f56e42\") " pod="openshift-ingress/e2e-shared-b-327614-openshift-default-779fd56f47-zwhfc"
Jul 17 20:46:04.031473 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:46:04.031368    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1d82fa77-d42a-4c95-97c1-d05777f56e42-istio-token\") pod \"e2e-shared-b-327614-openshift-default-779fd56f47-zwhfc\" (UID: \"1d82fa77-d42a-4c95-97c1-d05777f56e42\") " pod="openshift-ingress/e2e-shared-b-327614-openshift-default-779fd56f47-zwhfc"
Jul 17 20:46:04.031473 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:46:04.031404    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1d82fa77-d42a-4c95-97c1-d05777f56e42-istio-data\") pod \"e2e-shared-b-327614-openshift-default-779fd56f47-zwhfc\" (UID: \"1d82fa77-d42a-4c95-97c1-d05777f56e42\") " pod="openshift-ingress/e2e-shared-b-327614-openshift-default-779fd56f47-zwhfc"
Jul 17 20:46:04.031579 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:46:04.031480    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d82fa77-d42a-4c95-97c1-d05777f56e42-workload-socket\") pod \"e2e-shared-b-327614-openshift-default-779fd56f47-zwhfc\" (UID: \"1d82fa77-d42a-4c95-97c1-d05777f56e42\") " pod="openshift-ingress/e2e-shared-b-327614-openshift-default-779fd56f47-zwhfc"
Jul 17 20:46:04.031637 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:46:04.031577    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1d82fa77-d42a-4c95-97c1-d05777f56e42-workload-certs\") pod \"e2e-shared-b-327614-openshift-default-779fd56f47-zwhfc\" (UID: \"1d82fa77-d42a-4c95-97c1-d05777f56e42\") " pod="openshift-ingress/e2e-shared-b-327614-openshift-default-779fd56f47-zwhfc"
Jul 17 20:46:04.031782 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:46:04.031763    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d82fa77-d42a-4c95-97c1-d05777f56e42-credential-socket\") pod \"e2e-shared-b-327614-openshift-default-779fd56f47-zwhfc\" (UID: \"1d82fa77-d42a-4c95-97c1-d05777f56e42\") " pod="openshift-ingress/e2e-shared-b-327614-openshift-default-779fd56f47-zwhfc"
Jul 17 20:46:04.031979 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:46:04.031943    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1d82fa77-d42a-4c95-97c1-d05777f56e42-istiod-ca-cert\") pod \"e2e-shared-b-327614-openshift-default-779fd56f47-zwhfc\" (UID: \"1d82fa77-d42a-4c95-97c1-d05777f56e42\") " pod="openshift-ingress/e2e-shared-b-327614-openshift-default-779fd56f47-zwhfc"
Jul 17 20:46:04.033600 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:46:04.033572    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1d82fa77-d42a-4c95-97c1-d05777f56e42-istio-envoy\") pod \"e2e-shared-b-327614-openshift-default-779fd56f47-zwhfc\" (UID: \"1d82fa77-d42a-4c95-97c1-d05777f56e42\") " pod="openshift-ingress/e2e-shared-b-327614-openshift-default-779fd56f47-zwhfc"
Jul 17 20:46:04.033823 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:46:04.033796    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1d82fa77-d42a-4c95-97c1-d05777f56e42-istio-podinfo\") pod \"e2e-shared-b-327614-openshift-default-779fd56f47-zwhfc\" (UID: \"1d82fa77-d42a-4c95-97c1-d05777f56e42\") " pod="openshift-ingress/e2e-shared-b-327614-openshift-default-779fd56f47-zwhfc"
Jul 17 20:46:04.041836 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:46:04.041798    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1d82fa77-d42a-4c95-97c1-d05777f56e42-istio-token\") pod \"e2e-shared-b-327614-openshift-default-779fd56f47-zwhfc\" (UID: \"1d82fa77-d42a-4c95-97c1-d05777f56e42\") " pod="openshift-ingress/e2e-shared-b-327614-openshift-default-779fd56f47-zwhfc"
Jul 17 20:46:04.042459 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:46:04.042438    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cqqql\" (UniqueName: \"kubernetes.io/projected/1d82fa77-d42a-4c95-97c1-d05777f56e42-kube-api-access-cqqql\") pod \"e2e-shared-b-327614-openshift-default-779fd56f47-zwhfc\" (UID: \"1d82fa77-d42a-4c95-97c1-d05777f56e42\") " pod="openshift-ingress/e2e-shared-b-327614-openshift-default-779fd56f47-zwhfc"
Jul 17 20:46:04.131841 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:46:04.131754    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-327614-openshift-default-779fd56f47-zwhfc"
Jul 17 20:46:04.167595 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:46:04.167564    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:46:04.297078 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:46:04.297040    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-327614-openshift-default-779fd56f47-zwhfc"]
Jul 17 20:46:04.298734 ip-10-0-141-177 kubenswrapper[2572]: W0717 20:46:04.298694    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d82fa77_d42a_4c95_97c1_d05777f56e42.slice/crio-d758128cc955441f34dd91454d6a33d0570bcce212601b01b9efb6594bdae152 WatchSource:0}: Error finding container d758128cc955441f34dd91454d6a33d0570bcce212601b01b9efb6594bdae152: Status 404 returned error can't find the container with id d758128cc955441f34dd91454d6a33d0570bcce212601b01b9efb6594bdae152
Jul 17 20:46:04.300847 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:46:04.300814    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 17 20:46:04.300908 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:46:04.300884    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 17 20:46:04.300949 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:46:04.300911    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 17 20:46:04.804696 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:46:04.804663    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-327614-openshift-default-779fd56f47-zwhfc" event={"ID":"1d82fa77-d42a-4c95-97c1-d05777f56e42","Type":"ContainerStarted","Data":"0188b4a66c1250f25c128476da9e9e63ffcf137642844021cbda4a6f717cc935"}
Jul 17 20:46:04.804905 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:46:04.804727    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-327614-openshift-default-779fd56f47-zwhfc" event={"ID":"1d82fa77-d42a-4c95-97c1-d05777f56e42","Type":"ContainerStarted","Data":"d758128cc955441f34dd91454d6a33d0570bcce212601b01b9efb6594bdae152"}
Jul 17 20:46:05.132431 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:46:05.132338    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-327614-openshift-default-779fd56f47-zwhfc"
Jul 17 20:46:05.142830 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:46:05.142800    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-327614-openshift-default-779fd56f47-zwhfc"
Jul 17 20:46:05.171832 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:46:05.171779    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-327614-openshift-default-779fd56f47-zwhfc" podStartSLOduration=2.171762587 podStartE2EDuration="2.171762587s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 20:46:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 20:46:04.830684836 +0000 UTC m=+2989.672180479" watchObservedRunningTime="2026-07-17 20:46:05.171762587 +0000 UTC m=+2990.013258269"
Jul 17 20:46:05.810520 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:46:05.810489    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-327614-openshift-default-779fd56f47-zwhfc"
Jul 17 20:46:05.811486 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:46:05.811463    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-327614-openshift-default-779fd56f47-zwhfc"
Jul 17 20:46:06.870733 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:46:06.870702    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:46:06.998568 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:46:06.998534    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:46:07.116674 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:46:07.116642    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:46:07.335323 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:46:07.335288    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:46:07.775897 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:46:07.775865    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:46:07.876334 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:46:07.876302    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:46:11.234898 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:46:11.234873    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:46:11.842222 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:46:11.842190    2572 generic.go:356] "Generic (PLEG): container finished" podID="01d75fd3-cb65-4956-81c6-3fba18a4b78c" containerID="577bc8f335984d8100e473790d7e85fc8e3ee234b9375cde03895806205b7182" exitCode=0
Jul 17 20:46:11.842414 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:46:11.842269    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-72eefe-openshift-default-5c67c7c5f9-dzrjf" event={"ID":"01d75fd3-cb65-4956-81c6-3fba18a4b78c","Type":"ContainerDied","Data":"577bc8f335984d8100e473790d7e85fc8e3ee234b9375cde03895806205b7182"}
Jul 17 20:46:11.842657 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:46:11.842644    2572 scope.go:117] "RemoveContainer" containerID="577bc8f335984d8100e473790d7e85fc8e3ee234b9375cde03895806205b7182"
Jul 17 20:46:11.843681 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:46:11.843651    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 17 20:46:11.843777 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:46:11.843735    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 17 20:46:11.843839 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:46:11.843780    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 17 20:46:12.852421 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:46:12.852375    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-72eefe-openshift-default-5c67c7c5f9-dzrjf" event={"ID":"01d75fd3-cb65-4956-81c6-3fba18a4b78c","Type":"ContainerStarted","Data":"29cffa542ddf0f3188da73818ce49ee151da868591ea26629303573123e453f8"}
Jul 17 20:46:13.250381 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:46:13.250282    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-72eefe-openshift-default-5c67c7c5f9-dzrjf"
Jul 17 20:46:13.251724 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:46:13.251694    2572 patch_prober.go:28] interesting pod/e2e-shared-a-72eefe-openshift-default-5c67c7c5f9-dzrjf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused" start-of-body=
Jul 17 20:46:13.251853 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:46:13.251761    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-72eefe-openshift-default-5c67c7c5f9-dzrjf" podUID="01d75fd3-cb65-4956-81c6-3fba18a4b78c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused"
Jul 17 20:46:13.764009 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:46:13.763966    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-72eefe-openshift-default-5c67c7c5f9-dzrjf"
Jul 17 20:46:14.249479 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:46:14.249436    2572 patch_prober.go:28] interesting pod/e2e-shared-a-72eefe-openshift-default-5c67c7c5f9-dzrjf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused" start-of-body=
Jul 17 20:46:14.249976 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:46:14.249503    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-72eefe-openshift-default-5c67c7c5f9-dzrjf" podUID="01d75fd3-cb65-4956-81c6-3fba18a4b78c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused"
Jul 17 20:46:15.248580 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:46:15.248534    2572 patch_prober.go:28] interesting pod/e2e-shared-a-72eefe-openshift-default-5c67c7c5f9-dzrjf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused" start-of-body=
Jul 17 20:46:15.249359 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:46:15.248867    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-72eefe-openshift-default-5c67c7c5f9-dzrjf" podUID="01d75fd3-cb65-4956-81c6-3fba18a4b78c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused"
Jul 17 20:46:16.248579 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:46:16.248526    2572 patch_prober.go:28] interesting pod/e2e-shared-a-72eefe-openshift-default-5c67c7c5f9-dzrjf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused" start-of-body=
Jul 17 20:46:16.249121 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:46:16.248604    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-72eefe-openshift-default-5c67c7c5f9-dzrjf" podUID="01d75fd3-cb65-4956-81c6-3fba18a4b78c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused"
Jul 17 20:46:17.253925 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:46:17.253893    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-72eefe-openshift-default-5c67c7c5f9-dzrjf"
Jul 17 20:46:17.255116 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:46:17.255092    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-72eefe-openshift-default-5c67c7c5f9-dzrjf"
Jul 17 20:46:20.764818 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:46:20.764787    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:46:20.873881 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:46:20.873846    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:46:20.967849 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:46:20.967813    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:46:21.852255 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:46:21.852218    2572 patch_prober.go:28] interesting pod/e2e-shared-b-327614-openshift-default-779fd56f47-zwhfc container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 17 20:46:21.852653 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:46:21.852307    2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-327614-openshift-default-779fd56f47-zwhfc" podUID="1d82fa77-d42a-4c95-97c1-d05777f56e42" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 17 20:46:22.918484 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:46:22.918451    2572 generic.go:356] "Generic (PLEG): container finished" podID="1d82fa77-d42a-4c95-97c1-d05777f56e42" containerID="0188b4a66c1250f25c128476da9e9e63ffcf137642844021cbda4a6f717cc935" exitCode=0
Jul 17 20:46:22.918918 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:46:22.918520    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-327614-openshift-default-779fd56f47-zwhfc" event={"ID":"1d82fa77-d42a-4c95-97c1-d05777f56e42","Type":"ContainerDied","Data":"0188b4a66c1250f25c128476da9e9e63ffcf137642844021cbda4a6f717cc935"}
Jul 17 20:46:22.918964 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:46:22.918944    2572 scope.go:117] "RemoveContainer" containerID="0188b4a66c1250f25c128476da9e9e63ffcf137642844021cbda4a6f717cc935"
Jul 17 20:46:22.919977 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:46:22.919947    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 17 20:46:22.920090 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:46:22.920013    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 17 20:46:22.920090 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:46:22.920053    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 17 20:46:23.925650 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:46:23.925609    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-327614-openshift-default-779fd56f47-zwhfc" event={"ID":"1d82fa77-d42a-4c95-97c1-d05777f56e42","Type":"ContainerStarted","Data":"e34ecd65de9c918923ffc07d39f3210c879fc712014d46237a732ed10e364eb1"}
Jul 17 20:46:24.124356 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:46:24.124321    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:46:24.132633 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:46:24.132530    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-327614-openshift-default-779fd56f47-zwhfc"
Jul 17 20:46:24.132633 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:46:24.132587    2572 patch_prober.go:28] interesting pod/e2e-shared-b-327614-openshift-default-779fd56f47-zwhfc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" start-of-body=
Jul 17 20:46:24.132913 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:46:24.132642    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-327614-openshift-default-779fd56f47-zwhfc" podUID="1d82fa77-d42a-4c95-97c1-d05777f56e42" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused"
Jul 17 20:46:25.132466 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:46:25.132428    2572 patch_prober.go:28] interesting pod/e2e-shared-b-327614-openshift-default-779fd56f47-zwhfc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" start-of-body=
Jul 17 20:46:25.133021 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:46:25.132989    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-327614-openshift-default-779fd56f47-zwhfc" podUID="1d82fa77-d42a-4c95-97c1-d05777f56e42" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused"
Jul 17 20:46:26.138541 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:46:26.138497    2572 patch_prober.go:28] interesting pod/e2e-shared-b-327614-openshift-default-779fd56f47-zwhfc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" start-of-body=
Jul 17 20:46:26.139081 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:46:26.138572    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-327614-openshift-default-779fd56f47-zwhfc" podUID="1d82fa77-d42a-4c95-97c1-d05777f56e42" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused"
Jul 17 20:46:27.132873 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:46:27.132824    2572 patch_prober.go:28] interesting pod/e2e-shared-b-327614-openshift-default-779fd56f47-zwhfc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" start-of-body=
Jul 17 20:46:27.133225 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:46:27.132894    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-327614-openshift-default-779fd56f47-zwhfc" podUID="1d82fa77-d42a-4c95-97c1-d05777f56e42" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused"
Jul 17 20:46:28.136048 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:46:28.136017    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-327614-openshift-default-779fd56f47-zwhfc"
Jul 17 20:46:28.136539 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:46:28.136408    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-327614-openshift-default-779fd56f47-zwhfc"
Jul 17 20:46:28.136930 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:46:28.136909    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-327614-openshift-default-779fd56f47-zwhfc"
Jul 17 20:46:29.647518 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:46:29.647468    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:46:29.763181 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:46:29.763151    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:46:34.286125 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:46:34.286091    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:46:34.391160 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:46:34.391127    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:46:41.284310 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:46:41.284269    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:48:09.274557 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:48:09.274522    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:48:09.357514 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:48:09.357480    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:48:11.143820 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:48:11.143788    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:48:43.352818 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:48:43.352739    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:48:44.207371 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:48:44.207316    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:49:14.703373 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:49:14.703334    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:49:49.824127 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:49:49.824092    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:50:31.416126 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:50:31.416091    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:50:31.511452 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:50:31.511423    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:50:42.307186 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:50:42.307156    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:51:21.414696 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:51:21.414667    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:51:21.515544 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:51:21.515511    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:51:22.378260 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:51:22.378157    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:51:30.518229 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:51:30.518198    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:51:30.619471 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:51:30.619429    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:51:35.042087 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:51:35.042024    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:51:35.168907 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:51:35.168879    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:51:58.154174 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:51:58.154090    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:52:09.337428 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:52:09.337393    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:52:12.033746 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:52:12.033715    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:52:12.133679 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:52:12.133640    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:52:13.203496 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:52:13.203459    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:52:13.911631 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:52:13.911598    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:52:33.641315 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:52:33.641280    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:52:33.742607 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:52:33.742572    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:52:43.663671 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:52:43.663613    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:52:48.199580 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:52:48.199542    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:52:54.313280 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:52:54.313243    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:52:54.511098 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:52:54.511026    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:52:58.895317 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:52:58.895283    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-72eefe-openshift-default-5c67c7c5f9-dzrjf"]
Jul 17 20:52:58.895714 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:52:58.895497    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-72eefe-openshift-default-5c67c7c5f9-dzrjf" podUID="01d75fd3-cb65-4956-81c6-3fba18a4b78c" containerName="istio-proxy" containerID="cri-o://29cffa542ddf0f3188da73818ce49ee151da868591ea26629303573123e453f8" gracePeriod=30
Jul 17 20:52:58.931548 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:52:58.931519    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:52:59.153652 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:52:59.153565    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:52:59.885336 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:52:59.885305    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:52:59.987388 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:52:59.987355    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:53:02.256923 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:53:02.256886    2572 patch_prober.go:28] interesting pod/e2e-shared-a-72eefe-openshift-default-5c67c7c5f9-dzrjf container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 17 20:53:02.257334 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:53:02.256947    2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-72eefe-openshift-default-5c67c7c5f9-dzrjf" podUID="01d75fd3-cb65-4956-81c6-3fba18a4b78c" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 17 20:53:04.158322 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:53:04.158264    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-72eefe-openshift-default-5c67c7c5f9-dzrjf"
Jul 17 20:53:04.252957 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:53:04.252928    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/01d75fd3-cb65-4956-81c6-3fba18a4b78c-credential-socket\") pod \"01d75fd3-cb65-4956-81c6-3fba18a4b78c\" (UID: \"01d75fd3-cb65-4956-81c6-3fba18a4b78c\") "
Jul 17 20:53:04.253157 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:53:04.252968    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/01d75fd3-cb65-4956-81c6-3fba18a4b78c-istio-data\") pod \"01d75fd3-cb65-4956-81c6-3fba18a4b78c\" (UID: \"01d75fd3-cb65-4956-81c6-3fba18a4b78c\") "
Jul 17 20:53:04.253157 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:53:04.253007    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/01d75fd3-cb65-4956-81c6-3fba18a4b78c-istio-token\") pod \"01d75fd3-cb65-4956-81c6-3fba18a4b78c\" (UID: \"01d75fd3-cb65-4956-81c6-3fba18a4b78c\") "
Jul 17 20:53:04.253157 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:53:04.253034    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5jv4c\" (UniqueName: \"kubernetes.io/projected/01d75fd3-cb65-4956-81c6-3fba18a4b78c-kube-api-access-5jv4c\") pod \"01d75fd3-cb65-4956-81c6-3fba18a4b78c\" (UID: \"01d75fd3-cb65-4956-81c6-3fba18a4b78c\") "
Jul 17 20:53:04.253157 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:53:04.253135    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/01d75fd3-cb65-4956-81c6-3fba18a4b78c-istiod-ca-cert\") pod \"01d75fd3-cb65-4956-81c6-3fba18a4b78c\" (UID: \"01d75fd3-cb65-4956-81c6-3fba18a4b78c\") "
Jul 17 20:53:04.253395 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:53:04.253191    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/01d75fd3-cb65-4956-81c6-3fba18a4b78c-workload-certs\") pod \"01d75fd3-cb65-4956-81c6-3fba18a4b78c\" (UID: \"01d75fd3-cb65-4956-81c6-3fba18a4b78c\") "
Jul 17 20:53:04.253395 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:53:04.253243    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/01d75fd3-cb65-4956-81c6-3fba18a4b78c-workload-socket\") pod \"01d75fd3-cb65-4956-81c6-3fba18a4b78c\" (UID: \"01d75fd3-cb65-4956-81c6-3fba18a4b78c\") "
Jul 17 20:53:04.253395 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:53:04.253270    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/01d75fd3-cb65-4956-81c6-3fba18a4b78c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "01d75fd3-cb65-4956-81c6-3fba18a4b78c" (UID: "01d75fd3-cb65-4956-81c6-3fba18a4b78c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 20:53:04.253395 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:53:04.253290    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/01d75fd3-cb65-4956-81c6-3fba18a4b78c-istio-envoy\") pod \"01d75fd3-cb65-4956-81c6-3fba18a4b78c\" (UID: \"01d75fd3-cb65-4956-81c6-3fba18a4b78c\") "
Jul 17 20:53:04.253395 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:53:04.253392    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/01d75fd3-cb65-4956-81c6-3fba18a4b78c-istio-podinfo\") pod \"01d75fd3-cb65-4956-81c6-3fba18a4b78c\" (UID: \"01d75fd3-cb65-4956-81c6-3fba18a4b78c\") "
Jul 17 20:53:04.253632 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:53:04.253517    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/01d75fd3-cb65-4956-81c6-3fba18a4b78c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "01d75fd3-cb65-4956-81c6-3fba18a4b78c" (UID: "01d75fd3-cb65-4956-81c6-3fba18a4b78c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 20:53:04.253632 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:53:04.253581    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/01d75fd3-cb65-4956-81c6-3fba18a4b78c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "01d75fd3-cb65-4956-81c6-3fba18a4b78c" (UID: "01d75fd3-cb65-4956-81c6-3fba18a4b78c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 20:53:04.253768 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:53:04.253748    2572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/01d75fd3-cb65-4956-81c6-3fba18a4b78c-credential-socket\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Jul 17 20:53:04.253903 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:53:04.253789    2572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/01d75fd3-cb65-4956-81c6-3fba18a4b78c-istiod-ca-cert\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Jul 17 20:53:04.253903 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:53:04.253806    2572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/01d75fd3-cb65-4956-81c6-3fba18a4b78c-workload-socket\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Jul 17 20:53:04.253903 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:53:04.253748    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/01d75fd3-cb65-4956-81c6-3fba18a4b78c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "01d75fd3-cb65-4956-81c6-3fba18a4b78c" (UID: "01d75fd3-cb65-4956-81c6-3fba18a4b78c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 20:53:04.253903 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:53:04.253829    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/01d75fd3-cb65-4956-81c6-3fba18a4b78c-istio-data" (OuterVolumeSpecName: "istio-data") pod "01d75fd3-cb65-4956-81c6-3fba18a4b78c" (UID: "01d75fd3-cb65-4956-81c6-3fba18a4b78c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 20:53:04.255406 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:53:04.255377    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/01d75fd3-cb65-4956-81c6-3fba18a4b78c-istio-token" (OuterVolumeSpecName: "istio-token") pod "01d75fd3-cb65-4956-81c6-3fba18a4b78c" (UID: "01d75fd3-cb65-4956-81c6-3fba18a4b78c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 20:53:04.255510 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:53:04.255420    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/01d75fd3-cb65-4956-81c6-3fba18a4b78c-kube-api-access-5jv4c" (OuterVolumeSpecName: "kube-api-access-5jv4c") pod "01d75fd3-cb65-4956-81c6-3fba18a4b78c" (UID: "01d75fd3-cb65-4956-81c6-3fba18a4b78c"). InnerVolumeSpecName "kube-api-access-5jv4c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 20:53:04.255557 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:53:04.255505    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/01d75fd3-cb65-4956-81c6-3fba18a4b78c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "01d75fd3-cb65-4956-81c6-3fba18a4b78c" (UID: "01d75fd3-cb65-4956-81c6-3fba18a4b78c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 20:53:04.255766 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:53:04.255747    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/01d75fd3-cb65-4956-81c6-3fba18a4b78c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "01d75fd3-cb65-4956-81c6-3fba18a4b78c" (UID: "01d75fd3-cb65-4956-81c6-3fba18a4b78c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 17 20:53:04.355250 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:53:04.355219    2572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/01d75fd3-cb65-4956-81c6-3fba18a4b78c-istio-data\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Jul 17 20:53:04.355250 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:53:04.355244    2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/01d75fd3-cb65-4956-81c6-3fba18a4b78c-istio-token\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Jul 17 20:53:04.355250 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:53:04.355254    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5jv4c\" (UniqueName: \"kubernetes.io/projected/01d75fd3-cb65-4956-81c6-3fba18a4b78c-kube-api-access-5jv4c\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Jul 17 20:53:04.355442 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:53:04.355264    2572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/01d75fd3-cb65-4956-81c6-3fba18a4b78c-workload-certs\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Jul 17 20:53:04.355442 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:53:04.355273    2572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/01d75fd3-cb65-4956-81c6-3fba18a4b78c-istio-envoy\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Jul 17 20:53:04.355442 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:53:04.355281    2572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/01d75fd3-cb65-4956-81c6-3fba18a4b78c-istio-podinfo\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Jul 17 20:53:04.951893 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:53:04.951857    2572 generic.go:356] "Generic (PLEG): container finished" podID="01d75fd3-cb65-4956-81c6-3fba18a4b78c" containerID="29cffa542ddf0f3188da73818ce49ee151da868591ea26629303573123e453f8" exitCode=0
Jul 17 20:53:04.952108 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:53:04.951912    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-72eefe-openshift-default-5c67c7c5f9-dzrjf"
Jul 17 20:53:04.952108 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:53:04.951943    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-72eefe-openshift-default-5c67c7c5f9-dzrjf" event={"ID":"01d75fd3-cb65-4956-81c6-3fba18a4b78c","Type":"ContainerDied","Data":"29cffa542ddf0f3188da73818ce49ee151da868591ea26629303573123e453f8"}
Jul 17 20:53:04.952108 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:53:04.951997    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-72eefe-openshift-default-5c67c7c5f9-dzrjf" event={"ID":"01d75fd3-cb65-4956-81c6-3fba18a4b78c","Type":"ContainerDied","Data":"c37beb39c317f94b8210abd0f5ca49c415b8d6de40e9cb29b9c9b94d38f77022"}
Jul 17 20:53:04.952108 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:53:04.952020    2572 scope.go:117] "RemoveContainer" containerID="29cffa542ddf0f3188da73818ce49ee151da868591ea26629303573123e453f8"
Jul 17 20:53:04.962021 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:53:04.962000    2572 scope.go:117] "RemoveContainer" containerID="577bc8f335984d8100e473790d7e85fc8e3ee234b9375cde03895806205b7182"
Jul 17 20:53:04.970088 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:53:04.970059    2572 scope.go:117] "RemoveContainer" containerID="29cffa542ddf0f3188da73818ce49ee151da868591ea26629303573123e453f8"
Jul 17 20:53:04.970315 ip-10-0-141-177 kubenswrapper[2572]: E0717 20:53:04.970298    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"29cffa542ddf0f3188da73818ce49ee151da868591ea26629303573123e453f8\": container with ID starting with 29cffa542ddf0f3188da73818ce49ee151da868591ea26629303573123e453f8 not found: ID does not exist" containerID="29cffa542ddf0f3188da73818ce49ee151da868591ea26629303573123e453f8"
Jul 17 20:53:04.970357 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:53:04.970322    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"29cffa542ddf0f3188da73818ce49ee151da868591ea26629303573123e453f8"} err="failed to get container status \"29cffa542ddf0f3188da73818ce49ee151da868591ea26629303573123e453f8\": rpc error: code = NotFound desc = could not find container \"29cffa542ddf0f3188da73818ce49ee151da868591ea26629303573123e453f8\": container with ID starting with 29cffa542ddf0f3188da73818ce49ee151da868591ea26629303573123e453f8 not found: ID does not exist"
Jul 17 20:53:04.970357 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:53:04.970338    2572 scope.go:117] "RemoveContainer" containerID="577bc8f335984d8100e473790d7e85fc8e3ee234b9375cde03895806205b7182"
Jul 17 20:53:04.970582 ip-10-0-141-177 kubenswrapper[2572]: E0717 20:53:04.970564    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"577bc8f335984d8100e473790d7e85fc8e3ee234b9375cde03895806205b7182\": container with ID starting with 577bc8f335984d8100e473790d7e85fc8e3ee234b9375cde03895806205b7182 not found: ID does not exist" containerID="577bc8f335984d8100e473790d7e85fc8e3ee234b9375cde03895806205b7182"
Jul 17 20:53:04.970638 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:53:04.970590    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"577bc8f335984d8100e473790d7e85fc8e3ee234b9375cde03895806205b7182"} err="failed to get container status \"577bc8f335984d8100e473790d7e85fc8e3ee234b9375cde03895806205b7182\": rpc error: code = NotFound desc = could not find container \"577bc8f335984d8100e473790d7e85fc8e3ee234b9375cde03895806205b7182\": container with ID starting with 577bc8f335984d8100e473790d7e85fc8e3ee234b9375cde03895806205b7182 not found: ID does not exist"
Jul 17 20:53:04.979485 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:53:04.979464    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-72eefe-openshift-default-5c67c7c5f9-dzrjf"]
Jul 17 20:53:04.983217 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:53:04.983198    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-72eefe-openshift-default-5c67c7c5f9-dzrjf"]
Jul 17 20:53:05.687906 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:53:05.687875    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="01d75fd3-cb65-4956-81c6-3fba18a4b78c" path="/var/lib/kubelet/pods/01d75fd3-cb65-4956-81c6-3fba18a4b78c/volumes"
Jul 17 20:53:09.907759 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:53:09.907686    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:53:14.366368 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:53:14.366334    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:53:20.817171 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:53:20.817116    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:53:20.919782 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:53:20.919743    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:53:25.017053 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:53:25.017023    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-327614-openshift-default-779fd56f47-zwhfc"]
Jul 17 20:53:25.017492 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:53:25.017260    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-327614-openshift-default-779fd56f47-zwhfc" podUID="1d82fa77-d42a-4c95-97c1-d05777f56e42" containerName="istio-proxy" containerID="cri-o://e34ecd65de9c918923ffc07d39f3210c879fc712014d46237a732ed10e364eb1" gracePeriod=30
Jul 17 20:53:25.037700 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:53:25.037674    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:53:25.264777 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:53:25.264740    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:53:28.139064 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:53:28.139028    2572 patch_prober.go:28] interesting pod/e2e-shared-b-327614-openshift-default-779fd56f47-zwhfc container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 17 20:53:28.139468 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:53:28.139104    2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-327614-openshift-default-779fd56f47-zwhfc" podUID="1d82fa77-d42a-4c95-97c1-d05777f56e42" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 17 20:53:30.273452 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:53:30.273423    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-327614-openshift-default-779fd56f47-zwhfc"
Jul 17 20:53:30.396347 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:53:30.396270    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cqqql\" (UniqueName: \"kubernetes.io/projected/1d82fa77-d42a-4c95-97c1-d05777f56e42-kube-api-access-cqqql\") pod \"1d82fa77-d42a-4c95-97c1-d05777f56e42\" (UID: \"1d82fa77-d42a-4c95-97c1-d05777f56e42\") "
Jul 17 20:53:30.396347 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:53:30.396308    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d82fa77-d42a-4c95-97c1-d05777f56e42-credential-socket\") pod \"1d82fa77-d42a-4c95-97c1-d05777f56e42\" (UID: \"1d82fa77-d42a-4c95-97c1-d05777f56e42\") "
Jul 17 20:53:30.396347 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:53:30.396336    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1d82fa77-d42a-4c95-97c1-d05777f56e42-istio-envoy\") pod \"1d82fa77-d42a-4c95-97c1-d05777f56e42\" (UID: \"1d82fa77-d42a-4c95-97c1-d05777f56e42\") "
Jul 17 20:53:30.396586 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:53:30.396418    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1d82fa77-d42a-4c95-97c1-d05777f56e42-istio-podinfo\") pod \"1d82fa77-d42a-4c95-97c1-d05777f56e42\" (UID: \"1d82fa77-d42a-4c95-97c1-d05777f56e42\") "
Jul 17 20:53:30.396586 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:53:30.396471    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1d82fa77-d42a-4c95-97c1-d05777f56e42-workload-certs\") pod \"1d82fa77-d42a-4c95-97c1-d05777f56e42\" (UID: \"1d82fa77-d42a-4c95-97c1-d05777f56e42\") "
Jul 17 20:53:30.396586 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:53:30.396495    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1d82fa77-d42a-4c95-97c1-d05777f56e42-istiod-ca-cert\") pod \"1d82fa77-d42a-4c95-97c1-d05777f56e42\" (UID: \"1d82fa77-d42a-4c95-97c1-d05777f56e42\") "
Jul 17 20:53:30.396586 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:53:30.396532    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1d82fa77-d42a-4c95-97c1-d05777f56e42-istio-token\") pod \"1d82fa77-d42a-4c95-97c1-d05777f56e42\" (UID: \"1d82fa77-d42a-4c95-97c1-d05777f56e42\") "
Jul 17 20:53:30.396790 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:53:30.396588    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1d82fa77-d42a-4c95-97c1-d05777f56e42-istio-data\") pod \"1d82fa77-d42a-4c95-97c1-d05777f56e42\" (UID: \"1d82fa77-d42a-4c95-97c1-d05777f56e42\") "
Jul 17 20:53:30.396790 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:53:30.396636    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d82fa77-d42a-4c95-97c1-d05777f56e42-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "1d82fa77-d42a-4c95-97c1-d05777f56e42" (UID: "1d82fa77-d42a-4c95-97c1-d05777f56e42"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 20:53:30.396790 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:53:30.396680    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d82fa77-d42a-4c95-97c1-d05777f56e42-workload-socket\") pod \"1d82fa77-d42a-4c95-97c1-d05777f56e42\" (UID: \"1d82fa77-d42a-4c95-97c1-d05777f56e42\") "
Jul 17 20:53:30.396944 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:53:30.396813    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d82fa77-d42a-4c95-97c1-d05777f56e42-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "1d82fa77-d42a-4c95-97c1-d05777f56e42" (UID: "1d82fa77-d42a-4c95-97c1-d05777f56e42"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 20:53:30.396944 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:53:30.396889    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1d82fa77-d42a-4c95-97c1-d05777f56e42-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "1d82fa77-d42a-4c95-97c1-d05777f56e42" (UID: "1d82fa77-d42a-4c95-97c1-d05777f56e42"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 20:53:30.397279 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:53:30.397107    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d82fa77-d42a-4c95-97c1-d05777f56e42-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "1d82fa77-d42a-4c95-97c1-d05777f56e42" (UID: "1d82fa77-d42a-4c95-97c1-d05777f56e42"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 20:53:30.397279 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:53:30.397209    2572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d82fa77-d42a-4c95-97c1-d05777f56e42-workload-socket\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Jul 17 20:53:30.397279 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:53:30.397231    2572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d82fa77-d42a-4c95-97c1-d05777f56e42-credential-socket\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Jul 17 20:53:30.397279 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:53:30.397245    2572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1d82fa77-d42a-4c95-97c1-d05777f56e42-workload-certs\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Jul 17 20:53:30.397279 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:53:30.397257    2572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1d82fa77-d42a-4c95-97c1-d05777f56e42-istiod-ca-cert\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Jul 17 20:53:30.397628 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:53:30.397427    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d82fa77-d42a-4c95-97c1-d05777f56e42-istio-data" (OuterVolumeSpecName: "istio-data") pod "1d82fa77-d42a-4c95-97c1-d05777f56e42" (UID: "1d82fa77-d42a-4c95-97c1-d05777f56e42"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 20:53:30.398719 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:53:30.398697    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d82fa77-d42a-4c95-97c1-d05777f56e42-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "1d82fa77-d42a-4c95-97c1-d05777f56e42" (UID: "1d82fa77-d42a-4c95-97c1-d05777f56e42"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 20:53:30.398884 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:53:30.398869    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1d82fa77-d42a-4c95-97c1-d05777f56e42-istio-token" (OuterVolumeSpecName: "istio-token") pod "1d82fa77-d42a-4c95-97c1-d05777f56e42" (UID: "1d82fa77-d42a-4c95-97c1-d05777f56e42"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 20:53:30.398996 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:53:30.398977    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1d82fa77-d42a-4c95-97c1-d05777f56e42-kube-api-access-cqqql" (OuterVolumeSpecName: "kube-api-access-cqqql") pod "1d82fa77-d42a-4c95-97c1-d05777f56e42" (UID: "1d82fa77-d42a-4c95-97c1-d05777f56e42"). InnerVolumeSpecName "kube-api-access-cqqql". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 20:53:30.399053 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:53:30.398978    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1d82fa77-d42a-4c95-97c1-d05777f56e42-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "1d82fa77-d42a-4c95-97c1-d05777f56e42" (UID: "1d82fa77-d42a-4c95-97c1-d05777f56e42"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 17 20:53:30.497981 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:53:30.497952    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cqqql\" (UniqueName: \"kubernetes.io/projected/1d82fa77-d42a-4c95-97c1-d05777f56e42-kube-api-access-cqqql\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Jul 17 20:53:30.497981 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:53:30.497976    2572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1d82fa77-d42a-4c95-97c1-d05777f56e42-istio-envoy\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Jul 17 20:53:30.497981 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:53:30.497985    2572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1d82fa77-d42a-4c95-97c1-d05777f56e42-istio-podinfo\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Jul 17 20:53:30.498203 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:53:30.497992    2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1d82fa77-d42a-4c95-97c1-d05777f56e42-istio-token\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Jul 17 20:53:30.498203 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:53:30.498002    2572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1d82fa77-d42a-4c95-97c1-d05777f56e42-istio-data\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Jul 17 20:53:31.081368 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:53:31.081336    2572 generic.go:356] "Generic (PLEG): container finished" podID="1d82fa77-d42a-4c95-97c1-d05777f56e42" containerID="e34ecd65de9c918923ffc07d39f3210c879fc712014d46237a732ed10e364eb1" exitCode=0
Jul 17 20:53:31.081537 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:53:31.081389    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-327614-openshift-default-779fd56f47-zwhfc"
Jul 17 20:53:31.081537 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:53:31.081423    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-327614-openshift-default-779fd56f47-zwhfc" event={"ID":"1d82fa77-d42a-4c95-97c1-d05777f56e42","Type":"ContainerDied","Data":"e34ecd65de9c918923ffc07d39f3210c879fc712014d46237a732ed10e364eb1"}
Jul 17 20:53:31.081537 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:53:31.081484    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-327614-openshift-default-779fd56f47-zwhfc" event={"ID":"1d82fa77-d42a-4c95-97c1-d05777f56e42","Type":"ContainerDied","Data":"d758128cc955441f34dd91454d6a33d0570bcce212601b01b9efb6594bdae152"}
Jul 17 20:53:31.081537 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:53:31.081514    2572 scope.go:117] "RemoveContainer" containerID="e34ecd65de9c918923ffc07d39f3210c879fc712014d46237a732ed10e364eb1"
Jul 17 20:53:31.091740 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:53:31.091726    2572 scope.go:117] "RemoveContainer" containerID="0188b4a66c1250f25c128476da9e9e63ffcf137642844021cbda4a6f717cc935"
Jul 17 20:53:31.099683 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:53:31.099667    2572 scope.go:117] "RemoveContainer" containerID="e34ecd65de9c918923ffc07d39f3210c879fc712014d46237a732ed10e364eb1"
Jul 17 20:53:31.099917 ip-10-0-141-177 kubenswrapper[2572]: E0717 20:53:31.099900    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e34ecd65de9c918923ffc07d39f3210c879fc712014d46237a732ed10e364eb1\": container with ID starting with e34ecd65de9c918923ffc07d39f3210c879fc712014d46237a732ed10e364eb1 not found: ID does not exist" containerID="e34ecd65de9c918923ffc07d39f3210c879fc712014d46237a732ed10e364eb1"
Jul 17 20:53:31.099987 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:53:31.099928    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e34ecd65de9c918923ffc07d39f3210c879fc712014d46237a732ed10e364eb1"} err="failed to get container status \"e34ecd65de9c918923ffc07d39f3210c879fc712014d46237a732ed10e364eb1\": rpc error: code = NotFound desc = could not find container \"e34ecd65de9c918923ffc07d39f3210c879fc712014d46237a732ed10e364eb1\": container with ID starting with e34ecd65de9c918923ffc07d39f3210c879fc712014d46237a732ed10e364eb1 not found: ID does not exist"
Jul 17 20:53:31.099987 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:53:31.099951    2572 scope.go:117] "RemoveContainer" containerID="0188b4a66c1250f25c128476da9e9e63ffcf137642844021cbda4a6f717cc935"
Jul 17 20:53:31.100616 ip-10-0-141-177 kubenswrapper[2572]: E0717 20:53:31.100597    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0188b4a66c1250f25c128476da9e9e63ffcf137642844021cbda4a6f717cc935\": container with ID starting with 0188b4a66c1250f25c128476da9e9e63ffcf137642844021cbda4a6f717cc935 not found: ID does not exist" containerID="0188b4a66c1250f25c128476da9e9e63ffcf137642844021cbda4a6f717cc935"
Jul 17 20:53:31.100696 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:53:31.100623    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0188b4a66c1250f25c128476da9e9e63ffcf137642844021cbda4a6f717cc935"} err="failed to get container status \"0188b4a66c1250f25c128476da9e9e63ffcf137642844021cbda4a6f717cc935\": rpc error: code = NotFound desc = could not find container \"0188b4a66c1250f25c128476da9e9e63ffcf137642844021cbda4a6f717cc935\": container with ID starting with 0188b4a66c1250f25c128476da9e9e63ffcf137642844021cbda4a6f717cc935 not found: ID does not exist"
Jul 17 20:53:31.108106 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:53:31.108083    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-327614-openshift-default-779fd56f47-zwhfc"]
Jul 17 20:53:31.109728 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:53:31.109712    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-587c8b5647-6q4z2_0f2a06e4-1a7f-4ac5-8e81-f5f531c8a405/manager/0.log"
Jul 17 20:53:31.110915 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:53:31.110899    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-327614-openshift-default-779fd56f47-zwhfc"]
Jul 17 20:53:31.583948 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:53:31.583922    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-67bdc7ddc4-8w6gc_93200790-ba58-4f95-a32c-9e90388a7a50/copy-manifests/0.log"
Jul 17 20:53:31.590675 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:53:31.590655    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-67bdc7ddc4-8w6gc_93200790-ba58-4f95-a32c-9e90388a7a50/manager/0.log"
Jul 17 20:53:31.687878 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:53:31.687849    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1d82fa77-d42a-4c95-97c1-d05777f56e42" path="/var/lib/kubelet/pods/1d82fa77-d42a-4c95-97c1-d05777f56e42/volumes"
Jul 17 20:53:32.053536 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:53:32.053506    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-c89698cdd-xpc48_f1674f3c-ee0c-4d64-90a5-c6032638e4de/maas-api/0.log"
Jul 17 20:53:33.618929 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:53:33.618903    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-tnnhq_37950c44-17f5-4ad8-a942-f0552088189d/postgres/0.log"
Jul 17 20:53:34.976631 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:53:34.976600    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-xm6z5_f4c42bc9-1ec6-4675-8741-966bde69c503/manager/0.log"
Jul 17 20:53:35.081395 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:53:35.081370    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-pq6pt_ff23bc85-800a-48e3-b4aa-57c576dab652/manager/0.log"
Jul 17 20:53:35.307905 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:53:35.307877    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-tn9zq_04c98bd2-cfbf-46ff-b46e-26bf47d77323/registry-server/0.log"
Jul 17 20:53:35.984471 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:53:35.984446    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf449w7z_b045a938-3e18-4ad7-9da2-4fdcfa627a54/istio-proxy/0.log"
Jul 17 20:53:36.433100 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:53:36.433059    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-22gnc_4066ca84-39d8-4dfa-8b00-a3a11228aae4/istio-proxy/1.log"
Jul 17 20:53:36.550839 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:53:36.550809    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-7vbff_de96ce09-93d3-44d5-b157-1c8a47432407/payload-pre-processing/0.log"
Jul 17 20:53:37.117522 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:53:37.117493    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-2h8vp_d85900f6-eedb-4e03-ae70-974f2c09a516/main/0.log"
Jul 17 20:53:37.237228 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:53:37.237201    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-dl5x8_cb4aef12-4a25-467b-8166-93351e924785/main/0.log"
Jul 17 20:53:37.465567 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:53:37.465467    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbxlx28_93792ed5-d76a-434a-bd42-546afe5467e3/main/0.log"
Jul 17 20:53:43.392571 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:53:43.392535    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:53:43.469816 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:53:43.469783    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:53:46.312566 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:53:46.312538    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-nl98s_ad6bcb27-6b22-4d90-9c1a-065a78a17392/global-pull-secret-syncer/0.log"
Jul 17 20:53:46.408085 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:53:46.408037    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log"
Jul 17 20:53:46.499958 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:53:46.499936    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-141-177.ec2.internal_5d0ab5ce403b2c7eaf614aea64cc85b0/haproxy/0.log"
Jul 17 20:53:51.144512 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:53:51.144470    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-xm6z5_f4c42bc9-1ec6-4675-8741-966bde69c503/manager/0.log"
Jul 17 20:53:51.175410 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:53:51.175384    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-pq6pt_ff23bc85-800a-48e3-b4aa-57c576dab652/manager/0.log"
Jul 17 20:53:51.273875 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:53:51.273854    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-tn9zq_04c98bd2-cfbf-46ff-b46e-26bf47d77323/registry-server/0.log"
Jul 17 20:53:53.344185 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:53:53.344105    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-5db89769cd-5n4bf_9ac0468a-db31-41bf-ad46-faa4e081b565/metrics-server/0.log"
Jul 17 20:53:53.590421 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:53:53.590392    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pwdw7_a789aa14-a399-4ed6-886f-73a3813977db/node-exporter/0.log"
Jul 17 20:53:53.619790 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:53:53.619730    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pwdw7_a789aa14-a399-4ed6-886f-73a3813977db/kube-rbac-proxy/0.log"
Jul 17 20:53:53.641497 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:53:53.641477    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pwdw7_a789aa14-a399-4ed6-886f-73a3813977db/init-textfile/0.log"
Jul 17 20:53:53.676947 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:53:53.676928    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-txg94_a00d0a24-fedf-442b-93f4-661e223573b8/kube-rbac-proxy-main/0.log"
Jul 17 20:53:53.701704 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:53:53.701682    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-txg94_a00d0a24-fedf-442b-93f4-661e223573b8/kube-rbac-proxy-self/0.log"
Jul 17 20:53:53.729312 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:53:53.729296    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-txg94_a00d0a24-fedf-442b-93f4-661e223573b8/openshift-state-metrics/0.log"
Jul 17 20:53:53.782313 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:53:53.782292    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_febd94c4-f75a-440d-a9f3-4063865393e3/prometheus/0.log"
Jul 17 20:53:53.818598 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:53:53.818580    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_febd94c4-f75a-440d-a9f3-4063865393e3/config-reloader/0.log"
Jul 17 20:53:53.861326 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:53:53.861301    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_febd94c4-f75a-440d-a9f3-4063865393e3/thanos-sidecar/0.log"
Jul 17 20:53:53.895357 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:53:53.895292    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_febd94c4-f75a-440d-a9f3-4063865393e3/kube-rbac-proxy-web/0.log"
Jul 17 20:53:53.924589 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:53:53.924572    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_febd94c4-f75a-440d-a9f3-4063865393e3/kube-rbac-proxy/0.log"
Jul 17 20:53:53.950810 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:53:53.950790    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_febd94c4-f75a-440d-a9f3-4063865393e3/kube-rbac-proxy-thanos/0.log"
Jul 17 20:53:53.977406 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:53:53.977389    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_febd94c4-f75a-440d-a9f3-4063865393e3/init-config-reloader/0.log"
Jul 17 20:53:54.058888 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:53:54.058862    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-85574b5f49-bn2zk_155ab2ab-7deb-42d0-ba74-e443cb9f48a0/prometheus-operator-admission-webhook/0.log"
Jul 17 20:53:54.183315 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:53:54.183250    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5b5df5cf5f-6d7xn_f8a07ea9-cdd2-4019-872f-a9e3596e2e56/thanos-query/0.log"
Jul 17 20:53:54.207479 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:53:54.207454    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5b5df5cf5f-6d7xn_f8a07ea9-cdd2-4019-872f-a9e3596e2e56/kube-rbac-proxy-web/0.log"
Jul 17 20:53:54.229006 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:53:54.228986    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5b5df5cf5f-6d7xn_f8a07ea9-cdd2-4019-872f-a9e3596e2e56/kube-rbac-proxy/0.log"
Jul 17 20:53:54.251369 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:53:54.251350    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5b5df5cf5f-6d7xn_f8a07ea9-cdd2-4019-872f-a9e3596e2e56/prom-label-proxy/0.log"
Jul 17 20:53:54.273537 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:53:54.273514    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5b5df5cf5f-6d7xn_f8a07ea9-cdd2-4019-872f-a9e3596e2e56/kube-rbac-proxy-rules/0.log"
Jul 17 20:53:54.298527 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:53:54.298509    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5b5df5cf5f-6d7xn_f8a07ea9-cdd2-4019-872f-a9e3596e2e56/kube-rbac-proxy-metrics/0.log"
Jul 17 20:53:56.870494 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:53:56.870459    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-88bcd8cf7-wrcr8_41f9908d-ea61-4b65-8bb3-29894bf05754/console/0.log"
Jul 17 20:53:56.914479 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:53:56.914458    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-5bc67dcd46-fzddp_9e89f28b-5ef8-4da9-995d-418797b888aa/download-server/0.log"
Jul 17 20:53:57.236259 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:53:57.236221    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-wlh9g/perf-node-gather-daemonset-5bq9t"]
Jul 17 20:53:57.236624 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:53:57.236611    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="01d75fd3-cb65-4956-81c6-3fba18a4b78c" containerName="istio-proxy"
Jul 17 20:53:57.236671 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:53:57.236626    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="01d75fd3-cb65-4956-81c6-3fba18a4b78c" containerName="istio-proxy"
Jul 17 20:53:57.236671 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:53:57.236636    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f44f845-c345-4ab1-a4ba-26cfef90b608" containerName="istio-proxy"
Jul 17 20:53:57.236671 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:53:57.236642    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f44f845-c345-4ab1-a4ba-26cfef90b608" containerName="istio-proxy"
Jul 17 20:53:57.236671 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:53:57.236657    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1d82fa77-d42a-4c95-97c1-d05777f56e42" containerName="istio-proxy"
Jul 17 20:53:57.236671 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:53:57.236662    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="1d82fa77-d42a-4c95-97c1-d05777f56e42" containerName="istio-proxy"
Jul 17 20:53:57.236821 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:53:57.236737    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="1d82fa77-d42a-4c95-97c1-d05777f56e42" containerName="istio-proxy"
Jul 17 20:53:57.236821 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:53:57.236745    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="01d75fd3-cb65-4956-81c6-3fba18a4b78c" containerName="istio-proxy"
Jul 17 20:53:57.236821 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:53:57.236754    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="01d75fd3-cb65-4956-81c6-3fba18a4b78c" containerName="istio-proxy"
Jul 17 20:53:57.241541 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:53:57.241525    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wlh9g/perf-node-gather-daemonset-5bq9t"
Jul 17 20:53:57.245299 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:53:57.245277    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-wlh9g\"/\"openshift-service-ca.crt\""
Jul 17 20:53:57.245668 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:53:57.245646    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-wlh9g\"/\"default-dockercfg-kgm6k\""
Jul 17 20:53:57.246192 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:53:57.246174    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-wlh9g\"/\"kube-root-ca.crt\""
Jul 17 20:53:57.273149 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:53:57.273124    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wlh9g/perf-node-gather-daemonset-5bq9t"]
Jul 17 20:53:57.335623 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:53:57.335593    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/fffe8819-5453-4ece-942b-4c95dd2c0f10-podres\") pod \"perf-node-gather-daemonset-5bq9t\" (UID: \"fffe8819-5453-4ece-942b-4c95dd2c0f10\") " pod="openshift-must-gather-wlh9g/perf-node-gather-daemonset-5bq9t"
Jul 17 20:53:57.335810 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:53:57.335626    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fffe8819-5453-4ece-942b-4c95dd2c0f10-sys\") pod \"perf-node-gather-daemonset-5bq9t\" (UID: \"fffe8819-5453-4ece-942b-4c95dd2c0f10\") " pod="openshift-must-gather-wlh9g/perf-node-gather-daemonset-5bq9t"
Jul 17 20:53:57.335810 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:53:57.335669    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fffe8819-5453-4ece-942b-4c95dd2c0f10-lib-modules\") pod \"perf-node-gather-daemonset-5bq9t\" (UID: \"fffe8819-5453-4ece-942b-4c95dd2c0f10\") " pod="openshift-must-gather-wlh9g/perf-node-gather-daemonset-5bq9t"
Jul 17 20:53:57.335810 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:53:57.335735    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zrhtz\" (UniqueName: \"kubernetes.io/projected/fffe8819-5453-4ece-942b-4c95dd2c0f10-kube-api-access-zrhtz\") pod \"perf-node-gather-daemonset-5bq9t\" (UID: \"fffe8819-5453-4ece-942b-4c95dd2c0f10\") " pod="openshift-must-gather-wlh9g/perf-node-gather-daemonset-5bq9t"
Jul 17 20:53:57.335810 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:53:57.335795    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/fffe8819-5453-4ece-942b-4c95dd2c0f10-proc\") pod \"perf-node-gather-daemonset-5bq9t\" (UID: \"fffe8819-5453-4ece-942b-4c95dd2c0f10\") " pod="openshift-must-gather-wlh9g/perf-node-gather-daemonset-5bq9t"
Jul 17 20:53:57.436533 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:53:57.436495    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fffe8819-5453-4ece-942b-4c95dd2c0f10-lib-modules\") pod \"perf-node-gather-daemonset-5bq9t\" (UID: \"fffe8819-5453-4ece-942b-4c95dd2c0f10\") " pod="openshift-must-gather-wlh9g/perf-node-gather-daemonset-5bq9t"
Jul 17 20:53:57.436736 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:53:57.436557    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zrhtz\" (UniqueName: \"kubernetes.io/projected/fffe8819-5453-4ece-942b-4c95dd2c0f10-kube-api-access-zrhtz\") pod \"perf-node-gather-daemonset-5bq9t\" (UID: \"fffe8819-5453-4ece-942b-4c95dd2c0f10\") " pod="openshift-must-gather-wlh9g/perf-node-gather-daemonset-5bq9t"
Jul 17 20:53:57.436736 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:53:57.436594    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/fffe8819-5453-4ece-942b-4c95dd2c0f10-proc\") pod \"perf-node-gather-daemonset-5bq9t\" (UID: \"fffe8819-5453-4ece-942b-4c95dd2c0f10\") " pod="openshift-must-gather-wlh9g/perf-node-gather-daemonset-5bq9t"
Jul 17 20:53:57.436736 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:53:57.436673    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/fffe8819-5453-4ece-942b-4c95dd2c0f10-podres\") pod \"perf-node-gather-daemonset-5bq9t\" (UID: \"fffe8819-5453-4ece-942b-4c95dd2c0f10\") " pod="openshift-must-gather-wlh9g/perf-node-gather-daemonset-5bq9t"
Jul 17 20:53:57.436736 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:53:57.436694    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fffe8819-5453-4ece-942b-4c95dd2c0f10-lib-modules\") pod \"perf-node-gather-daemonset-5bq9t\" (UID: \"fffe8819-5453-4ece-942b-4c95dd2c0f10\") " pod="openshift-must-gather-wlh9g/perf-node-gather-daemonset-5bq9t"
Jul 17 20:53:57.436736 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:53:57.436701    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fffe8819-5453-4ece-942b-4c95dd2c0f10-sys\") pod \"perf-node-gather-daemonset-5bq9t\" (UID: \"fffe8819-5453-4ece-942b-4c95dd2c0f10\") " pod="openshift-must-gather-wlh9g/perf-node-gather-daemonset-5bq9t"
Jul 17 20:53:57.436929 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:53:57.436756    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fffe8819-5453-4ece-942b-4c95dd2c0f10-sys\") pod \"perf-node-gather-daemonset-5bq9t\" (UID: \"fffe8819-5453-4ece-942b-4c95dd2c0f10\") " pod="openshift-must-gather-wlh9g/perf-node-gather-daemonset-5bq9t"
Jul 17 20:53:57.436929 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:53:57.436760    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/fffe8819-5453-4ece-942b-4c95dd2c0f10-proc\") pod \"perf-node-gather-daemonset-5bq9t\" (UID: \"fffe8819-5453-4ece-942b-4c95dd2c0f10\") " pod="openshift-must-gather-wlh9g/perf-node-gather-daemonset-5bq9t"
Jul 17 20:53:57.436929 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:53:57.436819    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/fffe8819-5453-4ece-942b-4c95dd2c0f10-podres\") pod \"perf-node-gather-daemonset-5bq9t\" (UID: \"fffe8819-5453-4ece-942b-4c95dd2c0f10\") " pod="openshift-must-gather-wlh9g/perf-node-gather-daemonset-5bq9t"
Jul 17 20:53:57.447688 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:53:57.447655    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zrhtz\" (UniqueName: \"kubernetes.io/projected/fffe8819-5453-4ece-942b-4c95dd2c0f10-kube-api-access-zrhtz\") pod \"perf-node-gather-daemonset-5bq9t\" (UID: \"fffe8819-5453-4ece-942b-4c95dd2c0f10\") " pod="openshift-must-gather-wlh9g/perf-node-gather-daemonset-5bq9t"
Jul 17 20:53:57.551615 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:53:57.551511    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wlh9g/perf-node-gather-daemonset-5bq9t"
Jul 17 20:53:57.710488 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:53:57.710450    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wlh9g/perf-node-gather-daemonset-5bq9t"]
Jul 17 20:53:57.714942 ip-10-0-141-177 kubenswrapper[2572]: W0717 20:53:57.714912    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podfffe8819_5453_4ece_942b_4c95dd2c0f10.slice/crio-6fe8319fa7caacebe0c6704cae542e2bfb5b1bc575cf908e1d19fd08d39602ea WatchSource:0}: Error finding container 6fe8319fa7caacebe0c6704cae542e2bfb5b1bc575cf908e1d19fd08d39602ea: Status 404 returned error can't find the container with id 6fe8319fa7caacebe0c6704cae542e2bfb5b1bc575cf908e1d19fd08d39602ea
Jul 17 20:53:58.218541 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:53:58.218458    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wlh9g/perf-node-gather-daemonset-5bq9t" event={"ID":"fffe8819-5453-4ece-942b-4c95dd2c0f10","Type":"ContainerStarted","Data":"4a1e737163787ae1c43b4f8df45d3c50cfad06455a3877468506371dcc2da469"}
Jul 17 20:53:58.218541 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:53:58.218520    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-wlh9g/perf-node-gather-daemonset-5bq9t"
Jul 17 20:53:58.218541 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:53:58.218541    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wlh9g/perf-node-gather-daemonset-5bq9t" event={"ID":"fffe8819-5453-4ece-942b-4c95dd2c0f10","Type":"ContainerStarted","Data":"6fe8319fa7caacebe0c6704cae542e2bfb5b1bc575cf908e1d19fd08d39602ea"}
Jul 17 20:53:58.238104 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:53:58.238039    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-wlh9g/perf-node-gather-daemonset-5bq9t" podStartSLOduration=1.238023797 podStartE2EDuration="1.238023797s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 20:53:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 20:53:58.236267096 +0000 UTC m=+3463.077762732" watchObservedRunningTime="2026-07-17 20:53:58.238023797 +0000 UTC m=+3463.079519493"
Jul 17 20:53:58.882630 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:53:58.882595    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-4lxrh_357dfdb5-256c-4e3f-8859-c733e6dbc076/dns/0.log"
Jul 17 20:53:58.907019 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:53:58.906983    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-4lxrh_357dfdb5-256c-4e3f-8859-c733e6dbc076/kube-rbac-proxy/0.log"
Jul 17 20:53:59.162510 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:53:59.162419    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-n5s75_41b71668-ce0c-48b1-b378-35caba808bbb/dns-node-resolver/0.log"
Jul 17 20:53:59.869381 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:53:59.869340    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-784dddf6df-m4ss6_c80c71a8-4f84-4865-b355-15a6d13eaacc/registry/0.log"
Jul 17 20:53:59.918659 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:53:59.918632    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-ds9vw_95a783d7-db2c-4714-bd10-003a4d90aa3f/node-ca/0.log"
Jul 17 20:54:00.967717 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:54:00.967685    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf449w7z_b045a938-3e18-4ad7-9da2-4fdcfa627a54/istio-proxy/0.log"
Jul 17 20:54:01.186337 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:54:01.186277    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-22gnc_4066ca84-39d8-4dfa-8b00-a3a11228aae4/istio-proxy/0.log"
Jul 17 20:54:01.212650 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:54:01.212621    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-22gnc_4066ca84-39d8-4dfa-8b00-a3a11228aae4/istio-proxy/1.log"
Jul 17 20:54:01.246847 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:54:01.246819    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-7vbff_de96ce09-93d3-44d5-b157-1c8a47432407/payload-pre-processing/0.log"
Jul 17 20:54:02.295524 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:54:02.295494    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-zsjgs_a45b1c99-39f4-4e04-b920-ab30659bd943/serve-healthcheck-canary/0.log"
Jul 17 20:54:02.995128 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:54:02.995104    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-rkrjc_5440c8ce-a1e1-4930-936f-550f113abe1a/kube-rbac-proxy/0.log"
Jul 17 20:54:03.019679 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:54:03.019656    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-rkrjc_5440c8ce-a1e1-4930-936f-550f113abe1a/exporter/0.log"
Jul 17 20:54:03.047849 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:54:03.047822    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-rkrjc_5440c8ce-a1e1-4930-936f-550f113abe1a/extractor/0.log"
Jul 17 20:54:04.233715 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:54:04.233684    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-wlh9g/perf-node-gather-daemonset-5bq9t"
Jul 17 20:54:04.364113 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:54:04.364079    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p8crz_af4d8054-b7bc-47e6-9cc3-0e6d0df7a1a0/konnectivity-agent/0.log" limit=1024
Jul 17 20:54:05.505377 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:54:05.505348    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-587c8b5647-6q4z2_0f2a06e4-1a7f-4ac5-8e81-f5f531c8a405/manager/0.log"
Jul 17 20:54:05.707472 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:54:05.707445    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-67bdc7ddc4-8w6gc_93200790-ba58-4f95-a32c-9e90388a7a50/manager/0.log"
Jul 17 20:54:05.729002 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:54:05.728981    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-67bdc7ddc4-8w6gc_93200790-ba58-4f95-a32c-9e90388a7a50/copy-manifests/0.log"
Jul 17 20:54:07.035625 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:54:07.035601    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-7c54c94474-59v64_0943fc6c-a80a-4611-a6e0-96565d1cc33c/manager/0.log"
Jul 17 20:54:07.101212 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:54:07.101181    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-pkq24_fe506038-7a75-42b1-b807-9bbd4a0b4faa/openshift-lws-operator/0.log"
Jul 17 20:54:07.259690 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:54:07.259661    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf449w7z_b045a938-3e18-4ad7-9da2-4fdcfa627a54/istio-proxy/0.log"
Jul 17 20:54:07.416876 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:54:07.416846    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-22gnc_4066ca84-39d8-4dfa-8b00-a3a11228aae4/istio-proxy/0.log"
Jul 17 20:54:07.444579 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:54:07.444547    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-22gnc_4066ca84-39d8-4dfa-8b00-a3a11228aae4/istio-proxy/1.log"
Jul 17 20:54:07.467200 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:54:07.467126    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-7vbff_de96ce09-93d3-44d5-b157-1c8a47432407/payload-pre-processing/0.log"
Jul 17 20:54:08.830218 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:54:08.830195    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf449w7z_b045a938-3e18-4ad7-9da2-4fdcfa627a54/istio-proxy/0.log"
Jul 17 20:54:08.996534 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:54:08.996506    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-22gnc_4066ca84-39d8-4dfa-8b00-a3a11228aae4/istio-proxy/0.log"
Jul 17 20:54:09.024122 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:54:09.024083    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-22gnc_4066ca84-39d8-4dfa-8b00-a3a11228aae4/istio-proxy/1.log"
Jul 17 20:54:09.045275 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:54:09.045251    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-7vbff_de96ce09-93d3-44d5-b157-1c8a47432407/payload-pre-processing/0.log"
Jul 17 20:54:12.378292 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:54:12.378265    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7cc9c7ffd7-lnlq9_8e874537-2124-44d9-a714-a15aed94095f/migrator/0.log"
Jul 17 20:54:12.398684 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:54:12.398658    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7cc9c7ffd7-lnlq9_8e874537-2124-44d9-a714-a15aed94095f/graceful-termination/0.log"
Jul 17 20:54:14.211192 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:54:14.211165    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vgxht_9a15559c-d011-4add-8648-639549beb4ae/kube-multus-additional-cni-plugins/0.log"
Jul 17 20:54:14.233802 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:54:14.233761    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vgxht_9a15559c-d011-4add-8648-639549beb4ae/egress-router-binary-copy/0.log"
Jul 17 20:54:14.254746 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:54:14.254716    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vgxht_9a15559c-d011-4add-8648-639549beb4ae/cni-plugins/0.log"
Jul 17 20:54:14.275061 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:54:14.275037    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vgxht_9a15559c-d011-4add-8648-639549beb4ae/bond-cni-plugin/0.log"
Jul 17 20:54:14.295039 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:54:14.295016    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vgxht_9a15559c-d011-4add-8648-639549beb4ae/routeoverride-cni/0.log"
Jul 17 20:54:14.316884 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:54:14.316860    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vgxht_9a15559c-d011-4add-8648-639549beb4ae/whereabouts-cni-bincopy/0.log"
Jul 17 20:54:14.338676 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:54:14.338648    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vgxht_9a15559c-d011-4add-8648-639549beb4ae/whereabouts-cni/0.log"
Jul 17 20:54:14.406416 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:54:14.406339    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-l7dr9_a53f7848-40a2-47e5-ada6-9f59ebcb300b/kube-multus/0.log"
Jul 17 20:54:14.588691 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:54:14.588665    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-wdqgw_c6e298d5-0e70-47eb-8f91-788894463bc3/network-metrics-daemon/0.log"
Jul 17 20:54:14.607804 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:54:14.607774    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-wdqgw_c6e298d5-0e70-47eb-8f91-788894463bc3/kube-rbac-proxy/0.log"
Jul 17 20:54:15.705978 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:54:15.705952    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9glht_f15bf309-b082-4e3b-aa4c-eb0b8762a967/ovn-controller/0.log"
Jul 17 20:54:15.723954 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:54:15.723933    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9glht_f15bf309-b082-4e3b-aa4c-eb0b8762a967/ovn-acl-logging/0.log"
Jul 17 20:54:15.748774 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:54:15.748750    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9glht_f15bf309-b082-4e3b-aa4c-eb0b8762a967/kube-rbac-proxy-node/0.log"
Jul 17 20:54:15.771450 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:54:15.771424    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9glht_f15bf309-b082-4e3b-aa4c-eb0b8762a967/kube-rbac-proxy-ovn-metrics/0.log"
Jul 17 20:54:15.794165 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:54:15.794146    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9glht_f15bf309-b082-4e3b-aa4c-eb0b8762a967/northd/0.log"
Jul 17 20:54:15.822039 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:54:15.822018    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9glht_f15bf309-b082-4e3b-aa4c-eb0b8762a967/nbdb/0.log"
Jul 17 20:54:15.845958 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:54:15.845938    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9glht_f15bf309-b082-4e3b-aa4c-eb0b8762a967/sbdb/0.log"
Jul 17 20:54:15.929659 ip-10-0-141-177 kubenswrapper[2572]: I0717 20:54:15.929625    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9glht_f15bf309-b082-4e3b-aa4c-eb0b8762a967/ovnkube-controller/0.log"